00000100:00100000:3.0:1767318172.566987:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291845888:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 129us (1655us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318172.567013:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15944
00000100:00100000:3.0:1767318172.577595:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291846016
00000100:00100000:3.0:1767318172.577612:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291846016
00000100:00100000:3.0:1767318172.577732:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3482
00000100:00100000:3.0:1767318172.577747:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291846016:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318172.577839:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291846016:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 98us (2829us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318172.577847:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3482
00000100:00100000:3.0:1767318172.641342:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379435008
00000100:00100000:3.0:1767318172.641349:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379435008
00000100:00100000:3.0:1767318172.641405:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748
00000100:00100000:3.0:1767318172.641411:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379435008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318172.641430:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318172.641490:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379435008:12345-0@lo:38:kworker.0 Request processed in 78us (267us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318172.641497:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748
00000100:00100000:3.0:1767318172.643915:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379435136:0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.643956:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318172.643990:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318172.643996:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379435648:0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.644017:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318172.644051:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379435392
00000100:00100000:3.0:1767318172.644055:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379435392
00000100:00100000:3.0:1767318172.644090:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379435648
00000100:00100000:3.0:1767318172.644093:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379435648
00000100:00100000:3.0:1767318172.644112:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483
00000100:00100000:3.0:1767318172.644139:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379435392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.644177:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379435392:12345-0@lo:400:kworker.0 Request processed in 53us (511us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318172.644184:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483
00000100:00100000:3.0:1767318172.644196:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484
00000100:00100000:3.0:1767318172.644201:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379435648:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.644243:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379435648:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318172.644249:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484
00000100:00100000:3.0:1767318172.644283:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379435392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318172.644301:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379435648:0@lo:400:kworker.0
00000100:00100000:3.0:1767318174.683732:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379435904:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318176.218648:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379436032:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318176.218784:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318176.221609:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318177.683193:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291846272
00000100:00100000:3.0:1767318177.683204:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291846272
00000100:00100000:3.0:1767318177.683310:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3485
00000100:00100000:3.0:1767318177.683322:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291846272:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318177.683446:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291846272:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 126us (447us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318177.683455:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3485
00000100:00100000:3.0:1767318177.751541:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318177.751551:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379436672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.766116:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318177.766171:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379436544:0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.766203:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318177.766226:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379436544
00000100:00100000:3.0:1767318177.766231:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379436544
00000100:00100000:0.0:1767318177.767040:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379436672:12345-0@lo:400:kworker.0 Request processed in 71us (923us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318177.767063:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3486
00000100:00100000:0.0:1767318177.767094:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15949
00000100:00100000:0.0:1767318177.767099:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379436160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318177.767119:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318177.767152:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379436160:12345-0@lo:38:kworker.0 Request processed in 52us (1259us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318177.767159:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15949
00000100:00080000:0.0:1767318177.767180:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318177.767221:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318177.767227:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318177.767230:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379436160:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.767239:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379436288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.767270:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318177.767300:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379436288
00000100:00100000:0.0:1767318177.767304:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379436288
00000100:00100000:0.0:1767318177.767334:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749
00000100:00100000:0.0:1767318177.767340:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379436288:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318177.767352:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318177.767381:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379436288:12345-0@lo:38:kworker.0 Request processed in 41us (111us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318177.767387:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749
00000100:00080000:0.0:1767318177.767409:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318177.767436:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318177.767442:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318177.767446:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379436288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.767515:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379436800:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.767543:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318177.767640:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060
00000100:00100000:3.0:1767318177.767960:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379436544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.768011:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379436544:12345-0@lo:400:kworker.0 Request processed in 363us (1807us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318177.768018:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060
00000100:00080000:0.0:1767318177.768125:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318177.768130:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318177.768133:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379436800:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.768141:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379437056:0@lo:38:kworker.0
00000100:00100000:0.0:1767318177.768165:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318177.768297:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318177.768303:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318177.768306:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379437056:0@lo:38:kworker.0
00000100:00100000:3.0:1767318177.768542:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379436416
00000100:00100000:3.0:1767318177.768547:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379436416
00000100:00100000:3.0:1767318177.768917:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061
00000100:00100000:3.0:1767318177.768926:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379436416:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318177.768968:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379436416:12345-0@lo:400:kworker.0 Request processed in 44us (460us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318177.768974:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061
00000100:00080000:0.0:1767318177.769030:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318179.802336:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379437184:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318179.802409:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318179.802916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318181.338262:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318182.802081:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291846528
00000100:00100000:0.0:1767318182.802093:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291846528
00000100:00100000:0.0:1767318182.802175:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3488
00000100:00100000:0.0:1767318182.802186:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291846528:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318182.802281:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291846528:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (272us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318182.802289:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3488
00000100:00080000:3.0:1767318182.802364:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318182.812318:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291846400
00000100:00100000:0.0:1767318182.812329:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291846400
00000100:00100000:0.0:1767318182.812378:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15952
00000100:00100000:0.0:1767318182.812386:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291846400:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318182.812420:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318182.812486:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291846400:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 100us (291us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318182.812508:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15952
00000100:00100000:3.0:1767318182.872632:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379437440:0@lo:38:kworker.0
00000100:00100000:3.0:1767318182.872711:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318182.883251:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379437568:0@lo:38:kworker.0
00000100:00100000:3.0:1767318182.883334:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318182.883483:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379437568
00000100:00100000:0.0:1767318182.883491:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379437568
00000100:00100000:0.0:1767318182.883531:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750
00000100:00100000:0.0:1767318182.883539:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379437568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318182.883559:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318182.883601:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379437568:12345-0@lo:38:kworker.0 Request processed in 61us (265us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318182.883607:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750
00000100:00080000:3.0:1767318182.890489:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318182.890496:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318182.890500:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379437440:0@lo:38:kworker.0
00000100:00080000:3.0:1767318182.890536:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318182.890541:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318182.890544:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379437568:0@lo:38:kworker.0
00000100:00100000:0.0:1767318182.890897:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379437696:0@lo:400:kworker.0
00000100:00100000:0.0:1767318182.890970:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318182.893329:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318182.893372:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318182.893377:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318182.893380:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318182.893384:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3080
00000100:00080000:3.0:1767318182.893388:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318182.893392:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318182.893412:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47100 x1853164379438080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318182.899300:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318182.899306:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318182.899310:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318182.899314:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3080
00000100:00080000:3.0:1767318182.899318:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318182.899324:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318182.899360:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5ca80 x1853164379438336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318182.900092:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318182.900097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318182.900116:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379438336:0@lo:38:kworker.0
00000100:00100000:0.0:1767318182.905552:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379437696:0@lo:400:kworker.0
00000100:00100000:0.0:1767318184.919173:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379438464:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318184.919253:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318184.919751:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379438464:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318184.919989:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318186.457580:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379438592
00000100:00100000:3.0:1767318186.457589:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379438592
00000100:00100000:3.0:1767318186.457659:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797
00000100:00100000:3.0:1767318186.457670:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379438592:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318186.457699:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318186.457759:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379438592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (604us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318186.457767:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797
00000100:00100000:0.0:1767318186.457904:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379438592:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318186.900664:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291846912
00000100:00100000:3.0:1767318186.900683:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291846912
00000100:00100000:3.0:1767318186.900767:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3491
00000100:00100000:3.0:1767318186.900783:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291846912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767318186.900904:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318186.906101:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291846912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 5320us (5921us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318186.906112:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3491
00000100:00100000:3.0:1767318187.031234:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318162/real 1767318162]  req@ffff8b0e0bafc700 x1853164379432192/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318187.031271:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bafc700 x1853164379432192/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318187.031293:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318187.031362:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318187.031367:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379432192:0@lo:250:kworker.0
00000100:00100000:3.0:1767318187.037415:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379438720:0@lo:250:kworker.0
00000400:00000100:3.0:1767318187.037480:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379438720 offset 0 length 520: 4
00000100:00100000:3.0:1767318187.037544:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379438848:0@lo:38:kworker.0
00000100:00100000:3.0:1767318187.037585:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318187.037627:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379438848
00000100:00100000:3.0:1767318187.037634:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379438848
00000100:00100000:3.0:1767318187.038073:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379439616
00000100:00100000:3.0:1767318187.038078:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379439616
00000100:00100000:3.0:1767318187.044108:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493
00000100:00100000:3.0:1767318187.044133:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379439616:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318187.046009:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379439616:12345-0@lo:400:kworker.0 Request processed in 1871us (8147us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318187.046027:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493
00000100:00100000:3.0:1767318187.046107:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379439616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318187.048541:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379438976
00000100:00100000:0.0:1767318187.048557:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379438976
00000100:00100000:0.0:1767318187.048620:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751
00000100:00100000:0.0:1767318187.048629:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379438976:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318187.048654:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318187.048752:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379438976:12345-0@lo:38:kworker.0 Request processed in 122us (10003us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318187.048774:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751
00000100:00100000:0.0:1767318190.040218:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379439872:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318190.040293:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318190.040349:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379439872
00000100:00100000:3.0:1767318190.040357:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379439872
00000100:00100000:3.0:1767318190.040418:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798
00000100:00100000:3.0:1767318190.040429:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379439872:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318190.040460:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318190.040509:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379439872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (215us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318190.040516:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798
00000100:00100000:0.0:1767318190.040605:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379439872:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318191.575080:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318191.575104:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379440000:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318191.575172:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318191.575906:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379440000
00000100:00100000:3.0:1767318191.575915:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379440000
00000100:00100000:3.0:1767318191.575994:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799
00000100:00100000:3.0:1767318191.576003:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379440000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318191.576034:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318191.576114:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379440000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (941us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318191.576121:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799
00000100:00100000:0.0:1767318191.577177:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379440000:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318192.017467:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318192.088232:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318192.088242:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318192.088245:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318192.088249:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318192.088254:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318192.088261:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3089
00000100:00080000:0.0:1767318192.088265:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318192.088271:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318192.088311:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a680 x1853164379440128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318192.088336:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318192.088339:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318192.088341:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318192.088345:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3089
00000100:00080000:0.0:1767318192.088347:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318192.088365:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318192.088380:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19500 x1853164379440256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318192.088452:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318192.088455:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318192.088457:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318192.088460:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3089
00000100:00080000:0.0:1767318192.088463:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318192.088466:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318192.088477:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1aa00 x1853164379440768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318192.088492:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318192.088495:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318192.088497:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318192.088500:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3089
00000100:00080000:0.0:1767318192.088502:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318192.088506:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318192.088516:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31e76a00 x1853164379441024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318192.088547:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379440640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318192.088608:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318192.088668:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318192.088674:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379440512:0@lo:400:kworker.0
00000100:00100000:0.0:1767318192.088701:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318192.089116:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379440640
00000100:00100000:3.0:1767318192.089135:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379440640
00000100:00100000:3.0:1767318192.089226:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379440128
00000100:00100000:3.0:1767318192.089233:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379440128
00000100:00100000:3.0:1767318192.089256:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379440768
00000100:00100000:3.0:1767318192.089260:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379440768
00000100:00100000:3.0:1767318192.089274:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379441024
00000100:00100000:3.0:1767318192.089278:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379441024
00000100:00100000:3.0:1767318192.089303:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495
00000100:00100000:3.0:1767318192.089317:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379440640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318192.089413:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379440640:12345-0@lo:400:kworker.0 Request processed in 98us (802us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318192.089424:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495
00000100:00100000:3.0:1767318192.089534:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15963
00000100:00100000:3.0:1767318192.089553:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379441024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318192.089575:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318192.089827:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379441024:12345-0@lo:38:kworker.0 Request processed in 192us (663us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318192.089838:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15963
00000100:00100000:0.0:1767318192.089863:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379440256
00000100:00100000:0.0:1767318192.089913:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379440256
00000100:00100000:0.0:1767318192.089968:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752
00000100:00080000:3.0:1767318192.089968:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318192.089984:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379440256:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318192.089997:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318192.090009:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318192.090017:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318192.090022:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379441024:0@lo:38:kworker.0
00000100:00100000:0.0:1767318192.090051:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379440256:12345-0@lo:38:kworker.0 Request processed in 65us (1058us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767318192.090056:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318192.090061:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752
00000100:00080000:3.0:1767318192.090076:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318192.090082:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379440256:0@lo:38:kworker.0
00000100:00100000:3.0:1767318192.090911:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379440384
00000100:00100000:3.0:1767318192.090921:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379440384
00000100:00100000:3.0:1767318192.091011:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067
00000100:00100000:3.0:1767318192.091024:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379440384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318192.091108:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379440384:12345-0@lo:400:kworker.0 Request processed in 88us (434us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318192.091115:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067
00000100:00080000:0.0:1767318192.091202:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318192.091899:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318192.091991:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379440896:0@lo:400:kworker.0
00000100:00080000:0.0:1767318195.161646:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318196.695420:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379441280:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318196.695501:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318196.695971:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379441280:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318196.696435:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318197.142761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318197.152635:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318197.208416:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318197.208448:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379441664:0@lo:400:kworker.0
00000100:00100000:0.0:1767318197.208572:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318197.208838:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379441408
00000100:00100000:3.0:1767318197.208852:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379441408
00000100:00100000:0.0:1767318197.209040:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379441664
00000100:00100000:0.0:1767318197.209049:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379441664
00000100:00100000:0.0:1767318197.209126:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068
00000100:00100000:0.0:1767318197.209142:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379441664:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318197.209227:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379441664:12345-0@lo:400:kworker.0 Request processed in 89us (659us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318197.209239:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068
00000100:00080000:0.0:1767318197.209297:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318197.209343:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379441664:0@lo:400:kworker.0
00000100:00100000:0.0:1767318197.211471:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379441920:0@lo:38:kworker.0
00000100:00100000:3.0:1767318197.218400:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379441792
00000100:00100000:3.0:1767318197.218423:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379441792
00000100:00100000:3.0:1767318197.218528:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498
00000100:00100000:3.0:1767318197.218555:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379441792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318197.218688:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379441792:12345-0@lo:400:kworker.0 Request processed in 149us (8655us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318197.218699:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498
00000100:00100000:3.0:1767318197.218767:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318197.219031:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318197.220462:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379442176:0@lo:38:kworker.0
00000100:00100000:0.0:1767318197.220563:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318197.220619:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318197.220628:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318197.220633:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379441408:0@lo:38:kworker.0
00000100:00100000:0.0:1767318197.220746:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379442048:0@lo:400:kworker.0
00000100:00100000:0.0:1767318197.220790:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15967
00000100:00100000:0.0:1767318197.220798:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379442176:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318197.228173:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318197.228380:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379442176:12345-0@lo:38:kworker.0 Request processed in 7576us (7814us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318197.228396:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15967
00000100:00100000:3.0:1767318200.280795:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318200.280816:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379442304:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318200.280911:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318200.282308:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318201.815575:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379442432
00000100:00100000:3.0:1767318201.815596:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379442432
00000100:00100000:3.0:1767318201.815657:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803
00000100:00100000:3.0:1767318201.815667:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379442432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318201.815696:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318201.815745:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379442432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (435us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318201.815751:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803
00000100:00080000:3.0:1767318201.815771:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318202.257158:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318202.257260:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318202.258172:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291847552
00000100:00100000:0.0:1767318202.258185:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291847552
00000100:00100000:0.0:1767318202.258243:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291847680
00000100:00100000:0.0:1767318202.258247:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291847680
00000100:00100000:0.0:1767318202.258296:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3500
00000100:00100000:0.0:1767318202.264961:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291847680:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318202.265076:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291847680:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 6770us (7813us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318202.265087:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3500
00000100:00100000:0.0:1767318202.265144:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15968
00000100:00100000:0.0:1767318202.265150:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291847552:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318202.265184:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318202.265222:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291847552:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 70us (8073us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318202.265228:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15968
00000100:00100000:0.0:1767318202.327525:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379442560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318202.327555:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318202.328208:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379442944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318202.328242:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318202.332580:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318202.332593:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318202.332598:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379442560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318202.332610:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379442688:0@lo:38:kworker.0
00000100:00100000:0.0:1767318202.332670:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318202.332721:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379443072:0@lo:38:kworker.0
00000100:00100000:0.0:1767318202.332744:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318202.332760:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379443328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318202.332940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318202.333041:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379443072
00000100:00100000:0.0:1767318202.333048:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379443072
00000100:00100000:0.0:1767318202.333079:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379443328
00000100:00100000:0.0:1767318202.333083:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379443328
00000100:00100000:0.0:1767318202.333712:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15970
00000100:00100000:0.0:1767318202.333718:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379443072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318202.333729:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318202.333762:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379443072:12345-0@lo:38:kworker.0 Request processed in 42us (1016us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318202.333966:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15970
00000100:00100000:0.0:1767318202.333983:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15971
00000100:00100000:0.0:1767318202.333987:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379443328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318202.333997:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318202.334024:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379443328:12345-0@lo:38:kworker.0 Request processed in 35us (1085us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318202.334030:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15971
00000100:00100000:3.0:1767318202.334991:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379442944:0@lo:400:kworker.0
00000100:00080000:0.0:1767318205.401713:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318206.935246:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318206.935427:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379443584
00000100:00100000:0.0:1767318206.935435:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379443584
00000100:00100000:0.0:1767318206.935500:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805
00000100:00100000:0.0:1767318206.935509:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379443584:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318206.935537:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318206.935588:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379443584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (305us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318206.935596:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805
00000100:00100000:0.0:1767318207.375677:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291847936
00000100:00100000:0.0:1767318207.375686:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291847936
00000100:00100000:0.0:1767318207.375908:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3503
00000100:00100000:0.0:1767318207.375922:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291847936:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318207.376010:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291847936:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (649us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318207.376017:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3503
00000100:00100000:3.0:1767318207.376411:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318207.449231:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379443712:0@lo:38:kworker.0
00000100:00100000:0.0:1767318207.449262:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318207.449281:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379443840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318207.449294:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318207.449308:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379444224:0@lo:38:kworker.0
00000100:00100000:0.0:1767318207.449324:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318207.449337:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379444480:0@lo:38:kworker.0
00000100:00100000:0.0:1767318207.449356:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318207.449777:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318207.449781:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318207.449785:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379443712:0@lo:38:kworker.0
00000100:00080000:0.0:1767318207.449793:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318207.449815:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318207.449818:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379443840:0@lo:38:kworker.0
00000100:00080000:0.0:1767318207.449827:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318207.449830:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318207.449833:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379444224:0@lo:38:kworker.0
00000100:00080000:0.0:1767318207.449841:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318207.449844:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318207.449846:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379444480:0@lo:38:kworker.0
00000100:00100000:3.0:1767318207.449966:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379444096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318207.449997:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318207.450021:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318207.450025:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379444352:0@lo:400:kworker.0
00000100:00100000:3.0:1767318207.450038:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318207.450061:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379444096
00000100:00100000:3.0:1767318207.450063:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379444096
00000100:00100000:3.0:1767318207.450088:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379444352
00000100:00100000:3.0:1767318207.450090:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379444352
00000100:00100000:3.0:1767318207.450100:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504
00000100:00100000:3.0:1767318207.450104:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379444096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318207.450140:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379444096:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318207.450150:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504
00000100:00100000:3.0:1767318207.450159:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505
00000100:00100000:3.0:1767318207.450163:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379444352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318207.450182:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379444352:12345-0@lo:400:kworker.0 Request processed in 19us (143us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318207.450185:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505
00000100:00100000:3.0:1767318207.450203:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379444352:0@lo:400:kworker.0
00000100:00100000:3.0:1767318207.450208:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379444096:0@lo:400:kworker.0
00000100:00080000:3.0:1767318207.450219:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318210.520988:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318210.521009:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379444608:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318210.521090:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318210.521927:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318211.034227:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318211.473081:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291848320
00000100:00100000:0.0:1767318211.473091:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291848320
00000100:00100000:0.0:1767318211.473157:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291848192
00000100:00100000:0.0:1767318211.473161:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291848192
00000100:00100000:0.0:1767318211.473200:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3506
00000100:00100000:0.0:1767318211.473209:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291848320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318211.473288:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291848320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (345us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318211.473296:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3506
00000100:00100000:0.0:1767318211.473316:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15976
00000100:00100000:0.0:1767318211.473321:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291848192:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318211.473342:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318211.473369:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291848192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (355us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318211.473375:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15976
00000100:00080000:3.0:1767318211.474923:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318212.055753:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379444736
00000100:00100000:3.0:1767318212.055778:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379444736
00000100:00100000:3.0:1767318212.055961:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807
00000100:00100000:3.0:1767318212.055975:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379444736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318212.056015:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318212.056110:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379444736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (603us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318212.056120:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807
00000100:00100000:0.0:1767318212.056285:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379444736:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318212.568462:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379445248:0@lo:400:kworker.0
00000100:00100000:3.0:1767318212.568498:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318212.568536:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318212.568555:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379445120:0@lo:400:kworker.0
00000100:00100000:3.0:1767318212.568587:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318212.568964:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3507
00000100:00100000:0.0:1767318212.568978:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379445504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318212.569053:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379445504:12345-0@lo:400:kworker.0 Request processed in 77us (895us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318212.569061:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507
00000100:00100000:0.0:1767318212.569120:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379445504:0@lo:400:kworker.0
00000100:00100000:0.0:1767318212.569165:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379445120
00000100:00100000:0.0:1767318212.569169:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379445120
00000100:00080000:3.0:1767318212.574016:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318212.574034:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318212.576202:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071
00000100:00100000:0.0:1767318212.576217:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379445120:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318212.576312:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379445120:12345-0@lo:400:kworker.0 Request processed in 99us (7723us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318212.576335:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071
00000100:00100000:0.0:1767318212.577354:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379445120:0@lo:400:kworker.0
00010000:00010000:3.0:1767318215.131236:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318215.639612:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379445888
00000100:00100000:3.0:1767318215.639625:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379445888
00000100:00100000:3.0:1767318215.639728:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808
00000100:00100000:3.0:1767318215.639770:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379445888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318215.639811:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318215.639915:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379445888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (621us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318215.639923:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808
00000100:00100000:3.0:1767318215.639984:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379445888:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318216.592154:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291848448
00000100:00100000:3.0:1767318216.592168:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291848448
00000100:00100000:3.0:1767318216.592249:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15980
00000100:00100000:3.0:1767318216.592260:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291848448:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318216.592294:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318216.592389:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291848448:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 129us (374us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318216.592397:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15980
00000100:00100000:0.0:1767318216.592622:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318216.593400:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291848576
00000100:00100000:3.0:1767318216.593410:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291848576
00000100:00100000:3.0:1767318216.593482:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3509
00000100:00100000:3.0:1767318216.593491:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291848576:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318216.593582:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291848576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (960us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318216.593590:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3509
00000100:00100000:3.0:1767318217.175836:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379446016
00000100:00100000:3.0:1767318217.175845:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379446016
00000100:00100000:3.0:1767318217.175926:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809
00000100:00100000:3.0:1767318217.175935:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379446016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318217.175964:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318217.176023:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379446016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (390us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318217.176029:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809
00000100:00100000:0.0:1767318217.688079:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379446400:0@lo:400:kworker.0
00000100:00100000:0.0:1767318217.688110:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318217.688139:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318217.688144:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379446912:0@lo:400:kworker.0
00000100:00100000:0.0:1767318217.688166:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318217.688283:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379446656
00000100:00100000:3.0:1767318217.688290:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379446656
00000100:00100000:3.0:1767318217.688326:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379446912
00000100:00100000:3.0:1767318217.688330:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379446912
00000100:00100000:3.0:1767318217.688355:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510
00000100:00100000:3.0:1767318217.688364:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379446656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.688414:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379446656:12345-0@lo:400:kworker.0 Request processed in 51us (595us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318217.688426:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510
00000100:00100000:0.0:1767318217.688594:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379446400:0@lo:400:kworker.0
00000100:00100000:3.0:1767318217.696393:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379446784
00000100:00100000:3.0:1767318217.696405:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379446784
00000100:00100000:3.0:1767318217.696428:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379447040
00000100:00100000:3.0:1767318217.696432:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379447040
00000100:00100000:3.0:1767318217.696446:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15981
00000100:00100000:3.0:1767318217.696452:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379446784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318217.696473:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318217.696548:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379446784:12345-0@lo:38:kworker.0 Request processed in 94us (7286us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318217.696567:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15981
00000100:00080000:3.0:1767318217.696635:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318217.696640:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318217.696644:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379446784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318217.696703:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379446272
00000100:00100000:3.0:1767318217.696707:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379446272
00000100:00100000:3.0:1767318217.696737:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757
00000100:00100000:3.0:1767318217.696742:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379446272:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318217.696752:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318217.699747:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318217.699754:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318217.699758:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379447040:0@lo:38:kworker.0
00000100:00100000:3.0:1767318217.703321:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379446272:12345-0@lo:38:kworker.0 Request processed in 6567us (14107us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318217.703338:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757
00000100:00080000:0.0:1767318217.709184:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318217.709199:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318217.709204:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379446272:0@lo:38:kworker.0
00000100:00080000:0.0:1767318217.709237:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318217.709242:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318217.709245:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379446144:0@lo:38:kworker.0
00000100:00100000:3.0:1767318220.759471:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379447168
00000100:00100000:3.0:1767318220.759479:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379447168
00000100:00100000:3.0:1767318220.759545:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810
00000100:00100000:3.0:1767318220.759555:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379447168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318220.759583:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318220.759657:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318220.763477:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379447168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3912us (4108us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318220.763490:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810
00000100:00100000:3.0:1767318221.722510:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318221.722967:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3512
00000100:00100000:3.0:1767318221.722980:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291848832:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318221.723078:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291848832:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (588us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318221.723086:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3512
00000100:00100000:3.0:1767318222.296555:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379447296
00000100:00100000:3.0:1767318222.296566:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379447296
00000100:00100000:3.0:1767318222.296631:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811
00000100:00100000:3.0:1767318222.296640:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379447296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318222.296669:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318222.296755:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379447296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1086us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318222.296762:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811
00000100:00100000:0.0:1767318222.296823:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379447296:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318222.807172:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318222.807183:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318222.807199:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318222.807203:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318222.807207:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318222.807215:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3120
00000100:00080000:0.0:1767318222.807220:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318222.807227:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318222.807280:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729dc00 x1853164379447424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318222.807324:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318222.807328:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318222.807330:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318222.807333:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3120
00000100:00080000:0.0:1767318222.807335:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318222.807339:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318222.807406:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ea00 x1853164379447552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318222.807486:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318222.807496:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318222.807498:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318222.807504:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3120
00000100:00080000:0.0:1767318222.807507:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318222.807512:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318222.807537:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859880 x1853164379448064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318222.809218:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379447936:0@lo:400:kworker.0
00000100:00100000:3.0:1767318222.809231:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379447808:0@lo:400:kworker.0
00000100:00080000:3.0:1767318222.809257:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318222.809282:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379448064:0@lo:38:kworker.0
00000100:00100000:3.0:1767318222.809314:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318222.810034:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318222.810040:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318222.810044:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318222.810050:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3120
00000100:00080000:0.0:1767318222.810054:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318222.810059:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318222.810082:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858000 x1853164379448320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318222.810133:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379448192
00000100:00100000:0.0:1767318222.810138:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379448192
00000100:00100000:0.0:1767318222.810183:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514
00000100:00100000:0.0:1767318222.810190:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379448192:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318222.810230:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379448192:12345-0@lo:400:kworker.0 Request processed in 42us (129us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318222.810237:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514
00000100:00080000:3.0:1767318222.813908:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318222.813923:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318222.813927:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379447552:0@lo:38:kworker.0
00000100:00080000:3.0:1767318222.813946:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318222.813949:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318222.813952:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379447424:0@lo:38:kworker.0
00000100:00100000:3.0:1767318222.813986:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379448320:0@lo:38:kworker.0
00000100:00100000:3.0:1767318222.814069:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318222.814121:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318222.814126:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318222.814129:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379448064:0@lo:38:kworker.0
00000100:00080000:3.0:1767318222.814898:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318222.814904:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318222.814908:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379448320:0@lo:38:kworker.0
00000100:00080000:3.0:1767318225.881986:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318226.838498:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318227.416597:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379448576
00000100:00100000:0.0:1767318227.416609:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379448576
00000100:00100000:0.0:1767318227.416732:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813
00000100:00100000:0.0:1767318227.416744:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379448576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318227.416786:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318227.421042:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379448576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4283us (4623us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318227.421065:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813
00000100:00100000:3.0:1767318227.930388:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379448704:0@lo:38:kworker.0
00000100:00100000:3.0:1767318227.930478:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318227.930544:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379448832:0@lo:38:kworker.0
00000100:00100000:3.0:1767318227.930575:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318227.930649:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379449344:0@lo:38:kworker.0
00000100:00100000:3.0:1767318227.930674:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318227.930705:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379449600:0@lo:38:kworker.0
00000100:00100000:3.0:1767318227.930729:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318227.930783:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379448704
00000100:00100000:3.0:1767318227.930794:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379448704
00000100:00100000:0.0:1767318227.930823:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379449344
00000100:00100000:0.0:1767318227.930828:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379449344
00000100:00100000:3.0:1767318227.930833:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379449600
00000100:00100000:3.0:1767318227.930836:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379449600
00000100:00100000:3.0:1767318227.930855:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15989
00000100:00100000:3.0:1767318227.930864:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379448704:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318227.930907:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15990
00000100:00100000:0.0:1767318227.930912:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379449600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318227.930924:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318227.930982:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379448704:12345-0@lo:38:kworker.0 Request processed in 118us (503us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318227.931000:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15989
00000100:00100000:3.0:1767318227.931031:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15991
00000100:00100000:3.0:1767318227.931036:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379449344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318227.936668:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767318227.936935:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318227.937122:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379449344:12345-0@lo:38:kworker.0 Request processed in 6078us (6441us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318227.937136:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15991
00000100:00100000:0.0:1767318227.940997:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379449600:12345-0@lo:38:kworker.0 Request processed in 10067us (10249us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318227.941026:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15990
00000100:00100000:0.0:1767318230.999408:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318230.999439:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379449728:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318230.999553:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318231.000363:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318231.952196:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291849344
00000100:00100000:3.0:1767318231.952211:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291849344
00000100:00100000:3.0:1767318231.952318:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291849216
00000100:00100000:3.0:1767318231.952322:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291849216
00000100:00100000:3.0:1767318231.952357:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3518
00000100:00100000:3.0:1767318231.952371:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291849344:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318231.952476:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291849344:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 108us (624us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318231.952488:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3518
00000100:00100000:3.0:1767318232.535771:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3963f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379449856:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318232.535892:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318232.535999:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379449856
00000100:00100000:3.0:1767318232.536009:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379449856
00000100:00100000:3.0:1767318232.536076:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815
00000100:00100000:3.0:1767318232.536088:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379449856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318232.536128:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318232.536185:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379449856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318232.536211:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815
00000100:00080000:0.0:1767318232.536676:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318232.537610:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3963f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379449856:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318233.050597:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379450240:0@lo:400:kworker.0
00000100:00100000:0.0:1767318233.050644:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318233.051510:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379449984:0@lo:38:kworker.0
00000100:00100000:3.0:1767318233.051555:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318233.051599:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379450112:0@lo:38:kworker.0
00000100:00080000:0.0:1767318233.051765:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318233.051797:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379450240:0@lo:400:kworker.0
00000100:00100000:0.0:1767318233.051813:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318233.051819:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379450752:0@lo:400:kworker.0
00000100:00100000:0.0:1767318233.051842:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318233.051896:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379449984
00000100:00100000:0.0:1767318233.051902:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379449984
00000100:00100000:0.0:1767318233.051925:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379450752
00000100:00100000:0.0:1767318233.051927:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379450752
00000100:00100000:0.0:1767318233.051959:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520
00000100:00100000:0.0:1767318233.051965:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379450752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318233.052006:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379450752:12345-0@lo:400:kworker.0 Request processed in 40us (163us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318233.052012:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520
00000100:00100000:0.0:1767318233.052026:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15993
00000100:00100000:0.0:1767318233.052042:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379449984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318233.052063:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318233.052090:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379449984:12345-0@lo:38:kworker.0 Request processed in 48us (535us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318233.052096:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15993
00000100:00080000:0.0:1767318233.052120:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318233.052137:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379450752:0@lo:400:kworker.0
00000100:00100000:3.0:1767318233.052158:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318233.052206:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379450112
00000100:00100000:0.0:1767318233.052210:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379450112
00000100:00100000:3.0:1767318233.052213:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379450624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318233.052236:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760
00000100:00100000:0.0:1767318233.052243:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379450112:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318233.052251:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767318233.052259:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318233.052276:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379450880:0@lo:38:kworker.0
00000100:00100000:0.0:1767318233.052292:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379450112:12345-0@lo:38:kworker.0 Request processed in 48us (580us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318233.052299:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760
00000100:00100000:3.0:1767318233.052311:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318233.052335:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379450624
00000100:00100000:0.0:1767318233.052340:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379450624
00000100:00080000:3.0:1767318233.052348:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318233.052357:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379450880
00000100:00080000:3.0:1767318233.052357:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318233.052362:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379450880
00000100:00100000:3.0:1767318233.052366:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379449984:0@lo:38:kworker.0
00000100:00100000:0.0:1767318233.052379:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15994
00000100:00080000:3.0:1767318233.052384:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318233.052385:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379450624:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767318233.052393:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318233.052398:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379450112:0@lo:38:kworker.0
00010000:00020000:0.0:1767318233.052400:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318233.052437:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15995
00000100:00100000:0.0:1767318233.052440:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379450624:12345-0@lo:38:kworker.0 Request processed in 53us (191us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318233.052447:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379450880:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318233.052453:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15994
00010000:00020000:3.0:1767318233.052464:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318233.052498:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379450880:12345-0@lo:38:kworker.0 Request processed in 53us (189us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318233.052505:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15995
00000100:00080000:3.0:1767318233.052734:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318233.052739:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318233.052742:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379450624:0@lo:38:kworker.0
00000100:00080000:3.0:1767318233.052750:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318233.052752:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318233.052755:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379450880:0@lo:38:kworker.0
00000100:00100000:3.0:1767318236.122499:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318236.122534:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379451008:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318236.122644:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318237.072012:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291849728
00000100:00100000:0.0:1767318237.072054:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291849728
00000100:00100000:0.0:1767318237.072152:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291849600
00000100:00100000:0.0:1767318237.072155:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291849600
00000100:00100000:0.0:1767318237.072185:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3521
00000100:00100000:0.0:1767318237.072199:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291849728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318237.072309:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291849728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (504us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318237.072318:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3521
00000100:00100000:0.0:1767318237.072342:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 15996
00000100:00100000:0.0:1767318237.072347:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291849600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318237.072373:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318237.072407:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291849600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (558us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318237.072414:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 15996
00000100:00100000:3.0:1767318237.143436:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318212/real 1767318212]  req@ffff8b0e03609500 x1853164379445760/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318237.143481:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e03609500 x1853164379445760/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318237.143507:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318237.143546:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318237.143551:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379445760:0@lo:250:kworker.0
00000100:00100000:3.0:1767318237.144352:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379451136:0@lo:250:kworker.0
00000400:00000100:3.0:1767318237.144427:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379451136 offset 0 length 520: 4
00000100:00100000:3.0:1767318237.144488:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379451264:0@lo:38:kworker.0
00000100:00100000:3.0:1767318237.144528:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318237.144572:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379451392:0@lo:38:kworker.0
00000100:00100000:3.0:1767318237.144600:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318237.144623:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379451904:0@lo:38:kworker.0
00000100:00100000:3.0:1767318237.144665:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318237.144683:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379452160:0@lo:38:kworker.0
00000100:00100000:3.0:1767318237.144702:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318237.144744:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379451392
00000100:00100000:3.0:1767318237.144754:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379451392
00000100:00100000:3.0:1767318237.144801:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761
00000100:00100000:3.0:1767318237.144810:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379451392:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318237.144836:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318237.144912:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379451392:12345-0@lo:38:kworker.0 Request processed in 101us (309us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318237.144919:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761
00000100:00080000:3.0:1767318237.144965:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318237.144970:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318237.144973:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379451392:0@lo:38:kworker.0
00000100:00100000:0.0:1767318237.145906:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379451520:0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.145970:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318237.146005:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318237.146013:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379451648:0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.146051:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318237.146085:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379452032:0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.146116:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318237.146137:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318237.146143:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379451776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.146165:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318237.146203:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379451264
00000100:00100000:0.0:1767318237.146224:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379451264
00000100:00100000:0.0:1767318237.146255:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379451904
00000100:00100000:0.0:1767318237.146258:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379451904
00000100:00100000:0.0:1767318237.146267:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379452160
00000100:00100000:0.0:1767318237.146269:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379452160
00000100:00100000:0.0:1767318237.146277:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379452032
00000100:00100000:0.0:1767318237.146279:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379452032
00000100:00100000:0.0:1767318237.146315:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379451776
00000100:00100000:0.0:1767318237.146318:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379451776
00000100:00100000:0.0:1767318237.146335:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522
00000100:00100000:0.0:1767318237.146343:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379452032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.146400:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379452032:12345-0@lo:400:kworker.0 Request processed in 56us (282us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318237.146407:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522
00000100:00100000:0.0:1767318237.146426:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523
00000100:00100000:0.0:1767318237.146433:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379451776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.146461:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379451776:12345-0@lo:400:kworker.0 Request processed in 29us (295us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318237.146466:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523
00000100:00100000:0.0:1767318237.146478:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15997
00000100:00100000:0.0:1767318237.146482:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379451264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318237.146500:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318237.146532:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379451264:12345-0@lo:38:kworker.0 Request processed in 48us (2004us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318237.146547:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15997
00000100:00100000:0.0:1767318237.146561:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15998
00000100:00100000:0.0:1767318237.146566:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379451904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318237.146575:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318237.146609:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379451904:12345-0@lo:38:kworker.0 Request processed in 42us (1943us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318237.146615:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15998
00000100:00100000:0.0:1767318237.146629:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15999
00000100:00100000:0.0:1767318237.146632:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379452160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318237.146642:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318237.146664:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379452160:12345-0@lo:38:kworker.0 Request processed in 30us (1961us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318237.146670:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15999
00000100:00100000:0.0:1767318237.146706:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379451776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318237.146714:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379452032:0@lo:400:kworker.0
00000100:00080000:3.0:1767318237.148362:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318237.148370:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318237.148373:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379451264:0@lo:38:kworker.0
00000100:00080000:3.0:1767318237.148385:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318237.148389:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318237.148392:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379451904:0@lo:38:kworker.0
00000100:00080000:3.0:1767318237.148402:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318237.148406:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318237.148409:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379452160:0@lo:38:kworker.0
00000100:00080000:0.0:1767318237.148531:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318237.655183:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379452288:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318237.655306:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318237.655382:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379452288
00000100:00100000:3.0:1767318237.655392:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379452288
00000100:00100000:3.0:1767318237.655449:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817
00000100:00100000:3.0:1767318237.655459:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379452288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318237.655500:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318237.655575:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379452288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (268us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318237.655584:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817
00000100:00100000:0.0:1767318237.655697:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379452288:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318241.239437:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379452416:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318241.239583:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318241.243938:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318241.244055:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379452416:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318242.192563:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291849984
00000100:00100000:3.0:1767318242.192578:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291849984
00000100:00100000:3.0:1767318242.192681:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3524
00000100:00100000:3.0:1767318242.192696:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291849984:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767318242.192811:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318242.193133:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291849984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 440us (1282us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318242.193143:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3524
00000100:00100000:3.0:1767318242.203469:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291849856
00000100:00100000:3.0:1767318242.203484:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291849856
00000100:00100000:3.0:1767318242.203565:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16000
00000100:00100000:3.0:1767318242.203575:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291849856:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318242.203608:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318242.203696:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291849856:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 121us (386us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318242.203704:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16000
00000100:00100000:0.0:1767318242.265327:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379452928:0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.265423:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318242.265550:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318242.265557:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379452800:0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.265582:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318242.265624:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379452928
00000100:00100000:0.0:1767318242.265643:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379452928
00000100:00100000:0.0:1767318242.265708:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379452800
00000100:00100000:0.0:1767318242.265712:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379452800
00000100:00100000:0.0:1767318242.266311:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082
00000100:00100000:0.0:1767318242.266322:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379452928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.266394:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379452928:12345-0@lo:400:kworker.0 Request processed in 73us (970us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318242.266402:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082
00000100:00100000:0.0:1767318242.266422:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083
00000100:00100000:0.0:1767318242.266428:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379452800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.266456:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379452800:12345-0@lo:400:kworker.0 Request processed in 29us (873us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318242.266463:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083
00000100:00080000:0.0:1767318242.266626:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318242.266672:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379452800:0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.266686:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379452928:0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.267856:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379453312:0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.267946:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318242.268593:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379453056:0@lo:400:kworker.0
00000100:00100000:3.0:1767318242.275805:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318242.275961:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379453056
00000100:00100000:3.0:1767318242.275973:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379453056
00000100:00100000:3.0:1767318242.276054:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526
00000100:00100000:3.0:1767318242.276065:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379453056:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318242.276149:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379453056:12345-0@lo:400:kworker.0 Request processed in 85us (355us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318242.276156:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526
00000100:00080000:3.0:1767318242.276188:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318242.276234:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379453056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318242.277700:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379453312:0@lo:400:kworker.0
00000100:00100000:3.0:1767318242.280566:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379452544
00000100:00100000:3.0:1767318242.280576:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379452544
00000100:00100000:3.0:1767318242.280632:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379453184
00000100:00100000:3.0:1767318242.280637:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379453184
00000100:00100000:3.0:1767318242.280652:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379453440
00000100:00100000:3.0:1767318242.280655:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379453440
00000100:00100000:3.0:1767318242.280685:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16001
00000100:00100000:3.0:1767318242.280695:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379452544:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318242.280723:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318242.280906:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379452544:12345-0@lo:38:kworker.0 Request processed in 210us (1011us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318242.280915:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16001
00000100:00100000:3.0:1767318242.280934:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16002
00000100:00100000:3.0:1767318242.280939:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379453184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318242.280950:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318242.280976:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379453184:12345-0@lo:38:kworker.0 Request processed in 35us (873us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318242.281000:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16002
00000100:00100000:3.0:1767318242.281012:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16003
00000100:00100000:3.0:1767318242.281017:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379453440:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318242.281027:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318242.281056:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379453440:12345-0@lo:38:kworker.0 Request processed in 37us (730us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318242.281061:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16003
00000100:00100000:0.0:1767318242.281359:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379452672
00000100:00100000:0.0:1767318242.281366:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379452672
00000100:00100000:0.0:1767318242.281407:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762
00000100:00100000:0.0:1767318242.281413:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379452672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318242.281424:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318242.281482:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379452672:12345-0@lo:38:kworker.0 Request processed in 68us (1430us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318242.281510:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762
00000100:00100000:3.0:1767318242.775924:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379453568
00000100:00100000:3.0:1767318242.775936:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379453568
00000100:00100000:3.0:1767318242.776009:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819
00000100:00100000:3.0:1767318242.776020:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379453568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318242.776061:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318242.776134:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379453568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (500us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318242.776142:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819
00000100:00100000:3.0:1767318246.359540:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379453696
00000100:00100000:3.0:1767318246.359552:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379453696
00000100:00100000:3.0:1767318246.359650:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820
00000100:00100000:3.0:1767318246.359664:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379453696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318246.359703:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318246.359774:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379453696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (525us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318246.359786:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820
00000100:00100000:0.0:1767318246.359847:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379453696:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318247.315814:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291850240
00000100:00100000:3.0:1767318247.315839:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291850240
00000100:00100000:3.0:1767318247.316207:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291850112
00000100:00100000:3.0:1767318247.316230:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291850112
00000100:00100000:3.0:1767318247.316364:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3527
00000100:00100000:3.0:1767318247.316381:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291850240:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318247.316506:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291850240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 131us (2778us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318247.323205:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3527
00000100:00100000:3.0:1767318247.384649:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379454208:0@lo:400:kworker.0
00000100:00100000:3.0:1767318247.384708:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318247.384757:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318247.384763:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379454080:0@lo:400:kworker.0
00000100:00100000:3.0:1767318247.384782:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318247.385727:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379454208
00000100:00100000:0.0:1767318247.385739:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379454208
00000100:00100000:0.0:1767318247.385803:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379454080
00000100:00100000:0.0:1767318247.385806:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379454080
00000100:00100000:0.0:1767318247.385825:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084
00000100:00100000:0.0:1767318247.385834:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379454208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318247.385927:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379454208:12345-0@lo:400:kworker.0 Request processed in 94us (1218us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318247.385935:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084
00000100:00100000:0.0:1767318247.385951:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085
00000100:00100000:0.0:1767318247.385956:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379454080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318247.385979:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379454080:12345-0@lo:400:kworker.0 Request processed in 23us (1196us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318247.385985:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085
00000100:00100000:0.0:1767318247.386030:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379454080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318247.386040:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379454208:0@lo:400:kworker.0
00000100:00080000:3.0:1767318247.387784:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318251.481201:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318252.433841:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291850368
00000100:00100000:0.0:1767318252.433850:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291850368
00000100:00100000:0.0:1767318252.433951:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291850496
00000100:00100000:0.0:1767318252.433955:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291850496
00000100:00100000:0.0:1767318252.434001:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3530
00000100:00100000:0.0:1767318252.434012:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291850496:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318252.434091:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291850496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (425us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318252.434113:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3530
00000100:00100000:0.0:1767318252.434131:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16008
00000100:00100000:0.0:1767318252.434136:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291850368:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318252.434155:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318252.434184:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291850368:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (578us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318252.434190:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16008
00000100:00080000:0.0:1767318252.434208:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318252.504437:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318252.504448:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318252.504453:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318252.504457:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318252.504462:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318252.504469:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3149
00000100:00080000:0.0:1767318252.504474:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318252.504481:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318252.504526:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449c00 x1853164379455104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318252.504557:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318252.504561:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318252.504562:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318252.504567:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3149
00000100:00080000:0.0:1767318252.504569:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318252.504590:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318252.504605:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b480 x1853164379455232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318252.507339:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379455104
00000100:00100000:3.0:1767318252.507348:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379455104
00000100:00100000:3.0:1767318252.507383:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16009
00000100:00100000:3.0:1767318252.507390:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379455104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318252.507414:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318252.507461:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379455104:12345-0@lo:38:kworker.0 Request processed in 71us (1239us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318252.507465:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16009
00000100:00080000:0.0:1767318252.507792:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318252.507797:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318252.507799:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318252.507802:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3149
00000100:00080000:0.0:1767318252.507805:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318252.507808:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318252.507833:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379455744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318252.507859:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318252.507863:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318252.507885:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318252.507890:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3149
00000100:00080000:0.0:1767318252.507893:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318252.507897:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318252.507908:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a680 x1853164379456000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318252.507934:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379455744:0@lo:38:kworker.0
00000100:00100000:0.0:1767318252.507967:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.507990:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379456000:0@lo:38:kworker.0
00000100:00100000:0.0:1767318252.508011:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318252.508031:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379455744
00000100:00100000:0.0:1767318252.508046:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379455744
00000100:00100000:3.0:1767318252.510836:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379455872:0@lo:400:kworker.0
00000100:00100000:3.0:1767318252.510927:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318252.510962:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318252.510970:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379455616:0@lo:400:kworker.0
00000100:00100000:3.0:1767318252.510991:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318252.511031:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379455872
00000100:00100000:3.0:1767318252.511036:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379455872
00000100:00100000:3.0:1767318252.511086:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379455616
00000100:00100000:3.0:1767318252.511089:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379455616
00000100:00100000:3.0:1767318252.511102:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531
00000100:00100000:3.0:1767318252.511106:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379455872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318252.511141:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379455872:12345-0@lo:400:kworker.0 Request processed in 34us (215us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318252.511145:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531
00000100:00100000:3.0:1767318252.511154:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532
00000100:00100000:3.0:1767318252.511157:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379455616:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318252.511175:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379455616:12345-0@lo:400:kworker.0 Request processed in 18us (184us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318252.511178:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532
00000100:00080000:3.0:1767318252.511200:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318252.511219:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379455616:0@lo:400:kworker.0
00000100:00100000:3.0:1767318252.511224:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379455872:0@lo:400:kworker.0
00000100:00100000:0.0:1767318253.015945:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318253.015969:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379456128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318253.016038:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318253.016715:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379456128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318256.599248:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379456256
00000100:00100000:0.0:1767318256.599292:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379456256
00000100:00100000:0.0:1767318256.599354:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824
00000100:00100000:0.0:1767318256.599375:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379456256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318256.599406:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318256.599469:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379456256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (319us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318256.599476:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824
00000100:00080000:3.0:1767318256.599661:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318257.559516:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291850624
00000100:00100000:0.0:1767318257.559532:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291850624
00000100:00100000:0.0:1767318257.559599:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16012
00000100:00100000:0.0:1767318257.559608:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291850624:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318257.559635:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318257.560009:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291850624:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 398us (3514us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318257.560018:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16012
00000100:00100000:3.0:1767318257.573988:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:3.0:1767318257.574682:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318257.623196:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318257.623207:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318257.623210:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318257.623214:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318257.623219:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318257.623227:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3154
00000100:00080000:0.0:1767318257.623250:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318257.623256:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318257.623292:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b800 x1853164379456384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318257.623321:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318257.623325:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318257.623327:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318257.623331:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3154
00000100:00080000:0.0:1767318257.623333:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318257.623337:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318257.623362:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44ad80 x1853164379456512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318257.623437:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318257.623441:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318257.623443:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318257.623447:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3154
00000100:00080000:0.0:1767318257.623450:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318257.623453:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318257.623465:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a680 x1853164379457024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318257.623481:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318257.623484:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318257.623485:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318257.623489:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3154
00000100:00080000:0.0:1767318257.623497:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318257.623502:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318257.623516:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85df80 x1853164379457280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318257.623543:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379457152:0@lo:400:kworker.0
00000100:00100000:0.0:1767318257.623606:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318257.623668:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318257.623674:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379456896:0@lo:400:kworker.0
00000100:00100000:0.0:1767318257.623694:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318257.623720:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379457152
00000100:00100000:0.0:1767318257.623727:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379457152
00000100:00100000:0.0:1767318257.623775:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379456896
00000100:00100000:0.0:1767318257.623778:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379456896
00000100:00100000:0.0:1767318257.623801:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534
00000100:00100000:0.0:1767318257.623810:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379457152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318257.623862:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379457152:12345-0@lo:400:kworker.0 Request processed in 54us (255us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318257.623894:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534
00000100:00100000:0.0:1767318257.623913:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535
00000100:00100000:0.0:1767318257.623919:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379456896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318257.623948:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379456896:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318257.623953:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535
00000100:00080000:0.0:1767318257.623978:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318257.624008:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379456896:0@lo:400:kworker.0
00000100:00100000:0.0:1767318257.624019:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379457152:0@lo:400:kworker.0
00000100:00100000:3.0:1767318257.624241:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379456768:0@lo:400:kworker.0
00000100:00100000:3.0:1767318257.624280:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318257.624323:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318257.624330:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379456640:0@lo:400:kworker.0
00000100:00100000:3.0:1767318257.624364:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318257.624556:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379456768
00000100:00100000:0.0:1767318257.624561:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379456768
00000100:00080000:3.0:1767318257.624694:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318257.624757:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379456640
00000100:00100000:0.0:1767318257.624761:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379456640
00000100:00100000:3.0:1767318257.625563:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379456384:0@lo:38:kworker.0
00000100:00100000:3.0:1767318257.625612:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318257.625641:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379456512:0@lo:38:kworker.0
00000100:00100000:3.0:1767318257.625664:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318257.625690:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379457024:0@lo:38:kworker.0
00000100:00100000:3.0:1767318257.625712:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318257.625732:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379457280:0@lo:38:kworker.0
00000100:00100000:3.0:1767318257.625753:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318257.625787:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379456384
00000100:00100000:3.0:1767318257.625792:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379456384
00000100:00100000:3.0:1767318257.625816:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379457024
00000100:00100000:3.0:1767318257.625818:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379457024
00000100:00100000:3.0:1767318257.625831:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379457280
00000100:00100000:3.0:1767318257.625833:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379457280
00000100:00100000:3.0:1767318257.625849:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16013
00000100:00100000:3.0:1767318257.625855:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379456384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318257.625893:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318257.625932:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379456384:12345-0@lo:38:kworker.0 Request processed in 76us (319us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318257.625940:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16013
00000100:00100000:3.0:1767318257.625955:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16014
00000100:00100000:3.0:1767318257.625959:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379457024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318257.625968:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318257.625991:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379457024:12345-0@lo:38:kworker.0 Request processed in 31us (278us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318257.626010:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16014
00000100:00100000:3.0:1767318257.626022:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16015
00000100:00100000:3.0:1767318257.626026:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379457280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318257.626035:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318257.626061:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379457280:12345-0@lo:38:kworker.0 Request processed in 33us (307us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318257.626066:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16015
00000100:00080000:3.0:1767318257.626100:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318257.626104:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318257.626108:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379456384:0@lo:38:kworker.0
00000100:00080000:3.0:1767318257.626117:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318257.626120:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318257.626122:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379457024:0@lo:38:kworker.0
00000100:00080000:3.0:1767318257.626129:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318257.626132:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318257.626135:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379457280:0@lo:38:kworker.0
00000100:00100000:3.0:1767318257.626180:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379456512
00000100:00100000:3.0:1767318257.626184:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379456512
00000100:00100000:3.0:1767318257.626206:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765
00000100:00100000:3.0:1767318257.626211:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379456512:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318257.626221:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318257.626252:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379456512:12345-0@lo:38:kworker.0 Request processed in 40us (587us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318257.626258:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765
00000100:00080000:3.0:1767318257.626288:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318257.626293:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318257.626296:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379456512:0@lo:38:kworker.0
00000100:00100000:0.0:1767318258.139619:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318258.139646:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379457408:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318258.139718:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318258.139902:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379457408
00000100:00100000:3.0:1767318258.139911:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379457408
00000100:00100000:3.0:1767318258.139970:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825
00000100:00100000:3.0:1767318258.139981:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379457408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318258.140016:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318258.140084:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379457408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (365us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318258.140091:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825
00000400:00000100:0.0:1767318261.651083:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291850880 offset 0 length 520: 4
00000100:00100000:0.0:1767318261.651128:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318261.651202:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318261.651356:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291851008
00000100:00100000:3.0:1767318261.651365:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291851008
00000100:00100000:3.0:1767318261.651413:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3536
00000100:00080000:0.0:1767318261.651495:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318261.651677:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291851136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318261.651746:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291851136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 76us (544us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318261.658236:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3536
00000100:00100000:3.0:1767318261.721069:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379457536
00000100:00100000:3.0:1767318261.721078:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379457536
00000100:00100000:3.0:1767318261.721139:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826
00000100:00100000:3.0:1767318261.721149:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379457536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318261.721177:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318261.721227:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379457536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (268us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318261.721234:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826
00000100:00100000:3.0:1767318262.743221:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318237/real 1767318237]  req@ffff8b0f07a14700 x1853164379451136/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318262 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318262.743271:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f07a14700 x1853164379451136/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318262 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318262.743314:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318262.743349:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318262.743353:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379451136:0@lo:250:kworker.0
00000100:00080000:0.0:1767318262.743977:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318262.743989:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318262.743993:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318262.744001:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3139
00000100:00080000:0.0:1767318262.744005:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318262.744011:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318262.744048:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d180 x1853164379457664/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318262.744072:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318262.744075:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318262.744077:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318262.744081:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3160
00000100:00080000:0.0:1767318262.744083:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318262.744086:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318262.744104:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f800 x1853164379457792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318262.744130:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318262.744133:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318262.744135:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318262.744138:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3160
00000100:00080000:0.0:1767318262.744141:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318262.744146:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318262.744163:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e680 x1853164379457920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318262.744248:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318262.744252:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318262.744255:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318262.744259:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3160
00000100:00080000:0.0:1767318262.744261:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318262.744265:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318262.744295:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85dc00 x1853164379458432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318262.744330:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318262.744334:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318262.744336:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318262.744339:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3160
00000100:00080000:0.0:1767318262.744342:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318262.744345:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318262.744355:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ed80 x1853164379458688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318262.744821:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379457664:0@lo:250:kworker.0
00000400:00000100:3.0:1767318262.744951:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379457664 offset 0 length 520: 4
00000100:00100000:0.0:1767318262.744986:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379458048
00000100:00100000:0.0:1767318262.745071:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379458048
00000100:00100000:0.0:1767318262.745121:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090
00000100:00100000:0.0:1767318262.745129:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379458048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318262.750587:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379457792:0@lo:38:kworker.0
00000100:00100000:3.0:1767318262.750672:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318262.750713:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379457920:0@lo:38:kworker.0
00000100:00100000:3.0:1767318262.750744:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318262.750771:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379458432:0@lo:38:kworker.0
00000100:00100000:3.0:1767318262.752467:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318262.752552:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379458688:0@lo:38:kworker.0
00000100:00100000:3.0:1767318262.752622:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318262.752692:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379457920
00000100:00100000:3.0:1767318262.752702:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379457920
00000100:00100000:3.0:1767318262.752750:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766
00000100:00100000:3.0:1767318262.752759:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379457920:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318262.752787:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318262.753058:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379457920:12345-0@lo:38:kworker.0 Request processed in 297us (2311us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318262.753088:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766
00000100:00100000:3.0:1767318262.753120:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379457792
00000100:00100000:3.0:1767318262.753125:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379457792
00000100:00100000:3.0:1767318262.753149:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379458432
00000100:00100000:3.0:1767318262.753152:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379458432
00000100:00100000:3.0:1767318262.753167:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379458688
00000100:00100000:3.0:1767318262.753169:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379458688
00000100:00100000:3.0:1767318262.753183:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16017
00000100:00100000:3.0:1767318262.753188:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379457792:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318262.753199:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318262.753228:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379457792:12345-0@lo:38:kworker.0 Request processed in 39us (2557us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318262.753234:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16017
00000100:00100000:3.0:1767318262.753244:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16018
00000100:00100000:3.0:1767318262.753249:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379458432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318262.753256:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318262.753278:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379458432:12345-0@lo:38:kworker.0 Request processed in 28us (2483us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318262.753283:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16018
00000100:00100000:3.0:1767318262.753295:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16019
00000100:00100000:3.0:1767318262.753299:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379458688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318262.753317:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318262.753639:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379458688:12345-0@lo:38:kworker.0 Request processed in 338us (1016us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318262.753647:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16019
00000100:00080000:3.0:1767318262.753697:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318262.753710:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318262.753715:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379457792:0@lo:38:kworker.0
00000100:00080000:3.0:1767318262.753732:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318262.753736:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318262.753739:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379457920:0@lo:38:kworker.0
00000100:00080000:3.0:1767318262.753749:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318262.753753:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318262.753756:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379458432:0@lo:38:kworker.0
00000100:00080000:3.0:1767318262.753764:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318262.753768:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318262.753770:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379458688:0@lo:38:kworker.0
00000100:00100000:0.0:1767318262.754912:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379458048:12345-0@lo:400:kworker.0 Request processed in 9780us (9979us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318262.754927:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090
00000100:00100000:3.0:1767318262.755301:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379458048:0@lo:400:kworker.0
00000100:00100000:3.0:1767318262.755370:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379458176:0@lo:400:kworker.0
00000100:00100000:3.0:1767318263.255354:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379458816:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318263.255460:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318263.260096:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379458816:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318266.767991:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318266.768167:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291851264
00000100:00100000:0.0:1767318266.768276:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291851264
00000100:00100000:0.0:1767318266.768324:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16020
00000100:00100000:0.0:1767318266.768331:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291851264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318266.768356:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318266.768477:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291851264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 143us (493us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318266.768486:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16020
00000100:00100000:3.0:1767318266.776317:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291851392
00000100:00100000:3.0:1767318266.776328:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291851392
00000100:00100000:3.0:1767318266.776447:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3539
00000100:00100000:3.0:1767318266.776458:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291851392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318266.776540:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291851392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (476us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318266.776565:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3539
00000100:00100000:3.0:1767318266.841634:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379458944:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318266.841729:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318266.843367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318266.843426:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379458944:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318267.862999:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318267.863009:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318267.863012:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318267.863015:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318267.863019:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318267.863027:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3165
00000100:00080000:0.0:1767318267.863032:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318267.863038:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318267.863081:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ea00 x1853164379459072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318267.863123:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318267.863126:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318267.863128:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318267.863132:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3165
00000100:00080000:0.0:1767318267.863135:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318267.863138:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318267.863153:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ed80 x1853164379459200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318267.863215:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318267.863219:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318267.863221:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318267.863224:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3165
00000100:00080000:0.0:1767318267.863226:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318267.863230:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318267.863240:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85fb80 x1853164379459712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318267.863254:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318267.863257:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318267.863289:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318267.863293:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3165
00000100:00080000:0.0:1767318267.863295:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318267.863299:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318267.863310:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ce00 x1853164379459968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318267.864365:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379459584
00000100:00100000:3.0:1767318267.864371:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379459584
00000100:00100000:3.0:1767318267.864408:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379459840
00000100:00100000:3.0:1767318267.864411:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379459840
00000100:00100000:3.0:1767318267.864436:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3540
00000100:00100000:3.0:1767318267.864443:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379459584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318267.864491:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379459584:12345-0@lo:400:kworker.0 Request processed in 48us (398us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318267.864496:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3540
00000100:00100000:3.0:1767318267.864508:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541
00000100:00100000:3.0:1767318267.864513:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379459840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318267.864537:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379459840:12345-0@lo:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318267.864543:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541
00000100:00080000:3.0:1767318267.864563:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318267.864567:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318267.864586:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379459840:0@lo:400:kworker.0
00000100:00100000:3.0:1767318267.864595:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379459584:0@lo:400:kworker.0
00000100:00100000:3.0:1767318267.864620:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379459072:0@lo:38:kworker.0
00000100:00100000:3.0:1767318267.864656:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318267.864673:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379459200:0@lo:38:kworker.0
00000100:00100000:3.0:1767318267.864695:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318267.864719:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379459712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318267.864740:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318267.864769:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379459968:0@lo:38:kworker.0
00000100:00100000:3.0:1767318267.864789:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318267.864816:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379459200
00000100:00100000:3.0:1767318267.864820:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379459200
00000100:00100000:3.0:1767318267.864841:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767
00000100:00100000:3.0:1767318267.864845:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379459200:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318267.864864:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318267.864917:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379459200:12345-0@lo:38:kworker.0 Request processed in 70us (221us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318267.864923:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767
00000100:00100000:3.0:1767318267.864942:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379459072
00000100:00100000:3.0:1767318267.864945:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379459072
00000100:00100000:3.0:1767318267.864957:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379459712
00000100:00100000:3.0:1767318267.864959:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379459712
00000100:00100000:3.0:1767318267.864965:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379459968
00000100:00100000:3.0:1767318267.864967:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379459968
00000100:00100000:3.0:1767318267.864975:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16021
00000100:00100000:3.0:1767318267.864979:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379459072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318267.864988:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318267.865011:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379459072:12345-0@lo:38:kworker.0 Request processed in 31us (355us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318267.865025:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16021
00000100:00100000:3.0:1767318267.865036:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16022
00000100:00100000:3.0:1767318267.865040:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379459712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318267.865049:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318267.865072:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379459712:12345-0@lo:38:kworker.0 Request processed in 31us (332us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318267.865078:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16022
00000100:00100000:3.0:1767318267.865088:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16023
00000100:00100000:3.0:1767318267.865092:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379459968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318267.865100:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318267.865171:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379459968:12345-0@lo:38:kworker.0 Request processed in 76us (381us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318267.865177:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16023
00000100:00080000:3.0:1767318267.865203:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318267.865207:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318267.865211:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379459072:0@lo:38:kworker.0
00000100:00080000:3.0:1767318267.865217:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318267.865220:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318267.865223:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379459200:0@lo:38:kworker.0
00000100:00080000:3.0:1767318267.865230:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318267.865233:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318267.865236:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379459712:0@lo:38:kworker.0
00000100:00080000:3.0:1767318267.865242:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318267.865251:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318267.865254:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379459968:0@lo:38:kworker.0
00000100:00100000:0.0:1767318268.377379:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379460096
00000100:00100000:0.0:1767318268.377388:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379460096
00000100:00100000:0.0:1767318268.377446:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829
00000100:00100000:0.0:1767318268.377456:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379460096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318268.377487:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318268.377542:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379460096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318268.377550:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829
00000100:00100000:0.0:1767318271.887600:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291851648
00000100:00100000:0.0:1767318271.887610:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291851648
00000100:00080000:3.0:1767318271.887692:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318271.887699:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3542
00000100:00100000:0.0:1767318271.887711:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291851648:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318271.887791:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291851648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (316us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318271.887799:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3542
00000100:00100000:0.0:1767318271.888454:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291851520
00000100:00100000:0.0:1767318271.888459:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291851520
00000100:00100000:0.0:1767318271.888482:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16024
00000100:00100000:0.0:1767318271.888486:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291851520:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318271.888503:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318271.888538:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291851520:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (217us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318271.888542:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16024
00000100:00100000:3.0:1767318271.959382:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379460224:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318271.959462:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318271.959629:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379460224
00000100:00100000:0.0:1767318271.959638:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379460224
00000100:00100000:0.0:1767318271.960906:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830
00000100:00100000:0.0:1767318271.960923:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379460224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318271.960957:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318271.961036:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379460224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (1573us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318271.961043:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830
00000100:00080000:3.0:1767318271.963546:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318272.982985:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318272.982995:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318272.982999:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318272.983002:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318272.983007:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318272.983015:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3170
00000100:00080000:3.0:1767318272.983019:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318272.983027:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318272.983063:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379460352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318272.983092:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318272.983096:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318272.983097:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318272.983101:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3170
00000100:00080000:3.0:1767318272.983111:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318272.983115:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318272.983127:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05180 x1853164379460480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318272.983209:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318272.983223:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318272.983225:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318272.983229:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3170
00000100:00080000:3.0:1767318272.983231:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318272.983235:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318272.983245:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05c00 x1853164379460992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318272.983260:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318272.983263:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318272.983265:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318272.983268:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3170
00000100:00080000:3.0:1767318272.983270:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318272.983273:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318272.983282:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04380 x1853164379461248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318272.984035:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379460352:0@lo:38:kworker.0
00000100:00100000:0.0:1767318272.984069:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318272.984097:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379460480:0@lo:38:kworker.0
00000100:00100000:0.0:1767318272.984126:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318272.984141:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379460992:0@lo:38:kworker.0
00000100:00100000:0.0:1767318272.984152:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318272.984162:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379461248:0@lo:38:kworker.0
00000100:00100000:0.0:1767318272.984173:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318272.984200:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379460352
00000100:00100000:0.0:1767318272.984204:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379460352
00000100:00100000:0.0:1767318272.984235:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379460992
00000100:00100000:0.0:1767318272.984239:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379460992
00000100:00100000:0.0:1767318272.984249:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379461248
00000100:00100000:0.0:1767318272.984251:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379461248
00000100:00100000:0.0:1767318272.984265:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16025
00000100:00100000:0.0:1767318272.984269:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379460352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318272.984299:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318272.984333:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379460352:12345-0@lo:38:kworker.0 Request processed in 61us (262us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318272.984338:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16025
00000100:00100000:0.0:1767318272.984357:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16026
00000100:00100000:0.0:1767318272.984365:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379460992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318272.984375:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318272.984398:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379460992:12345-0@lo:38:kworker.0 Request processed in 36us (244us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318272.984402:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16026
00000100:00100000:0.0:1767318272.984409:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379460864
00000100:00100000:0.0:1767318272.984413:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379460864
00000100:00100000:0.0:1767318272.984431:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3543
00000100:00100000:0.0:1767318272.984437:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379460864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318272.984471:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379460864:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318272.984476:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3543
00000100:00100000:0.0:1767318272.984483:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379461120
00000100:00100000:0.0:1767318272.984487:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379461120
00000100:00100000:0.0:1767318272.984502:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544
00000100:00100000:0.0:1767318272.984506:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379461120:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318272.984530:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379461120:12345-0@lo:400:kworker.0 Request processed in 23us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318272.984535:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544
00000100:00080000:0.0:1767318272.984563:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318272.984567:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318272.984569:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379460352:0@lo:38:kworker.0
00000100:00080000:0.0:1767318272.984574:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318272.984576:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318272.984578:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379460992:0@lo:38:kworker.0
00000100:00080000:0.0:1767318272.985282:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318272.985288:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318272.985291:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379461248:0@lo:38:kworker.0
00000100:00080000:3.0:1767318272.985370:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318272.985374:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318272.985384:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379460480
00000100:00100000:3.0:1767318272.985387:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379460480
00000100:00100000:3.0:1767318272.985418:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768
00000100:00100000:3.0:1767318272.985423:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379460480:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318272.985435:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318272.985490:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318272.985494:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318272.985497:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379460480:0@lo:38:kworker.0
00000100:00100000:3.0:1767318272.985535:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379460480:12345-0@lo:38:kworker.0 Request processed in 53us (1350us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318272.985548:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768
00000100:00100000:0.0:1767318273.496200:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379461376
00000100:00100000:0.0:1767318273.496237:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379461376
00000100:00100000:0.0:1767318273.496290:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831
00000100:00100000:0.0:1767318273.496299:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379461376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318273.496334:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318273.496388:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379461376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (491us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318273.496396:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831
00000100:00080000:3.0:1767318277.010963:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318277.016076:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291851776
00000100:00100000:3.0:1767318277.016092:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291851776
00000100:00100000:3.0:1767318277.016158:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16028
00000100:00100000:3.0:1767318277.016167:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291851776:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318277.016201:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318277.016283:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291851776:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 114us (4153us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318277.016290:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16028
00000100:00100000:0.0:1767318277.079395:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379461504
00000100:00100000:0.0:1767318277.079404:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379461504
00000100:00100000:0.0:1767318277.079530:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832
00000100:00100000:0.0:1767318277.079539:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379461504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318277.079569:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318277.079644:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379461504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318277.079652:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832
00000100:00100000:3.0:1767318277.080013:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379461504:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318278.104081:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318278.104091:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318278.104094:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318278.104117:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318278.104121:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318278.104129:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3175
00000100:00080000:0.0:1767318278.104134:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318278.104140:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318278.104185:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f800 x1853164379461632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318278.104215:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318278.104218:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318278.104221:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318278.104224:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3175
00000100:00080000:0.0:1767318278.104227:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318278.104230:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318278.104242:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ca80 x1853164379461760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318278.104305:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318278.104308:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318278.104309:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318278.104313:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3175
00000100:00080000:0.0:1767318278.104315:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318278.104319:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318278.104331:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ea00 x1853164379462272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318278.104346:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318278.104355:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318278.104357:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318278.104360:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3175
00000100:00080000:0.0:1767318278.104362:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318278.104366:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318278.104377:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44bb80 x1853164379462528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318278.104829:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379462144
00000100:00100000:3.0:1767318278.104838:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379462144
00000100:00100000:3.0:1767318278.104911:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379462400
00000100:00100000:3.0:1767318278.104915:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379462400
00000100:00100000:3.0:1767318278.104937:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3546
00000100:00100000:3.0:1767318278.104945:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379462144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318278.105001:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379462144:12345-0@lo:400:kworker.0 Request processed in 56us (308us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318278.105009:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3546
00000100:00100000:3.0:1767318278.105025:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3547
00000100:00100000:3.0:1767318278.105031:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379462400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318278.105057:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379462400:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318278.105063:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3547
00000100:00100000:3.0:1767318278.615235:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379462656:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318278.615304:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318278.615530:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379462656
00000100:00100000:0.0:1767318278.615553:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379462656
00000100:00100000:0.0:1767318278.615610:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833
00000100:00100000:0.0:1767318278.615619:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379462656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318278.615646:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318278.615699:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379462656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (394us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318278.615706:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833
00000100:00100000:3.0:1767318278.615979:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379462656:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318282.140665:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291852160
00000100:00100000:3.0:1767318282.140682:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291852160
00000100:00100000:3.0:1767318282.140847:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291852032
00000100:00100000:3.0:1767318282.140851:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291852032
00000100:00100000:0.0:1767318282.143124:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3548
00000100:00100000:0.0:1767318282.143160:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291852160:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318282.143261:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291852160:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (12834us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318282.143270:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3548
00000100:00100000:0.0:1767318282.143293:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16032
00000100:00100000:0.0:1767318282.143297:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291852032:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318282.143318:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318282.143345:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291852032:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (11929us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318282.143366:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16032
00000100:00080000:3.0:1767318282.213008:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318283.223055:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318283.223065:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318283.223068:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318283.223072:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318283.223076:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318283.223084:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767318283.223089:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318283.223095:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318283.223150:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a680 x1853164379462912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318283.223177:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318283.223180:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318283.223182:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318283.223186:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767318283.223188:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318283.223191:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318283.223204:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b800 x1853164379463040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318283.223267:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318283.223271:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318283.223273:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318283.223276:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767318283.223292:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318283.223295:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318283.223310:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44bb80 x1853164379463552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318283.223327:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318283.223331:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318283.223332:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318283.223336:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3180
00000100:00080000:0.0:1767318283.223338:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318283.223342:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318283.223359:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcf480 x1853164379463808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318283.224525:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318283.224588:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379463424:0@lo:400:kworker.0
00000100:00100000:3.0:1767318283.224618:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318283.224646:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318283.224652:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379463680:0@lo:400:kworker.0
00000100:00100000:3.0:1767318283.224678:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318283.224705:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379463424
00000100:00100000:3.0:1767318283.224709:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379463424
00000100:00100000:3.0:1767318283.224738:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379463680
00000100:00100000:3.0:1767318283.224742:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379463680
00000100:00100000:3.0:1767318283.224759:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549
00000100:00100000:3.0:1767318283.224766:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379463424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318283.224799:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379463424:12345-0@lo:400:kworker.0 Request processed in 33us (179us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318283.224804:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549
00000100:00100000:3.0:1767318283.224815:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550
00000100:00100000:3.0:1767318283.224821:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379463680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318283.224843:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379463680:12345-0@lo:400:kworker.0 Request processed in 22us (164us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318283.224861:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550
00000100:00080000:3.0:1767318283.224893:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318283.224911:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379463680:0@lo:400:kworker.0
00000100:00100000:3.0:1767318283.224921:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379463424:0@lo:400:kworker.0
00000100:00100000:3.0:1767318283.735592:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379463936
00000100:00100000:3.0:1767318283.735601:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379463936
00000100:00100000:3.0:1767318283.735653:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835
00000100:00100000:3.0:1767318283.735662:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379463936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318283.735690:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318283.735747:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379463936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (324us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318283.735755:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835
00000100:00100000:3.0:1767318287.263982:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291852544
00000100:00100000:3.0:1767318287.263992:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291852544
00000100:00100000:3.0:1767318287.264091:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3551
00000100:00100000:3.0:1767318287.264109:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291852544:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318287.264184:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291852544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (702us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318287.264192:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3551
00000100:00080000:0.0:1767318287.264976:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318287.322883:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379464064
00000100:00100000:0.0:1767318287.322892:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379464064
00000100:00100000:0.0:1767318287.322968:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836
00000100:00100000:0.0:1767318287.322977:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379464064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318287.323005:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318287.323051:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379464064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (613us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318287.323058:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836
00000100:00080000:3.0:1767318287.323290:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318287.323295:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318287.323298:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318287.323303:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3165
00000100:00080000:3.0:1767318287.323307:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318287.323311:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318287.323343:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164379464192/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318287.323366:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318287.323369:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318287.323371:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318287.323375:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3185
00000100:00080000:3.0:1767318287.323377:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318287.323382:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318287.323396:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05180 x1853164379464320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318287.323405:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318287.323408:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318287.323410:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318287.323413:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3185
00000100:00080000:3.0:1767318287.323416:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318287.323419:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318287.323430:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04380 x1853164379464448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318287.323482:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318287.323485:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318287.323487:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318287.323490:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3185
00000100:00080000:3.0:1767318287.323493:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318287.323497:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318287.323516:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379464832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318287.323537:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318287.323541:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318287.323542:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318287.323545:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3185
00000100:00080000:3.0:1767318287.323548:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318287.323552:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318287.323561:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04700 x1853164379465088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318287.323585:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379464704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.323618:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318287.323641:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318287.323646:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379464576:0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.323707:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318287.323742:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379464576
00000100:00100000:3.0:1767318287.323746:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379464576
00000100:00100000:3.0:1767318287.323776:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100
00000100:00100000:3.0:1767318287.323782:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379464576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.323818:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379464576:12345-0@lo:400:kworker.0 Request processed in 37us (111us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318287.323824:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100
00000100:00100000:3.0:1767318287.323845:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379464960:0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.323866:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318287.323934:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379464576:0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.323974:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379464704
00000100:00100000:3.0:1767318287.323978:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379464704
00000100:00100000:3.0:1767318287.324001:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379464960
00000100:00100000:3.0:1767318287.324004:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379464960
00000100:00100000:3.0:1767318287.324021:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552
00000100:00100000:3.0:1767318287.324026:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379464704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.324060:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379464704:12345-0@lo:400:kworker.0 Request processed in 33us (441us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318287.324065:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552
00000100:00100000:3.0:1767318287.324076:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553
00000100:00100000:3.0:1767318287.324093:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379464960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.324266:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379464960:12345-0@lo:400:kworker.0 Request processed in 184us (398us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318287.324273:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553
00000100:00100000:3.0:1767318287.324298:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379464960:0@lo:400:kworker.0
00000100:00100000:3.0:1767318287.324316:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379464704:0@lo:400:kworker.0
00000100:00100000:0.0:1767318288.857754:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379465216
00000100:00100000:0.0:1767318288.857763:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379465216
00000100:00100000:0.0:1767318288.857818:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837
00000100:00100000:0.0:1767318288.857828:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379465216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318288.857861:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318288.857954:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379465216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (324us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318288.857962:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837
00000100:00100000:3.0:1767318292.369722:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291852672
00000100:00100000:3.0:1767318292.369733:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291852672
00000100:00100000:3.0:1767318292.369930:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291852800
00000100:00100000:3.0:1767318292.369935:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291852800
00000100:00100000:0.0:1767318292.372103:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3554
00000100:00100000:0.0:1767318292.372128:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291852800:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318292.372221:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291852800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 105us (2565us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318292.372229:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3554
00000100:00100000:0.0:1767318292.372255:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16040
00000100:00100000:0.0:1767318292.372260:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291852672:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318292.372280:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318292.372303:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291852672:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (2703us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318292.372309:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16040
00000100:00100000:3.0:1767318292.439222:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379465344:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318292.439297:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318292.439419:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318292.439424:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318292.439427:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318292.439432:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318292.439447:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318292.439452:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3189
00000100:00080000:0.0:1767318292.439456:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318292.439483:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318292.439508:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd180 x1853164379465472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318292.439554:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318292.439558:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318292.439560:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318292.439564:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3189
00000100:00080000:0.0:1767318292.439567:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318292.439571:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318292.439586:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc700 x1853164379465600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318292.439619:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318292.439622:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318292.439624:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318292.439627:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3189
00000100:00080000:0.0:1767318292.439630:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318292.439633:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318292.439643:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164379465984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318292.439657:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318292.439660:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318292.439662:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318292.439664:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3189
00000100:00080000:0.0:1767318292.439667:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318292.439670:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318292.439678:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164379466240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318292.439719:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379465856:0@lo:400:kworker.0
00000100:00100000:0.0:1767318292.439755:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318292.439777:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318292.439783:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379466112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318292.439805:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318292.439829:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318292.439836:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379465728:0@lo:400:kworker.0
00000100:00100000:0.0:1767318292.439861:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318292.439923:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379465728
00000100:00100000:0.0:1767318292.439930:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379465728
00000100:00100000:0.0:1767318292.439987:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101
00000100:00100000:0.0:1767318292.439998:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379465728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318292.440061:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379465728:12345-0@lo:400:kworker.0 Request processed in 66us (199us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318292.440069:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101
00000100:00100000:0.0:1767318292.440116:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379465728:0@lo:400:kworker.0
00000100:00100000:3.0:1767318292.440603:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379465856
00000100:00100000:3.0:1767318292.440609:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379465856
00000100:00100000:3.0:1767318292.440655:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379466112
00000100:00100000:3.0:1767318292.440659:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379466112
00000100:00100000:3.0:1767318292.440681:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3555
00000100:00100000:3.0:1767318292.440709:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379465856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318292.440762:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379465856:12345-0@lo:400:kworker.0 Request processed in 67us (1007us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318292.440769:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555
00000100:00100000:3.0:1767318292.440781:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556
00000100:00100000:3.0:1767318292.440788:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379466112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318292.440813:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379466112:12345-0@lo:400:kworker.0 Request processed in 26us (1007us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318292.440818:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3556
00000100:00100000:0.0:1767318292.441138:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379466112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318292.441149:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379465856:0@lo:400:kworker.0
00000100:00100000:1.0:1767318292.442848:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379465600
00000100:00100000:1.0:1767318292.442860:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379465600
00000100:00100000:1.0:1767318292.442914:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772
00000100:00100000:1.0:1767318292.442920:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379465600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318292.442931:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318292.442964:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379465600:12345-0@lo:38:kworker.0 Request processed in 43us (1270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318292.442971:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772
00000100:00100000:3.0:1767318292.443167:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379465344:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318292.952235:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318293.975170:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318293.975755:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379466368
00000100:00100000:1.0:1767318293.975764:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379466368
00000100:00100000:1.0:1767318293.975819:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839
00000100:00100000:1.0:1767318293.975828:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379466368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318293.975858:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318293.975929:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379466368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (413us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318293.975937:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839
00010000:00010000:1.0:1767318294.999090:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318297.047497:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318297.489671:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318297.489864:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291852928
00000100:00100000:3.0:1767318297.489904:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291852928
00000100:00100000:3.0:1767318297.489979:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16044
00000100:00100000:3.0:1767318297.489987:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291852928:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318297.490023:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318297.490097:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291852928:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 108us (435us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318297.490104:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16044
00000100:00100000:1.0:1767318297.504851:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318297.505112:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291853056
00000100:00100000:3.0:1767318297.505123:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291853056
00000100:00100000:3.0:1767318297.505192:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3557
00000100:00100000:3.0:1767318297.505203:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291853056:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318297.505273:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291853056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (431us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318297.505280:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3557
00000100:00100000:0.0:1767318297.560252:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379466496:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318297.560309:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318297.560396:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379466496
00000100:00100000:0.0:1767318297.560403:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379466496
00000100:00100000:0.0:1767318297.560443:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840
00000100:00100000:0.0:1767318297.560449:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379466496:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318297.560481:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318297.560519:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379466496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (210us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318297.560531:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840
00000100:00100000:0.0:1767318297.560552:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379466880:0@lo:400:kworker.0
00000100:00100000:0.0:1767318297.560574:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318297.560590:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318297.560596:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379467008:0@lo:400:kworker.0
00000100:00100000:0.0:1767318297.560616:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318297.565603:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379466496:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318297.565630:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318297.565639:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379467264:0@lo:400:kworker.0
00000100:00100000:0.0:1767318297.565691:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318297.565738:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379467264
00000100:00100000:0.0:1767318297.565742:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379467264
00000100:00100000:0.0:1767318297.565783:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559
00000100:00100000:0.0:1767318297.565902:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379467264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318297.565942:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379467264:12345-0@lo:400:kworker.0 Request processed in 44us (251us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318297.565946:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559
00000100:00100000:0.0:1767318297.565987:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379467264:0@lo:400:kworker.0
00000100:00080000:0.0:1767318297.566037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318297.566042:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318297.566053:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379466880
00000100:00100000:0.0:1767318297.566056:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379466880
00000100:00100000:0.0:1767318297.566078:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102
00000100:00100000:0.0:1767318297.566093:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379466880:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318297.567728:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318297.567776:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379466624:0@lo:38:kworker.0
00000100:00100000:3.0:1767318297.568137:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318297.568189:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379466752:0@lo:38:kworker.0
00000100:00100000:1.0:1767318297.568192:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379466624
00000100:00100000:1.0:1767318297.568200:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379466624
00000100:00100000:3.0:1767318297.568225:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318297.568272:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379467136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318297.568295:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318297.574001:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379467136
00000100:00100000:1.0:1767318297.574017:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379467136
00000100:00100000:3.0:1767318297.574054:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379467392:0@lo:38:kworker.0
00000100:00100000:1.0:1767318297.574089:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16045
00000100:00100000:1.0:1767318297.574097:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379466624:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318297.574114:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:1.0:1767318297.574141:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318297.574157:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379466752
00000100:00100000:3.0:1767318297.574163:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379466752
00000100:00100000:3.0:1767318297.574193:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773
00000100:00100000:1.0:1767318297.574199:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379466624:12345-0@lo:38:kworker.0 Request processed in 100us (6061us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318297.574201:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379466752:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318297.574214:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16045
00010000:00020000:3.0:1767318297.574218:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318297.574237:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379467392
00000100:00100000:1.0:1767318297.574242:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379467392
00000100:00100000:3.0:1767318297.574256:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379466752:12345-0@lo:38:kworker.0 Request processed in 55us (6031us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318297.574259:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16046
00000100:00100000:1.0:1767318297.574265:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379467136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318297.574275:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318297.574303:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379467136:12345-0@lo:38:kworker.0 Request processed in 36us (6006us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318297.574308:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16046
00000100:00100000:1.0:1767318297.574320:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16047
00000100:00100000:1.0:1767318297.574323:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379467392:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318297.574408:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318297.574435:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379467392:12345-0@lo:38:kworker.0 Request processed in 109us (321us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318297.574441:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16047
00000100:00100000:0.0:1767318297.575125:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379466880:12345-0@lo:400:kworker.0 Request processed in 9029us (14549us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318297.575135:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102
00000100:00100000:0.0:1767318297.575181:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07abce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379467008:0@lo:400:kworker.0
00000100:00100000:0.0:1767318297.575194:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379466880:0@lo:400:kworker.0
00000100:00100000:3.0:1767318297.575370:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773
00010000:00010000:1.0:1767318298.071498:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318299.095085:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379467520:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318299.095157:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318299.095423:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379467520
00000100:00100000:1.0:1767318299.095432:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379467520
00000100:00100000:1.0:1767318299.095514:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841
00000100:00100000:1.0:1767318299.095524:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379467520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318299.095556:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318299.095612:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379467520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (455us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318299.095633:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841
00000100:00080000:0.0:1767318299.095755:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318301.143990:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318302.167108:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318302.611135:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318302.611187:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:0.0:1767318302.613135:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318302.679746:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379467648:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318302.679829:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318302.679978:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379467648
00000100:00100000:0.0:1767318302.681251:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379467648
00000100:00100000:0.0:1767318302.681338:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842
00000100:00100000:0.0:1767318302.681348:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379467648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318302.681380:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318302.681445:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379467648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (1617us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318302.681453:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842
00000100:00080000:3.0:1767318302.681678:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318302.681940:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379467648:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318302.682565:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318302.682572:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318302.682575:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318302.682579:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318302.682583:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318302.682589:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3199
00000100:00080000:1.0:1767318302.682593:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318302.682597:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318302.682631:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ca80 x1853164379467776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318302.682662:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318302.682666:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318302.682667:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318302.682671:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3199
00000100:00080000:1.0:1767318302.682673:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318302.682677:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318302.682689:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f800 x1853164379467904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318302.682925:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318302.682930:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318302.682932:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318302.682935:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3199
00000100:00080000:1.0:1767318302.682938:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318302.682952:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318302.682964:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f480 x1853164379468288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318302.682980:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318302.682983:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318302.682985:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318302.682987:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3199
00000100:00080000:1.0:1767318302.682989:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318302.682994:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318302.683021:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f1880 x1853164379468544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318302.683048:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379468160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318302.683078:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318302.683103:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318302.683108:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379468416:0@lo:400:kworker.0
00000100:00100000:1.0:1767318302.683128:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318302.683524:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468160
00000100:00100000:3.0:1767318302.683533:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468160
00000100:00100000:3.0:1767318302.683586:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468416
00000100:00100000:3.0:1767318302.683589:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468416
00000100:00080000:1.0:1767318302.683652:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318302.683667:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379467776:0@lo:38:kworker.0
00000100:00100000:1.0:1767318302.683700:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318302.683760:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468032
00000100:00100000:0.0:1767318302.683765:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468032
00000100:00100000:0.0:1767318302.683815:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103
00000100:00100000:0.0:1767318302.683823:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379468032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318302.683892:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31fbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379468032:12345-0@lo:400:kworker.0 Request processed in 71us (1065us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318302.683909:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103
00000100:00100000:1.0:1767318302.693537:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379467904:0@lo:38:kworker.0
00000100:00100000:1.0:1767318302.693608:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318302.693643:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379468288:0@lo:38:kworker.0
00000100:00100000:1.0:1767318302.693669:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318302.693741:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379467776
00000100:00100000:3.0:1767318302.693750:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379467776
00000100:00100000:3.0:1767318302.693829:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561
00000100:00100000:3.0:1767318302.693843:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379468160:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318302.693925:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379468160:12345-0@lo:400:kworker.0 Request processed in 88us (10846us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318302.693961:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561
00000100:00100000:3.0:1767318302.693981:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562
00000100:00100000:3.0:1767318302.693988:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379468416:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318302.694024:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379468416:12345-0@lo:400:kworker.0 Request processed in 36us (10894us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318302.694029:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562
00000100:00100000:3.0:1767318302.694042:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16049
00000100:00100000:3.0:1767318302.694046:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379467776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318302.694065:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318302.694094:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379467776:12345-0@lo:38:kworker.0 Request processed in 47us (10394us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318302.694100:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16049
00000100:00100000:3.0:1767318302.694170:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379467904
00000100:00100000:3.0:1767318302.694174:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379467904
00000100:00100000:3.0:1767318302.694203:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774
00000100:00100000:3.0:1767318302.694206:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379467904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318302.694216:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318302.694243:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379467904:12345-0@lo:38:kworker.0 Request processed in 35us (635us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318302.694248:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774
00000100:00100000:1.0:1767318302.697249:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468288
00000100:00100000:1.0:1767318302.697264:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468288
00000100:00100000:1.0:1767318302.697325:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16050
00000100:00100000:1.0:1767318302.697333:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379468288:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318302.697356:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318302.697419:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379468288:12345-0@lo:38:kworker.0 Request processed in 85us (3747us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318302.697425:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16050
00000100:00100000:1.0:1767318302.697661:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379468416:0@lo:400:kworker.0
00000100:00100000:1.0:1767318302.697777:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379468160:0@lo:400:kworker.0
00000100:00080000:1.0:1767318302.697824:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318302.697829:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318302.697833:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379468288:0@lo:38:kworker.0
00000100:00100000:1.0:1767318302.697843:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379468544:0@lo:38:kworker.0
00000100:00100000:1.0:1767318302.697901:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318302.697937:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318302.697951:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318302.697955:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379467776:0@lo:38:kworker.0
00000100:00080000:1.0:1767318302.697966:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318302.697969:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318302.697988:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379467904:0@lo:38:kworker.0
00000100:00100000:1.0:1767318302.698008:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468544
00000100:00100000:1.0:1767318302.698013:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468544
00000100:00100000:1.0:1767318302.698035:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16051
00000100:00100000:1.0:1767318302.698039:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379468544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318302.698051:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318302.698084:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379468544:12345-0@lo:38:kworker.0 Request processed in 43us (182us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318302.698090:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16051
00000100:00080000:1.0:1767318302.698116:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318302.698120:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318302.698122:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379468544:0@lo:38:kworker.0
00000100:00080000:1.0:1767318302.698233:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318304.220080:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468672
00000100:00100000:0.0:1767318304.220089:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468672
00000100:00100000:0.0:1767318304.220161:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843
00000100:00100000:0.0:1767318304.220171:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379468672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318304.220202:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318304.220261:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379468672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (704us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318304.220269:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843
00000100:00080000:1.0:1767318304.220404:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318304.220514:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379468672:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318305.239537:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318306.263266:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318307.727596:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318307.727644:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:0.0:1767318307.728039:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318307.728041:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16052
00000100:00100000:1.0:1767318307.728050:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291853440:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318307.728069:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318307.733806:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291853440:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 5742us (6147us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318307.733822:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16052
00000100:00100000:3.0:1767318307.801373:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379468800:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318307.801454:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318307.804441:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468800
00000100:00100000:0.0:1767318307.804456:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468800
00000100:00100000:0.0:1767318307.804552:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844
00000100:00100000:0.0:1767318307.804562:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379468800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318307.804595:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318307.804676:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379468800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (3221us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318307.804684:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844
00000100:00100000:3.0:1767318307.804731:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379468800:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318307.804812:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318307.805148:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379469184:0@lo:400:kworker.0
00000100:00100000:3.0:1767318307.805197:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318307.805231:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318307.805235:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379469312:0@lo:400:kworker.0
00000100:00100000:3.0:1767318307.805255:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318307.805296:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379468928:0@lo:38:kworker.0
00000100:00100000:3.0:1767318307.805307:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379469568
00000100:00100000:3.0:1767318307.805311:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379469568
00000100:00100000:1.0:1767318307.805324:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318307.805351:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379469056:0@lo:38:kworker.0
00000100:00100000:3.0:1767318307.805355:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379469312
00000100:00100000:3.0:1767318307.805358:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379469312
00000100:00100000:1.0:1767318307.805374:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318307.805376:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3564
00000100:00100000:3.0:1767318307.805382:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379469568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318307.805393:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379469440:0@lo:38:kworker.0
00000100:00100000:1.0:1767318307.805412:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318307.805426:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379469696:0@lo:38:kworker.0
00000100:00100000:3.0:1767318307.805426:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379469568:12345-0@lo:400:kworker.0 Request processed in 44us (201us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318307.805433:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3564
00000100:00100000:1.0:1767318307.805444:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318307.805444:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379468928
00000100:00100000:3.0:1767318307.805447:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379468928
00000100:00100000:3.0:1767318307.805456:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379469440
00000100:00100000:3.0:1767318307.805458:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379469440
00000100:00100000:3.0:1767318307.805464:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379469696
00000100:00100000:3.0:1767318307.805466:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379469696
00000100:00100000:1.0:1767318307.805467:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565
00000100:00100000:1.0:1767318307.805474:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379469312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318307.805474:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16053
00000100:00100000:3.0:1767318307.805478:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379468928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318307.805494:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318307.805522:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379469312:12345-0@lo:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318307.805522:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379468928:12345-0@lo:38:kworker.0 Request processed in 42us (197us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318307.805528:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16053
00000100:00100000:0.0:1767318307.805764:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379469184
00000100:00100000:0.0:1767318307.805770:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379469184
00000100:00100000:0.0:1767318307.805811:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104
00000100:00100000:0.0:1767318307.805818:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379469184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318307.805851:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379469184:12345-0@lo:400:kworker.0 Request processed in 34us (653us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318307.805867:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104
00000100:00100000:1.0:1767318307.812633:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565
00000100:00100000:1.0:1767318307.812684:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16054
00000100:00100000:1.0:1767318307.812693:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379469440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318307.812719:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318307.818044:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379469440:12345-0@lo:38:kworker.0 Request processed in 105us (7384us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318307.818055:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16054
00010000:00010000:1.0:1767318309.335145:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318309.335284:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379469824:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318309.335354:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318309.335843:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379469824
00000100:00100000:1.0:1767318309.335853:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379469824
00000100:00100000:1.0:1767318309.336058:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845
00000100:00100000:1.0:1767318309.336066:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379469824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318309.336089:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318309.336136:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379469824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (781us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318309.336159:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845
00000100:00100000:0.0:1767318309.336183:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379469824:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318310.359234:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318311.830344:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291853952
00000100:00100000:0.0:1767318311.830355:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291853952
00000100:00100000:0.0:1767318311.830426:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3566
00000100:00100000:0.0:1767318311.830438:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291853952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318311.830524:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291853952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (511us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318311.830532:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3566
00000100:00100000:0.0:1767318311.840110:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:1.0:1767318312.919036:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318312.919048:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318312.919052:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318312.919056:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318312.919061:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318312.919069:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3210
00000100:00080000:1.0:1767318312.919074:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318312.919083:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318312.919126:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f0e00 x1853164379469952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318312.919145:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318312.919148:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318312.919151:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318312.919165:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3210
00000100:00080000:1.0:1767318312.919170:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318312.919174:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318312.919190:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f0a80 x1853164379470080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318312.919285:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318312.919520:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379470336:0@lo:400:kworker.0
00000100:00100000:0.0:1767318312.919575:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318312.919620:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379470208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318312.919644:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318312.919681:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379470336
00000100:00100000:0.0:1767318312.919688:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379470336
00000100:00100000:0.0:1767318312.919735:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379470208
00000100:00100000:0.0:1767318312.919739:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379470208
00000100:00100000:0.0:1767318312.919766:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105
00000100:00100000:0.0:1767318312.919774:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379470336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318312.919833:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379470336:12345-0@lo:400:kworker.0 Request processed in 57us (257us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318312.919865:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105
00000100:00100000:0.0:1767318312.919929:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106
00000100:00100000:0.0:1767318312.919937:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379470208:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318312.919973:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379470464:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318312.919974:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379470208:12345-0@lo:400:kworker.0 Request processed in 38us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318312.919983:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106
00000100:00100000:3.0:1767318312.920021:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318312.920047:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379470336:0@lo:400:kworker.0
00000100:00100000:0.0:1767318312.920064:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379470208:0@lo:400:kworker.0
00000100:00100000:3.0:1767318312.920065:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379470464
00000100:00100000:3.0:1767318312.920071:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379470464
00000100:00100000:0.0:1767318312.920099:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379469952
00000100:00100000:0.0:1767318312.920104:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379469952
00000100:00100000:0.0:1767318312.920130:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16057
00000100:00100000:0.0:1767318312.920134:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379469952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318312.920152:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318312.920299:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379469952:12345-0@lo:38:kworker.0 Request processed in 162us (1023us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318312.920306:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16057
00000100:00100000:0.0:1767318312.920511:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379470080
00000100:00100000:0.0:1767318312.920517:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379470080
00000100:00100000:0.0:1767318312.920697:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776
00000100:00100000:0.0:1767318312.920702:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379470080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318312.920714:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318312.920743:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379470080:12345-0@lo:38:kworker.0 Request processed in 40us (1180us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318312.920749:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776
00000100:00080000:0.0:1767318312.920784:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318312.920789:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318312.921947:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379470592:0@lo:400:kworker.0
00000100:00100000:0.0:1767318312.921992:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318312.922104:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318312.922109:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318312.922112:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318312.922117:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3210
00000100:00080000:1.0:1767318312.922134:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318312.922140:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318312.924921:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379470592
00000100:00100000:0.0:1767318312.924937:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379470592
00000100:00080000:0.0:1767318312.924981:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318312.925155:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567
00000100:00100000:1.0:1767318312.925189:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f3800 x1853164379470720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318312.925245:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318312.925251:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318312.925254:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318312.925260:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3210
00000100:00080000:1.0:1767318312.925264:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318312.925269:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318312.925287:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f0a80 x1853164379470976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318312.925306:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318312.925310:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318312.925314:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318312.925332:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3189
00000100:00080000:1.0:1767318312.925335:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318312.925339:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318312.925353:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f0e00 x1853164379471104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318312.925407:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379470848
00000100:00100000:1.0:1767318312.925413:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379470848
00000100:00080000:1.0:1767318312.925433:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318312.925858:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379470592:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318312.925936:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379470592:12345-0@lo:400:kworker.0 Request processed in 771us (3942us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318312.925947:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567
00000100:00100000:0.0:1767318312.925996:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379470592:0@lo:400:kworker.0
00000100:00100000:3.0:1767318312.928901:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846
00000100:00100000:3.0:1767318312.928929:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379470464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318312.928972:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318312.929077:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379470464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (9056us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318312.929085:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846
00000100:00100000:1.0:1767318312.933323:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379470464:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318313.433606:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318314.455829:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318314.455889:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379471232:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318314.455953:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318314.456126:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379471232
00000100:00100000:3.0:1767318314.456134:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379471232
00000100:00100000:3.0:1767318314.456196:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847
00000100:00100000:3.0:1767318314.456205:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379471232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318314.456233:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318314.456279:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379471232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (326us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318314.456285:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847
00000100:00080000:0.0:1767318314.457201:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318314.457249:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379471232:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318314.457373:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318316.503151:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318316.943850:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318316.944067:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291854208
00000100:00100000:1.0:1767318316.944078:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291854208
00000100:00100000:1.0:1767318316.944180:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3569
00000100:00100000:1.0:1767318316.944191:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291854208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318316.944275:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291854208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (463us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318316.944283:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3569
00000100:00080000:0.0:1767318316.944352:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318316.945396:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318316.945482:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291854080
00000100:00100000:1.0:1767318316.945499:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291854080
00000100:00100000:1.0:1767318316.945538:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16060
00000100:00100000:1.0:1767318316.945545:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291854080:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318316.945568:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318316.945621:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291854080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 76us (229us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318316.945629:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16060
00010000:00010000:1.0:1767318317.527183:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318318.039005:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318318.039015:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318318.039018:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318318.039022:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318318.039026:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318318.039033:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3215
00000100:00080000:1.0:1767318318.039038:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318318.039044:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318318.039093:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f1500 x1853164379471360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318318.039117:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318318.039121:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318318.039122:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318318.039126:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3215
00000100:00080000:1.0:1767318318.039129:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318318.039132:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318318.039142:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f1c00 x1853164379471488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318318.039215:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318318.039218:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318318.039220:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318318.039223:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3215
00000100:00080000:1.0:1767318318.039225:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318318.039228:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318318.039237:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336f2a00 x1853164379472000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318318.039249:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318318.039252:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318318.039254:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318318.039257:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3215
00000100:00080000:1.0:1767318318.039259:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318318.039272:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318318.039292:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608000 x1853164379472256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318318.039323:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379472128:0@lo:400:kworker.0
00000100:00100000:1.0:1767318318.039393:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318318.039461:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318318.039467:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379471872:0@lo:400:kworker.0
00000100:00100000:1.0:1767318318.039489:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318318.039517:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379472128
00000100:00100000:1.0:1767318318.039524:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379472128
00000100:00100000:1.0:1767318318.039586:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379471872
00000100:00100000:1.0:1767318318.039590:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379471872
00000100:00100000:1.0:1767318318.039615:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3570
00000100:00100000:1.0:1767318318.039624:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379472128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318318.039673:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379472128:12345-0@lo:400:kworker.0 Request processed in 50us (279us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318318.039679:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3570
00000100:00100000:1.0:1767318318.039697:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571
00000100:00100000:1.0:1767318318.039716:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379471872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318318.039742:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379471872:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318318.039747:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571
00000100:00100000:1.0:1767318318.039786:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379471872:0@lo:400:kworker.0
00000100:00100000:1.0:1767318318.039797:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379472128:0@lo:400:kworker.0
00000100:00100000:0.0:1767318318.039911:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379471744:0@lo:400:kworker.0
00000100:00100000:0.0:1767318318.039943:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318318.039985:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318318.039991:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379471616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318318.040012:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318318.040043:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318318.040053:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379471744
00000100:00100000:0.0:1767318318.040062:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379471744
00000100:00100000:0.0:1767318318.040093:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379471616
00000100:00100000:0.0:1767318318.040095:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379471616
00000100:00100000:0.0:1767318318.040114:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107
00000100:00100000:0.0:1767318318.040121:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379471744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318318.040157:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108
00000100:00100000:0.0:1767318318.040165:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379471744:12345-0@lo:400:kworker.0 Request processed in 44us (219us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318318.040170:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379471616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318318.040175:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107
00000100:00080000:0.0:1767318318.040220:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318318.040224:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318318.040230:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379471616:12345-0@lo:400:kworker.0 Request processed in 63us (214us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318318.040238:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108
00000100:00100000:0.0:1767318318.040248:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379471616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318318.040261:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379471744:0@lo:400:kworker.0
00000100:00100000:1.0:1767318318.040283:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379471360
00000100:00100000:1.0:1767318318.040288:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379471360
00000100:00100000:1.0:1767318318.040307:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16061
00000100:00100000:1.0:1767318318.040311:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379471360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318318.040328:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318318.040360:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379471360:12345-0@lo:38:kworker.0 Request processed in 47us (178us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318318.040367:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16061
00000100:00100000:3.0:1767318318.040726:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379472384:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318318.040749:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318318.040765:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16063
00000100:00100000:1.0:1767318318.040773:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379472256:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318318.040777:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379472384
00000100:00100000:3.0:1767318318.040781:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379472384
00010000:00020000:1.0:1767318318.040785:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318318.040816:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848
00000100:00100000:3.0:1767318318.040826:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379472384:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318318.040832:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379472256:12345-0@lo:38:kworker.0 Request processed in 56us (250us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318318.040840:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16063
00000100:00100000:0.0:1767318318.040846:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379471488
00000100:00100000:0.0:1767318318.040852:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379471488
00002000:00000024:3.0:1767318318.040853:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318318.040921:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379472384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (168us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318318.040926:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777
00000100:00100000:0.0:1767318318.040934:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379471488:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318318.040940:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848
00010000:00020000:0.0:1767318318.040949:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318318.042161:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379472384:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318318.043362:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379471488:12345-0@lo:38:kworker.0 Request processed in 2423us (2875us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318318.043374:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777
00010000:00010000:1.0:1767318318.552047:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318319.582228:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379472512
00000100:00100000:3.0:1767318319.582244:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379472512
00000100:00100000:3.0:1767318319.582311:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849
00000100:00100000:3.0:1767318319.582322:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379472512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318319.582357:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318319.582482:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379472512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (4214us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318319.582488:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849
00010000:00010000:1.0:1767318320.605430:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318321.625814:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318322.063523:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318322.064549:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291854464
00000100:00100000:1.0:1767318322.064554:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291854464
00000100:00100000:1.0:1767318322.064603:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3572
00000100:00100000:1.0:1767318322.064609:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291854464:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318322.064669:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291854464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 59us (191us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318322.064693:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3572
00000100:00080000:0.0:1767318322.064755:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318323.159140:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318323.159151:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318323.159155:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318323.159159:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318323.159164:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318323.159173:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3220
00000100:00080000:3.0:1767318323.159178:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318323.159186:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318323.162152:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09046a00 x1853164379472640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318323.162193:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318323.162197:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318323.162200:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318323.162205:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3220
00000100:00080000:3.0:1767318323.162224:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318323.162230:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318323.162253:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09046300 x1853164379472768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318323.162334:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318323.162338:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318323.162340:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318323.162344:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3220
00000100:00080000:3.0:1767318323.162347:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318323.162350:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318323.162362:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09045f80 x1853164379473280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318323.162378:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318323.162382:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318323.162383:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318323.162386:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3220
00000100:00080000:3.0:1767318323.162389:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318323.162392:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318323.162401:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04700 x1853164379473536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318323.162439:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379473408:0@lo:400:kworker.0
00000100:00100000:3.0:1767318323.162500:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318323.162554:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318323.162558:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379473152:0@lo:400:kworker.0
00000100:00100000:3.0:1767318323.162585:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318323.162912:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379472640:0@lo:38:kworker.0
00000100:00100000:1.0:1767318323.162948:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318323.162980:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379472768:0@lo:38:kworker.0
00000100:00100000:1.0:1767318323.163004:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318323.163009:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379473024:0@lo:400:kworker.0
00000100:00100000:1.0:1767318323.163025:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379473280:0@lo:38:kworker.0
00000100:00100000:0.0:1767318323.163039:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318323.163044:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318323.163057:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379473536:0@lo:38:kworker.0
00000100:00100000:0.0:1767318323.163060:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1767318323.163064:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379472896:0@lo:400:kworker.0
00000100:00100000:1.0:1767318323.163075:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318323.163081:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318323.163105:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379472768
00000100:00100000:0.0:1767318323.163107:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379473664:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318323.163112:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379472768
00000100:00100000:0.0:1767318323.163128:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318323.163145:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778
00000100:00100000:0.0:1767318323.163150:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473024
00000100:00100000:1.0:1767318323.163152:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379472768:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318323.163164:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473024
00010000:00020000:1.0:1767318323.163171:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318323.163203:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379472896
00000100:00100000:0.0:1767318323.163207:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379472896
00000100:00100000:1.0:1767318323.163207:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379472768:12345-0@lo:38:kworker.0 Request processed in 55us (202us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318323.163214:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778
00000100:00100000:1.0:1767318323.163239:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473664
00000100:00100000:1.0:1767318323.163243:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473664
00000100:00100000:1.0:1767318323.163264:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850
00000100:00100000:1.0:1767318323.163270:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7020:x1853164379473664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318323.163293:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318323.163436:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473408
00000100:00100000:3.0:1767318323.163441:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473408
00000100:00100000:3.0:1767318323.163473:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473152
00000100:00100000:3.0:1767318323.163476:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473152
00000100:00100000:3.0:1767318323.163491:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379472640
00000100:00100000:3.0:1767318323.163493:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379472640
00000100:00100000:3.0:1767318323.163501:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473280
00000100:00100000:3.0:1767318323.163503:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473280
00000100:00100000:3.0:1767318323.163509:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473536
00000100:00100000:3.0:1767318323.163511:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473536
00000100:00100000:3.0:1767318323.163520:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573
00000100:00100000:3.0:1767318323.163526:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379473408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318323.163566:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379473408:12345-0@lo:400:kworker.0 Request processed in 40us (1064us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318323.163572:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573
00000100:00100000:3.0:1767318323.163585:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574
00000100:00100000:3.0:1767318323.163590:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379473152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318323.163625:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109
00000100:00100000:0.0:1767318323.163633:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379473024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318323.163670:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379473024:12345-0@lo:400:kworker.0 Request processed in 38us (629us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318323.163675:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109
00000100:00100000:0.0:1767318323.163688:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110
00000100:00100000:0.0:1767318323.163694:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:7020:x1853164379472896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318323.163701:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7020:x1853164379473664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 431us (571us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318323.163717:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:7020:x1853164379472896:12345-0@lo:400:kworker.0 Request processed in 24us (635us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318323.163717:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850
00000100:00100000:0.0:1767318323.163721:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110
00000100:00080000:0.0:1767318323.163734:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318323.163738:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318323.163740:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318323.163770:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318323.163773:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379472896:0@lo:400:kworker.0
00000100:00080000:1.0:1767318323.163774:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318323.163778:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379472768:0@lo:38:kworker.0
00000100:00100000:0.0:1767318323.163787:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379473664:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318323.163795:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379473024:0@lo:400:kworker.0
00000100:00100000:1.0:1767318323.163802:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16065
00000100:00100000:1.0:1767318323.163806:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379472640:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318323.163817:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318323.163823:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16066
00000100:00100000:0.0:1767318323.163828:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379473280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318323.163837:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318323.163847:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379472640:12345-0@lo:38:kworker.0 Request processed in 39us (899us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318323.163852:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16065
00000100:00100000:0.0:1767318323.163892:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379473280:12345-0@lo:38:kworker.0 Request processed in 35us (818us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318323.163895:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16067
00000100:00100000:0.0:1767318323.163899:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16066
00000100:00100000:1.0:1767318323.163900:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379473536:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318323.163909:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318323.163929:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318323.163933:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318323.163933:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379473536:12345-0@lo:38:kworker.0 Request processed in 32us (857us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318323.163936:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379472640:0@lo:38:kworker.0
00000100:00100000:1.0:1767318323.163939:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16067
00000100:00080000:0.0:1767318323.163944:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318323.163947:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318323.163950:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379473280:0@lo:38:kworker.0
00000100:00080000:0.0:1767318323.163958:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318323.163961:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318323.163964:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379473536:0@lo:38:kworker.0
00000100:00100000:3.0:1767318323.164041:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379473152:12345-0@lo:400:kworker.0 Request processed in 450us (1455us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318323.164048:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574
00000100:00100000:3.0:1767318323.164075:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379473152:0@lo:400:kworker.0
00000100:00100000:3.0:1767318323.164086:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379473408:0@lo:400:kworker.0
00010000:00010000:1.0:1767318324.695438:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318324.695464:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473792
00000100:00100000:1.0:1767318324.695472:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473792
00000100:00100000:1.0:1767318324.695568:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851
00000100:00100000:1.0:1767318324.695577:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379473792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318324.695607:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318324.695667:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379473792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (472us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318324.695692:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851
00000100:00100000:3.0:1767318324.695865:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379473792:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318325.728351:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318326.743174:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318327.185437:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:0.0:1767318327.185856:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318327.187141:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00010000:00010000:0.0:1767318327.767053:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318328.279306:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318328.279329:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318328.279331:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318328.279336:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3225
00000100:00080000:2.0:1767318328.279338:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318328.279342:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318328.279360:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608000 x1853164379474048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318328.279443:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318328.279447:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318328.279449:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318328.279453:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3225
00000100:00080000:2.0:1767318328.279456:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318328.279460:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318328.279473:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a15180 x1853164379474560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318328.279490:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318328.279493:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318328.279495:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318328.279498:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3225
00000100:00080000:2.0:1767318328.279500:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318328.279504:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318328.279514:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379474816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318328.279690:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379474304:0@lo:400:kworker.0
00000100:00100000:1.0:1767318328.279791:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318328.279909:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318328.279920:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379474176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318328.279945:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318328.280039:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379474432:0@lo:400:kworker.0
00000100:00100000:3.0:1767318328.280102:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318328.280142:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318328.280147:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379474688:0@lo:400:kworker.0
00000100:00100000:3.0:1767318328.280171:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318328.280308:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474432
00000100:00100000:1.0:1767318328.280318:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474432
00000100:00100000:1.0:1767318328.280395:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474688
00000100:00100000:1.0:1767318328.280399:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474688
00000100:00100000:1.0:1767318328.280430:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576
00000100:00100000:1.0:1767318328.280439:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379474432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318328.280501:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379474432:12345-0@lo:400:kworker.0 Request processed in 62us (415us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318328.280509:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576
00000100:00100000:1.0:1767318328.280531:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577
00000100:00100000:1.0:1767318328.280537:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379474688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318328.280565:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379474688:12345-0@lo:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318328.280571:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577
00000100:00100000:1.0:1767318328.280625:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379474688:0@lo:400:kworker.0
00000100:00100000:1.0:1767318328.280636:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379474432:0@lo:400:kworker.0
00000100:00100000:0.0:1767318328.280777:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379473920:0@lo:38:kworker.0
00000100:00100000:0.0:1767318328.280812:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318328.280831:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379474048:0@lo:38:kworker.0
00000100:00100000:0.0:1767318328.280856:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318328.280899:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379474560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318328.280922:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318328.280939:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379474816:0@lo:38:kworker.0
00000100:00100000:0.0:1767318328.280962:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318328.280990:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474304
00000100:00100000:0.0:1767318328.280995:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474304
00000100:00100000:0.0:1767318328.281037:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474176
00000100:00100000:0.0:1767318328.281040:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474176
00000100:00100000:0.0:1767318328.281059:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111
00000100:00100000:0.0:1767318328.281065:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379474304:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318328.281119:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379474304:12345-0@lo:400:kworker.0 Request processed in 54us (1329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318328.281126:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111
00000100:00100000:0.0:1767318328.281140:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112
00000100:00100000:0.0:1767318328.281146:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379474176:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318328.281175:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379474176:12345-0@lo:400:kworker.0 Request processed in 29us (1229us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318328.281181:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112
00000100:00100000:0.0:1767318328.281199:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379473920
00000100:00100000:0.0:1767318328.281202:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379473920
00000100:00100000:0.0:1767318328.281219:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474560
00000100:00100000:0.0:1767318328.281222:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474560
00000100:00100000:0.0:1767318328.281235:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474816
00000100:00100000:0.0:1767318328.281237:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474816
00000100:00100000:0.0:1767318328.281248:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16069
00000100:00100000:0.0:1767318328.281252:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379473920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318328.281273:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318328.281307:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379473920:12345-0@lo:38:kworker.0 Request processed in 53us (494us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318328.281314:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16069
00000100:00100000:0.0:1767318328.281326:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16070
00000100:00100000:0.0:1767318328.281330:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379474560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318328.281338:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318328.281372:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379474560:12345-0@lo:38:kworker.0 Request processed in 40us (449us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318328.281378:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16070
00000100:00100000:0.0:1767318328.281391:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16071
00000100:00100000:0.0:1767318328.281394:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379474816:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318328.281403:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318328.281426:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379474816:12345-0@lo:38:kworker.0 Request processed in 30us (463us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318328.281431:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16071
00000100:00100000:0.0:1767318328.281448:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474048
00000100:00100000:0.0:1767318328.281452:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474048
00000100:00100000:0.0:1767318328.281472:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779
00000100:00100000:0.0:1767318328.281476:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379474048:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318328.281484:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318328.281506:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379474048:12345-0@lo:38:kworker.0 Request processed in 29us (649us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318328.281511:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779
00000100:00080000:0.0:1767318328.281557:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318328.281563:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318328.281567:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379473920:0@lo:38:kworker.0
00000100:00080000:0.0:1767318328.281575:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318328.281579:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318328.281582:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379474048:0@lo:38:kworker.0
00000100:00080000:0.0:1767318328.281589:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318328.281592:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318328.281600:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379474560:0@lo:38:kworker.0
00000100:00080000:0.0:1767318328.281609:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318328.281612:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318328.281614:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379474816:0@lo:38:kworker.0
00000100:00100000:0.0:1767318328.281648:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379474176:0@lo:400:kworker.0
00000100:00100000:0.0:1767318328.281657:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379474304:0@lo:400:kworker.0
00000100:00080000:3.0:1767318328.281813:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318328.281819:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318328.281822:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318328.282244:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379474944:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318328.282286:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318328.283355:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379474944
00000100:00100000:1.0:1767318328.283384:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379474944
00000100:00100000:1.0:1767318328.283449:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852
00000100:00100000:1.0:1767318328.283459:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379474944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318328.283495:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318328.283569:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379474944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (1281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318328.283577:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852
00000100:00100000:3.0:1767318328.283696:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379474944:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318328.793193:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318329.815363:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318329.815682:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379475072:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318329.815817:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318329.816297:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475072
00000100:00100000:2.0:1767318329.816326:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475072
00000100:00100000:2.0:1767318329.816396:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853
00000100:00100000:2.0:1767318329.816406:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379475072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318329.816577:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318329.816656:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379475072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 251us (839us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318329.816664:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853
00000100:00100000:0.0:1767318329.816784:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379475072:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318330.839253:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318331.863143:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318332.307057:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318332.307158:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291854848
00000100:00100000:2.0:1767318332.307176:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291854848
00000100:00100000:2.0:1767318332.307226:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16072
00000100:00100000:2.0:1767318332.307235:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291854848:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318332.307258:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318332.307322:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291854848:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 87us (284us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318332.307330:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16072
00000100:00100000:3.0:1767318332.311581:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318332.314022:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291854976
00000100:00100000:0.0:1767318332.314039:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291854976
00000100:00100000:0.0:1767318332.314351:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3578
00000100:00100000:0.0:1767318332.314363:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291854976:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318332.314459:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291854976:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (3126us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318332.314466:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3578
00000100:00080000:3.0:1767318332.318068:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318332.887120:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318333.398997:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318333.399009:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318333.399013:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318333.399016:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318333.399021:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318333.399031:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767318333.399035:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318333.399043:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318333.399090:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b800 x1853164379475200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318333.399135:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318333.399139:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318333.399141:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318333.399144:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767318333.399146:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318333.399151:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318333.399166:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379475328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318333.399227:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318333.399230:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318333.399232:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318333.399236:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767318333.399239:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318333.399242:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318333.399257:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebfb80 x1853164379475840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318333.399272:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318333.399275:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318333.399277:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318333.399280:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3230
00000100:00080000:2.0:1767318333.399282:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318333.399286:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318333.399296:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448a80 x1853164379476096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318333.399319:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379475584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.399344:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379475712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318333.399451:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379475456:0@lo:400:kworker.0
00000100:00100000:0.0:1767318333.400764:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379475200:0@lo:38:kworker.0
00000100:00100000:2.0:1767318333.406391:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318333.406498:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318333.406512:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379475968:0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.406555:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318333.406620:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475712
00000100:00100000:2.0:1767318333.406627:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475712
00000100:00100000:2.0:1767318333.406702:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475968
00000100:00100000:2.0:1767318333.406705:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475968
00000100:00100000:2.0:1767318333.406735:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579
00000100:00100000:2.0:1767318333.406744:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379475712:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.406803:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379475712:12345-0@lo:400:kworker.0 Request processed in 60us (419us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318333.406810:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579
00000100:00100000:2.0:1767318333.406827:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580
00000100:00100000:2.0:1767318333.406833:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379475968:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.406857:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379475968:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318333.406863:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580
00000100:00100000:2.0:1767318333.406932:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379475968:0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.406945:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379475712:0@lo:400:kworker.0
00000100:00080000:2.0:1767318333.407024:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318333.409922:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318333.410003:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318333.410015:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379476224:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318333.410324:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475584
00000100:00100000:2.0:1767318333.410332:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475584
00000100:00100000:2.0:1767318333.410401:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113
00000100:00100000:2.0:1767318333.410434:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379475584:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.410490:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379475584:12345-0@lo:400:kworker.0 Request processed in 58us (574us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318333.410497:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113
00000100:00080000:2.0:1767318333.410599:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318333.410651:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318333.410714:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379475584:0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.410910:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379476224
00000100:00100000:2.0:1767318333.410914:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379476224
00000100:00100000:2.0:1767318333.410959:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854
00000100:00100000:2.0:1767318333.410965:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379476224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318333.410989:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318333.411026:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379476224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (964us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318333.411032:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854
00000100:00080000:3.0:1767318333.411240:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318333.411271:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379476224:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318333.415159:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318333.415263:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475456
00000100:00100000:2.0:1767318333.415273:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475456
00000100:00100000:2.0:1767318333.415336:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114
00000100:00100000:2.0:1767318333.415345:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379475456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318333.418646:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379475456:12345-0@lo:400:kworker.0 Request processed in 3291us (3483us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318333.418673:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114
00000100:00100000:1.0:1767318333.418751:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379475456:0@lo:400:kworker.0
00000100:00100000:0.0:1767318333.419712:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318333.419836:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379475328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318333.419897:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318333.419979:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379475840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318333.420004:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318333.424126:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379476096:0@lo:38:kworker.0
00000100:00100000:0.0:1767318333.424192:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318333.424302:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475200
00000100:00100000:1.0:1767318333.424325:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475200
00000100:00100000:1.0:1767318333.424393:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475840
00000100:00100000:1.0:1767318333.424397:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475840
00000100:00100000:1.0:1767318333.424428:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16073
00000100:00100000:1.0:1767318333.424436:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379475200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318333.424458:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318333.424516:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379475200:12345-0@lo:38:kworker.0 Request processed in 79us (4805us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318333.424524:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16073
00000100:00100000:1.0:1767318333.424546:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16074
00000100:00100000:1.0:1767318333.424550:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379475840:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318333.424961:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379475328
00000100:00100000:2.0:1767318333.424966:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379475328
00000100:00100000:2.0:1767318333.424998:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780
00000100:00100000:2.0:1767318333.425003:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379475328:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318333.425015:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318333.425050:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379475328:12345-0@lo:38:kworker.0 Request processed in 46us (5152us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318333.425063:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780
00010000:00020000:1.0:1767318333.425178:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318333.425271:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379475840:12345-0@lo:38:kworker.0 Request processed in 719us (5265us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318333.425279:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16074
00000100:00080000:0.0:1767318333.430890:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318333.430902:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318333.430907:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379475200:0@lo:38:kworker.0
00000100:00080000:0.0:1767318333.430922:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318333.430926:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318333.430929:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379475328:0@lo:38:kworker.0
00000100:00080000:0.0:1767318333.430941:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318333.430945:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318333.430948:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379475840:0@lo:38:kworker.0
00000100:00100000:3.0:1767318333.433890:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379476096
00000100:00100000:3.0:1767318333.433906:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379476096
00000100:00100000:3.0:1767318333.433978:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16075
00000100:00100000:3.0:1767318333.433986:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379476096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318333.434012:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318333.435804:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379476096:12345-0@lo:38:kworker.0 Request processed in 1797us (11591us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318333.435819:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16075
00000100:00080000:1.0:1767318333.435918:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318333.435926:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318333.435929:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379476096:0@lo:38:kworker.0
00010000:00010000:1.0:1767318333.911101:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318334.935738:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318334.935824:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318334.935844:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379476352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318334.935929:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318334.937372:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379476352
00000100:00100000:1.0:1767318334.937385:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379476352
00000100:00100000:1.0:1767318334.937459:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855
00000100:00100000:1.0:1767318334.937479:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379476352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318334.937514:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318334.937589:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379476352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1660us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318334.937597:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855
00000100:00100000:3.0:1767318334.937830:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379476352:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318335.959117:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767318336.402485:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291855104 offset 0 length 520: 4
00000100:00100000:3.0:1767318336.405281:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318336.405767:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318336.406060:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291855232
00000100:00100000:2.0:1767318336.406071:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291855232
00000100:00100000:2.0:1767318336.406119:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291855360
00000100:00100000:2.0:1767318336.406123:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291855360
00000100:00100000:2.0:1767318336.406190:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3581
00000100:00100000:2.0:1767318336.406201:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291855360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318336.406280:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291855360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (514us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318336.406289:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3581
00000100:00100000:2.0:1767318336.406322:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16076
00000100:00100000:2.0:1767318336.406327:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291855232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318336.406345:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318336.406374:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291855232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (1246us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318336.406380:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16076
00000100:00080000:0.0:1767318336.408587:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318336.983762:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318337.559244:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318312/real 1767318312]  req@ffff8b0f336f0e00 x1853164379471104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318337.559280:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f336f0e00 x1853164379471104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318337.559300:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318337.559326:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318337.559330:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379471104:0@lo:250:kworker.0
00000100:00080000:3.0:1767318337.559415:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318337.559420:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318337.559423:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318337.559428:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3215
00000100:00080000:3.0:1767318337.559432:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318337.559438:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318337.559470:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eea00 x1853164379476480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318337.559495:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318337.559499:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318337.559501:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318337.559505:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3235
00000100:00080000:3.0:1767318337.559507:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318337.559510:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318337.559524:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec380 x1853164379476608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318337.559532:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318337.559536:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1767318337.559659:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379476480:0@lo:250:kworker.0
00000400:00000100:1.0:1767318337.559706:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379476480 offset 0 length 520: 4
00000100:00100000:1.0:1767318337.559756:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379476608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318337.559806:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318337.560245:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318337.560250:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3235
00000100:00080000:3.0:1767318337.560253:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318337.560257:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318337.560274:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef100 x1853164379476736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318337.560343:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318337.560346:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318337.560348:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318337.560352:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3235
00000100:00080000:3.0:1767318337.560355:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318337.560359:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318337.560369:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edf80 x1853164379477248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318337.560383:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318337.560387:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318337.560388:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318337.560391:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3235
00000100:00080000:3.0:1767318337.560393:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318337.560396:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318337.560403:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec700 x1853164379477504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318337.560428:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379477120:0@lo:400:kworker.0
00000100:00100000:3.0:1767318337.560458:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318337.560495:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318337.560501:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379477376:0@lo:400:kworker.0
00000100:00100000:3.0:1767318337.560522:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318337.560659:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379476736:0@lo:38:kworker.0
00000100:00100000:1.0:1767318337.560688:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318337.560704:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379477248:0@lo:38:kworker.0
00000100:00100000:1.0:1767318337.560725:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318337.560738:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379477504:0@lo:38:kworker.0
00000100:00100000:1.0:1767318337.560755:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318337.561692:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379476864:0@lo:400:kworker.0
00000100:00100000:0.0:1767318337.561743:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318337.562068:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379476608
00000100:00100000:3.0:1767318337.562078:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379476608
00000100:00100000:3.0:1767318337.562114:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379477120
00000100:00100000:3.0:1767318337.562117:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379477120
00000100:00100000:3.0:1767318337.562149:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379477376
00000100:00100000:3.0:1767318337.562152:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379477376
00000100:00100000:3.0:1767318337.562167:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379477248
00000100:00100000:3.0:1767318337.562169:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379477248
00000100:00100000:3.0:1767318337.562176:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379477504
00000100:00100000:3.0:1767318337.562179:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379477504
00000100:00100000:3.0:1767318337.562190:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582
00000100:00100000:3.0:1767318337.562199:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379477120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318337.562265:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379477120:12345-0@lo:400:kworker.0 Request processed in 67us (1805us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318337.562271:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582
00000100:00100000:3.0:1767318337.562287:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583
00000100:00100000:3.0:1767318337.562293:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379477376:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318337.562319:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379477376:12345-0@lo:400:kworker.0 Request processed in 26us (1796us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318337.562324:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583
00000100:00100000:3.0:1767318337.562334:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16077
00000100:00100000:3.0:1767318337.562338:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379476608:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318337.562356:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318337.562386:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379476608:12345-0@lo:38:kworker.0 Request processed in 45us (2579us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318337.562406:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16077
00000100:00100000:3.0:1767318337.562418:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16078
00000100:00100000:3.0:1767318337.562421:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379477248:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318337.562430:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318337.562454:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379477248:12345-0@lo:38:kworker.0 Request processed in 32us (1728us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318337.562459:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16078
00000100:00100000:3.0:1767318337.562469:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16079
00000100:00100000:3.0:1767318337.562473:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379477504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318337.562481:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318337.562505:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379477504:12345-0@lo:38:kworker.0 Request processed in 30us (1749us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318337.562511:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16079
00000100:00080000:3.0:1767318337.562529:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318337.562961:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379476992:0@lo:400:kworker.0
00000100:00100000:0.0:1767318337.563085:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379476736
00000100:00100000:0.0:1767318337.563091:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379476736
00000100:00100000:0.0:1767318337.563115:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781
00000100:00100000:0.0:1767318337.563120:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379476736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318337.563131:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318337.563677:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379477376:0@lo:400:kworker.0
00000100:00100000:1.0:1767318337.563836:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379476864
00000100:00100000:1.0:1767318337.563842:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379476864
00000100:00100000:1.0:1767318337.563923:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115
00000100:00100000:1.0:1767318337.563932:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379476864:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.568142:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318337.568268:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318337.568287:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318337.568291:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379477248:0@lo:38:kworker.0
00000100:00080000:2.0:1767318337.568318:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318337.568322:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318337.568325:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379477504:0@lo:38:kworker.0
00000100:00080000:2.0:1767318337.568346:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318337.568350:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318337.568353:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379476608:0@lo:38:kworker.0
00000100:00080000:2.0:1767318337.568422:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318337.568456:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379476992
00000100:00100000:2.0:1767318337.568462:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379476992
00000100:00100000:2.0:1767318337.570271:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116
00000100:00100000:2.0:1767318337.570283:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379476992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318337.570885:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379476992:12345-0@lo:400:kworker.0 Request processed in 585us (2733us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318337.570894:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116
00000100:00080000:2.0:1767318337.571084:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318337.571147:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379476736:12345-0@lo:38:kworker.0 Request processed in 8024us (10455us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318337.571156:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781
00000100:00080000:0.0:1767318337.571195:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318337.571212:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318337.571217:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379476736:0@lo:38:kworker.0
00000100:00100000:2.0:1767318337.571226:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379476992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318337.575509:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379477120:0@lo:400:kworker.0
00000100:00100000:1.0:1767318337.576262:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379476864:12345-0@lo:400:kworker.0 Request processed in 12327us (14514us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318337.576276:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115
00000100:00100000:0.0:1767318337.580191:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379476864:0@lo:400:kworker.0
00010000:00010000:1.0:1767318338.011562:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318338.522011:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379477632:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318338.522095:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318338.522193:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379477632
00000100:00100000:2.0:1767318338.522201:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379477632
00000100:00100000:2.0:1767318338.522243:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856
00000100:00100000:2.0:1767318338.522251:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379477632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318338.522278:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318338.522332:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379477632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (237us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318338.522356:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856
00000100:00100000:0.0:1767318338.522613:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379477632:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318339.036192:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318340.055059:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318340.055681:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318340.061194:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379477760:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318340.061281:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318340.064321:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379477760
00000100:00100000:1.0:1767318340.064335:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379477760
00000100:00100000:1.0:1767318340.064503:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857
00000100:00100000:1.0:1767318340.064515:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379477760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318340.064550:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318340.064646:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379477760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (3364us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318340.064654:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857
00000100:00100000:0.0:1767318340.067276:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379477760:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318340.068282:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318341.079248:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318341.519414:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318341.519467:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318341.524386:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291855616
00000100:00100000:1.0:1767318341.524401:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291855616
00000100:00080000:3.0:1767318341.524782:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318341.525289:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291855488
00000100:00100000:1.0:1767318341.525296:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291855488
00000100:00100000:1.0:1767318341.525324:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3584
00000100:00100000:1.0:1767318341.525338:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291855616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318341.525422:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291855616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (6018us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318341.525430:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3584
00000100:00100000:1.0:1767318341.525454:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16080
00000100:00100000:1.0:1767318341.525459:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291855488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318341.525479:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318341.526994:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291855488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1526us (7519us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318341.527021:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16080
00010000:00010000:1.0:1767318342.104153:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318342.614973:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318342.614985:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318342.614987:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318342.614991:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318342.614995:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318342.615002:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3239
00000100:00080000:3.0:1767318342.615028:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318342.615035:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318342.615085:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec000 x1853164379477888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318342.615112:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318342.615115:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318342.615117:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318342.615121:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3239
00000100:00080000:3.0:1767318342.615124:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318342.615128:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318342.615141:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef480 x1853164379478016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318342.615189:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379477888:0@lo:38:kworker.0
00000100:00080000:3.0:1767318342.615213:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318342.615215:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318342.615217:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318342.615220:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3239
00000100:00080000:3.0:1767318342.615222:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318342.615225:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318342.615235:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edc00 x1853164379478528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318342.615249:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318342.615251:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318342.615253:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767318342.615255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318342.615256:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3239
00000100:00080000:3.0:1767318342.615263:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318342.615267:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318342.615276:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec380 x1853164379478784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318342.615298:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379478656:0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.615308:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379478016:0@lo:38:kworker.0
00000100:00100000:3.0:1767318342.615326:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318342.615338:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318342.615352:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318342.615358:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379478400:0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.615359:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379478528:0@lo:38:kworker.0
00000100:00100000:3.0:1767318342.615377:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318342.615393:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379477888
00000100:00100000:0.0:1767318342.615400:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379477888
00000100:00100000:3.0:1767318342.615404:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478656
00000100:00100000:3.0:1767318342.615407:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478656
00000100:00100000:0.0:1767318342.615428:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478400
00000100:00100000:0.0:1767318342.615431:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478400
00000100:00100000:3.0:1767318342.615449:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585
00000100:00100000:1.0:1767318342.615501:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379478144:0@lo:400:kworker.0
00000100:00100000:2.0:1767318342.615505:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379478272:0@lo:400:kworker.0
00000100:00100000:1.0:1767318342.615532:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318342.615573:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379478656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318342.615638:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379478656:12345-0@lo:400:kworker.0 Request processed in 182us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318342.616788:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586
00000100:00100000:0.0:1767318342.616806:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379478400:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.616888:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379478400:12345-0@lo:400:kworker.0 Request processed in 89us (1508us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318342.616895:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586
00000100:00100000:0.0:1767318342.616922:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16081
00000100:00100000:0.0:1767318342.616926:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379477888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318342.616945:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318342.616973:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379477888:12345-0@lo:38:kworker.0 Request processed in 45us (1718us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318342.616980:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16081
00000100:00100000:0.0:1767318342.617002:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478016
00000100:00100000:0.0:1767318342.617008:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478016
00000100:00100000:0.0:1767318342.617040:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782
00000100:00100000:0.0:1767318342.617045:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379478016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318342.617055:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318342.617184:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379478016:12345-0@lo:38:kworker.0 Request processed in 34us (1741us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318342.617192:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782
00000100:00100000:0.0:1767318342.617239:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478144
00000100:00100000:0.0:1767318342.617243:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478144
00000100:00100000:0.0:1767318342.617286:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117
00000100:00100000:0.0:1767318342.617293:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379478144:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.619454:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379478144:12345-0@lo:400:kworker.0 Request processed in 2153us (3912us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318342.619466:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117
00000100:00100000:0.0:1767318342.619713:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379478144:0@lo:400:kworker.0
00000100:00080000:0.0:1767318342.619773:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318342.619778:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318342.619795:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318342.619822:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379478784:0@lo:38:kworker.0
00000100:00100000:0.0:1767318342.619897:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318342.619922:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318342.619926:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318342.619930:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379477888:0@lo:38:kworker.0
00000100:00080000:0.0:1767318342.619939:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318342.619942:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318342.619945:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379478016:0@lo:38:kworker.0
00000100:00100000:0.0:1767318342.619971:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478528
00000100:00100000:0.0:1767318342.619977:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478528
00000100:00100000:0.0:1767318342.620000:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478784
00000100:00100000:0.0:1767318342.620002:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478784
00000100:00100000:0.0:1767318342.620017:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16082
00000100:00100000:0.0:1767318342.620022:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379478528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318342.620040:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318342.620072:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379478528:12345-0@lo:38:kworker.0 Request processed in 49us (276us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318342.620079:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16082
00000100:00100000:2.0:1767318342.620192:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318342.620256:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16083
00000100:00100000:0.0:1767318342.620260:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379478784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318342.620271:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318342.620295:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379478784:12345-0@lo:38:kworker.0 Request processed in 33us (397us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318342.620307:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16083
00000100:00080000:0.0:1767318342.620421:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318342.620425:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318342.620429:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379478528:0@lo:38:kworker.0
00000100:00080000:0.0:1767318342.620436:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318342.620439:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318342.620442:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379478784:0@lo:38:kworker.0
00000100:00100000:0.0:1767318342.620471:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478272
00000100:00100000:0.0:1767318342.620475:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478272
00000100:00080000:0.0:1767318342.620600:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318342.620632:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118
00000100:00100000:0.0:1767318342.620639:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379478272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318342.620682:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379478272:12345-0@lo:400:kworker.0 Request processed in 44us (490us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318342.620689:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118
00000100:00100000:3.0:1767318342.621700:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585
00000100:00100000:3.0:1767318342.621770:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379478400:0@lo:400:kworker.0
00000100:00100000:3.0:1767318342.621786:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379478656:0@lo:400:kworker.0
00000100:00100000:3.0:1767318342.621836:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379478272:0@lo:400:kworker.0
00010000:00010000:1.0:1767318343.127069:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318343.640754:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379478912:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318343.640835:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318343.640889:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379478912
00000100:00100000:0.0:1767318343.640898:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379478912
00000100:00100000:0.0:1767318343.640944:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858
00000100:00100000:0.0:1767318343.640967:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379478912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318343.640998:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318343.641051:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379478912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (215us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318343.641058:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858
00000100:00100000:3.0:1767318343.641164:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379478912:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318344.151048:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318345.177203:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318345.178119:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379479040:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318345.178208:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318345.178337:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479040
00000100:00100000:1.0:1767318345.178346:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479040
00000100:00100000:1.0:1767318345.178414:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859
00000100:00100000:1.0:1767318345.178425:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379479040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318345.178454:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318345.179173:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318345.184537:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379479040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6103us (6318us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318345.184581:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859
00000100:00100000:3.0:1767318345.184723:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379479040:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318346.199143:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318346.639337:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318346.639457:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291855872
00000100:00100000:1.0:1767318346.639469:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291855872
00000100:00100000:1.0:1767318346.639556:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3587
00000100:00100000:1.0:1767318346.639567:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291855872:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318346.639649:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291855872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (321us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318346.639657:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3587
00000100:00080000:0.0:1767318346.640333:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318346.646667:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318346.646769:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291855744
00000100:00100000:2.0:1767318346.646778:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291855744
00000100:00100000:2.0:1767318346.646827:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16084
00000100:00100000:2.0:1767318346.646835:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291855744:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318346.646858:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318346.646944:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291855744:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 108us (286us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318346.646951:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16084
00010000:00010000:1.0:1767318347.223024:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318347.735263:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318347.735271:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318347.735274:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318347.735278:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318347.735282:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318347.735289:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3245
00000100:00080000:3.0:1767318347.735294:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318347.735301:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318347.735335:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec380 x1853164379479168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318347.735351:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318347.735353:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318347.735355:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318347.735359:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3245
00000100:00080000:3.0:1767318347.735361:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318347.735364:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318347.735376:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edc00 x1853164379479296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318347.735435:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318347.735438:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318347.735446:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318347.735450:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3245
00000100:00080000:3.0:1767318347.735452:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318347.735457:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318347.735470:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd880 x1853164379479808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318347.735487:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318347.735490:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318347.735492:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318347.735496:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3245
00000100:00080000:3.0:1767318347.735498:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318347.735502:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318347.735511:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ff480 x1853164379480064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318347.735513:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379479424:0@lo:400:kworker.0
00000100:00100000:3.0:1767318347.735531:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379479552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318347.735631:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379479168:0@lo:38:kworker.0
00000100:00100000:0.0:1767318347.736069:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379479680:0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.738613:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.738741:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479424
00000100:00100000:1.0:1767318347.738751:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479424
00000100:00100000:1.0:1767318347.738807:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119
00000100:00100000:1.0:1767318347.738817:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379479424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318347.738913:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.738927:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379479424:12345-0@lo:400:kworker.0 Request processed in 112us (322us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318347.738935:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119
00000100:00100000:1.0:1767318347.738952:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479552
00000100:00100000:1.0:1767318347.738956:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479552
00000100:00100000:3.0:1767318347.738962:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379479936:0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.738979:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120
00000100:00100000:1.0:1767318347.738985:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379479552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318347.738996:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.739017:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379479552:12345-0@lo:400:kworker.0 Request processed in 32us (105us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318347.739023:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120
00000100:00100000:1.0:1767318347.739076:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379479424:0@lo:400:kworker.0
00000100:00080000:1.0:1767318347.739106:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318347.739110:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318347.739159:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318347.739180:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379479296:0@lo:38:kworker.0
00000100:00100000:2.0:1767318347.739205:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318347.739234:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379479808:0@lo:38:kworker.0
00000100:00100000:2.0:1767318347.739256:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318347.739669:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379479552:0@lo:400:kworker.0
00000100:00100000:0.0:1767318347.739824:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479296
00000100:00100000:0.0:1767318347.739828:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479296
00000100:00100000:0.0:1767318347.739850:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783
00000100:00100000:0.0:1767318347.739855:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379479296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318347.739890:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318347.739925:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379479296:12345-0@lo:38:kworker.0 Request processed in 68us (718us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318347.739931:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783
00000100:00100000:2.0:1767318347.740716:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379480064:0@lo:38:kworker.0
00000100:00100000:2.0:1767318347.740750:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318347.740832:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479936
00000100:00100000:1.0:1767318347.740838:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479936
00000100:00100000:1.0:1767318347.740893:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479168
00000100:00100000:1.0:1767318347.740897:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479168
00000100:00100000:1.0:1767318347.740928:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479808
00000100:00100000:1.0:1767318347.740932:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479808
00000100:00100000:1.0:1767318347.740946:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588
00000100:00100000:1.0:1767318347.740952:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379479936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318347.740999:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379479936:12345-0@lo:400:kworker.0 Request processed in 47us (2001us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318347.741005:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588
00000100:00100000:1.0:1767318347.741021:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16085
00000100:00100000:1.0:1767318347.741025:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379479168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318347.741038:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318347.741063:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379479168:12345-0@lo:38:kworker.0 Request processed in 36us (1905us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318347.741069:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16085
00000100:00100000:1.0:1767318347.741082:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16086
00000100:00100000:1.0:1767318347.741086:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379479808:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318347.741095:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318347.741117:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379479808:12345-0@lo:38:kworker.0 Request processed in 30us (1861us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318347.741123:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16086
00000100:00080000:1.0:1767318347.741139:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318347.741502:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379479936:0@lo:400:kworker.0
00000100:00080000:2.0:1767318347.742345:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.742352:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.742356:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379479168:0@lo:38:kworker.0
00000100:00080000:2.0:1767318347.742367:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.742380:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.742384:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379479296:0@lo:38:kworker.0
00000100:00080000:2.0:1767318347.742397:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.742400:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.742403:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379479808:0@lo:38:kworker.0
00000100:00100000:0.0:1767318347.742466:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318347.742554:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480064
00000100:00100000:2.0:1767318347.742561:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480064
00000100:00100000:2.0:1767318347.742592:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379479680
00000100:00100000:2.0:1767318347.742595:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379479680
00000100:00100000:2.0:1767318347.742629:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589
00000100:00100000:2.0:1767318347.742637:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379479680:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318347.742690:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379479680:12345-0@lo:400:kworker.0 Request processed in 53us (223us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318347.742696:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589
00000100:00100000:2.0:1767318347.742712:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16087
00000100:00100000:2.0:1767318347.742716:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379480064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318347.742729:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318347.742760:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379480064:12345-0@lo:38:kworker.0 Request processed in 42us (2009us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318347.742766:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16087
00000100:00080000:2.0:1767318347.742781:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318347.742797:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318347.742801:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318347.742804:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379480064:0@lo:38:kworker.0
00000100:00100000:0.0:1767318347.742890:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379479680:0@lo:400:kworker.0
00010000:00010000:0.0:1767318348.247999:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318348.759338:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318348.759358:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379480192:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318348.759435:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318348.759566:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480192
00000100:00100000:1.0:1767318348.759574:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480192
00000100:00100000:1.0:1767318348.759621:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860
00000100:00100000:1.0:1767318348.759629:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379480192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318348.759656:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318348.759708:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379480192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (272us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318348.759715:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860
00000100:00100000:3.0:1767318348.759798:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379480192:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318349.272225:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318350.295281:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318350.295317:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379480320:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318350.295400:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767318350.295686:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318350.296336:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480320
00000100:00100000:2.0:1767318350.296360:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480320
00000100:00100000:2.0:1767318350.296452:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861
00000100:00100000:2.0:1767318350.296463:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379480320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318350.296492:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318350.296530:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318350.296570:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379480320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1168us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318350.296577:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861
00000100:00100000:0.0:1767318350.296607:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379480320:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318351.320740:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318351.760908:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318351.762052:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318351.786671:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291856128
00000100:00100000:0.0:1767318351.786686:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291856128
00000100:00080000:3.0:1767318351.786924:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318351.787349:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291856000
00000100:00100000:1.0:1767318351.787356:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291856000
00000100:00100000:1.0:1767318351.787399:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3590
00000100:00100000:1.0:1767318351.787409:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291856128:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318351.787595:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291856128:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 186us (26727us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318351.787603:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3590
00000100:00100000:1.0:1767318351.787625:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16088
00000100:00100000:1.0:1767318351.787629:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291856000:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318351.787665:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318351.787695:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291856000:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 64us (25650us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318351.787701:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16088
00010000:00010000:0.0:1767318352.343919:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318352.855138:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.855175:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318352.855178:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.855182:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.855186:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.855193:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3250
00000100:00080000:1.0:1767318352.855198:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318352.855205:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318352.855243:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a15880 x1853164379480448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318352.855269:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.855273:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.855274:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.855278:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3250
00000100:00080000:1.0:1767318352.855280:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318352.855284:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318352.855298:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ee300 x1853164379480576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318352.855353:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.855357:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.855359:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.855362:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3250
00000100:00080000:1.0:1767318352.855365:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318352.855368:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318352.855379:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef480 x1853164379481088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318352.855410:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318352.855413:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318352.855415:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318352.855421:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3250
00000100:00080000:1.0:1767318352.855428:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767318352.855430:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379480832:0@lo:400:kworker.0
00000100:00080000:1.0:1767318352.855435:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318352.855456:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09045f80 x1853164379481344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318352.855527:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379481216:0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.855585:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318352.855607:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318352.855703:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379480704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318352.855723:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480832
00000100:00100000:3.0:1767318352.855734:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480832
00000100:00100000:2.0:1767318352.855807:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379480448:0@lo:38:kworker.0
00000100:00100000:3.0:1767318352.855818:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121
00000100:00100000:3.0:1767318352.855832:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379480832:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.859814:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318352.859835:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379480960:0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.859914:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318352.859988:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481216
00000100:00100000:1.0:1767318352.859997:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481216
00000100:00100000:1.0:1767318352.860058:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480960
00000100:00100000:1.0:1767318352.860062:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480960
00000100:00100000:1.0:1767318352.860092:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591
00000100:00100000:1.0:1767318352.860101:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379481216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.860155:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379481216:12345-0@lo:400:kworker.0 Request processed in 55us (4549us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318352.860179:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591
00000100:00100000:1.0:1767318352.860200:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592
00000100:00100000:1.0:1767318352.860206:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379480960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.860233:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379480960:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318352.860254:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592
00000100:00100000:1.0:1767318352.860302:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379480960:0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.860315:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379481216:0@lo:400:kworker.0
00000100:00080000:1.0:1767318352.860376:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318352.860382:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318352.860685:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318352.862730:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480704
00000100:00100000:1.0:1767318352.862745:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480704
00000100:00100000:1.0:1767318352.862827:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122
00000100:00100000:1.0:1767318352.862836:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379480704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.862943:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379480704:12345-0@lo:400:kworker.0 Request processed in 108us (2257us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318352.862949:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122
00000100:00080000:0.0:1767318352.863037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318352.863077:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379480704:0@lo:400:kworker.0
00000100:00100000:2.0:1767318352.884036:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318352.884100:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379480576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.884137:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318352.884171:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480576
00000100:00100000:2.0:1767318352.884179:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480576
00000100:00100000:2.0:1767318352.884216:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784
00000100:00100000:2.0:1767318352.884223:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379480576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318352.884247:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318352.884287:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379480576:12345-0@lo:38:kworker.0 Request processed in 62us (148us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318352.884294:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784
00000100:00080000:2.0:1767318352.884341:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318352.884345:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318352.884348:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379480576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.884355:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379481088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.884379:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318352.884401:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379480448
00000100:00100000:2.0:1767318352.884420:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379480448
00000100:00100000:2.0:1767318352.884440:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481088
00000100:00100000:2.0:1767318352.884443:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481088
00000100:00100000:2.0:1767318352.884457:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16089
00000100:00100000:2.0:1767318352.884462:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379480448:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318352.884473:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318352.884741:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16090
00000100:00100000:1.0:1767318352.884747:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379481088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318352.884758:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318352.884792:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379481088:12345-0@lo:38:kworker.0 Request processed in 43us (412us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318352.884798:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16090
00000100:00100000:2.0:1767318352.884904:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379480448:12345-0@lo:38:kworker.0 Request processed in 48us (482us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318352.884910:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16089
00000100:00080000:2.0:1767318352.884936:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318352.884941:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318352.884944:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379481088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.885368:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379481344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318352.885404:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318352.885502:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318352.885506:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318352.885509:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379480448:0@lo:38:kworker.0
00000100:00100000:3.0:1767318352.886541:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379480832:12345-0@lo:400:kworker.0 Request processed in 30701us (30946us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318352.886560:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121
00000100:00100000:2.0:1767318352.887354:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379480832:0@lo:400:kworker.0
00000100:00100000:1.0:1767318352.888436:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481344
00000100:00100000:1.0:1767318352.888448:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481344
00000100:00100000:1.0:1767318352.888609:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16091
00000100:00100000:1.0:1767318352.888618:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379481344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318352.888642:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318352.888737:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379481344:12345-0@lo:38:kworker.0 Request processed in 119us (3330us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318352.888757:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16091
00000100:00080000:3.0:1767318352.888855:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318352.888861:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318352.888864:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379481344:0@lo:38:kworker.0
00010000:00010000:1.0:1767318353.369116:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318353.879239:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318353.879259:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379481472:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318353.879335:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318353.879662:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481472
00000100:00100000:2.0:1767318353.879671:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481472
00000100:00100000:2.0:1767318353.879724:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862
00000100:00100000:2.0:1767318353.879733:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f302f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379481472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318353.879760:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318353.879813:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f302f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379481472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (478us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318353.879837:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862
00000100:00100000:3.0:1767318353.880666:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379481472:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318354.391893:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318355.415140:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318355.415311:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379481600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318355.415371:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318355.415417:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481600
00000100:00100000:1.0:1767318355.415425:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481600
00000100:00100000:1.0:1767318355.415633:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863
00000100:00100000:1.0:1767318355.415642:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379481600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318355.415673:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318355.415736:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379481600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (362us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318355.415744:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863
00000100:00100000:0.0:1767318355.415904:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379481600:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318355.416086:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318356.443620:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318356.884316:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318356.884361:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318356.884593:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291856384
00000100:00100000:1.0:1767318356.884603:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291856384
00000100:00100000:1.0:1767318356.884680:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291856256
00000100:00100000:1.0:1767318356.884684:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291856256
00000100:00100000:1.0:1767318356.884709:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3593
00000100:00100000:1.0:1767318356.884720:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291856384:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318356.884793:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291856384:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 75us (487us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318356.884800:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3593
00000100:00100000:1.0:1767318356.884823:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16092
00000100:00100000:1.0:1767318356.884828:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291856256:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318356.884849:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318356.884918:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291856256:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 87us (554us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318356.884924:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16092
00000100:00080000:0.0:1767318356.885080:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318357.463971:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318357.975396:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318357.975408:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318357.975412:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318357.975500:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318357.975506:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318357.975514:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3255
00000100:00080000:1.0:1767318357.975519:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318357.975525:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318357.975574:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09046680 x1853164379481728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318357.975607:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318357.975611:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318357.975613:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318357.975617:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3255
00000100:00080000:1.0:1767318357.975620:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318357.975624:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318357.975638:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09045880 x1853164379481856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318357.975715:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379481984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318357.975723:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379481728:0@lo:38:kworker.0
00000100:00080000:1.0:1767318357.975827:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318357.975831:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318357.975834:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318357.975838:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3255
00000100:00080000:1.0:1767318357.975841:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318357.975863:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318357.975898:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09044380 x1853164379482368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318357.975927:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318357.975931:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318357.975933:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318357.975936:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3255
00000100:00080000:1.0:1767318357.975939:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318357.975943:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318357.975954:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e09045f80 x1853164379482624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318357.975985:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379482112:0@lo:400:kworker.0
00000100:00100000:2.0:1767318357.976079:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379482240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318357.979087:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318357.979184:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379481856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318357.979685:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318357.979733:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379482368:0@lo:38:kworker.0
00000100:00100000:3.0:1767318357.979775:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318357.980414:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379482624:0@lo:38:kworker.0
00000100:00100000:3.0:1767318357.980470:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318357.980522:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481856
00000100:00100000:3.0:1767318357.980530:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481856
00000100:00100000:3.0:1767318357.980563:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785
00000100:00100000:3.0:1767318357.980568:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379481856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318357.980590:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318357.981222:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379481856:12345-0@lo:38:kworker.0 Request processed in 648us (1532us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318357.981702:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785
00000100:00100000:3.0:1767318357.981750:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481728
00000100:00100000:3.0:1767318357.981758:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481728
00000100:00100000:3.0:1767318357.981796:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379482368
00000100:00100000:3.0:1767318357.981800:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379482368
00000100:00100000:3.0:1767318357.982336:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379482624
00000100:00100000:3.0:1767318357.982342:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379482624
00000100:00100000:3.0:1767318357.982375:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16093
00000100:00100000:3.0:1767318357.982951:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379481728:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318357.982973:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318357.983047:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379481728:12345-0@lo:38:kworker.0 Request processed in 98us (3969us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318357.983053:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16093
00000100:00100000:3.0:1767318357.983070:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16094
00000100:00100000:3.0:1767318357.983074:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379482368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318357.983084:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318357.983127:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379482368:12345-0@lo:38:kworker.0 Request processed in 51us (3351us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318357.983133:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16094
00000100:00100000:3.0:1767318357.983145:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16095
00000100:00100000:3.0:1767318357.983149:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379482624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318357.983159:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318357.983183:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379482624:12345-0@lo:38:kworker.0 Request processed in 32us (2741us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318357.983189:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16095
00000100:00080000:3.0:1767318357.983335:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318357.983341:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318357.983345:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379482368:0@lo:38:kworker.0
00000100:00080000:3.0:1767318357.983359:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318357.983361:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318357.983364:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379482624:0@lo:38:kworker.0
00000100:00080000:3.0:1767318357.983372:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318357.983374:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318357.983377:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379481728:0@lo:38:kworker.0
00000100:00080000:3.0:1767318357.983387:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318357.983390:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318357.983393:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09045880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379481856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318357.983472:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e09046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379482496:0@lo:400:kworker.0
00000100:00100000:3.0:1767318357.983508:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318357.983554:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379482496
00000100:00100000:3.0:1767318357.983559:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379482496
00000100:00100000:3.0:1767318357.983608:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594
00000100:00100000:3.0:1767318357.983616:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379482496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318357.983675:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379482496:12345-0@lo:400:kworker.0 Request processed in 60us (166us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318357.983681:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594
00000100:00100000:3.0:1767318357.983711:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379482496:0@lo:400:kworker.0
00000100:00080000:3.0:1767318357.983735:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318357.989368:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318357.989423:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379481984
00000100:00100000:3.0:1767318357.989434:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379481984
00000100:00100000:3.0:1767318357.989513:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123
00000100:00100000:3.0:1767318357.989523:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379481984:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318357.989598:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379481984:12345-0@lo:400:kworker.0 Request processed in 77us (237us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318357.989606:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123
00000100:00080000:3.0:1767318357.989915:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318357.991634:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379481984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318357.991762:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318357.991931:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379482112
00000100:00100000:3.0:1767318357.991939:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379482112
00000100:00100000:2.0:1767318357.992137:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318357.992165:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379482240
00000100:00100000:2.0:1767318357.992168:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379482240
00000100:00100000:2.0:1767318357.992198:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595
00000100:00100000:2.0:1767318357.992206:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379482240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318357.992249:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379482240:12345-0@lo:400:kworker.0 Request processed in 43us (112us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318357.992255:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595
00000100:00100000:2.0:1767318357.992298:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379482240:0@lo:400:kworker.0
00000100:00100000:3.0:1767318357.992361:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124
00000100:00100000:3.0:1767318357.992372:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379482112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318357.992427:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379482112:12345-0@lo:400:kworker.0 Request processed in 58us (665us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318357.992433:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124
00000100:00100000:2.0:1767318357.992568:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e09044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379482112:0@lo:400:kworker.0
00000100:00080000:0.0:1767318357.992910:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318357.992916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318358.487280:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318358.999097:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379482752:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318358.999171:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318358.999385:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379482752
00000100:00100000:3.0:1767318358.999394:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379482752
00000100:00100000:3.0:1767318358.999471:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864
00000100:00100000:3.0:1767318358.999480:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379482752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318358.999527:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318358.999899:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379482752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 419us (727us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318358.999905:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864
00000100:00100000:0.0:1767318358.999976:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379482752:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318359.511181:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318360.535065:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318360.535250:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379482880:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318360.535353:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318360.535554:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379482880
00000100:00100000:2.0:1767318360.535562:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379482880
00000100:00100000:2.0:1767318360.535651:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865
00000100:00100000:2.0:1767318360.535661:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379482880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318360.535692:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318360.535737:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379482880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (384us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318360.535745:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865
00000100:00080000:3.0:1767318360.535813:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318360.535849:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379482880:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318361.559141:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318361.999109:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318361.999166:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318361.999253:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291856640
00000100:00100000:2.0:1767318361.999262:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291856640
00000100:00100000:2.0:1767318361.999342:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291856512
00000100:00100000:2.0:1767318361.999345:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291856512
00000100:00100000:2.0:1767318361.999362:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3596
00000100:00100000:2.0:1767318361.999382:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291856640:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318361.999454:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16096
00000100:00100000:1.0:1767318361.999461:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291856512:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318361.999481:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318361.999485:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291856640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 105us (393us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318361.999493:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3596
00000100:00100000:1.0:1767318361.999506:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291856512:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (340us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318361.999512:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16096
00000100:00080000:0.0:1767318361.999647:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767318362.001710:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291856768 offset 0 length 520: 4
00000100:00100000:3.0:1767318362.071359:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318337/real 1767318337]  req@ffff8b0e0a2eea00 x1853164379476480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318362.071413:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0a2eea00 x1853164379476480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318362 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318362.071427:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318362.081475:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318362.081573:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318362.081578:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318362.081588:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3239
00000100:00080000:2.0:1767318362.081655:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318362.081664:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318362.081704:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23480 x1853164379483008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318362.081724:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318362.081727:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318362.081729:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318362.081733:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318362.081735:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318362.081739:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318362.081757:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21180 x1853164379483136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318362.081766:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318362.081769:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318362.081771:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318362.081774:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318362.082271:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318362.082276:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318362.082293:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45880 x1853164379483264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318362.082382:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379483392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318362.082463:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318362.082583:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379483392
00000100:00100000:1.0:1767318362.082601:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379483392
00000100:00100000:1.0:1767318362.082666:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125
00000100:00100000:1.0:1767318362.082675:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379483392:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318362.083771:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318362.083793:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379476480:0@lo:250:kworker.0
00000100:00100000:3.0:1767318362.083835:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379483520:0@lo:400:kworker.0
00000100:00100000:3.0:1767318362.083917:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318362.083957:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379483008:0@lo:250:kworker.0
00000400:00000100:3.0:1767318362.083975:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379483008 offset 0 length 520: 4
00000100:00100000:3.0:1767318362.083994:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379483136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318362.084013:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318362.084037:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379483136
00000100:00100000:3.0:1767318362.084042:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379483136
00000100:00100000:3.0:1767318362.084081:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16097
00000100:00100000:3.0:1767318362.084087:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379483136:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318362.084107:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318362.084138:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379483136:12345-0@lo:38:kworker.0 Request processed in 50us (124us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318362.084145:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16097
00000100:00080000:3.0:1767318362.084178:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318362.084182:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318362.084185:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379483136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318362.084191:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379483264:0@lo:38:kworker.0
00000100:00100000:3.0:1767318362.084211:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318362.084229:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379483264
00000100:00100000:3.0:1767318362.084232:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379483264
00000100:00100000:3.0:1767318362.084247:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786
00000100:00100000:3.0:1767318362.084266:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379483264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318362.084276:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318362.084302:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379483264:12345-0@lo:38:kworker.0 Request processed in 35us (90us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318362.084308:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786
00000100:00080000:3.0:1767318362.084334:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318362.084338:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318362.084341:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379483264:0@lo:38:kworker.0
00000100:00100000:3.0:1767318362.084528:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379483520
00000100:00100000:3.0:1767318362.084532:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379483520
00000100:00100000:3.0:1767318362.084559:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126
00000100:00100000:3.0:1767318362.084565:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379483520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318362.086394:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379483520:12345-0@lo:400:kworker.0 Request processed in 1819us (2467us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318362.086416:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126
00000100:00100000:3.0:1767318362.086578:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379483520:0@lo:400:kworker.0
00000100:00080000:3.0:1767318362.086726:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318362.086731:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318362.092269:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379483392:12345-0@lo:400:kworker.0 Request processed in 9583us (9795us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318362.092287:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125
00000100:00100000:0.0:1767318362.094243:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379483392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318362.095766:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379483648:0@lo:400:kworker.0
00000100:00100000:0.0:1767318362.095861:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318362.096418:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379483648
00000100:00100000:3.0:1767318362.096427:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379483648
00000100:00100000:3.0:1767318362.096509:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597
00000100:00100000:3.0:1767318362.096522:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379483648:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318362.096607:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318362.097121:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318362.097127:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318362.097131:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318362.097137:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318362.097141:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318362.097146:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318362.097179:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5e680 x1853164379483776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318362.097248:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379483904:0@lo:400:kworker.0
00000100:00100000:1.0:1767318362.097285:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318362.097322:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379483904
00000100:00100000:1.0:1767318362.097326:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379483904
00000100:00100000:1.0:1767318362.097363:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598
00000100:00100000:1.0:1767318362.097370:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379483904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318362.097416:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379483904:12345-0@lo:400:kworker.0 Request processed in 46us (129us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318362.097424:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598
00000100:00080000:1.0:1767318362.097449:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318362.097475:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379483904:0@lo:400:kworker.0
00000100:00100000:1.0:1767318362.097530:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379483776:0@lo:38:kworker.0
00000100:00100000:1.0:1767318362.097556:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318362.097578:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379483776
00000100:00100000:1.0:1767318362.097582:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379483776
00000100:00100000:1.0:1767318362.097615:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16098
00000100:00100000:1.0:1767318362.097620:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379483776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318362.097638:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318362.097668:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379483776:12345-0@lo:38:kworker.0 Request processed in 46us (111us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318362.097674:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16098
00000100:00080000:1.0:1767318362.097715:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318362.097721:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318362.097724:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379483776:0@lo:38:kworker.0
00000100:00100000:3.0:1767318362.098811:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379483648:12345-0@lo:400:kworker.0 Request processed in 2289us (2944us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318362.098823:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597
00000100:00100000:0.0:1767318362.099343:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379483648:0@lo:400:kworker.0
00000100:00080000:2.0:1767318362.099476:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318362.099482:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318362.099571:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318362.099576:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3260
00000100:00080000:2.0:1767318362.099580:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318362.099585:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318362.099698:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164379484032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318362.099765:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379484032:0@lo:38:kworker.0
00000100:00100000:1.0:1767318362.099834:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318362.104674:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484032
00000100:00100000:3.0:1767318362.104692:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484032
00000100:00100000:3.0:1767318362.104762:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16099
00000100:00100000:3.0:1767318362.104771:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379484032:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318362.105173:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318362.107162:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379484032:12345-0@lo:38:kworker.0 Request processed in 2380us (7316us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318362.107179:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16099
00000100:00080000:1.0:1767318362.107356:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318362.107363:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318362.107368:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379484032:0@lo:38:kworker.0
00010000:00010000:1.0:1767318362.583299:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318363.607129:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318364.119175:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318364.119191:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379484160:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318364.119251:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318364.119372:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484160
00000100:00100000:2.0:1767318364.119379:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484160
00000100:00100000:2.0:1767318364.119505:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866
00000100:00100000:2.0:1767318364.119516:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379484160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318364.119548:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318364.119626:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379484160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (373us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318364.119634:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866
00000100:00100000:0.0:1767318364.119666:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379484160:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318364.120769:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318364.631523:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318365.655157:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318365.655181:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379484288:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318365.655285:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318365.655481:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484288
00000100:00100000:2.0:1767318365.655490:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484288
00000100:00100000:2.0:1767318365.655561:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867
00000100:00100000:2.0:1767318365.655571:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379484288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318365.655599:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318365.655649:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379484288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (364us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318365.655656:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867
00000100:00100000:2.0:1767318365.655702:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379484288:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318365.655766:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318365.656246:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318366.679234:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318367.123427:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318367.123475:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318367.123632:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291857024
00000100:00100000:3.0:1767318367.123643:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291857024
00000100:00100000:3.0:1767318367.123708:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291856896
00000100:00100000:3.0:1767318367.123712:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291856896
00000100:00100000:3.0:1767318367.123730:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3599
00000100:00100000:3.0:1767318367.123741:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291857024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318367.123815:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291857024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 75us (397us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318367.123822:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3599
00000100:00100000:3.0:1767318367.123840:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16100
00000100:00100000:3.0:1767318367.123845:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291856896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318367.123863:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318367.123914:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291856896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 66us (438us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318367.123920:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16100
00000100:00080000:0.0:1767318367.124239:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318367.192580:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318367.192600:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318367.192603:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318367.192607:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318367.192612:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318367.192619:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3264
00000100:00080000:2.0:1767318367.192624:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318367.192630:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318367.192670:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164379484416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318367.192700:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318367.192704:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318367.192718:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318367.192722:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3264
00000100:00080000:2.0:1767318367.192725:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318367.192729:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318367.192745:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360ad80 x1853164379484544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318367.192820:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318367.192824:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318367.192826:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318367.192830:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3264
00000100:00080000:2.0:1767318367.192832:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318367.192835:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318367.192847:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19880 x1853164379485056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318367.192862:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318367.192865:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318367.192886:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318367.192890:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3264
00000100:00080000:2.0:1767318367.192892:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318367.192897:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318367.192911:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18e00 x1853164379485312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318367.192940:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379485184:0@lo:400:kworker.0
00000100:00100000:1.0:1767318367.193063:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379484416:0@lo:38:kworker.0
00000100:00100000:1.0:1767318367.193123:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318367.193186:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379484544:0@lo:38:kworker.0
00000100:00100000:1.0:1767318367.193211:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318367.193235:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379485056:0@lo:38:kworker.0
00000100:00100000:1.0:1767318367.193256:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318367.193272:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379485312:0@lo:38:kworker.0
00000100:00100000:1.0:1767318367.193292:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318367.193346:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484416
00000100:00100000:1.0:1767318367.193354:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484416
00000100:00100000:1.0:1767318367.193709:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485056
00000100:00100000:1.0:1767318367.193714:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485056
00000100:00100000:1.0:1767318367.193730:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485312
00000100:00100000:1.0:1767318367.193733:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485312
00000100:00100000:1.0:1767318367.193763:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16101
00000100:00100000:1.0:1767318367.193770:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379484416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318367.193790:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318367.193836:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379484416:12345-0@lo:38:kworker.0 Request processed in 65us (712us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318367.193842:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16101
00000100:00100000:1.0:1767318367.193862:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16102
00000100:00100000:1.0:1767318367.193866:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379485056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318367.193896:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318367.193920:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379485056:12345-0@lo:38:kworker.0 Request processed in 52us (663us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318367.193926:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16102
00000100:00100000:1.0:1767318367.193937:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16103
00000100:00100000:1.0:1767318367.193941:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379485312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318367.193950:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318367.194090:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379485312:12345-0@lo:38:kworker.0 Request processed in 146us (797us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318367.194095:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16103
00000100:00080000:1.0:1767318367.194139:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318367.194144:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318367.194147:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379484416:0@lo:38:kworker.0
00000100:00080000:1.0:1767318367.194157:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318367.194160:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318367.194163:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379485056:0@lo:38:kworker.0
00000100:00080000:1.0:1767318367.194183:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318367.194187:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318367.194189:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379485312:0@lo:38:kworker.0
00000100:00100000:1.0:1767318367.194239:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379484928:0@lo:400:kworker.0
00000100:00100000:1.0:1767318367.194265:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318367.194293:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484928
00000100:00100000:1.0:1767318367.194297:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484928
00000100:00100000:3.0:1767318367.194438:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379484800:0@lo:400:kworker.0
00000100:00100000:3.0:1767318367.194473:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318367.194500:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318367.194506:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379484672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318367.194527:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318367.194554:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484544
00000100:00100000:3.0:1767318367.194558:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484544
00000100:00100000:3.0:1767318367.194580:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787
00000100:00100000:3.0:1767318367.194585:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379484544:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318367.194596:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318367.194635:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379484544:12345-0@lo:38:kworker.0 Request processed in 48us (1422us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318367.194641:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787
00000100:00100000:3.0:1767318367.194667:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484800
00000100:00100000:3.0:1767318367.194670:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484800
00000100:00100000:3.0:1767318367.194707:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379484672
00000100:00100000:3.0:1767318367.194710:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379484672
00000100:00100000:3.0:1767318367.194730:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127
00000100:00100000:3.0:1767318367.194737:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379484800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318367.194777:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379484800:12345-0@lo:400:kworker.0 Request processed in 41us (303us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318367.194782:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127
00000100:00100000:3.0:1767318367.194794:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128
00000100:00100000:3.0:1767318367.194800:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379484672:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318367.194828:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379484672:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318367.194834:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128
00000100:00100000:3.0:1767318367.194899:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379484672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318367.194912:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379484800:0@lo:400:kworker.0
00000100:00080000:3.0:1767318367.194943:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318367.194947:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318367.194950:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379484544:0@lo:38:kworker.0
00000100:00100000:1.0:1767318367.195184:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600
00000100:00100000:1.0:1767318367.195191:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379484928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318367.195229:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379484928:12345-0@lo:400:kworker.0 Request processed in 39us (964us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318367.195235:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600
00000100:00100000:1.0:1767318367.195267:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379484928:0@lo:400:kworker.0
00000100:00100000:2.0:1767318367.195639:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318367.195748:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318367.195754:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318367.195756:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318367.195920:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485184
00000100:00100000:1.0:1767318367.195926:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485184
00000100:00100000:1.0:1767318367.196026:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601
00000100:00100000:1.0:1767318367.196034:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379485184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318367.196073:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379485184:12345-0@lo:400:kworker.0 Request processed in 40us (434us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318367.196080:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601
00000100:00100000:2.0:1767318367.196579:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379485184:0@lo:400:kworker.0
00000100:00080000:0.0:1767318367.197373:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318367.703229:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318368.727066:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318369.243686:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318369.243712:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379485440:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318369.243782:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318369.243865:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485440
00000100:00100000:1.0:1767318369.243889:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485440
00000100:00080000:0.0:1767318369.244055:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318369.244223:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868
00000100:00100000:1.0:1767318369.244234:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379485440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318369.244265:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318369.244473:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379485440:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318369.244535:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379485440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 302us (751us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318369.244542:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868
00010000:00010000:2.0:1767318369.751106:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318370.775125:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318370.775937:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379485568:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318370.776001:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318370.776126:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485568
00000100:00100000:3.0:1767318370.776134:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485568
00000100:00100000:3.0:1767318370.776184:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869
00000100:00100000:3.0:1767318370.776190:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379485568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318370.776235:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318370.776276:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379485568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (276us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318370.776281:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869
00000100:00080000:0.0:1767318370.776418:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318370.776449:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379485568:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318371.799053:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318372.243500:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318372.244084:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291857280
00000100:00100000:2.0:1767318372.244095:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291857280
00000100:00100000:2.0:1767318372.244172:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3602
00000100:00100000:2.0:1767318372.244183:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291857280:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318372.244344:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291857280:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 162us (853us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318372.244353:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3602
00000100:00080000:0.0:1767318372.244954:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318372.255091:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318372.265035:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291857152
00000100:00100000:3.0:1767318372.265052:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291857152
00000100:00100000:3.0:1767318372.265138:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16104
00000100:00100000:3.0:1767318372.265634:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291857152:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318372.265660:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318372.267237:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291857152:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2081us (12147us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318372.267250:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16104
00000100:00080000:2.0:1767318372.311027:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318372.311038:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318372.311041:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318372.311046:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318372.311050:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318372.311058:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3269
00000100:00080000:2.0:1767318372.311063:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318372.311070:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318372.311108:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a680 x1853164379485696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318372.312275:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318372.312283:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318372.312286:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318372.312292:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3269
00000100:00080000:2.0:1767318372.312295:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318372.312301:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318372.312380:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18a80 x1853164379485824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318372.312446:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318372.312449:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318372.312451:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318372.312455:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3269
00000100:00080000:2.0:1767318372.312457:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318372.312461:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318372.312471:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebce00 x1853164379486336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318372.312495:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318372.312498:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318372.312500:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318372.312504:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3269
00000100:00080000:2.0:1767318372.312506:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318372.312509:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318372.312517:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3963c700 x1853164379486592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318372.312552:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379486208:0@lo:400:kworker.0
00000100:00100000:2.0:1767318372.312649:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318372.312708:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318372.312713:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3963fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379486464:0@lo:400:kworker.0
00000100:00100000:2.0:1767318372.312731:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318372.312770:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486208
00000100:00100000:2.0:1767318372.312781:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486208
00000100:00100000:2.0:1767318372.312823:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486464
00000100:00100000:2.0:1767318372.312826:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486464
00000100:00100000:2.0:1767318372.312846:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603
00000100:00100000:2.0:1767318372.312853:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379486208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318372.312917:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379486208:12345-0@lo:400:kworker.0 Request processed in 63us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318372.312924:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603
00000100:00100000:2.0:1767318372.312938:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604
00000100:00100000:2.0:1767318372.312943:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379486464:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318372.312963:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379486464:12345-0@lo:400:kworker.0 Request processed in 20us (231us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318372.312968:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604
00000100:00100000:2.0:1767318372.313002:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3963fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379486464:0@lo:400:kworker.0
00000100:00100000:2.0:1767318372.313010:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379486208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318372.313105:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379486080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318372.313137:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318372.313176:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318372.313181:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379485952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318372.313202:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318372.313233:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318372.313243:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486080
00000100:00100000:0.0:1767318372.313246:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486080
00000100:00100000:0.0:1767318372.313273:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485952
00000100:00100000:0.0:1767318372.313275:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485952
00000100:00100000:0.0:1767318372.313292:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129
00000100:00100000:0.0:1767318372.313298:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379486080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318372.313340:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379486080:12345-0@lo:400:kworker.0 Request processed in 43us (203us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318372.313346:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129
00000100:00100000:0.0:1767318372.313357:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130
00000100:00100000:0.0:1767318372.313362:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379485952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318372.313383:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379485952:12345-0@lo:400:kworker.0 Request processed in 21us (180us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318372.313388:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130
00000100:00080000:0.0:1767318372.313405:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318372.313407:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318372.313420:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379485952:0@lo:400:kworker.0
00000100:00100000:0.0:1767318372.313428:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379486080:0@lo:400:kworker.0
00000100:00100000:2.0:1767318372.318432:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379485696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318372.319321:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318372.319371:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379485824:0@lo:38:kworker.0
00000100:00100000:2.0:1767318372.319402:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318372.319439:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379486336:0@lo:38:kworker.0
00000100:00100000:2.0:1767318372.319458:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318372.319494:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3963c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379486592:0@lo:38:kworker.0
00000100:00100000:2.0:1767318372.319516:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318372.319550:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485696
00000100:00100000:2.0:1767318372.319558:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485696
00000100:00100000:2.0:1767318372.319608:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486336
00000100:00100000:2.0:1767318372.319612:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486336
00000100:00100000:2.0:1767318372.319625:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486592
00000100:00100000:2.0:1767318372.319628:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486592
00000100:00100000:2.0:1767318372.319644:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16105
00000100:00100000:2.0:1767318372.319651:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379485696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318372.319676:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318372.319717:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379485696:12345-0@lo:38:kworker.0 Request processed in 64us (407us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318372.319724:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16105
00000100:00100000:2.0:1767318372.319741:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16106
00000100:00100000:2.0:1767318372.319745:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379486336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318372.319755:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318372.319775:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379486336:12345-0@lo:38:kworker.0 Request processed in 29us (316us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318372.319781:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16106
00000100:00100000:2.0:1767318372.319791:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16107
00000100:00100000:2.0:1767318372.319795:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379486592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318372.319803:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318372.319824:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379486592:12345-0@lo:38:kworker.0 Request processed in 28us (307us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318372.319829:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16107
00000100:00080000:2.0:1767318372.319866:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318372.319888:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318372.319892:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3963c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379486592:0@lo:38:kworker.0
00000100:00080000:2.0:1767318372.319917:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318372.319927:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318372.319930:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379485696:0@lo:38:kworker.0
00000100:00080000:2.0:1767318372.319941:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318372.319944:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318372.319946:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379486336:0@lo:38:kworker.0
00000100:00100000:3.0:1767318372.321341:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379485824
00000100:00100000:3.0:1767318372.321355:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379485824
00000100:00100000:3.0:1767318372.321402:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788
00000100:00100000:3.0:1767318372.321409:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379485824:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318372.321425:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318372.321499:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379485824:12345-0@lo:38:kworker.0 Request processed in 89us (2095us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318372.321506:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788
00000100:00080000:2.0:1767318372.321696:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318372.321701:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318372.321705:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379485824:0@lo:38:kworker.0
00010000:00010000:0.0:1767318372.823243:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318373.847426:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318374.359823:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318374.359842:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379486720:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318374.359940:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318374.363345:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486720
00000100:00100000:3.0:1767318374.363363:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486720
00000100:00100000:3.0:1767318374.363473:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870
00000100:00100000:3.0:1767318374.363485:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379486720:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318374.363524:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318374.363624:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379486720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (3683us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318374.363646:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870
00000100:00100000:2.0:1767318374.363935:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379486720:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318374.364259:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318374.871176:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318375.895308:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318375.895592:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318375.899908:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379486848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318375.899991:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318375.900230:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486848
00000100:00100000:3.0:1767318375.900240:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486848
00000100:00100000:3.0:1767318375.900444:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871
00000100:00100000:3.0:1767318375.900455:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379486848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318375.900498:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318375.900566:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379486848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (572us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318375.900573:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871
00000100:00100000:1.0:1767318375.900675:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379486848:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318375.903407:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318376.919058:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318377.363734:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318377.363796:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318377.367188:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291857408
00000100:00100000:1.0:1767318377.367203:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291857408
00000100:00100000:1.0:1767318377.367261:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291857536
00000100:00100000:1.0:1767318377.367274:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291857536
00000100:00100000:1.0:1767318377.367329:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3605
00000100:00100000:1.0:1767318377.367342:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291857536:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318377.367434:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291857536:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 96us (3637us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318377.367442:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3605
00000100:00100000:1.0:1767318377.367466:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16108
00000100:00100000:1.0:1767318377.367471:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291857408:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318377.367493:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318377.367534:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291857408:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 61us (3812us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318377.367556:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16108
00000100:00080000:0.0:1767318377.367859:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318377.431302:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318377.431314:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318377.431317:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318377.431322:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318377.431327:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318377.431335:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3274
00000100:00080000:3.0:1767318377.431340:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318377.431346:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318377.431385:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6a00 x1853164379486976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318377.431413:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318377.431417:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318377.431419:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318377.431423:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3274
00000100:00080000:3.0:1767318377.431425:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318377.431444:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318377.431456:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6300 x1853164379487104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318377.431509:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379487232:0@lo:400:kworker.0
00000100:00100000:2.0:1767318377.431585:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318377.431685:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379487232
00000100:00100000:0.0:1767318377.431692:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379487232
00000100:00100000:0.0:1767318377.431746:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131
00000100:00100000:0.0:1767318377.431755:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379487232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318377.432212:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379486976:0@lo:38:kworker.0
00000100:00100000:1.0:1767318377.432275:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318377.432301:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379487104:0@lo:38:kworker.0
00000100:00100000:1.0:1767318377.432324:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318377.432380:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318377.432398:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379487104
00000100:00100000:1.0:1767318377.432402:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379487104
00000100:00100000:1.0:1767318377.432429:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789
00000100:00100000:1.0:1767318377.432435:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379487104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318377.432454:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318377.432490:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379487104:12345-0@lo:38:kworker.0 Request processed in 53us (164us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318377.432497:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789
00000100:00080000:1.0:1767318377.432549:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318377.432555:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318377.432558:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379487104:0@lo:38:kworker.0
00000100:00100000:1.0:1767318377.432593:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379487360:0@lo:400:kworker.0
00000100:00100000:1.0:1767318377.432619:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318377.432647:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379487360
00000100:00100000:1.0:1767318377.432652:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379487360
00000100:00100000:1.0:1767318377.432683:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132
00000100:00100000:1.0:1767318377.432690:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379487360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318377.432724:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379487360:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318377.432745:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132
00000100:00080000:1.0:1767318377.432761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318377.432780:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379487360:0@lo:400:kworker.0
00000100:00100000:1.0:1767318377.432813:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379486976
00000100:00100000:1.0:1767318377.432818:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379486976
00000100:00100000:1.0:1767318377.432838:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16109
00000100:00100000:1.0:1767318377.432842:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379486976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318377.432853:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318377.432904:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379486976:12345-0@lo:38:kworker.0 Request processed in 60us (629us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318377.432909:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16109
00000100:00080000:1.0:1767318377.432935:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318377.433204:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318377.433209:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379486976:0@lo:38:kworker.0
00000100:00100000:0.0:1767318377.434590:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379487232:12345-0@lo:400:kworker.0 Request processed in 2830us (2998us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318377.434603:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131
00000100:00080000:3.0:1767318377.434896:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318377.434901:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318377.434904:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318377.434910:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3274
00000100:00080000:3.0:1767318377.434914:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318377.434919:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318377.441410:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379487232:0@lo:400:kworker.0
00000100:00100000:3.0:1767318377.441563:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7100 x1853164379487616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318377.441618:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318377.441622:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318377.441625:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318377.441629:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3274
00000100:00080000:3.0:1767318377.441632:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318377.441638:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318377.441834:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379487616:0@lo:38:kworker.0
00000100:00100000:2.0:1767318377.442482:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318377.442545:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379487616
00000100:00100000:2.0:1767318377.442553:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379487616
00000100:00100000:2.0:1767318377.442595:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16110
00000100:00100000:2.0:1767318377.442603:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379487616:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318377.442626:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318377.442854:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5f80 x1853164379487872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318377.443028:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379487872:0@lo:38:kworker.0
00000100:00100000:3.0:1767318377.443063:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318377.443094:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379487872
00000100:00100000:3.0:1767318377.443099:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379487872
00000100:00100000:3.0:1767318377.443122:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16111
00000100:00100000:3.0:1767318377.443127:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379487872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318377.443154:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318377.443429:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379487488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318377.443468:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318377.443495:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318377.443501:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379487744:0@lo:400:kworker.0
00000100:00100000:0.0:1767318377.443543:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318377.443573:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379487616:12345-0@lo:38:kworker.0 Request processed in 968us (1090us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318377.443579:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379487488
00000100:00100000:2.0:1767318377.443584:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16110
00000100:00100000:0.0:1767318377.443586:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379487488
00000100:00100000:2.0:1767318377.443605:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379487744
00000100:00100000:2.0:1767318377.443618:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379487744
00000100:00100000:0.0:1767318377.443638:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606
00000100:00100000:0.0:1767318377.443647:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379487488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318377.443691:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379487488:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0
00000100:00080000:1.0:1767318377.443890:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318377.443937:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379487488:0@lo:400:kworker.0
00000100:00080000:1.0:1767318377.443993:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318377.443999:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318377.444002:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379487616:0@lo:38:kworker.0
00000100:00100000:3.0:1767318377.444127:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379487872:12345-0@lo:38:kworker.0 Request processed in 998us (1062us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318377.444252:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318377.444257:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318377.444260:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379487872:0@lo:38:kworker.0
00000100:00100000:2.0:1767318377.444472:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607
00000100:00100000:2.0:1767318377.444482:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379487744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318377.444524:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379487744:12345-0@lo:400:kworker.0 Request processed in 45us (981us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318377.444531:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607
00000100:00100000:1.0:1767318377.444620:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379487744:0@lo:400:kworker.0
00000100:00100000:0.0:1767318377.445782:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606
00000100:00100000:3.0:1767318377.445840:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16111
00010000:00010000:2.0:1767318377.943322:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318378.967122:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318379.479168:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379488000:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318379.479280:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318379.479940:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488000
00000100:00100000:0.0:1767318379.479952:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488000
00000100:00100000:0.0:1767318379.480065:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872
00000100:00100000:0.0:1767318379.480075:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379488000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318379.480106:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318379.480162:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379488000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (882us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318379.480184:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872
00000100:00100000:0.0:1767318379.480254:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379488000:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318379.486473:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318379.992042:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318381.015127:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318381.016399:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318381.016439:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3963c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379488128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318381.016551:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318381.017297:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488128
00000100:00100000:3.0:1767318381.017314:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488128
00000100:00080000:2.0:1767318381.017419:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318381.017447:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873
00000100:00100000:3.0:1767318381.017461:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379488128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318381.017499:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318381.017594:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379488128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (1043us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318381.017601:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873
00000100:00100000:2.0:1767318381.017717:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3963c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379488128:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318382.039945:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318382.481133:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318382.481182:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318382.481530:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291857792
00000100:00100000:0.0:1767318382.481543:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291857792
00000100:00100000:3.0:1767318382.481730:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291857664
00000100:00100000:3.0:1767318382.481737:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291857664
00000100:00100000:0.0:1767318382.483610:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3608
00000100:00100000:0.0:1767318382.483634:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291857792:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318382.483762:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291857792:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 139us (2646us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318382.483771:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3608
00000100:00100000:0.0:1767318382.483798:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16112
00000100:00100000:0.0:1767318382.483804:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291857664:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318382.483831:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318382.483896:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291857664:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 91us (2712us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318382.483904:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16112
00000100:00080000:2.0:1767318382.490978:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318382.551278:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318382.551293:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318382.551298:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318382.551327:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318382.551333:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318382.551343:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3279
00000100:00080000:0.0:1767318382.551349:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318382.551356:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318382.551405:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85dc00 x1853164379488256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318382.551480:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379488256:0@lo:38:kworker.0
00000100:00100000:3.0:1767318382.551577:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318382.551656:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488256
00000100:00100000:1.0:1767318382.551668:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488256
00000100:00100000:1.0:1767318382.551726:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16113
00000100:00100000:1.0:1767318382.551735:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379488256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318382.551763:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318382.552038:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318382.552042:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318382.552044:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318382.552050:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3279
00000100:00080000:0.0:1767318382.552053:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318382.552057:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318382.552078:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d880 x1853164379488384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318382.560553:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379488256:12345-0@lo:38:kworker.0 Request processed in 8801us (8958us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318382.560572:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16113
00000100:00100000:3.0:1767318382.561730:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379488384:0@lo:38:kworker.0
00000100:00100000:3.0:1767318382.561834:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318382.561910:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488384
00000100:00100000:1.0:1767318382.561920:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488384
00000100:00080000:3.0:1767318382.561952:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318382.561958:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318382.561962:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379488256:0@lo:38:kworker.0
00000100:00100000:1.0:1767318382.561965:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790
00000100:00100000:1.0:1767318382.561974:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379488384:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318382.562003:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318382.562065:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379488384:12345-0@lo:38:kworker.0 Request processed in 90us (231us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318382.562072:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790
00000100:00080000:3.0:1767318382.562352:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318382.562357:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318382.562360:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379488384:0@lo:38:kworker.0
00000100:00080000:0.0:1767318382.562699:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318382.562706:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318382.562709:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318382.562714:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3279
00000100:00080000:0.0:1767318382.562719:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318382.562725:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318382.562740:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318382.562748:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07800 x1853164379488896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318382.562753:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379488768:0@lo:400:kworker.0
00000100:00080000:0.0:1767318382.562767:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318382.562780:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318382.562782:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318382.562785:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3279
00000100:00080000:0.0:1767318382.562787:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318382.562791:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318382.562804:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859f80 x1853164379489152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318382.562804:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318382.562832:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379489024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318382.562849:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488768
00000100:00100000:3.0:1767318382.562853:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318382.562854:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488768
00000100:00100000:3.0:1767318382.562909:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379489024
00000100:00100000:3.0:1767318382.562913:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379489024
00000100:00100000:0.0:1767318382.562924:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609
00000100:00100000:0.0:1767318382.562930:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379488768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318382.562940:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610
00000100:00100000:3.0:1767318382.562945:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379489024:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318382.562977:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379489024:12345-0@lo:400:kworker.0 Request processed in 32us (123us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318382.562984:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610
00000100:00100000:2.0:1767318382.563013:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379488640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318382.563048:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379488512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318382.563052:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318382.563075:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318382.563090:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318382.563120:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488640
00000100:00100000:1.0:1767318382.563124:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488640
00000100:00100000:2.0:1767318382.563125:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379488896:0@lo:38:kworker.0
00000100:00100000:1.0:1767318382.563150:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488512
00000100:00100000:2.0:1767318382.563150:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318382.563153:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488512
00000100:00100000:2.0:1767318382.563166:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379489152:0@lo:38:kworker.0
00000100:00100000:1.0:1767318382.563179:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133
00000100:00100000:1.0:1767318382.563185:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379488640:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318382.563185:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318382.563215:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379488896
00000100:00100000:1.0:1767318382.563229:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379488640:12345-0@lo:400:kworker.0 Request processed in 33us (165us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318382.563230:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379488896
00000100:00100000:1.0:1767318382.563245:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133
00000100:00100000:2.0:1767318382.563250:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379489152
00000100:00100000:2.0:1767318382.563253:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379489152
00000100:00100000:1.0:1767318382.563260:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134
00000100:00100000:1.0:1767318382.563265:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379488512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318382.563270:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16114
00000100:00100000:2.0:1767318382.563273:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379488896:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318382.563288:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318382.563296:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379488512:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318382.563301:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134
00000100:00100000:2.0:1767318382.563316:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379488896:12345-0@lo:38:kworker.0 Request processed in 41us (165us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318382.563322:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16114
00000100:00100000:1.0:1767318382.563330:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16115
00000100:00100000:1.0:1767318382.563334:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379489152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318382.563344:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318382.563363:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379488640:0@lo:400:kworker.0
00000100:00100000:1.0:1767318382.563367:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379489152:12345-0@lo:38:kworker.0 Request processed in 31us (181us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318382.563372:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16115
00000100:00080000:2.0:1767318382.563382:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318382.563394:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318382.563395:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379488512:0@lo:400:kworker.0
00000100:00080000:2.0:1767318382.563398:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318382.563401:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379488896:0@lo:38:kworker.0
00000100:00080000:2.0:1767318382.563408:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318382.563412:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318382.563415:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379489152:0@lo:38:kworker.0
00000100:00100000:0.0:1767318382.563837:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379488768:12345-0@lo:400:kworker.0 Request processed in 904us (1030us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318382.563846:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609
00000100:00100000:3.0:1767318382.564196:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379489024:0@lo:400:kworker.0
00000100:00100000:2.0:1767318382.564298:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379488768:0@lo:400:kworker.0
00010000:00010000:1.0:1767318383.063984:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318384.087127:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318384.602299:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318384.602325:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379489280:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318384.602417:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318384.602539:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379489280
00000100:00100000:1.0:1767318384.602559:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379489280
00000100:00100000:1.0:1767318384.602633:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874
00000100:00100000:1.0:1767318384.602642:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379489280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318384.602680:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318384.602728:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379489280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (311us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318384.602736:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874
00000100:00080000:0.0:1767318384.602945:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318384.602991:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379489280:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318385.111172:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318386.135320:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318386.135352:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379489408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318386.135456:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318386.135703:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379489408
00000100:00100000:3.0:1767318386.135714:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379489408
00000100:00100000:3.0:1767318386.135803:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875
00000100:00100000:3.0:1767318386.135814:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379489408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318386.135860:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00010000:00010000:0.0:1767318386.135903:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318386.136094:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318386.139635:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379489408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3807us (4162us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318386.139655:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875
00000100:00100000:3.0:1767318386.139792:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379489408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318386.587243:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767318386.587295:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291857920 offset 0 length 520: 4
00000100:00100000:1.0:1767318386.587325:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318386.587375:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858176
00000100:00100000:2.0:1767318386.587388:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858176
00000100:00080000:3.0:1767318386.587464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318386.587483:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858048
00000100:00100000:2.0:1767318386.587488:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858048
00000100:00100000:2.0:1767318386.587522:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3611
00000100:00100000:2.0:1767318386.587536:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291858176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318386.587566:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16116
00000100:00100000:0.0:1767318386.587574:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291858048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318386.587600:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318386.587644:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291858176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (420us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318386.587653:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3611
00000100:00100000:0.0:1767318386.587662:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291858048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 89us (337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318386.587669:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16116
00010000:00010000:1.0:1767318387.162504:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318387.673044:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318362/real 1767318362]  req@ffff8b0e0dc23480 x1853164379483008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318387 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318387.673094:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0dc23480 x1853164379483008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318387 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318387.673119:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318387.673130:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318387.673134:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379483008:0@lo:250:kworker.0
00000100:00080000:1.0:1767318387.673311:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318387.673318:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318387.673322:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318387.673328:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3264
00000100:00080000:1.0:1767318387.673333:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318387.673340:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318387.673384:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec000 x1853164379489536/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318387.673412:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318387.673416:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318387.673418:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318387.673422:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3284
00000100:00080000:1.0:1767318387.673424:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318387.673428:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318387.673447:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec380 x1853164379489664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318387.673457:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318387.673461:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318387.673464:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318387.673468:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3284
00000100:00080000:1.0:1767318387.673471:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318387.673475:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318387.673506:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2efb80 x1853164379489792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318387.673580:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379489920:0@lo:400:kworker.0
00000100:00080000:1.0:1767318387.673591:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318387.673596:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318387.673598:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318387.673602:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3284
00000100:00080000:1.0:1767318387.673605:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318387.673609:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318387.673624:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3b80 x1853164379490304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318387.673641:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318387.673644:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318387.673646:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318387.673650:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3284
00000100:00080000:1.0:1767318387.673652:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318387.673657:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318387.673669:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc700 x1853164379490560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318387.673675:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318387.673710:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379490432:0@lo:400:kworker.0
00000100:00100000:1.0:1767318387.673750:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318387.673754:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318387.673763:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379490048:0@lo:400:kworker.0
00000100:00100000:1.0:1767318387.673777:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318387.673785:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379490176:0@lo:400:kworker.0
00000100:00100000:2.0:1767318387.673796:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318387.673815:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318387.673839:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379489920
00000100:00100000:2.0:1767318387.673848:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379489920
00000100:00100000:1.0:1767318387.673861:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490048
00000100:00100000:1.0:1767318387.673911:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490048
00000100:00100000:2.0:1767318387.673944:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135
00000100:00080000:3.0:1767318387.673948:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318387.673954:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136
00000100:00100000:2.0:1767318387.673959:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379489920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318387.673968:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379490048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318387.673990:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490432
00000100:00100000:3.0:1767318387.673996:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490432
00000100:00100000:3.0:1767318387.674046:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490176
00000100:00100000:3.0:1767318387.674050:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490176
00000100:00100000:0.0:1767318387.674076:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612
00000100:00100000:1.0:1767318387.674098:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379490048:12345-0@lo:400:kworker.0 Request processed in 134us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318387.674107:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136
00000100:00100000:1.0:1767318387.674161:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379489536:0@lo:250:kworker.0
00000400:00000100:1.0:1767318387.674194:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379489536 offset 0 length 520: 4
00000100:00100000:1.0:1767318387.674213:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379489664:0@lo:38:kworker.0
00000100:00100000:1.0:1767318387.674234:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318387.674253:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379489792:0@lo:38:kworker.0
00000100:00100000:1.0:1767318387.674280:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318387.674298:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379490304:0@lo:38:kworker.0
00000100:00100000:1.0:1767318387.674317:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318387.674333:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379490560:0@lo:38:kworker.0
00000100:00100000:1.0:1767318387.674353:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318387.674382:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379489792
00000100:00100000:1.0:1767318387.674386:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379489792
00000100:00100000:1.0:1767318387.674411:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791
00000100:00100000:1.0:1767318387.674416:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f080bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379489792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318387.674448:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318387.674486:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f080bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379489792:12345-0@lo:38:kworker.0 Request processed in 69us (205us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318387.674494:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791
00000100:00100000:1.0:1767318387.674682:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379489664
00000100:00100000:1.0:1767318387.674694:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379489664
00000100:00100000:0.0:1767318387.674726:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379490432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318387.674772:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379490432:12345-0@lo:400:kworker.0 Request processed in 50us (1021us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318387.678404:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613
00000100:00100000:3.0:1767318387.678444:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379490176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318387.678582:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379490176:12345-0@lo:400:kworker.0 Request processed in 161us (4768us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318387.678592:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613
00000100:00100000:3.0:1767318387.678633:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490304
00000100:00100000:3.0:1767318387.678642:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490304
00000100:00100000:3.0:1767318387.678663:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490560
00000100:00100000:3.0:1767318387.678667:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490560
00000100:00100000:3.0:1767318387.678679:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16117
00000100:00100000:3.0:1767318387.678684:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379490304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318387.678709:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318387.678744:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379490304:12345-0@lo:38:kworker.0 Request processed in 58us (4426us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318387.678751:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16117
00000100:00100000:3.0:1767318387.678764:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16118
00000100:00100000:3.0:1767318387.678768:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379490560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318387.678777:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318387.678804:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379490560:12345-0@lo:38:kworker.0 Request processed in 35us (4451us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318387.678810:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16118
00000100:00080000:3.0:1767318387.678840:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318387.679442:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379490048:0@lo:400:kworker.0
00000100:00100000:1.0:1767318387.679537:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16119
00000100:00100000:1.0:1767318387.679546:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379489664:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318387.679559:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318387.679609:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379489664:12345-0@lo:38:kworker.0 Request processed in 62us (5373us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318387.679616:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16119
00000100:00080000:1.0:1767318387.679664:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318387.679670:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318387.679674:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379489664:0@lo:38:kworker.0
00000100:00080000:1.0:1767318387.679688:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318387.679691:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318387.679694:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379489792:0@lo:38:kworker.0
00000100:00080000:1.0:1767318387.679705:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318387.679709:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318387.679712:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379490304:0@lo:38:kworker.0
00000100:00080000:1.0:1767318387.679721:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318387.679725:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318387.679728:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379490560:0@lo:38:kworker.0
00000100:00100000:1.0:1767318387.679793:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379490176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318387.679808:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379490432:0@lo:400:kworker.0
00000100:00100000:2.0:1767318387.681370:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379489920:12345-0@lo:400:kworker.0 Request processed in 7398us (7680us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318387.681390:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135
00000100:00100000:0.0:1767318387.681970:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612
00000100:00100000:3.0:1767318387.682398:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379489920:0@lo:400:kworker.0
00010000:00010000:0.0:1767318388.183106:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318389.207740:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318389.720974:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379490688:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318389.721060:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318389.721421:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490688
00000100:00100000:1.0:1767318389.721431:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490688
00000100:00100000:1.0:1767318389.721511:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876
00000100:00100000:1.0:1767318389.721534:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379490688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318389.721566:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318389.721643:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379490688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (583us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318389.721660:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876
00000100:00100000:2.0:1767318389.721755:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379490688:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318389.722178:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318390.231082:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318391.255340:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318391.255370:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379490816:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318391.255456:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318391.255703:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490816
00000100:00100000:2.0:1767318391.255712:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490816
00000100:00100000:2.0:1767318391.255778:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877
00000100:00100000:2.0:1767318391.255787:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379490816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318391.255817:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318391.255891:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379490816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (413us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318391.255899:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877
00000100:00100000:2.0:1767318391.255963:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379490816:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318391.256110:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318391.257166:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318391.699351:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318391.699506:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318391.699642:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858432
00000100:00100000:1.0:1767318391.699655:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858432
00000100:00100000:1.0:1767318391.699747:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858304
00000100:00100000:1.0:1767318391.699751:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858304
00000100:00100000:1.0:1767318391.699781:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3614
00000100:00100000:1.0:1767318391.699796:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291858432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318391.699958:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291858432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 166us (624us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318391.699967:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3614
00000100:00100000:1.0:1767318391.699993:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16120
00000100:00100000:1.0:1767318391.699998:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291858304:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318391.700037:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318391.700063:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291858304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 64us (559us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318391.700069:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16120
00000100:00080000:0.0:1767318391.700324:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318392.281556:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318392.791905:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318392.791918:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318392.791930:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318392.791956:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318392.791960:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318392.791968:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3290
00000100:00080000:2.0:1767318392.791973:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318392.791981:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318392.792027:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07800 x1853164379490944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318392.792052:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318392.792055:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318392.792056:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318392.792060:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3290
00000100:00080000:2.0:1767318392.792061:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318392.792064:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318392.792072:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05500 x1853164379491072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318392.792143:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318392.792147:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318392.792149:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318392.792156:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3290
00000100:00080000:2.0:1767318392.792159:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318392.792163:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318392.792176:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07abf100 x1853164379491584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318392.792194:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767318392.792198:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379490944:0@lo:38:kworker.0
00000100:00080000:2.0:1767318392.792202:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318392.792204:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318392.792207:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3290
00000100:00080000:2.0:1767318392.792209:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318392.792213:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318392.792224:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07abd500 x1853164379491840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318392.792254:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379491456:0@lo:400:kworker.0
00000100:00100000:0.0:1767318392.792285:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379491328:0@lo:400:kworker.0
00000100:00100000:1.0:1767318392.792295:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318392.792337:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379490944
00000100:00100000:0.0:1767318392.792346:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318392.792346:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379490944
00000100:00100000:1.0:1767318392.792366:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379491072:0@lo:38:kworker.0
00000100:00100000:1.0:1767318392.792396:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318392.792397:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16121
00000100:00100000:2.0:1767318392.792405:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379490944:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318392.792407:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318392.792418:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379491200:0@lo:400:kworker.0
00000100:00100000:1.0:1767318392.792431:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379491584:0@lo:38:kworker.0
00010000:00020000:2.0:1767318392.792431:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318392.792452:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318392.792465:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318392.792480:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379490944:12345-0@lo:38:kworker.0 Request processed in 75us (189us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318392.792489:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16121
00000100:00100000:2.0:1767318392.792510:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491584
00000100:00100000:1.0:1767318392.792512:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379491840:0@lo:38:kworker.0
00000100:00100000:2.0:1767318392.792513:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491584
00000100:00100000:0.0:1767318392.792515:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491072
00000100:00100000:0.0:1767318392.792520:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491072
00000100:00100000:2.0:1767318392.792534:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16122
00000100:00100000:2.0:1767318392.792540:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379491584:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318392.792546:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767318392.792550:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318392.792556:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792
00000100:00100000:0.0:1767318392.792562:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379491072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318392.792575:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318392.792586:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767318392.792586:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379491584:12345-0@lo:38:kworker.0 Request processed in 43us (120us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318392.792591:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318392.792592:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16122
00000100:00100000:1.0:1767318392.792596:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379490944:0@lo:38:kworker.0
00000100:00100000:2.0:1767318392.792605:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491840
00000100:00100000:2.0:1767318392.792613:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491840
00000100:00100000:0.0:1767318392.792617:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379491072:12345-0@lo:38:kworker.0 Request processed in 51us (217us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318392.792617:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318392.792626:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318392.792632:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792
00000100:00100000:1.0:1767318392.792635:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379491072:0@lo:38:kworker.0
00000100:00080000:1.0:1767318392.792649:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318392.792656:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318392.792660:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379491584:0@lo:38:kworker.0
00000100:00100000:3.0:1767318392.792690:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379491712:0@lo:400:kworker.0
00000100:00100000:0.0:1767318392.792691:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491328
00000100:00100000:0.0:1767318392.792699:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491328
00000100:00100000:2.0:1767318392.792724:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16123
00000100:00100000:2.0:1767318392.792732:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379491840:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318392.792744:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318392.792755:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491200
00000100:00100000:0.0:1767318392.792759:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491200
00000100:00100000:1.0:1767318392.792768:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137
00000100:00100000:1.0:1767318392.792781:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379491328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318392.792797:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318392.792805:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379491840:12345-0@lo:38:kworker.0 Request processed in 69us (255us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318392.792816:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138
00000100:00100000:2.0:1767318392.792817:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16123
00000100:00100000:0.0:1767318392.792833:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379491200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318392.792840:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491712
00000100:00100000:2.0:1767318392.792845:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491712
00000100:00100000:1.0:1767318392.792853:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379491328:12345-0@lo:400:kworker.0 Request processed in 78us (509us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318392.792861:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137
00000100:00100000:2.0:1767318392.792911:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615
00000100:00100000:2.0:1767318392.792921:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379491712:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318392.792926:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318392.792933:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318392.795797:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379491328:0@lo:400:kworker.0
00000100:00100000:0.0:1767318392.795833:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379491200:12345-0@lo:400:kworker.0 Request processed in 3004us (3378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318392.795844:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138
00000100:00100000:1.0:1767318392.795847:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379491200:0@lo:400:kworker.0
00000100:00080000:1.0:1767318392.796261:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318392.796268:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318392.796294:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379491840:0@lo:38:kworker.0
00000100:00100000:2.0:1767318392.796405:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379491712:12345-0@lo:400:kworker.0 Request processed in 3486us (3611us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318392.796416:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615
00000100:00100000:0.0:1767318392.796646:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379491712:0@lo:400:kworker.0
00000100:00100000:3.0:1767318392.803642:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318392.803914:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491456
00000100:00100000:2.0:1767318392.803925:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491456
00000100:00100000:2.0:1767318392.804015:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616
00000100:00100000:2.0:1767318392.804024:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379491456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318392.804160:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379491456:12345-0@lo:400:kworker.0 Request processed in 137us (525us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318392.804168:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616
00000100:00080000:1.0:1767318392.806070:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318392.810132:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379491456:0@lo:400:kworker.0
00010000:00010000:0.0:1767318393.304303:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318394.327123:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318394.839440:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318394.843479:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379491968:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318394.843559:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318394.843715:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379491968
00000100:00100000:1.0:1767318394.843724:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379491968
00000100:00100000:1.0:1767318394.843784:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878
00000100:00100000:1.0:1767318394.843790:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379491968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318394.843821:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318394.843891:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379491968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (331us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318394.843898:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878
00000100:00080000:0.0:1767318394.843953:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318394.844200:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379491968:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318395.351285:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318396.375231:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318396.375420:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379492096:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318396.375493:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318396.375646:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492096
00000100:00100000:2.0:1767318396.375655:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492096
00000100:00100000:2.0:1767318396.375727:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879
00000100:00100000:2.0:1767318396.375738:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379492096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318396.375768:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318396.375816:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379492096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (322us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318396.375837:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879
00000100:00080000:0.0:1767318396.376052:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318396.376088:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379492096:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318396.818516:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318396.818612:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318396.837039:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858560
00000100:00100000:0.0:1767318396.837058:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858560
00000100:00100000:0.0:1767318396.837142:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858688
00000100:00100000:0.0:1767318396.837147:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858688
00000100:00100000:0.0:1767318396.837206:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3617
00000100:00100000:0.0:1767318396.837217:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291858688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318396.837317:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291858688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (18704us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318396.837324:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3617
00000100:00100000:0.0:1767318396.837345:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16124
00000100:00100000:0.0:1767318396.837350:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291858560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318396.837371:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318396.837801:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318396.838239:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291858560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (18890us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318396.838253:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16124
00010000:00010000:1.0:1767318397.399014:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318397.911283:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318397.911293:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318397.911296:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318397.911300:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318397.911304:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318397.911313:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3295
00000100:00080000:3.0:1767318397.911317:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318397.911323:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318397.911368:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7480 x1853164379492224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318397.911443:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379492224:0@lo:38:kworker.0
00000100:00100000:2.0:1767318397.911515:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318397.912118:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318397.912122:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318397.912124:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318397.912129:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3295
00000100:00080000:3.0:1767318397.912144:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318397.912148:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318397.912165:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164379492352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318397.912339:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492224
00000100:00100000:0.0:1767318397.912346:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492224
00000100:00100000:0.0:1767318397.912385:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16125
00000100:00100000:0.0:1767318397.912393:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379492224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318397.912421:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318397.915475:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379492352:0@lo:38:kworker.0
00000100:00100000:2.0:1767318397.915555:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318397.915646:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492352
00000100:00100000:1.0:1767318397.915656:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492352
00000100:00100000:1.0:1767318397.915699:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793
00000100:00100000:1.0:1767318397.915707:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379492352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318397.915729:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318397.915771:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379492352:12345-0@lo:38:kworker.0 Request processed in 63us (215us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318397.915778:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793
00000100:00080000:3.0:1767318397.916312:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318397.916319:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318397.916322:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318397.916327:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3295
00000100:00080000:3.0:1767318397.916331:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318397.916347:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318397.916369:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4a80 x1853164379492864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318397.916562:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379492736:0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.916601:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318397.916645:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492736
00000100:00100000:1.0:1767318397.916650:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492736
00000100:00100000:1.0:1767318397.916697:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618
00000100:00100000:1.0:1767318397.916704:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379492736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.916765:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379492736:12345-0@lo:400:kworker.0 Request processed in 61us (163us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318397.916772:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618
00000100:00080000:1.0:1767318397.916792:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318397.916824:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379492736:0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.916846:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379492480:0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.916902:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318397.916923:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318397.916928:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379492608:0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.916950:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318397.916975:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492480
00000100:00100000:1.0:1767318397.916978:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492480
00000100:00100000:1.0:1767318397.917006:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492608
00000100:00100000:1.0:1767318397.917009:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492608
00000100:00100000:1.0:1767318397.917027:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139
00000100:00100000:1.0:1767318397.917034:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379492480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.917066:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379492480:12345-0@lo:400:kworker.0 Request processed in 33us (164us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318397.917073:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139
00000100:00100000:1.0:1767318397.917098:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140
00000100:00100000:1.0:1767318397.917105:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379492608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.917132:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379492608:12345-0@lo:400:kworker.0 Request processed in 28us (181us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318397.917138:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140
00000100:00080000:1.0:1767318397.917172:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318397.917187:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379492608:0@lo:400:kworker.0
00000100:00100000:1.0:1767318397.917203:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379492480:0@lo:400:kworker.0
00000100:00080000:3.0:1767318397.917323:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318397.917328:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318397.917330:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318397.917349:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3295
00000100:00080000:3.0:1767318397.917353:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318397.917357:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318397.917372:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5500 x1853164379493120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318397.917677:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318397.917686:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379492992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318397.917718:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318397.917755:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492992
00000100:00100000:3.0:1767318397.917760:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492992
00000100:00100000:3.0:1767318397.917810:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619
00000100:00100000:3.0:1767318397.917817:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379492992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318397.917854:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379492992:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318397.917860:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619
00000100:00080000:3.0:1767318397.917900:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318397.917920:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379492992:0@lo:400:kworker.0
00000100:00100000:0.0:1767318397.918927:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379492224:12345-0@lo:38:kworker.0 Request processed in 6528us (7405us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318397.918939:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16125
00000100:00080000:2.0:1767318397.919740:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318397.919747:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318397.919751:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379492224:0@lo:38:kworker.0
00000100:00100000:2.0:1767318397.919779:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379492864:0@lo:38:kworker.0
00000100:00100000:2.0:1767318397.919834:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318397.919857:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379493120:0@lo:38:kworker.0
00000100:00100000:2.0:1767318397.919991:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318397.920015:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318397.920019:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318397.920023:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379492352:0@lo:38:kworker.0
00000100:00100000:3.0:1767318397.920110:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379492864
00000100:00100000:3.0:1767318397.920117:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379492864
00000100:00100000:3.0:1767318397.920152:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379493120
00000100:00100000:3.0:1767318397.920156:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379493120
00000100:00100000:3.0:1767318397.920180:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16126
00000100:00100000:3.0:1767318397.920187:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379492864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318397.920210:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318397.920257:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379492864:12345-0@lo:38:kworker.0 Request processed in 69us (423us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318397.920263:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16126
00000100:00100000:3.0:1767318397.920276:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16127
00000100:00100000:3.0:1767318397.920280:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379493120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318397.920289:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318397.920313:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379493120:12345-0@lo:38:kworker.0 Request processed in 31us (322us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318397.920318:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16127
00000100:00080000:2.0:1767318397.920511:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318397.920516:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318397.920519:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379492864:0@lo:38:kworker.0
00000100:00080000:2.0:1767318397.920527:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318397.920530:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318397.920533:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379493120:0@lo:38:kworker.0
00010000:00010000:0.0:1767318398.423142:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318399.447264:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318399.959178:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379493248:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318399.959278:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318399.959649:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379493248
00000100:00100000:3.0:1767318399.959657:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379493248
00000100:00100000:3.0:1767318399.959725:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880
00000100:00100000:3.0:1767318399.959735:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379493248:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318399.959762:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:3.0:1767318399.959786:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318399.959848:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379493248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (570us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318399.959857:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880
00000100:00100000:2.0:1767318399.960053:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379493248:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318400.471250:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318401.495736:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318401.495759:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379493376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318401.495825:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767318401.495904:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318401.496125:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379493376
00000100:00100000:3.0:1767318401.496133:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379493376
00000100:00100000:3.0:1767318401.496193:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881
00000100:00100000:3.0:1767318401.496202:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379493376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318401.496228:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318401.496338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318401.497175:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379493376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 969us (1345us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318401.497185:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881
00000100:00100000:0.0:1767318401.500497:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379493376:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318401.937268:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318401.937363:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318401.939554:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858816
00000100:00100000:0.0:1767318401.939568:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858816
00000100:00100000:0.0:1767318401.939627:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291858944
00000100:00100000:0.0:1767318401.939632:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291858944
00000100:00100000:0.0:1767318401.939711:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3620
00000100:00100000:0.0:1767318401.939723:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291858944:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318401.939808:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291858944:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (2445us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318401.939815:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3620
00000100:00100000:0.0:1767318401.939836:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16128
00000100:00100000:0.0:1767318401.939840:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291858816:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318401.939860:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318401.939903:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291858816:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 60us (2995us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318401.939909:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16128
00000100:00080000:3.0:1767318401.940305:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318402.519484:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318403.031148:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318403.031158:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318403.031177:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318403.031181:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318403.031185:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318403.031192:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3300
00000100:00080000:0.0:1767318403.031197:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318403.031204:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318403.031240:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729e300 x1853164379493504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318403.031266:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318403.031270:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318403.031271:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318403.031275:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3300
00000100:00080000:0.0:1767318403.031277:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318403.031281:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318403.031294:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729dc00 x1853164379493632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318403.031355:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318403.031358:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318403.031360:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318403.031364:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3300
00000100:00080000:0.0:1767318403.031366:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318403.031369:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318403.031379:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e62a00 x1853164379494144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318403.031404:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318403.031406:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318403.031408:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318403.031411:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3300
00000100:00080000:0.0:1767318403.031413:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318403.031417:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318403.031426:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e60000 x1853164379494400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318403.031457:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379494272:0@lo:400:kworker.0
00000100:00100000:0.0:1767318403.031525:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318403.031586:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318403.031592:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379494016:0@lo:400:kworker.0
00000100:00100000:0.0:1767318403.031616:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318403.031707:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379493760:0@lo:400:kworker.0
00000100:00100000:3.0:1767318403.031743:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318403.031784:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318403.031789:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379493888:0@lo:400:kworker.0
00000100:00100000:3.0:1767318403.031811:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318403.031916:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379493760
00000100:00100000:1.0:1767318403.031924:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379493760
00000100:00100000:1.0:1767318403.031983:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379493888
00000100:00100000:1.0:1767318403.031986:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379493888
00000100:00100000:1.0:1767318403.032010:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141
00000100:00100000:1.0:1767318403.032019:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379493760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318403.032125:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379493760:12345-0@lo:400:kworker.0 Request processed in 108us (381us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318403.032132:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141
00000100:00100000:1.0:1767318403.032150:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142
00000100:00100000:1.0:1767318403.032155:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379493888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318403.032179:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379493888:12345-0@lo:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318403.032183:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142
00000100:00100000:1.0:1767318403.032205:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494272
00000100:00100000:1.0:1767318403.032208:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494272
00000100:00100000:1.0:1767318403.032229:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494016
00000100:00100000:1.0:1767318403.032231:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494016
00000100:00100000:1.0:1767318403.032247:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621
00000100:00100000:1.0:1767318403.032253:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379494272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318403.032293:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379494272:12345-0@lo:400:kworker.0 Request processed in 40us (768us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318403.032299:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621
00000100:00100000:1.0:1767318403.032309:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622
00000100:00100000:1.0:1767318403.032314:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379494016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318403.032336:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379494016:12345-0@lo:400:kworker.0 Request processed in 22us (719us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318403.032341:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622
00000100:00100000:1.0:1767318403.032379:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379494016:0@lo:400:kworker.0
00000100:00100000:1.0:1767318403.032390:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379494272:0@lo:400:kworker.0
00000100:00080000:3.0:1767318403.032461:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318403.032466:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318403.032467:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318403.032484:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379493888:0@lo:400:kworker.0
00000100:00100000:3.0:1767318403.032492:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379493760:0@lo:400:kworker.0
00000100:00100000:2.0:1767318403.032809:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379493504:0@lo:38:kworker.0
00000100:00100000:2.0:1767318403.032850:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318403.032906:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379493632:0@lo:38:kworker.0
00000100:00100000:2.0:1767318403.032931:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318403.032957:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379494144:0@lo:38:kworker.0
00000100:00100000:2.0:1767318403.032979:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318403.032993:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379494400:0@lo:38:kworker.0
00000100:00100000:2.0:1767318403.033013:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318403.033050:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379493504
00000100:00100000:2.0:1767318403.033055:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379493504
00000100:00100000:2.0:1767318403.033078:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494144
00000100:00100000:2.0:1767318403.033081:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494144
00000100:00100000:2.0:1767318403.033093:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494400
00000100:00100000:2.0:1767318403.033095:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494400
00000100:00100000:2.0:1767318403.033105:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16129
00000100:00100000:2.0:1767318403.033109:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379493504:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318403.033125:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318403.033161:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379493504:12345-0@lo:38:kworker.0 Request processed in 50us (309us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318403.033166:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16129
00000100:00100000:2.0:1767318403.033179:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16130
00000100:00100000:2.0:1767318403.033192:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379494144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318403.033201:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318403.033224:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379494144:12345-0@lo:38:kworker.0 Request processed in 31us (244us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318403.033229:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16130
00000100:00100000:2.0:1767318403.033240:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16131
00000100:00100000:2.0:1767318403.033244:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379494400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318403.033252:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318403.033274:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379494400:12345-0@lo:38:kworker.0 Request processed in 28us (260us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318403.033279:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16131
00000100:00080000:2.0:1767318403.033303:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318403.033308:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318403.033311:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379493504:0@lo:38:kworker.0
00000100:00080000:2.0:1767318403.033319:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318403.033322:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318403.033325:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379494144:0@lo:38:kworker.0
00000100:00080000:2.0:1767318403.033332:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318403.033335:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318403.033337:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379494400:0@lo:38:kworker.0
00000100:00100000:3.0:1767318403.033413:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379493632
00000100:00100000:3.0:1767318403.033418:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379493632
00000100:00100000:3.0:1767318403.033446:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794
00000100:00100000:3.0:1767318403.033458:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379493632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318403.033468:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318403.033505:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379493632:12345-0@lo:38:kworker.0 Request processed in 46us (572us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318403.033511:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794
00000100:00080000:3.0:1767318403.033542:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318403.033546:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318403.033549:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379493632:0@lo:38:kworker.0
00010000:00010000:1.0:1767318403.543435:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318404.567580:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318405.079359:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318405.081391:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379494528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318405.081461:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318405.081582:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494528
00000100:00100000:0.0:1767318405.081590:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494528
00000100:00100000:0.0:1767318405.081650:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882
00000100:00100000:0.0:1767318405.081659:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379494528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318405.081686:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318405.081729:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379494528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (268us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318405.081737:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882
00000100:00080000:3.0:1767318405.082020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318405.082062:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379494528:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318405.598608:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318406.615067:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318406.616621:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318406.616664:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379494656:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318406.616733:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318406.616861:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494656
00000100:00100000:2.0:1767318406.616892:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494656
00000100:00100000:2.0:1767318406.617316:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883
00000100:00100000:2.0:1767318406.617326:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379494656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318406.617370:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318406.617431:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379494656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (698us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318406.617438:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883
00000100:00100000:2.0:1767318406.617508:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379494656:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318406.618265:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318407.055411:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318407.055722:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291859200
00000100:00100000:1.0:1767318407.055733:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291859200
00000100:00100000:1.0:1767318407.055824:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3623
00000100:00080000:0.0:1767318407.055834:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318407.055835:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291859200:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318407.055952:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291859200:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (550us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318407.055960:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3623
00000100:00100000:3.0:1767318407.056773:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318407.056822:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291859072
00000100:00100000:2.0:1767318407.056828:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291859072
00000100:00100000:2.0:1767318407.056894:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16132
00000100:00100000:2.0:1767318407.056903:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291859072:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318407.056926:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318407.056968:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291859072:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 65us (198us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318407.056976:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16132
00010000:00010000:2.0:1767318407.639346:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318408.152115:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318408.152126:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318408.152148:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318408.152152:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318408.152158:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318408.152167:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3305
00000100:00080000:1.0:1767318408.152172:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318408.152179:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318408.152222:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e61500 x1853164379494784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318408.152286:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379494784:0@lo:38:kworker.0
00000100:00100000:2.0:1767318408.152361:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318408.152522:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494784
00000100:00100000:3.0:1767318408.152530:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494784
00000100:00100000:3.0:1767318408.152576:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16133
00000100:00100000:3.0:1767318408.152584:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379494784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318408.152604:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318408.152746:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318408.152751:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318408.152753:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318408.152757:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3305
00000100:00080000:1.0:1767318408.152760:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318408.152764:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318408.152781:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e60000 x1853164379494912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318408.152865:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379494912:0@lo:38:kworker.0
00000100:00100000:3.0:1767318408.153061:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379494784:12345-0@lo:38:kworker.0 Request processed in 476us (698us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318408.153070:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16133
00000100:00100000:2.0:1767318408.153151:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318408.153201:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318408.153207:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318408.153211:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379494784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318408.153285:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379494912
00000100:00100000:3.0:1767318408.153290:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379494912
00000100:00100000:3.0:1767318408.153320:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795
00000100:00100000:3.0:1767318408.153336:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379494912:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318408.153350:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318408.153469:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379494912:12345-0@lo:38:kworker.0 Request processed in 132us (316us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318408.153475:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795
00000100:00080000:0.0:1767318408.153595:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318408.153607:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318408.153611:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379494912:0@lo:38:kworker.0
00000100:00100000:0.0:1767318408.153767:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379495040:0@lo:400:kworker.0
00000100:00100000:0.0:1767318408.153943:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318408.154103:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379495168:0@lo:400:kworker.0
00000100:00100000:3.0:1767318408.154132:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318408.154241:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318408.154245:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318408.154248:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318408.154252:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3305
00000100:00080000:1.0:1767318408.154255:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318408.154260:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318408.154278:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4000 x1853164379495424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318408.154316:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318408.154319:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318408.154321:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318408.154325:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3305
00000100:00080000:1.0:1767318408.154327:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318408.154331:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318408.154344:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e2680 x1853164379495680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318408.154369:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379495552:0@lo:400:kworker.0
00000100:00100000:1.0:1767318408.154399:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318408.154422:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318408.154427:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379495296:0@lo:400:kworker.0
00000100:00100000:1.0:1767318408.154447:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318408.154472:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495552
00000100:00100000:1.0:1767318408.154477:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495552
00000100:00100000:0.0:1767318408.154594:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379495424:0@lo:38:kworker.0
00000100:00100000:0.0:1767318408.154627:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318408.154645:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379495680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318408.154665:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318408.154706:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495296
00000100:00100000:0.0:1767318408.154710:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495296
00000100:00100000:0.0:1767318408.154749:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495424
00000100:00100000:0.0:1767318408.154752:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495424
00000100:00100000:0.0:1767318408.154765:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495680
00000100:00100000:0.0:1767318408.154767:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495680
00000100:00100000:0.0:1767318408.154778:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624
00000100:00100000:0.0:1767318408.154785:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379495296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318408.154842:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379495296:12345-0@lo:400:kworker.0 Request processed in 57us (393us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318408.154849:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624
00000100:00100000:0.0:1767318408.154864:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16134
00000100:00100000:0.0:1767318408.154886:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379495424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318408.154899:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318408.154929:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379495424:12345-0@lo:38:kworker.0 Request processed in 59us (302us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318408.154935:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16134
00000100:00100000:0.0:1767318408.154948:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16135
00000100:00100000:0.0:1767318408.154958:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379495680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318408.154969:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318408.155004:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379495680:12345-0@lo:38:kworker.0 Request processed in 44us (338us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318408.155010:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16135
00000100:00080000:0.0:1767318408.155029:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318408.155053:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379495296:0@lo:400:kworker.0
00000100:00080000:0.0:1767318408.155075:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318408.155079:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318408.155082:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379495424:0@lo:38:kworker.0
00000100:00080000:0.0:1767318408.155089:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318408.155092:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318408.155095:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379495680:0@lo:38:kworker.0
00000100:00100000:1.0:1767318408.155374:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625
00000100:00100000:1.0:1767318408.155381:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379495552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318408.155417:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379495552:12345-0@lo:400:kworker.0 Request processed in 37us (1017us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318408.155424:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625
00000100:00100000:1.0:1767318408.155455:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379495552:0@lo:400:kworker.0
00000100:00080000:0.0:1767318408.155654:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318408.155735:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495040
00000100:00100000:2.0:1767318408.155741:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495040
00000100:00100000:2.0:1767318408.155794:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495168
00000100:00100000:2.0:1767318408.155799:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495168
00000100:00100000:2.0:1767318408.155822:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143
00000100:00100000:2.0:1767318408.155829:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379495040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318408.155884:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379495040:12345-0@lo:400:kworker.0 Request processed in 41us (1926us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318408.155891:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143
00000100:00100000:2.0:1767318408.155906:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144
00000100:00100000:2.0:1767318408.155912:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379495168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318408.155944:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379495168:12345-0@lo:400:kworker.0 Request processed in 32us (1811us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318408.155949:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144
00000100:00100000:2.0:1767318408.155977:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379495040:0@lo:400:kworker.0
00000100:00100000:3.0:1767318408.156091:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379495168:0@lo:400:kworker.0
00000100:00080000:0.0:1767318408.156146:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318408.156150:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318408.663564:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318409.689615:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318410.199292:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318410.199311:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379495808:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318410.199380:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318410.199506:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495808
00000100:00100000:0.0:1767318410.199515:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495808
00000100:00100000:0.0:1767318410.199582:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884
00000100:00100000:0.0:1767318410.199591:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379495808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318410.199617:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318410.199676:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379495808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (294us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318410.199683:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884
00000100:00100000:0.0:1767318410.199728:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379495808:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318410.200247:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318410.711084:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318411.736082:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318411.738355:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379495936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318411.738443:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318411.738763:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379495936
00000100:00100000:2.0:1767318411.738773:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379495936
00000100:00100000:2.0:1767318411.738846:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885
00000100:00100000:2.0:1767318411.738856:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379495936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318411.738913:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318411.738997:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318411.742820:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379495936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3955us (4365us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318411.742834:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885
00000100:00100000:0.0:1767318411.743214:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379495936:0@lo:13:osp-pre-0-1.0
00000400:00000100:2.0:1767318412.181720:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291859328 offset 0 length 520: 4
00000100:00100000:2.0:1767318412.181768:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318412.181832:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318412.183914:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291859584
00000100:00100000:0.0:1767318412.183930:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291859584
00000100:00100000:0.0:1767318412.184036:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3626
00000100:00100000:0.0:1767318412.184048:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291859584:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318412.184133:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291859584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (2364us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318412.184142:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3626
00000100:00100000:0.0:1767318412.184161:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291859456
00000100:00100000:0.0:1767318412.184165:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291859456
00000100:00100000:0.0:1767318412.184183:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16136
00000100:00100000:0.0:1767318412.184188:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291859456:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318412.184208:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318412.184231:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291859456:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 42us (2399us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318412.184238:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16136
00000100:00080000:2.0:1767318412.186102:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318412.254437:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318387/real 1767318387]  req@ffff8b0e0a2ec000 x1853164379489536/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318412.254473:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0a2ec000 x1853164379489536/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318412.254493:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318412.254524:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318412.254528:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379489536:0@lo:250:kworker.0
00000100:00080000:3.0:1767318412.255921:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318412.255929:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318412.255933:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318412.255938:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3290
00000100:00080000:3.0:1767318412.255943:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318412.255957:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318412.255991:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164379496064/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318412.256011:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318412.256014:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318412.256016:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318412.256019:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3310
00000100:00080000:3.0:1767318412.256021:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318412.256024:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318412.256056:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729e300 x1853164379496192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318412.256065:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318412.256069:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318412.256070:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318412.256074:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3310
00000100:00080000:3.0:1767318412.256076:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318412.256080:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318412.256091:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ce00 x1853164379496320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318412.256138:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318412.256142:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318412.256143:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318412.256147:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3310
00000100:00080000:3.0:1767318412.256149:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318412.256152:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318412.256162:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79f80 x1853164379496704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318412.256186:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318412.256190:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318412.256191:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318412.256195:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3310
00000100:00080000:3.0:1767318412.256197:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318412.256201:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318412.256217:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7aa00 x1853164379496960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318412.256247:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379496576:0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256307:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318412.256375:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318412.256381:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379496448:0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256407:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318412.256452:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379496832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256476:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318412.256533:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379496576
00000100:00100000:3.0:1767318412.256541:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379496576
00000100:00100000:3.0:1767318412.256593:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379496832
00000100:00100000:3.0:1767318412.256597:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379496832
00000100:00100000:3.0:1767318412.256629:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627
00000100:00100000:3.0:1767318412.256638:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379496576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256684:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379496576:12345-0@lo:400:kworker.0 Request processed in 47us (376us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318412.256692:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627
00000100:00100000:3.0:1767318412.256706:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628
00000100:00100000:3.0:1767318412.256710:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379496832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256732:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379496832:12345-0@lo:400:kworker.0 Request processed in 22us (256us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318412.256737:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628
00000100:00100000:3.0:1767318412.256754:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379496448
00000100:00100000:3.0:1767318412.256756:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379496448
00000100:00100000:3.0:1767318412.256777:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145
00000100:00100000:3.0:1767318412.256782:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379496448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256812:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379496448:12345-0@lo:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318412.256818:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145
00000100:00100000:3.0:1767318412.256894:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379496832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256919:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379496448:0@lo:400:kworker.0
00000100:00100000:3.0:1767318412.256927:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379496576:0@lo:400:kworker.0
00000100:00080000:2.0:1767318412.257504:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318412.257510:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318412.258419:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379496064:0@lo:250:kworker.0
00000400:00000100:0.0:1767318412.258472:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379496064 offset 0 length 520: 4
00000100:00100000:0.0:1767318412.258507:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379496192:0@lo:38:kworker.0
00000100:00100000:0.0:1767318412.258538:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318412.258561:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379496320:0@lo:38:kworker.0
00000100:00100000:0.0:1767318412.258594:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318412.258701:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379496320
00000100:00100000:2.0:1767318412.258707:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379496320
00000100:00100000:2.0:1767318412.258745:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796
00000100:00100000:2.0:1767318412.258752:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379496320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318412.258771:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318412.258829:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379496192
00000100:00100000:3.0:1767318412.258833:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379496192
00000100:00100000:3.0:1767318412.258852:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16137
00000100:00100000:3.0:1767318412.258856:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379496192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318412.258866:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318412.264082:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379496320:12345-0@lo:38:kworker.0 Request processed in 5319us (5476us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318412.264098:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796
00000100:00100000:3.0:1767318412.264339:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379496192:12345-0@lo:38:kworker.0 Request processed in 5480us (5799us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318412.264349:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16137
00000100:00080000:0.0:1767318412.274111:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318412.274123:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318412.274128:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379496320:0@lo:38:kworker.0
00000100:00100000:0.0:1767318412.274141:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379496704:0@lo:38:kworker.0
00000100:00100000:0.0:1767318412.274199:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318412.274229:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379496960:0@lo:38:kworker.0
00000100:00100000:0.0:1767318412.274254:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318412.274445:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318412.274451:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318412.274454:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379496192:0@lo:38:kworker.0
00000100:00100000:1.0:1767318412.278191:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379496704
00000100:00100000:1.0:1767318412.278208:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379496704
00000100:00100000:1.0:1767318412.278256:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379496960
00000100:00100000:1.0:1767318412.278261:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379496960
00000100:00100000:1.0:1767318412.278291:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16138
00000100:00100000:1.0:1767318412.278300:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379496704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318412.278338:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318412.278427:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379496704:12345-0@lo:38:kworker.0 Request processed in 127us (4226us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318412.278434:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16138
00000100:00100000:1.0:1767318412.278466:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16139
00000100:00100000:1.0:1767318412.278471:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379496960:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318412.278490:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318412.278525:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379496960:12345-0@lo:38:kworker.0 Request processed in 44us (4261us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318412.278532:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16139
00000100:00080000:0.0:1767318412.279791:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318412.279801:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318412.279806:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379496704:0@lo:38:kworker.0
00000100:00080000:0.0:1767318412.279818:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318412.279821:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318412.279824:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379496960:0@lo:38:kworker.0
00010000:00010000:0.0:1767318412.759017:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318413.784563:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318414.807167:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318415.319181:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318415.319206:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379497088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318415.319278:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318415.319518:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497088
00000100:00100000:2.0:1767318415.319526:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497088
00000100:00100000:2.0:1767318415.319595:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886
00000100:00100000:2.0:1767318415.319604:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e09044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379497088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318415.319631:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318415.319679:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e09044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379497088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (400us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318415.319686:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886
00000100:00100000:2.0:1767318415.319733:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379497088:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318415.320243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318415.833544:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318416.857404:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318416.857516:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318416.857808:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379497216:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318416.857920:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318416.858056:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497216
00000100:00100000:1.0:1767318416.858066:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497216
00000100:00080000:0.0:1767318416.858165:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318416.862343:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887
00000100:00100000:1.0:1767318416.862368:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379497216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318416.862405:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318416.862990:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379497216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 634us (5068us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318416.862999:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887
00000100:00100000:0.0:1767318416.865127:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379497216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318417.303390:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318417.303514:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291859840
00000100:00100000:1.0:1767318417.303524:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291859840
00000100:00100000:1.0:1767318417.303626:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3629
00000100:00100000:1.0:1767318417.303638:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291859840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318417.303712:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291859840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 77us (334us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318417.303720:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3629
00000100:00080000:2.0:1767318417.303809:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318417.308362:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318417.308525:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291859712
00000100:00100000:3.0:1767318417.308536:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291859712
00000100:00100000:3.0:1767318417.308605:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16140
00000100:00100000:3.0:1767318417.308618:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291859712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318417.308642:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318417.308715:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291859712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 100us (361us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318417.308723:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16140
00000100:00080000:1.0:1767318417.368819:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318417.368828:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318417.368831:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318417.368835:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318417.368839:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318417.368846:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3314
00000100:00080000:1.0:1767318417.368851:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318417.368858:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318417.368950:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e2680 x1853164379497344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318417.368973:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318417.368976:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318417.368988:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318417.368992:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3314
00000100:00080000:1.0:1767318417.368994:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318417.368998:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318417.369014:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3480 x1853164379497472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318417.369089:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318417.369105:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318417.369108:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318417.369112:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3314
00000100:00080000:1.0:1767318417.369114:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318417.369118:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318417.369132:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44000 x1853164379497856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318417.369137:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318417.369160:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379497600:0@lo:400:kworker.0
00000100:00080000:1.0:1767318417.369164:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318417.369169:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318417.369171:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318417.369174:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3314
00000100:00080000:1.0:1767318417.369177:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318417.369181:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318417.369192:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164379498112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318417.369220:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379497728:0@lo:400:kworker.0
00000100:00100000:2.0:1767318417.369239:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318417.369257:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318417.369326:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497600
00000100:00100000:2.0:1767318417.369334:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497600
00000100:00100000:3.0:1767318417.369350:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379497984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318417.369404:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318417.369406:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146
00000100:00100000:2.0:1767318417.369419:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379497600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318417.369454:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497728
00000100:00100000:3.0:1767318417.369459:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497728
00000100:00100000:2.0:1767318417.369486:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379497600:12345-0@lo:400:kworker.0 Request processed in 57us (235us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318417.369492:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497984
00000100:00100000:2.0:1767318417.369496:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146
00000100:00100000:3.0:1767318417.369498:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497984
00000100:00080000:2.0:1767318417.369526:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318417.369530:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630
00000100:00080000:2.0:1767318417.369532:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318417.369540:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379497728:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318417.369561:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379497600:0@lo:400:kworker.0
00000100:00100000:3.0:1767318417.369581:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379497728:12345-0@lo:400:kworker.0 Request processed in 42us (323us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318417.369589:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630
00000100:00100000:2.0:1767318417.369601:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631
00000100:00100000:2.0:1767318417.369619:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379497984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318417.369657:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379497984:12345-0@lo:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318417.369663:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631
00000100:00100000:3.0:1767318417.369692:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379497984:0@lo:400:kworker.0
00000100:00100000:0.0:1767318417.373263:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379497344:0@lo:38:kworker.0
00000100:00100000:0.0:1767318417.373340:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318417.373370:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379497472:0@lo:38:kworker.0
00000100:00100000:0.0:1767318417.373399:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318417.373426:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379497856:0@lo:38:kworker.0
00000100:00100000:0.0:1767318417.373445:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318417.373463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379498112:0@lo:38:kworker.0
00000100:00100000:0.0:1767318417.373482:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318417.373513:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497472
00000100:00100000:0.0:1767318417.373521:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497472
00000100:00100000:3.0:1767318417.373523:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497344
00000100:00100000:3.0:1767318417.373526:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497344
00000100:00100000:3.0:1767318417.373552:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379497856
00000100:00100000:3.0:1767318417.373554:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379497856
00000100:00100000:0.0:1767318417.373557:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797
00000100:00100000:3.0:1767318417.373567:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379498112
00000100:00100000:3.0:1767318417.373570:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379498112
00000100:00100000:0.0:1767318417.373577:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379497472:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318417.373583:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16141
00000100:00100000:3.0:1767318417.373588:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379497344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318417.373598:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767318417.373598:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318417.373641:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379497344:12345-0@lo:38:kworker.0 Request processed in 51us (301us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318417.373648:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16141
00000100:00100000:3.0:1767318417.373674:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16142
00000100:00100000:3.0:1767318417.373678:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379497856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318417.373686:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318417.373738:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16143
00000100:00100000:2.0:1767318417.373744:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379498112:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318417.373753:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318417.374412:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379497728:0@lo:400:kworker.0
00000100:00100000:0.0:1767318417.374797:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379497472:12345-0@lo:38:kworker.0 Request processed in 1217us (1395us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318417.374805:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797
00000100:00100000:3.0:1767318417.374920:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379497856:12345-0@lo:38:kworker.0 Request processed in 1238us (1471us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318417.374944:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16142
00000100:00100000:2.0:1767318417.378817:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379498112:12345-0@lo:38:kworker.0 Request processed in 5061us (5323us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318417.378833:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16143
00000100:00080000:1.0:1767318417.379928:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318417.379938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318417.379942:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379497344:0@lo:38:kworker.0
00000100:00080000:1.0:1767318417.379965:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318417.379968:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318417.379971:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379497472:0@lo:38:kworker.0
00000100:00080000:1.0:1767318417.380011:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318417.380014:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318417.380017:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379497856:0@lo:38:kworker.0
00000100:00080000:1.0:1767318417.380026:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318417.380029:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318417.380032:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379498112:0@lo:38:kworker.0
00010000:00010000:1.0:1767318417.879114:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318418.903220:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318419.928027:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318420.440643:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318420.440663:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379498240:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318420.440730:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318420.440967:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379498240
00000100:00100000:1.0:1767318420.440977:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379498240
00000100:00100000:1.0:1767318420.441042:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888
00000100:00100000:1.0:1767318420.441051:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379498240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318420.441078:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318420.441121:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379498240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (391us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318420.441128:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888
00000100:00080000:2.0:1767318420.441240:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318420.441416:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379498240:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318420.951673:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318421.986634:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318421.989711:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379498368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318421.989810:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318421.990216:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379498368
00000100:00100000:3.0:1767318421.990225:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379498368
00000100:00080000:0.0:1767318421.990296:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318421.990307:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889
00000100:00100000:3.0:1767318421.990319:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379498368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318421.990348:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318421.990405:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379498368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (595us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318421.990413:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889
00000100:00100000:0.0:1767318421.990435:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379498368:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318422.417778:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318422.417830:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318422.417975:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291860096
00000100:00100000:3.0:1767318422.417985:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291860096
00000100:00100000:3.0:1767318422.418054:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291859968
00000100:00100000:3.0:1767318422.418058:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291859968
00000100:00100000:3.0:1767318422.418079:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3632
00000100:00080000:2.0:1767318422.418191:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318422.418230:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291860096:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318422.418617:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291860096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 529us (848us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318422.418626:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3632
00000100:00100000:3.0:1767318422.418646:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16144
00000100:00100000:3.0:1767318422.418651:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291859968:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318422.418672:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318422.418714:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291859968:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 61us (883us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318422.418720:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16144
00000100:00080000:2.0:1767318422.487120:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318422.487130:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318422.487133:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318422.487137:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318422.487141:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318422.487148:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3319
00000100:00080000:2.0:1767318422.487153:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318422.487160:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318422.487310:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e86680 x1853164379498496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318422.487373:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379498496:0@lo:38:kworker.0
00000100:00100000:1.0:1767318422.487460:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318422.487798:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318422.487803:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318422.487805:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318422.487809:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3319
00000100:00080000:2.0:1767318422.487812:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318422.487817:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318422.487834:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e84380 x1853164379498624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318422.488146:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379498496
00000100:00100000:0.0:1767318422.488156:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379498496
00000100:00100000:0.0:1767318422.488208:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16145
00000100:00100000:0.0:1767318422.488215:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379498496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318422.488248:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318422.493387:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379498624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318422.493474:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318422.493716:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318422.493721:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318422.493725:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318422.493730:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3319
00000100:00080000:2.0:1767318422.493734:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318422.493739:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318422.493762:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e84a80 x1853164379499008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318422.493793:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318422.493796:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318422.493798:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318422.493801:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3319
00000100:00080000:2.0:1767318422.493804:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318422.493808:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318422.493819:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e85c00 x1853164379499264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318422.493847:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379498880:0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.493908:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.493935:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318422.493941:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379498752:0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.493966:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.493988:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318422.493997:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379499136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.494019:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318422.494047:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379498752
00000100:00100000:2.0:1767318422.494054:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379498752
00000100:00100000:2.0:1767318422.494113:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147
00000100:00100000:2.0:1767318422.494122:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379498752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.494171:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379498752:12345-0@lo:400:kworker.0 Request processed in 50us (204us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318422.494178:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147
00000100:00080000:2.0:1767318422.494200:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318422.494248:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379498752:0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.494285:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379498880
00000100:00100000:2.0:1767318422.494289:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379498880
00000100:00100000:2.0:1767318422.494319:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499136
00000100:00100000:2.0:1767318422.494323:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499136
00000100:00100000:2.0:1767318422.494343:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633
00000100:00100000:2.0:1767318422.494348:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379498880:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.494385:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379498880:12345-0@lo:400:kworker.0 Request processed in 36us (476us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318422.494391:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633
00000100:00100000:2.0:1767318422.494404:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634
00000100:00100000:2.0:1767318422.494411:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379499136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.494441:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379499136:12345-0@lo:400:kworker.0 Request processed in 31us (421us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318422.494447:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634
00000100:00080000:2.0:1767318422.494462:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318422.494478:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379499136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318422.494498:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379498880:0@lo:400:kworker.0
00000100:00100000:3.0:1767318422.497394:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379498624
00000100:00100000:3.0:1767318422.497410:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379498624
00000100:00100000:3.0:1767318422.497477:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798
00000100:00100000:3.0:1767318422.497486:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379498624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318422.497513:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318422.497761:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379498624:12345-0@lo:38:kworker.0 Request processed in 275us (4286us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318422.497768:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798
00000100:00100000:0.0:1767318422.498127:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379498496:12345-0@lo:38:kworker.0 Request processed in 9909us (10664us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318422.498136:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16145
00000100:00080000:1.0:1767318422.499147:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318422.499155:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318422.499159:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379498496:0@lo:38:kworker.0
00000100:00100000:1.0:1767318422.499190:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379499008:0@lo:38:kworker.0
00000100:00100000:1.0:1767318422.499270:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318422.499305:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379499264:0@lo:38:kworker.0
00000100:00100000:0.0:1767318422.499328:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499008
00000100:00100000:1.0:1767318422.499335:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318422.499338:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499008
00000100:00080000:1.0:1767318422.499374:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318422.499383:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318422.499387:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379498624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318422.499427:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499264
00000100:00100000:0.0:1767318422.499432:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499264
00000100:00100000:3.0:1767318422.499465:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16146
00000100:00100000:3.0:1767318422.499473:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379499008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318422.499491:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318422.499564:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379499008:12345-0@lo:38:kworker.0 Request processed in 91us (294us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318422.499572:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16146
00000100:00100000:3.0:1767318422.499591:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16147
00000100:00100000:3.0:1767318422.499595:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379499264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318422.499605:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318422.499630:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3963d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379499264:12345-0@lo:38:kworker.0 Request processed in 33us (296us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318422.499635:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16147
00000100:00080000:1.0:1767318422.499712:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318422.499717:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318422.499721:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379499008:0@lo:38:kworker.0
00000100:00080000:1.0:1767318422.499731:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318422.499734:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318422.499737:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379499264:0@lo:38:kworker.0
00010000:00010000:0.0:1767318422.999153:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318424.023150:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318425.047003:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318425.559317:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318425.559333:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379499392:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318425.559413:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318425.559536:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499392
00000100:00100000:1.0:1767318425.559546:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499392
00000100:00100000:1.0:1767318425.559605:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890
00000100:00100000:1.0:1767318425.559615:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379499392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318425.559656:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318425.559697:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379499392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318425.559703:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890
00000100:00100000:0.0:1767318425.559949:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379499392:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318425.561129:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318426.071170:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318427.097040:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318427.097909:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379499520:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318427.098008:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318427.098080:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499520
00000100:00100000:1.0:1767318427.098089:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499520
00000100:00080000:2.0:1767318427.098139:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318427.098162:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891
00000100:00100000:1.0:1767318427.098171:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379499520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318427.098210:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318427.098270:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379499520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (261us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318427.098277:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891
00000100:00100000:2.0:1767318427.098623:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379499520:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318427.539316:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318427.539506:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318427.551632:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291860352
00000100:00100000:2.0:1767318427.551649:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291860352
00000100:00100000:2.0:1767318427.551776:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291860224
00000100:00100000:2.0:1767318427.551781:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291860224
00000100:00100000:2.0:1767318427.551806:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3635
00000100:00100000:2.0:1767318427.551848:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291860352:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318427.551950:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291860352:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (12643us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318427.551959:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3635
00000100:00100000:2.0:1767318427.551979:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16148
00000100:00100000:2.0:1767318427.551984:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291860224:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318427.552004:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318427.552029:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291860224:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (12524us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318427.552035:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16148
00000100:00080000:0.0:1767318427.556491:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318427.607528:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318427.607538:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318427.607541:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318427.607544:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318427.607547:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318427.607553:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3324
00000100:00080000:1.0:1767318427.607556:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318427.607562:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318427.607602:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570e00 x1853164379499648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318427.607631:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318427.607634:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318427.607636:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318427.607640:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3324
00000100:00080000:1.0:1767318427.607642:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318427.607646:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318427.607682:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06309180 x1853164379499776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318427.607744:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318427.607747:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318427.607755:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318427.607759:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3324
00000100:00080000:1.0:1767318427.607761:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318427.607765:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318427.607776:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0630bb80 x1853164379500288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318427.607793:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318427.607795:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318427.607797:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318427.607800:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3324
00000100:00080000:1.0:1767318427.607802:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318427.607806:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318427.607827:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06308380 x1853164379500544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318427.607858:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379500416:0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.607899:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379499904:0@lo:400:kworker.0
00000100:00100000:1.0:1767318427.607933:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318427.607933:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318427.607986:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379499648:0@lo:38:kworker.0
00000100:00100000:2.0:1767318427.608065:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499904
00000100:00100000:2.0:1767318427.608073:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499904
00000100:00100000:3.0:1767318427.608090:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379500160:0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.608113:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318427.608127:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148
00000100:00100000:3.0:1767318427.608133:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318427.608135:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379499904:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.608137:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379500032:0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.608157:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318427.608185:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500416
00000100:00100000:3.0:1767318427.608188:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500416
00000100:00100000:2.0:1767318427.608213:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379499904:12345-0@lo:400:kworker.0 Request processed in 79us (280us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318427.608214:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500160
00000100:00100000:3.0:1767318427.608217:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500160
00000100:00100000:2.0:1767318427.608220:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148
00000100:00100000:3.0:1767318427.608235:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636
00000100:00100000:3.0:1767318427.608241:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379500416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318427.608245:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500032
00000100:00100000:2.0:1767318427.608247:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500032
00000100:00100000:2.0:1767318427.608267:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149
00000100:00100000:3.0:1767318427.608271:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379500416:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318427.608273:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379500032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.608277:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636
00000100:00100000:3.0:1767318427.608289:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637
00000100:00100000:3.0:1767318427.608294:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379500160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318427.608301:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379500032:12345-0@lo:400:kworker.0 Request processed in 28us (144us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318427.608307:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149
00000100:00100000:3.0:1767318427.608334:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379500160:12345-0@lo:400:kworker.0 Request processed in 40us (220us total) trans 0 rc 0/0
00000100:00080000:2.0:1767318427.608340:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318427.608340:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637
00000100:00080000:2.0:1767318427.608345:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318427.608372:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379500032:0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.608372:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379499904:0@lo:400:kworker.0
00000100:00100000:2.0:1767318427.608381:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379500160:0@lo:400:kworker.0
00000100:00100000:0.0:1767318427.612822:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318427.612911:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379499776:0@lo:38:kworker.0
00000100:00100000:0.0:1767318427.612957:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318427.613006:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379500288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318427.613038:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318427.613057:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379500544:0@lo:38:kworker.0
00000100:00100000:0.0:1767318427.613070:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318427.613107:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499648
00000100:00100000:0.0:1767318427.613113:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499648
00000100:00100000:0.0:1767318427.613135:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500288
00000100:00100000:0.0:1767318427.613137:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500288
00000100:00100000:0.0:1767318427.613143:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500544
00000100:00100000:0.0:1767318427.613145:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500544
00000100:00100000:0.0:1767318427.613162:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16149
00000100:00100000:0.0:1767318427.613166:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379499648:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318427.613192:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318427.613228:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379499648:12345-0@lo:38:kworker.0 Request processed in 59us (423us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318427.613235:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16149
00000100:00100000:0.0:1767318427.613251:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16150
00000100:00100000:0.0:1767318427.613255:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379500288:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318427.613264:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318427.613285:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379500288:12345-0@lo:38:kworker.0 Request processed in 29us (246us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318427.613291:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16150
00000100:00100000:0.0:1767318427.613302:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16151
00000100:00100000:0.0:1767318427.613306:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379500544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318427.613325:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318427.613350:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379500544:12345-0@lo:38:kworker.0 Request processed in 42us (278us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318427.613355:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16151
00000100:00080000:0.0:1767318427.613393:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318427.613397:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318427.613401:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379499648:0@lo:38:kworker.0
00000100:00080000:0.0:1767318427.613410:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318427.613413:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318427.613416:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379500288:0@lo:38:kworker.0
00000100:00080000:0.0:1767318427.613423:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318427.613426:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318427.613428:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379500544:0@lo:38:kworker.0
00000100:00100000:1.0:1767318427.613691:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379500416:0@lo:400:kworker.0
00000100:00100000:3.0:1767318427.616716:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379499776
00000100:00100000:3.0:1767318427.616731:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379499776
00000100:00100000:3.0:1767318427.616791:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799
00000100:00100000:3.0:1767318427.616800:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379499776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318427.616833:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318427.616955:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379499776:12345-0@lo:38:kworker.0 Request processed in 155us (3997us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318427.616977:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799
00000100:00080000:1.0:1767318427.617063:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318427.617068:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318427.617071:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379499776:0@lo:38:kworker.0
00010000:00010000:2.0:1767318428.119389:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318429.143207:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318430.167375:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318430.679094:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318430.679115:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379500672:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318430.679184:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318430.679289:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500672
00000100:00100000:1.0:1767318430.679297:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500672
00000100:00100000:1.0:1767318430.679353:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892
00000100:00100000:1.0:1767318430.679362:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379500672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318430.679400:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318430.679439:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379500672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (255us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318430.679446:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892
00000100:00080000:2.0:1767318430.679663:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318430.679768:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379500672:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318431.191384:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318432.215035:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318432.215213:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379500800:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318432.215292:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318432.215428:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500800
00000100:00100000:1.0:1767318432.215437:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500800
00000100:00100000:1.0:1767318432.215504:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893
00000100:00100000:1.0:1767318432.215514:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379500800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318432.215543:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318432.215583:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379500800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (290us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318432.215590:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893
00000100:00100000:0.0:1767318432.215838:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379500800:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318432.216157:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318432.660634:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318432.660686:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318432.660798:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291860608
00000100:00100000:3.0:1767318432.660809:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291860608
00000100:00100000:3.0:1767318432.660908:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291860480
00000100:00100000:3.0:1767318432.660912:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291860480
00000100:00100000:3.0:1767318432.660932:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3638
00000100:00100000:3.0:1767318432.660943:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291860608:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318432.661370:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16152
00000100:00100000:1.0:1767318432.661377:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291860480:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318432.661396:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318432.661454:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291860608:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 512us (831us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318432.661462:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3638
00000100:00080000:2.0:1767318432.661530:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318432.666471:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291860480:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 5078us (5769us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318432.666484:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16152
00000100:00080000:1.0:1767318432.727178:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318432.727189:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318432.727192:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318432.727196:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318432.727200:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318432.727208:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3330
00000100:00080000:1.0:1767318432.727233:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318432.727240:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318432.727275:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0630a680 x1853164379500928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318432.727306:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318432.727309:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318432.727311:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318432.727315:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3330
00000100:00080000:1.0:1767318432.727317:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318432.727321:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318432.727335:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06308e00 x1853164379501056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318432.727403:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318432.727406:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318432.727408:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318432.727411:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3330
00000100:00080000:1.0:1767318432.727413:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318432.727416:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318432.727425:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0630aa00 x1853164379501568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318432.727439:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318432.727442:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318432.727444:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318432.727446:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3330
00000100:00080000:1.0:1767318432.727453:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318432.727457:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318432.727472:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06308700 x1853164379501824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318432.727499:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379501312:0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.727565:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318432.727630:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318432.727637:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379501440:0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.727663:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318432.727698:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501312
00000100:00100000:1.0:1767318432.727706:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501312
00000100:00100000:1.0:1767318432.727756:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150
00000100:00100000:1.0:1767318432.727797:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379501312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.727846:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06309880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379501312:12345-0@lo:400:kworker.0 Request processed in 82us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318432.727854:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150
00000100:00100000:1.0:1767318432.727928:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379501312:0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.727951:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501440
00000100:00100000:1.0:1767318432.727954:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501440
00000100:00100000:1.0:1767318432.727991:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3639
00000100:00100000:1.0:1767318432.728000:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379501440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318432.728065:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379501184:0@lo:400:kworker.0
00000100:00100000:3.0:1767318432.728154:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318432.728260:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379500928:0@lo:38:kworker.0
00000100:00100000:0.0:1767318432.728323:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379501696:0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.737802:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379501440:12345-0@lo:400:kworker.0 Request processed in 9792us (10126us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318432.737819:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3639
00000100:00080000:1.0:1767318432.737886:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318432.737943:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379501440:0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.738039:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501184
00000100:00100000:1.0:1767318432.738046:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501184
00000100:00100000:1.0:1767318432.738096:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151
00000100:00100000:1.0:1767318432.738104:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379501184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.738190:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379501184:12345-0@lo:400:kworker.0 Request processed in 87us (10038us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318432.738196:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151
00000100:00080000:1.0:1767318432.738210:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318432.740166:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379501184:0@lo:400:kworker.0
00000100:00100000:2.0:1767318432.747255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318432.747313:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379501056:0@lo:38:kworker.0
00000100:00100000:2.0:1767318432.747355:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318432.747401:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379501568:0@lo:38:kworker.0
00000100:00100000:2.0:1767318432.747423:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318432.747444:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379501824:0@lo:38:kworker.0
00000100:00100000:2.0:1767318432.747465:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318432.747692:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501568
00000100:00100000:1.0:1767318432.747700:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501568
00000100:00100000:1.0:1767318432.747732:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501824
00000100:00100000:1.0:1767318432.747735:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501824
00000100:00100000:1.0:1767318432.747753:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16153
00000100:00100000:1.0:1767318432.747769:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379501568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318432.747793:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318432.747841:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379501568:12345-0@lo:38:kworker.0 Request processed in 80us (416us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318432.747849:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16153
00000100:00100000:1.0:1767318432.747887:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16154
00000100:00100000:1.0:1767318432.747891:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379501824:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318432.747901:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318432.747925:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379501824:12345-0@lo:38:kworker.0 Request processed in 32us (458us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318432.747930:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16154
00000100:00100000:2.0:1767318432.748311:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379500928
00000100:00100000:2.0:1767318432.748317:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379500928
00000100:00100000:3.0:1767318432.748415:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501056
00000100:00100000:3.0:1767318432.748420:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501056
00000100:00100000:3.0:1767318432.748444:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800
00000100:00100000:3.0:1767318432.748449:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379501056:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318432.748460:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318432.748498:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379501056:12345-0@lo:38:kworker.0 Request processed in 47us (1142us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318432.748504:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800
00000100:00100000:2.0:1767318432.748546:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16155
00000100:00100000:2.0:1767318432.748551:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379500928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318432.748561:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318432.748589:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379500928:12345-0@lo:38:kworker.0 Request processed in 37us (1343us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318432.748595:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16155
00000100:00100000:0.0:1767318432.748664:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318432.772997:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501696
00000100:00100000:1.0:1767318432.773025:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501696
00000100:00100000:1.0:1767318432.773121:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3640
00000100:00100000:1.0:1767318432.773149:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379501696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318432.773266:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379501696:12345-0@lo:400:kworker.0 Request processed in 119us (24601us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318432.773273:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3640
00000100:00080000:1.0:1767318432.773311:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318432.773374:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379501696:0@lo:400:kworker.0
00000100:00080000:3.0:1767318432.773895:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318432.773901:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318432.773905:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379500928:0@lo:38:kworker.0
00000100:00080000:3.0:1767318432.773931:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318432.773934:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318432.773937:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379501056:0@lo:38:kworker.0
00000100:00080000:3.0:1767318432.773947:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318432.773961:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318432.773965:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379501568:0@lo:38:kworker.0
00000100:00080000:3.0:1767318432.773976:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318432.773980:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318432.773983:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379501824:0@lo:38:kworker.0
00010000:00010000:0.0:1767318433.239277:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318434.263351:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318435.287268:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318435.802569:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318435.802601:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379501952:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318435.802828:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318435.803407:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379501952
00000100:00100000:1.0:1767318435.803415:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379501952
00000100:00100000:1.0:1767318435.803483:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894
00000100:00100000:1.0:1767318435.803492:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379501952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318435.803522:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318435.803571:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379501952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (743us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318435.803579:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894
00000100:00080000:3.0:1767318435.803763:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318435.803824:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379501952:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318436.312089:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767318436.754799:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291860736 offset 0 length 520: 4
00000100:00100000:2.0:1767318436.754919:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318436.755018:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318436.755187:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291860864
00000100:00100000:0.0:1767318436.755200:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291860864
00000100:00100000:0.0:1767318436.755251:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291860992
00000100:00100000:0.0:1767318436.755254:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291860992
00000100:00100000:0.0:1767318436.755316:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3641
00000100:00100000:0.0:1767318436.755326:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291860992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318436.755408:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291860992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (388us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318436.755416:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3641
00000100:00100000:0.0:1767318436.755434:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16156
00000100:00100000:0.0:1767318436.755439:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291860864:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318436.755470:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318436.755496:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291860864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (625us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318436.755502:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16156
00000100:00080000:2.0:1767318436.756250:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318437.335099:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318437.335347:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318437.335381:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379502080:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318437.335482:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318437.335615:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502080
00000100:00100000:2.0:1767318437.335626:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502080
00000100:00100000:2.0:1767318437.335696:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895
00000100:00100000:2.0:1767318437.335707:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379502080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318437.335756:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318437.335815:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379502080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (331us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318437.335824:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895
00000100:00080000:3.0:1767318437.336135:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318437.336186:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379502080:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318437.847384:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318437.847396:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318437.847400:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318437.847405:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318437.847409:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318437.847419:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3335
00000100:00080000:3.0:1767318437.847437:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318437.847447:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318437.847466:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318412/real 1767318412]  req@ffff8b0e0729f100 x1853164379496064/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318437 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318437.847493:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79180 x1853164379502208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318437.847529:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767318437.847534:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0729f100 x1853164379496064/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318437 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318437.847537:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318437.847542:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318437.847557:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3335
00000100:00080000:3.0:1767318437.847561:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318437.847568:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318437.847580:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379502208:0@lo:38:kworker.0
00000100:00100000:3.0:1767318437.847588:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164379502336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318437.847674:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318437.847678:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318437.847681:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767318437.847686:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318437.847692:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318437.847699:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3335
00000100:00080000:3.0:1767318437.847703:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318437.847712:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379502464:0@lo:400:kworker.0
00000100:00080000:3.0:1767318437.847723:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318437.847746:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d180 x1853164379502848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318437.847767:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318437.847771:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318437.847773:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318437.847779:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3335
00000100:00080000:3.0:1767318437.847782:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318437.847790:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00080000:2.0:1767318437.847800:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318437.847809:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681f80 x1853164379503104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318437.847818:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318437.847830:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318437.847840:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379496064:0@lo:250:kworker.0
00000100:00100000:2.0:1767318437.847916:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379502336:0@lo:38:kworker.0
00000100:00100000:1.0:1767318437.847926:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379502976:0@lo:400:kworker.0
00000100:00100000:2.0:1767318437.847967:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318437.848019:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379502848:0@lo:38:kworker.0
00000100:00080000:3.0:1767318437.848144:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318437.848150:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318437.848153:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767318437.848157:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502464
00000100:00080000:3.0:1767318437.848160:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3314
00000100:00080000:3.0:1767318437.848165:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318437.848170:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318437.848181:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502464
00000100:00100000:3.0:1767318437.848188:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682680 x1853164379503232/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318437.848237:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318437.848270:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152
00000100:00100000:0.0:1767318437.848285:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379502464:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318437.848301:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502208
00000100:00100000:1.0:1767318437.848315:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502208
00000100:00100000:1.0:1767318437.848345:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502976
00000100:00100000:1.0:1767318437.848348:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502976
00000100:00100000:0.0:1767318437.848373:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379502464:12345-0@lo:400:kworker.0 Request processed in 88us (564us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318437.848383:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152
00000100:00100000:1.0:1767318437.848386:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3642
00000100:00100000:1.0:1767318437.848404:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379502976:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767318437.848425:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318437.848433:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318437.848489:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379502976:12345-0@lo:400:kworker.0 Request processed in 88us (514us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318437.848490:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379502464:0@lo:400:kworker.0
00000100:00100000:1.0:1767318437.848509:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3642
00000100:00100000:0.0:1767318437.848533:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379502976:0@lo:400:kworker.0
00000100:00100000:1.0:1767318437.848547:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16157
00000100:00100000:1.0:1767318437.848553:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379502208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318437.848573:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318437.848613:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379502208:12345-0@lo:38:kworker.0 Request processed in 55us (927us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318437.848618:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379502720:0@lo:400:kworker.0
00000100:00100000:1.0:1767318437.848626:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16157
00000100:00100000:0.0:1767318437.848663:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318437.848677:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379502592:0@lo:400:kworker.0
00000100:00100000:1.0:1767318437.848696:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502720
00000100:00100000:1.0:1767318437.848700:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502720
00000100:00100000:1.0:1767318437.848765:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3643
00000100:00100000:0.0:1767318437.848776:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318437.848785:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379502720:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318437.848810:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502592
00000100:00100000:0.0:1767318437.848816:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502592
00000100:00100000:1.0:1767318437.848827:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379502720:12345-0@lo:400:kworker.0 Request processed in 47us (166us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318437.848834:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3643
00000100:00100000:0.0:1767318437.848862:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153
00000100:00080000:1.0:1767318437.848908:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318437.848925:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379502592:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318437.848948:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379502720:0@lo:400:kworker.0
00000100:00100000:0.0:1767318437.848978:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379502592:12345-0@lo:400:kworker.0 Request processed in 106us (209us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318437.848985:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153
00000100:00100000:1.0:1767318437.849026:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379502592:0@lo:400:kworker.0
00000100:00100000:0.0:1767318437.849051:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318437.849083:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502336
00000100:00100000:0.0:1767318437.849084:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379503104:0@lo:38:kworker.0
00000100:00100000:1.0:1767318437.849093:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502336
00000100:00100000:0.0:1767318437.849124:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318437.849131:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801
00000100:00100000:1.0:1767318437.849136:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379502336:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318437.849146:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318437.849162:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318437.849169:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318437.849175:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379502208:0@lo:38:kworker.0
00000100:00100000:1.0:1767318437.849193:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379502336:12345-0@lo:38:kworker.0 Request processed in 55us (1229us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318437.849201:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801
00000100:00100000:0.0:1767318437.849206:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379503232:0@lo:250:kworker.0
00000100:00100000:1.0:1767318437.849230:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379502848
00000100:00100000:1.0:1767318437.849235:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379502848
00000400:00000100:0.0:1767318437.849239:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379503232 offset 0 length 520: 4
00000100:00100000:1.0:1767318437.849257:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379503104
00000100:00100000:1.0:1767318437.849264:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379503104
00000100:00100000:1.0:1767318437.849281:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16158
00000100:00080000:0.0:1767318437.849282:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318437.849291:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379502848:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767318437.849297:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00010000:00020000:1.0:1767318437.849306:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318437.849308:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379502336:0@lo:38:kworker.0
00000100:00080000:0.0:1767318437.849348:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318437.849352:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379502848:12345-0@lo:38:kworker.0 Request processed in 64us (302us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318437.849357:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16158
00000100:00080000:0.0:1767318437.849372:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318437.849381:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379502848:0@lo:38:kworker.0
00000100:00100000:1.0:1767318437.849381:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16159
00000100:00100000:1.0:1767318437.849395:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379503104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318437.849408:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318437.849453:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379503104:12345-0@lo:38:kworker.0 Request processed in 59us (331us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318437.849461:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16159
00000100:00080000:0.0:1767318437.849480:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318437.849487:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318437.849492:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379503104:0@lo:38:kworker.0
00010000:00010000:1.0:1767318438.359412:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318439.383272:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318440.407317:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318440.921766:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318440.921790:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379503360:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318440.921894:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318440.921966:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379503360
00000100:00100000:1.0:1767318440.921975:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379503360
00000100:00100000:1.0:1767318440.922031:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896
00000100:00100000:1.0:1767318440.922040:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379503360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318440.922111:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318440.922168:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379503360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (272us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318440.922176:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896
00000100:00080000:1.0:1767318440.922205:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318440.922243:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379503360:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318441.431465:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318441.872000:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318441.880120:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291861248
00000100:00100000:3.0:1767318441.880137:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291861248
00000100:00100000:3.0:1767318441.880299:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3644
00000100:00100000:3.0:1767318441.880331:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291861248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318441.880455:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291861248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 145us (8464us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318441.880464:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3644
00000100:00080000:1.0:1767318441.880906:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318441.911833:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318441.911924:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291861120
00000100:00100000:3.0:1767318441.911934:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291861120
00000100:00100000:3.0:1767318441.911979:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16160
00000100:00100000:3.0:1767318441.911987:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291861120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318441.912009:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318441.912067:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291861120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 79us (244us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318441.912075:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16160
00010000:00010000:3.0:1767318442.456392:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318442.456452:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379503488:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318442.456523:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318442.456597:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379503488
00000100:00100000:2.0:1767318442.456614:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379503488
00000100:00100000:2.0:1767318442.456731:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897
00000100:00100000:2.0:1767318442.456743:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379503488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318442.456786:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318442.456892:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318442.456894:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379503488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (344us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318442.456909:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897
00000100:00100000:3.0:1767318442.457802:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379503488:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318442.970986:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318442.971000:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318442.971006:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318442.971012:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318442.971019:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318442.971030:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3340
00000100:00080000:2.0:1767318442.971037:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318442.971048:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318442.971105:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e86680 x1853164379503616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318442.971144:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318442.971148:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318442.971150:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318442.971164:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3340
00000100:00080000:2.0:1767318442.971167:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318442.971171:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318442.971190:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164379503744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318442.971319:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318442.971323:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318442.971325:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318442.971329:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3340
00000100:00080000:2.0:1767318442.971332:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318442.971336:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318442.971348:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f347800 x1853164379504256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318442.971369:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318442.971372:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318442.971374:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318442.971377:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3340
00000100:00080000:2.0:1767318442.971390:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318442.971395:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318442.971408:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f345880 x1853164379504512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318442.971447:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379504128:0@lo:400:kworker.0
00000100:00100000:2.0:1767318442.971537:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318442.971621:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318442.971628:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379504000:0@lo:400:kworker.0
00000100:00100000:2.0:1767318442.971658:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318442.972003:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379504384:0@lo:400:kworker.0
00000100:00100000:3.0:1767318442.972045:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318442.972094:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318442.972101:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379503872:0@lo:400:kworker.0
00000100:00100000:3.0:1767318442.972126:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318442.972314:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504000
00000100:00100000:0.0:1767318442.972325:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504000
00000100:00100000:0.0:1767318442.972400:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379503872
00000100:00100000:0.0:1767318442.972404:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379503872
00000100:00100000:0.0:1767318442.972445:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154
00000100:00100000:0.0:1767318442.972456:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379504000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318442.972527:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379504000:12345-0@lo:400:kworker.0 Request processed in 73us (867us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318442.972535:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154
00000100:00100000:0.0:1767318442.972555:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155
00000100:00100000:0.0:1767318442.972560:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379503872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318442.972592:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379503872:12345-0@lo:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318442.972598:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155
00000100:00080000:0.0:1767318442.972630:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318442.972651:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379503616:0@lo:38:kworker.0
00000100:00100000:0.0:1767318442.972699:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318442.972724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379503744:0@lo:38:kworker.0
00000100:00100000:0.0:1767318442.972775:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318442.972800:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379504256:0@lo:38:kworker.0
00000100:00100000:0.0:1767318442.972828:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318442.972846:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379504512:0@lo:38:kworker.0
00000100:00100000:0.0:1767318442.972912:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318442.972951:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504128
00000100:00100000:0.0:1767318442.972956:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504128
00000100:00100000:0.0:1767318442.972992:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504384
00000100:00100000:0.0:1767318442.972995:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504384
00000100:00100000:0.0:1767318442.973008:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379503616
00000100:00100000:0.0:1767318442.973011:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379503616
00000100:00100000:0.0:1767318442.973020:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504256
00000100:00100000:0.0:1767318442.973022:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504256
00000100:00100000:0.0:1767318442.973029:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504512
00000100:00100000:0.0:1767318442.973031:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504512
00000100:00100000:0.0:1767318442.973042:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3645
00000100:00100000:0.0:1767318442.973048:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379504128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318442.973086:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379504128:12345-0@lo:400:kworker.0 Request processed in 38us (1548us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318442.973092:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3645
00000100:00100000:0.0:1767318442.973105:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3646
00000100:00100000:0.0:1767318442.973110:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379504384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318442.973139:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379504384:12345-0@lo:400:kworker.0 Request processed in 29us (1093us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318442.973145:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3646
00000100:00100000:0.0:1767318442.973155:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16161
00000100:00100000:0.0:1767318442.973173:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379503616:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318442.973207:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318442.973245:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379503616:12345-0@lo:38:kworker.0 Request processed in 71us (545us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318442.973253:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16161
00000100:00100000:0.0:1767318442.973266:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16162
00000100:00100000:0.0:1767318442.973270:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379504256:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318442.973279:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318442.973302:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379504256:12345-0@lo:38:kworker.0 Request processed in 30us (473us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318442.973307:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16162
00000100:00100000:0.0:1767318442.973317:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16163
00000100:00100000:0.0:1767318442.973321:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379504512:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318442.973329:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318442.973349:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379504512:12345-0@lo:38:kworker.0 Request processed in 27us (480us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318442.973355:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16163
00000100:00100000:0.0:1767318442.973374:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379503744
00000100:00100000:0.0:1767318442.973377:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379503744
00000100:00100000:0.0:1767318442.973399:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802
00000100:00100000:0.0:1767318442.973404:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379503744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318442.973414:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318442.973440:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379503744:12345-0@lo:38:kworker.0 Request processed in 34us (665us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318442.973446:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802
00000100:00080000:0.0:1767318442.973471:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318442.973525:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379504000:0@lo:400:kworker.0
00000100:00100000:0.0:1767318442.973539:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379504128:0@lo:400:kworker.0
00000100:00080000:0.0:1767318442.973577:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318442.973583:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318442.973586:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379503616:0@lo:38:kworker.0
00000100:00080000:0.0:1767318442.973594:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318442.973598:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318442.973601:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379503744:0@lo:38:kworker.0
00000100:00080000:0.0:1767318442.973609:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318442.973612:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318442.973615:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379504256:0@lo:38:kworker.0
00000100:00080000:0.0:1767318442.973622:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318442.973643:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318442.973647:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379504512:0@lo:38:kworker.0
00000100:00100000:3.0:1767318442.974322:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379503872:0@lo:400:kworker.0
00000100:00100000:3.0:1767318442.974337:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379504384:0@lo:400:kworker.0
00010000:00010000:0.0:1767318443.479296:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318444.503536:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318445.527096:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318446.039383:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379504640:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318446.039498:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318446.039739:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504640
00000100:00100000:3.0:1767318446.039751:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504640
00000100:00100000:3.0:1767318446.039838:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898
00000100:00100000:3.0:1767318446.039851:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379504640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318446.039910:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767318446.044314:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318446.054346:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379504640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 14484us (14833us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318446.054367:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898
00000100:00100000:0.0:1767318446.055441:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379504640:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318446.551225:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318446.995083:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318446.995322:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291861504
00000100:00100000:3.0:1767318446.995336:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291861504
00000100:00100000:2.0:1767318446.995576:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:0.0:1767318446.995674:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318446.996703:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291861376
00000100:00100000:3.0:1767318446.996714:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291861376
00000100:00100000:3.0:1767318446.996810:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3647
00000100:00100000:3.0:1767318446.996827:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291861504:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318447.000218:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291861504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 3378us (5133us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318447.000237:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3647
00000100:00100000:3.0:1767318447.000290:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16164
00000100:00100000:3.0:1767318447.000311:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291861376:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318447.000340:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318447.000373:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291861376:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 63us (4797us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318447.000606:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16164
00010000:00010000:0.0:1767318447.575883:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318447.575974:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379504768:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318447.576089:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318447.576505:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504768
00000100:00100000:0.0:1767318447.576516:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504768
00000100:00100000:0.0:1767318447.576608:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899
00000100:00100000:0.0:1767318447.576650:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379504768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318447.576689:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318447.576750:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379504768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (660us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318447.576758:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899
00000100:00080000:1.0:1767318447.576863:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318447.576951:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379504768:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318448.088695:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318448.088706:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318448.088709:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318448.088714:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318448.088719:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318448.088728:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3345
00000100:00080000:2.0:1767318448.088734:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318448.088744:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318448.088795:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f346300 x1853164379504896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318448.088830:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318448.088834:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318448.088836:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318448.088840:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3345
00000100:00080000:2.0:1767318448.088843:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318448.088847:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318448.088865:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f347480 x1853164379505024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318448.088958:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318448.088962:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318448.088963:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318448.088967:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3345
00000100:00080000:2.0:1767318448.088970:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318448.088974:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318448.088985:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f346d80 x1853164379505536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318448.089018:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318448.089022:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318448.089024:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318448.089027:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3345
00000100:00080000:2.0:1767318448.089030:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318448.089035:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318448.089046:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f344a80 x1853164379505792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318448.089079:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379505152:0@lo:400:kworker.0
00000100:00100000:2.0:1767318448.089175:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318448.089250:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318448.089256:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379505664:0@lo:400:kworker.0
00000100:00100000:0.0:1767318448.089701:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379505408:0@lo:400:kworker.0
00000100:00100000:0.0:1767318448.089749:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379504896:0@lo:38:kworker.0
00000100:00100000:2.0:1767318448.090248:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318448.090650:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379505280:0@lo:400:kworker.0
00000100:00100000:1.0:1767318448.093527:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318448.093612:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379505024:0@lo:38:kworker.0
00000100:00100000:1.0:1767318448.093703:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318448.093741:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379505536:0@lo:38:kworker.0
00000100:00100000:1.0:1767318448.093766:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318448.093798:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379505792:0@lo:38:kworker.0
00000100:00100000:1.0:1767318448.093821:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318448.094085:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505664
00000100:00100000:1.0:1767318448.094098:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505664
00000100:00100000:1.0:1767318448.094182:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379504896
00000100:00100000:1.0:1767318448.094186:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379504896
00000100:00100000:1.0:1767318448.094204:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505536
00000100:00100000:1.0:1767318448.094207:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505536
00000100:00100000:1.0:1767318448.094218:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505792
00000100:00100000:1.0:1767318448.094221:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505792
00000100:00100000:1.0:1767318448.094236:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3648
00000100:00100000:1.0:1767318448.094264:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379505664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318448.095466:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379505664:12345-0@lo:400:kworker.0 Request processed in 1192us (5209us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318448.095481:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3648
00000100:00100000:1.0:1767318448.095520:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16165
00000100:00100000:1.0:1767318448.095526:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379504896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318448.095553:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318448.095594:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379504896:12345-0@lo:38:kworker.0 Request processed in 67us (2078us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318448.095600:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16165
00000100:00100000:1.0:1767318448.095611:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16166
00000100:00100000:1.0:1767318448.095615:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379505536:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318448.095637:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318448.095663:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379505536:12345-0@lo:38:kworker.0 Request processed in 46us (1896us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318448.095668:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16166
00000100:00100000:1.0:1767318448.095680:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16167
00000100:00100000:1.0:1767318448.095684:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379505792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318448.095694:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318448.095718:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379505792:12345-0@lo:38:kworker.0 Request processed in 32us (1896us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318448.095724:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16167
00000100:00100000:1.0:1767318448.095761:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505024
00000100:00100000:1.0:1767318448.095769:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505024
00000100:00100000:1.0:1767318448.095803:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803
00000100:00100000:1.0:1767318448.095821:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379505024:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318448.095831:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318448.095860:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379505024:12345-0@lo:38:kworker.0 Request processed in 39us (2158us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318448.095867:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803
00000100:00080000:1.0:1767318448.095906:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318448.095970:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318448.095976:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318448.095980:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379504896:0@lo:38:kworker.0
00000100:00080000:1.0:1767318448.095994:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318448.095999:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318448.096529:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379505024:0@lo:38:kworker.0
00000100:00080000:1.0:1767318448.096554:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318448.096558:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318448.096562:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379505536:0@lo:38:kworker.0
00000100:00080000:1.0:1767318448.096574:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318448.096578:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318448.096580:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379505792:0@lo:38:kworker.0
00000100:00100000:1.0:1767318448.096726:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505152
00000100:00100000:1.0:1767318448.096732:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505152
00000100:00100000:1.0:1767318448.096787:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156
00000100:00100000:1.0:1767318448.096795:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379505152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318448.096854:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379505152:12345-0@lo:400:kworker.0 Request processed in 61us (7680us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318448.096897:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156
00000100:00080000:1.0:1767318448.096918:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318448.105463:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f344e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379505664:0@lo:400:kworker.0
00000100:00100000:2.0:1767318448.105490:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379505152:0@lo:400:kworker.0
00000100:00100000:3.0:1767318448.107773:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318448.108301:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505280
00000100:00100000:2.0:1767318448.108314:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505280
00000100:00100000:2.0:1767318448.108385:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157
00000100:00100000:2.0:1767318448.108399:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379505280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318448.108486:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379505280:12345-0@lo:400:kworker.0 Request processed in 90us (723us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318448.108495:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157
00000100:00100000:3.0:1767318448.108912:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379505280:0@lo:400:kworker.0
00000100:00100000:0.0:1767318448.116422:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318448.116718:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505408
00000100:00100000:2.0:1767318448.116732:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505408
00000100:00100000:2.0:1767318448.116916:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3649
00000100:00100000:2.0:1767318448.116929:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379505408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318448.117440:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379505408:12345-0@lo:400:kworker.0 Request processed in 512us (1028us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318448.117450:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3649
00000100:00100000:0.0:1767318448.118368:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f344380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379505408:0@lo:400:kworker.0
00000100:00080000:3.0:1767318448.118584:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318448.599270:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318449.623627:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318450.647037:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318451.159823:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379505920:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318451.159950:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318451.163965:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379505920
00000100:00100000:3.0:1767318451.163982:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379505920
00000100:00100000:3.0:1767318451.164073:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900
00000100:00100000:3.0:1767318451.164084:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379505920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318451.164120:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318451.164223:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379505920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 142us (4271us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318451.164230:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900
00000100:00100000:2.0:1767318451.164795:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379505920:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318451.165532:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318451.671093:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318452.121404:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318452.121452:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318452.121546:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291861760
00000100:00100000:0.0:1767318452.121557:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291861760
00000100:00100000:0.0:1767318452.121670:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291861632
00000100:00100000:0.0:1767318452.121674:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291861632
00000100:00100000:0.0:1767318452.121696:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3650
00000100:00100000:0.0:1767318452.121707:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291861760:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318452.121802:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291861760:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (407us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318452.121811:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3650
00000100:00100000:0.0:1767318452.121830:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16168
00000100:00100000:0.0:1767318452.121835:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291861632:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318452.121895:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318452.121921:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291861632:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 83us (467us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318452.121941:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16168
00000100:00080000:1.0:1767318452.122828:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318452.695639:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379506048:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318452.695712:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1767318452.695984:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318452.696072:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506048
00000100:00100000:2.0:1767318452.696083:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506048
00000100:00100000:2.0:1767318452.696341:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901
00000100:00100000:2.0:1767318452.696351:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379506048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318452.696380:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318452.696445:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379506048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (732us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318452.696453:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901
00000100:00100000:0.0:1767318452.696605:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379506048:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318452.696684:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318453.207088:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318453.207098:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318453.207101:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318453.207105:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318453.207109:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318453.207116:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3350
00000100:00080000:1.0:1767318453.207121:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318453.207126:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318453.207169:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06309180 x1853164379506176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318453.207186:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318453.207189:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318453.207191:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318453.207229:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3350
00000100:00080000:1.0:1767318453.207232:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318453.207236:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318453.207247:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06308380 x1853164379506304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318453.207318:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379506432:0@lo:400:kworker.0
00000100:00100000:0.0:1767318453.207380:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318453.207488:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506432
00000100:00100000:3.0:1767318453.207495:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506432
00000100:00100000:3.0:1767318453.207594:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158
00000100:00100000:3.0:1767318453.207604:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379506432:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318453.207687:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318453.207705:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318453.207708:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318453.207711:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3350
00000100:00080000:1.0:1767318453.207714:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318453.207718:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318453.207733:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0630a300 x1853164379506688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318453.207763:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318453.207767:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318453.207769:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318453.207772:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3350
00000100:00080000:1.0:1767318453.207774:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318453.207778:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318453.207789:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06308a80 x1853164379506944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318453.207810:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318453.207847:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379506560:0@lo:400:kworker.0
00000100:00100000:1.0:1767318453.207892:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318453.207909:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318453.207913:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379506816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318453.207926:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318453.207941:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506560
00000100:00100000:1.0:1767318453.207944:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506560
00000100:00100000:1.0:1767318453.207975:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506816
00000100:00100000:1.0:1767318453.207978:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506816
00000100:00100000:1.0:1767318453.207999:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3651
00000100:00100000:1.0:1767318453.208009:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379506560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318453.208037:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379506560:12345-0@lo:400:kworker.0 Request processed in 28us (145us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318453.208042:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3651
00000100:00100000:1.0:1767318453.208057:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3652
00000100:00100000:1.0:1767318453.208061:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379506816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318453.208076:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379506816:12345-0@lo:400:kworker.0 Request processed in 15us (149us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318453.208079:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3652
00000100:00080000:1.0:1767318453.208091:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318453.208109:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379506816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318453.208115:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379506560:0@lo:400:kworker.0
00000100:00100000:2.0:1767318453.208186:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379506176:0@lo:38:kworker.0
00000100:00100000:2.0:1767318453.208208:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318453.208226:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379506304:0@lo:38:kworker.0
00000100:00100000:2.0:1767318453.208239:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318453.208252:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379506688:0@lo:38:kworker.0
00000100:00100000:3.0:1767318453.208975:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379506432:12345-0@lo:400:kworker.0 Request processed in 1367us (1588us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318453.208986:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158
00000100:00100000:3.0:1767318453.209017:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506176
00000100:00100000:3.0:1767318453.209022:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506176
00000100:00100000:1.0:1767318453.209046:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506304
00000100:00100000:1.0:1767318453.209050:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506304
00000100:00100000:3.0:1767318453.209050:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16169
00000100:00100000:3.0:1767318453.209055:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379506176:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318453.209069:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804
00000100:00100000:1.0:1767318453.209073:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379506304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318453.209073:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767318453.209082:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318453.209112:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379506304:12345-0@lo:38:kworker.0 Request processed in 38us (871us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318453.209112:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379506176:12345-0@lo:38:kworker.0 Request processed in 56us (902us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318453.209118:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804
00000100:00100000:3.0:1767318453.209119:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16169
00000100:00100000:0.0:1767318453.209278:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379506432:0@lo:400:kworker.0
00000100:00100000:2.0:1767318453.209823:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318453.209851:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379506944:0@lo:38:kworker.0
00000100:00100000:2.0:1767318453.209888:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318453.209918:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318453.209923:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318453.209926:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379506176:0@lo:38:kworker.0
00000100:00080000:2.0:1767318453.209936:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318453.209936:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506688
00000100:00100000:3.0:1767318453.209940:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506688
00000100:00080000:2.0:1767318453.209941:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318453.209943:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379506304:0@lo:38:kworker.0
00000100:00100000:1.0:1767318453.210092:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379506944
00000100:00100000:1.0:1767318453.210097:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379506944
00000100:00100000:1.0:1767318453.210137:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16170
00000100:00100000:1.0:1767318453.210142:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379506944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318453.210157:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318453.210178:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16171
00000100:00100000:3.0:1767318453.210182:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379506688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318453.210192:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318453.210203:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379506944:12345-0@lo:38:kworker.0 Request processed in 60us (314us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318453.210210:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16170
00000100:00100000:3.0:1767318453.210216:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379506688:12345-0@lo:38:kworker.0 Request processed in 33us (393us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318453.210221:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16171
00000100:00080000:2.0:1767318453.210309:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318453.210313:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318453.210315:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379506688:0@lo:38:kworker.0
00000100:00080000:2.0:1767318453.210320:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318453.210431:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318453.210434:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379506944:0@lo:38:kworker.0
00010000:00010000:0.0:1767318453.719129:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318454.743488:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318455.769437:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318456.279270:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318456.279291:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379507072:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318456.279356:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318456.279753:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507072
00000100:00100000:3.0:1767318456.279762:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507072
00000100:00100000:3.0:1767318456.279838:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902
00000100:00100000:3.0:1767318456.279847:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379507072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318456.279898:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318456.280020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318456.280241:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379507072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 394us (882us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318456.280249:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902
00000100:00100000:1.0:1767318456.280327:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379507072:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318456.791371:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318457.234423:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318457.234516:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318457.234559:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291862016
00000100:00100000:3.0:1767318457.234570:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291862016
00000100:00100000:0.0:1767318457.234624:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291861888
00000100:00100000:0.0:1767318457.234630:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291861888
00000100:00100000:3.0:1767318457.234649:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3653
00000100:00080000:1.0:1767318457.234678:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318457.234710:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291862016:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318457.234791:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291862016:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318457.239785:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16172
00000100:00100000:0.0:1767318457.239798:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291861888:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318457.239825:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318457.239908:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291861888:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 109us (5391us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318457.239913:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16172
00000100:00100000:3.0:1767318457.244516:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3653
00010000:00010000:0.0:1767318457.817546:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318457.817606:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379507200:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318457.817674:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318457.817816:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507200
00000100:00100000:0.0:1767318457.817824:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507200
00000100:00100000:0.0:1767318457.817901:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903
00000100:00100000:0.0:1767318457.817910:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379507200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318457.817950:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318457.817989:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379507200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318457.817994:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903
00000100:00080000:2.0:1767318457.818130:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318457.818167:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379507200:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318458.330482:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318458.330495:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318458.330497:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318458.330501:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318458.330506:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318458.330514:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3355
00000100:00080000:2.0:1767318458.330519:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318458.330527:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318458.330581:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f346300 x1853164379507328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318458.330617:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318458.330621:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318458.330623:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318458.330627:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3355
00000100:00080000:2.0:1767318458.330630:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318458.330633:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318458.330674:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80e00 x1853164379507456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318458.330727:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318458.330730:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318458.330732:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318458.330735:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3355
00000100:00080000:2.0:1767318458.330738:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318458.330742:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318458.330753:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c81c00 x1853164379507840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318458.330793:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318458.330797:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318458.330799:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318458.330803:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3355
00000100:00080000:2.0:1767318458.330805:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318458.330810:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318458.330822:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c83800 x1853164379508096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318458.330847:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318458.330865:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379507968:0@lo:400:kworker.0
00000100:00100000:2.0:1767318458.330969:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318458.331273:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379507584:0@lo:400:kworker.0
00000100:00100000:1.0:1767318458.331310:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318458.331349:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318458.331355:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379507712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318458.331376:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318458.331408:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507968
00000100:00100000:1.0:1767318458.331417:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507968
00000100:00100000:1.0:1767318458.331468:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507712
00000100:00100000:1.0:1767318458.331472:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507712
00000100:00100000:1.0:1767318458.331498:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3654
00000100:00100000:1.0:1767318458.331508:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379507968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318458.331582:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379507968:12345-0@lo:400:kworker.0 Request processed in 74us (612us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318458.331588:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3654
00000100:00100000:1.0:1767318458.331610:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3655
00000100:00100000:1.0:1767318458.331616:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379507712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318458.331647:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379507712:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318458.331652:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3655
00000100:00080000:1.0:1767318458.331670:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318458.331729:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379507712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318458.331755:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379507968:0@lo:400:kworker.0
00000100:00100000:2.0:1767318458.331980:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507584
00000100:00100000:2.0:1767318458.331985:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507584
00000100:00080000:1.0:1767318458.332149:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318458.332200:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379507328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318458.332248:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318458.332286:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379507456:0@lo:38:kworker.0
00000100:00100000:0.0:1767318458.332311:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318458.332377:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507456
00000100:00100000:1.0:1767318458.332382:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507456
00000100:00100000:1.0:1767318458.332406:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805
00000100:00100000:1.0:1767318458.332413:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379507456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318458.332436:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318458.332453:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159
00000100:00100000:3.0:1767318458.332466:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379507584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318458.332475:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379507456:12345-0@lo:38:kworker.0 Request processed in 59us (162us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318458.332483:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805
00000100:00100000:3.0:1767318458.332522:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379507584:12345-0@lo:400:kworker.0 Request processed in 61us (1210us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318458.332525:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507328
00000100:00100000:1.0:1767318458.332539:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507328
00000100:00100000:3.0:1767318458.332544:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159
00000100:00100000:1.0:1767318458.332567:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16173
00000100:00100000:1.0:1767318458.332573:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379507328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318458.332584:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318458.332586:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379507584:0@lo:400:kworker.0
00000100:00100000:1.0:1767318458.332615:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379507328:12345-0@lo:38:kworker.0 Request processed in 41us (366us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318458.332623:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16173
00000100:00080000:0.0:1767318458.337361:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318458.337375:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318458.337381:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379507456:0@lo:38:kworker.0
00000100:00100000:0.0:1767318458.337393:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379507840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318458.337462:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318458.337506:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379508096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318458.337647:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379507840
00000100:00100000:1.0:1767318458.337655:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379507840
00000100:00100000:1.0:1767318458.337709:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16174
00000100:00100000:1.0:1767318458.337716:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379507840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318458.337741:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318458.337785:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379507840:12345-0@lo:38:kworker.0 Request processed in 67us (322us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318458.337805:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16174
00000100:00100000:0.0:1767318458.337909:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318458.338050:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318458.338056:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318458.338059:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379507328:0@lo:38:kworker.0
00000100:00080000:0.0:1767318458.338068:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318458.338072:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318458.338075:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379507840:0@lo:38:kworker.0
00000100:00100000:3.0:1767318458.338158:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379508096
00000100:00100000:3.0:1767318458.338163:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379508096
00000100:00100000:3.0:1767318458.338197:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16175
00000100:00100000:3.0:1767318458.338202:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379508096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318458.338212:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318458.338258:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379508096:12345-0@lo:38:kworker.0 Request processed in 55us (348us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318458.338263:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16175
00000100:00080000:0.0:1767318458.338333:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318458.338338:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318458.338340:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379508096:0@lo:38:kworker.0
00010000:00010000:3.0:1767318458.840801:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318459.863216:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318460.890617:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318461.399532:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318461.399564:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379508224:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318461.399650:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318461.400181:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379508224
00000100:00100000:2.0:1767318461.400189:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379508224
00000100:00100000:2.0:1767318461.400314:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904
00000100:00100000:2.0:1767318461.400325:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379508224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318461.400374:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318461.400435:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379508224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (783us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318461.400452:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904
00000100:00100000:3.0:1767318461.400612:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379508224:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318461.401085:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318461.911178:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318462.356280:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767318462.356361:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291862144 offset 0 length 520: 4
00000100:00100000:2.0:1767318462.356382:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318462.356719:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291862400
00000100:00100000:1.0:1767318462.356739:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291862400
00000100:00100000:1.0:1767318462.356820:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291862272
00000100:00100000:1.0:1767318462.356824:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291862272
00000100:00100000:1.0:1767318462.356850:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3656
00000100:00080000:2.0:1767318462.356974:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318462.357060:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291862400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318462.357188:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291862400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 132us (917us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318462.357705:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16176
00000100:00100000:2.0:1767318462.357713:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291862272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318462.357745:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318462.357783:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291862272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 69us (1398us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318462.357791:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16176
00000100:00100000:1.0:1767318462.358316:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3656
00000100:00100000:1.0:1767318462.425040:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318437/real 1767318437]  req@ffff8b0e02682680 x1853164379503232/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318462 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318462.425131:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e02682680 x1853164379503232/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318462 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318462.425146:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318462.425184:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318462.425188:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379503232:0@lo:250:kworker.0
00000100:00080000:2.0:1767318462.426916:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318462.426925:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318462.426930:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318462.426935:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3340
00000100:00080000:2.0:1767318462.426940:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318462.426948:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318462.426987:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80000 x1853164379508352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318462.427020:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318462.427024:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318462.427026:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318462.427029:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3360
00000100:00080000:2.0:1767318462.427032:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318462.427036:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318462.427052:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c81180 x1853164379508480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318462.427061:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318462.427065:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318462.427067:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318462.427071:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3360
00000100:00080000:2.0:1767318462.427073:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318462.427077:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318462.427091:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c83100 x1853164379508608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318462.427149:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318462.427153:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318462.427155:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318462.427159:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3360
00000100:00080000:2.0:1767318462.427162:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318462.427166:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318462.427172:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379508736:0@lo:400:kworker.0
00000100:00100000:2.0:1767318462.427180:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c82680 x1853164379509120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318462.427217:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318462.427222:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318462.427224:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318462.427228:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3360
00000100:00080000:2.0:1767318462.427230:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318462.427235:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318462.427248:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318462.427249:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c82d80 x1853164379509376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318462.427351:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318462.427359:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379508864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318462.427385:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318462.427459:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379508352:0@lo:250:kworker.0
00000400:00000100:1.0:1767318462.427486:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379508352 offset 0 length 520: 4
00000100:00100000:0.0:1767318462.427577:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379509248:0@lo:400:kworker.0
00000100:00100000:2.0:1767318462.427695:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379508736
00000100:00100000:2.0:1767318462.427703:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379508736
00000100:00100000:2.0:1767318462.427763:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379508864
00000100:00100000:2.0:1767318462.427766:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379508864
00000100:00100000:2.0:1767318462.427800:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160
00000100:00100000:2.0:1767318462.427808:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379508736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318462.431622:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379508480:0@lo:38:kworker.0
00000100:00100000:1.0:1767318462.431691:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318462.431731:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379508608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318462.431798:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318462.431835:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379509120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318462.431863:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318462.432040:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379509376:0@lo:38:kworker.0
00000100:00100000:1.0:1767318462.432077:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318462.432142:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379508608
00000100:00100000:1.0:1767318462.432149:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379508608
00000100:00100000:1.0:1767318462.432200:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806
00000100:00100000:1.0:1767318462.432208:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379508608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318462.432229:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318462.432271:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379508608:12345-0@lo:38:kworker.0 Request processed in 62us (471us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318462.432278:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806
00000100:00080000:1.0:1767318462.432335:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318462.432340:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318462.432343:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379508608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318462.432368:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379508480
00000100:00100000:1.0:1767318462.432372:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379508480
00000100:00100000:1.0:1767318462.432394:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379509120
00000100:00100000:1.0:1767318462.432397:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379509120
00000100:00100000:1.0:1767318462.432408:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379509376
00000100:00100000:1.0:1767318462.432410:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379509376
00000100:00100000:1.0:1767318462.432421:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16177
00000100:00100000:1.0:1767318462.432425:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379508480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318462.432435:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318462.432465:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379508480:12345-0@lo:38:kworker.0 Request processed in 38us (774us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318462.432472:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16177
00000100:00100000:1.0:1767318462.432502:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16178
00000100:00100000:1.0:1767318462.432506:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379509120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318462.432516:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318462.432554:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379509120:12345-0@lo:38:kworker.0 Request processed in 46us (690us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318462.432559:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16178
00000100:00100000:1.0:1767318462.432571:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16179
00000100:00100000:1.0:1767318462.432574:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379509376:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318462.432583:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318462.432604:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379509376:12345-0@lo:38:kworker.0 Request processed in 28us (528us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318462.432609:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16179
00000100:00080000:1.0:1767318462.432642:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318462.432646:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318462.432648:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379508480:0@lo:38:kworker.0
00000100:00080000:1.0:1767318462.432656:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318462.432659:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318462.432661:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379509120:0@lo:38:kworker.0
00000100:00080000:1.0:1767318462.432668:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318462.432670:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318462.432673:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379509376:0@lo:38:kworker.0
00000100:00100000:1.0:1767318462.432721:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161
00000100:00100000:1.0:1767318462.432732:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379508864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318462.432771:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379508864:12345-0@lo:400:kworker.0 Request processed in 43us (5385us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318462.432783:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161
00000100:00100000:1.0:1767318462.432815:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379508992:0@lo:400:kworker.0
00000100:00100000:1.0:1767318462.432842:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318462.434282:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379508992
00000100:00100000:1.0:1767318462.434296:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379508992
00000100:00100000:1.0:1767318462.434349:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3657
00000100:00100000:1.0:1767318462.434358:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379508992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318462.434435:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379508992:12345-0@lo:400:kworker.0 Request processed in 79us (1591us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318462.434442:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3657
00000100:00100000:1.0:1767318462.434517:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379508992:0@lo:400:kworker.0
00000100:00080000:1.0:1767318462.434593:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318462.434599:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318462.439938:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379508864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318462.443478:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379508736:12345-0@lo:400:kworker.0 Request processed in 15659us (16220us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318462.443508:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160
00000100:00100000:3.0:1767318462.443727:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379508736:0@lo:400:kworker.0
00000100:00100000:0.0:1767318462.443762:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318462.443864:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379509248
00000100:00100000:2.0:1767318462.443899:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379509248
00000100:00100000:2.0:1767318462.444276:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3658
00000100:00100000:2.0:1767318462.444287:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379509248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318462.444514:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379509248:12345-0@lo:400:kworker.0 Request processed in 229us (754us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318462.444523:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3658
00000100:00100000:0.0:1767318462.444601:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379509248:0@lo:400:kworker.0
00000100:00080000:3.0:1767318462.445241:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318462.938040:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318462.938482:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379509504:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318462.938584:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318462.938697:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379509504
00000100:00100000:0.0:1767318462.938707:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379509504
00000100:00100000:0.0:1767318462.938761:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905
00000100:00100000:0.0:1767318462.938769:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379509504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318462.938828:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318462.938903:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379509504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (318us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318462.938912:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905
00000100:00100000:3.0:1767318462.939094:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379509504:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318463.959108:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318464.983357:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318466.007018:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318466.521140:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379509632:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318466.521245:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318466.521390:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379509632
00000100:00100000:2.0:1767318466.521401:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379509632
00000100:00100000:2.0:1767318466.521517:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906
00000100:00100000:2.0:1767318466.521529:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379509632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318466.521559:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318466.521660:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318466.525095:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379509632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3558us (3839us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318466.525112:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906
00000100:00100000:3.0:1767318466.526529:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0630a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379509632:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318467.031317:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318467.475042:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318467.475279:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318467.475705:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291862656
00000100:00100000:0.0:1767318467.475716:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291862656
00000100:00100000:2.0:1767318467.475750:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291862528
00000100:00100000:2.0:1767318467.475757:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291862528
00000100:00100000:2.0:1767318467.475809:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3659
00000100:00100000:0.0:1767318467.475820:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16180
00000100:00100000:2.0:1767318467.475824:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291862656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318467.475832:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291862528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318467.475863:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318467.475969:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291862656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 150us (936us total) trans 0 rc 0/0
00000100:00080000:1.0:1767318467.475970:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318467.475992:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3659
00000100:00100000:0.0:1767318467.477879:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291862528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2027us (2578us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318467.477893:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16180
00000100:00080000:3.0:1767318467.543487:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.543535:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318467.543539:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.543543:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.543546:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.543563:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3364
00000100:00080000:3.0:1767318467.543568:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.543575:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318467.543609:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682d80 x1853164379509760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318467.543634:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.543637:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.543639:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.543643:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3364
00000100:00080000:3.0:1767318467.543645:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.543648:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318467.543691:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1c00 x1853164379509888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318467.543735:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.543737:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.543739:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.543742:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3364
00000100:00080000:3.0:1767318467.543744:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.543747:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318467.543755:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1880 x1853164379510400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318467.543769:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379510144:0@lo:400:kworker.0
00000100:00080000:3.0:1767318467.543776:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318467.543780:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318467.543782:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318467.543786:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3364
00000100:00080000:3.0:1767318467.543789:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318467.543793:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318467.543814:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0000 x1853164379510656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318467.543838:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379510272:0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.543854:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318467.543954:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379510016:0@lo:400:kworker.0
00000100:00100000:1.0:1767318467.544330:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379509760:0@lo:38:kworker.0
00000100:00100000:3.0:1767318467.544528:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318467.544620:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318467.544627:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379510528:0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.544652:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318467.544690:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510272
00000100:00100000:3.0:1767318467.544697:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510272
00000100:00100000:0.0:1767318467.544734:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510528
00000100:00100000:0.0:1767318467.544744:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510528
00000100:00100000:0.0:1767318467.544784:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3660
00000100:00100000:0.0:1767318467.544792:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379510528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.544841:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379510528:12345-0@lo:400:kworker.0 Request processed in 50us (188us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318467.544848:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660
00000100:00080000:0.0:1767318467.544913:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318467.544932:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510144
00000100:00100000:0.0:1767318467.544935:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510144
00000100:00100000:0.0:1767318467.544981:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162
00000100:00100000:0.0:1767318467.544988:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379510144:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318467.545020:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379510144:12345-0@lo:400:kworker.0 Request processed in 33us (1167us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318467.545026:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162
00000100:00080000:0.0:1767318467.545039:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318467.545067:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379510144:0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.545748:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3661
00000100:00100000:3.0:1767318467.545767:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379510272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.545867:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379510272:12345-0@lo:400:kworker.0 Request processed in 110us (1338us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318467.545896:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3661
00000100:00100000:3.0:1767318467.545936:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379510528:0@lo:400:kworker.0
00000100:00100000:3.0:1767318467.545948:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379510272:0@lo:400:kworker.0
00000100:00100000:2.0:1767318467.546139:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318467.546248:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318467.546281:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379509888:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.546333:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318467.546404:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379509760
00000100:00100000:3.0:1767318467.546418:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379509760
00000100:00100000:3.0:1767318467.546442:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16181
00000100:00100000:3.0:1767318467.546460:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0630a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379509760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318467.546479:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318467.546512:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0630a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379509760:12345-0@lo:38:kworker.0 Request processed in 51us (264us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318467.546519:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16181
00000100:00100000:1.0:1767318467.546582:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379510400:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.546604:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318467.546627:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379510656:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.546646:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318467.546675:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318467.546680:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318467.546683:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379509760:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.546710:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510400
00000100:00100000:1.0:1767318467.546713:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510400
00000100:00100000:1.0:1767318467.546731:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16182
00000100:00100000:1.0:1767318467.546736:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379510400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318467.546746:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318467.546777:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510016
00000100:00100000:1.0:1767318467.546780:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379510400:12345-0@lo:38:kworker.0 Request processed in 42us (174us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318467.546783:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510016
00000100:00100000:1.0:1767318467.546790:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16182
00000100:00100000:0.0:1767318467.546817:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163
00000100:00100000:0.0:1767318467.546825:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379510016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318467.546847:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510656
00000100:00100000:1.0:1767318467.546852:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510656
00000100:00100000:0.0:1767318467.546892:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379510016:12345-0@lo:400:kworker.0 Request processed in 67us (752us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318467.546898:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16183
00000100:00100000:0.0:1767318467.546903:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163
00000100:00100000:1.0:1767318467.546908:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379510656:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318467.546920:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318467.546953:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318467.546958:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318467.546961:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379510400:0@lo:38:kworker.0
00000100:00100000:1.0:1767318467.551497:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379510656:12345-0@lo:38:kworker.0 Request processed in 4579us (4838us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318467.551511:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16183
00000100:00100000:2.0:1767318467.555313:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379509888
00000100:00100000:2.0:1767318467.555331:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379509888
00000100:00100000:2.0:1767318467.555396:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807
00000100:00100000:2.0:1767318467.555405:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379509888:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318467.555429:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318467.555516:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379509888:12345-0@lo:38:kworker.0 Request processed in 111us (9182us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318467.555523:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807
00000100:00080000:0.0:1767318467.557335:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318467.557344:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379510016:0@lo:400:kworker.0
00000100:00080000:0.0:1767318467.557360:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318467.557365:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379510656:0@lo:38:kworker.0
00000100:00080000:0.0:1767318467.557402:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318467.557407:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318467.557410:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379509888:0@lo:38:kworker.0
00010000:00010000:0.0:1767318468.055037:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318468.055190:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379510784:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318468.055256:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318468.055519:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510784
00000100:00100000:3.0:1767318468.055529:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510784
00000100:00100000:3.0:1767318468.055595:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907
00000100:00100000:3.0:1767318468.055605:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379510784:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318468.055634:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318468.055698:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379510784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (441us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318468.055707:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907
00000100:00100000:1.0:1767318468.056051:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379510784:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318469.079693:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318470.103030:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318471.127887:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318471.639313:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379510912:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318471.639425:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318471.639528:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379510912
00000100:00100000:3.0:1767318471.639541:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379510912
00000100:00100000:3.0:1767318471.639624:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908
00000100:00100000:3.0:1767318471.639635:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379510912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318471.639716:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767318471.639795:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318471.643274:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379510912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3628us (3835us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318471.643292:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908
00000100:00100000:0.0:1767318471.645305:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379510912:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318472.151023:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318472.598496:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318472.598680:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318472.602999:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291862784
00000100:00100000:1.0:1767318472.603016:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291862784
00000100:00100000:2.0:1767318472.603110:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291862912
00000100:00100000:2.0:1767318472.603116:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291862912
00000100:00100000:1.0:1767318472.603123:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16184
00000100:00100000:1.0:1767318472.603134:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291862784:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318472.603157:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318472.603225:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318472.603225:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291862784:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 92us (4746us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318472.604694:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16184
00000100:00100000:1.0:1767318472.604759:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3662
00000100:00100000:1.0:1767318472.604774:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291862912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318472.604996:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291862912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 227us (6316us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318472.605002:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3662
00000100:00080000:1.0:1767318472.663034:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318472.663048:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318472.663052:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318472.663056:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318472.663070:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318472.663079:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3369
00000100:00080000:1.0:1767318472.663083:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318472.663089:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318472.663130:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7ca80 x1853164379511040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318472.663158:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318472.663162:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318472.663164:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318472.663168:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3369
00000100:00080000:1.0:1767318472.663170:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318472.663174:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318472.663189:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7d500 x1853164379511168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318472.663252:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318472.663278:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318472.663280:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318472.663285:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3369
00000100:00080000:1.0:1767318472.663287:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318472.663291:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318472.663304:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7c700 x1853164379511680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318472.663311:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379511424:0@lo:400:kworker.0
00000100:00080000:1.0:1767318472.663321:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318472.663324:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318472.663326:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318472.663329:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3369
00000100:00080000:1.0:1767318472.663332:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318472.663335:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318472.663344:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7df80 x1853164379511936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318472.663369:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379511552:0@lo:400:kworker.0
00000100:00100000:2.0:1767318472.663395:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318472.663413:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318472.663482:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511424
00000100:00100000:0.0:1767318472.663490:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511424
00000100:00100000:3.0:1767318472.663535:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379511296:0@lo:400:kworker.0
00000100:00100000:0.0:1767318472.663549:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164
00000100:00100000:0.0:1767318472.663560:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379511424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318472.663567:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318472.663619:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379511424:12345-0@lo:400:kworker.0 Request processed in 61us (225us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318472.663622:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511296
00000100:00100000:3.0:1767318472.663628:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511296
00000100:00100000:0.0:1767318472.663631:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164
00000100:00100000:3.0:1767318472.663659:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165
00000100:00100000:3.0:1767318472.663666:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379511296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318472.663699:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379511296:12345-0@lo:400:kworker.0 Request processed in 34us (136us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318472.663716:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379511424:0@lo:400:kworker.0
00000100:00100000:2.0:1767318472.663743:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379511296:0@lo:400:kworker.0
00000100:00080000:2.0:1767318472.663762:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318472.663774:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379511808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318472.663808:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318472.663851:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511552
00000100:00100000:2.0:1767318472.663854:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511552
00000100:00100000:2.0:1767318472.663906:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511808
00000100:00100000:2.0:1767318472.663909:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511808
00000100:00100000:2.0:1767318472.663926:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3663
00000100:00100000:2.0:1767318472.663931:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379511552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318472.663958:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379511552:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318472.663964:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3663
00000100:00100000:2.0:1767318472.663974:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3664
00000100:00100000:2.0:1767318472.663980:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379511808:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318472.664002:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379511808:12345-0@lo:400:kworker.0 Request processed in 22us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318472.664007:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664
00000100:00080000:2.0:1767318472.664021:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318472.664043:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379511808:0@lo:400:kworker.0
00000100:00100000:2.0:1767318472.664065:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379511040:0@lo:38:kworker.0
00000100:00100000:2.0:1767318472.664085:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318472.664098:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379511168:0@lo:38:kworker.0
00000100:00100000:2.0:1767318472.664113:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318472.664131:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379511680:0@lo:38:kworker.0
00000100:00100000:2.0:1767318472.664146:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318472.664156:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379511936:0@lo:38:kworker.0
00000100:00100000:2.0:1767318472.664170:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318472.664199:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511040
00000100:00100000:2.0:1767318472.664202:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511040
00000100:00100000:2.0:1767318472.664216:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511680
00000100:00100000:2.0:1767318472.664218:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511680
00000100:00100000:2.0:1767318472.664227:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511936
00000100:00100000:2.0:1767318472.664229:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511936
00000100:00100000:2.0:1767318472.664241:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16185
00000100:00100000:2.0:1767318472.664245:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379511040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318472.664261:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318472.664288:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379511040:12345-0@lo:38:kworker.0 Request processed in 42us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318472.664294:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16185
00000100:00100000:2.0:1767318472.664305:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16186
00000100:00100000:2.0:1767318472.664309:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379511680:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318472.664326:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318472.664392:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379511680:12345-0@lo:38:kworker.0 Request processed in 81us (244us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318472.664409:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16186
00000100:00100000:2.0:1767318472.664423:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16187
00000100:00100000:2.0:1767318472.664426:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379511936:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318472.664435:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318472.664463:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379511936:12345-0@lo:38:kworker.0 Request processed in 35us (291us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318472.664468:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16187
00000100:00080000:2.0:1767318472.664494:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318472.664499:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318472.664507:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379511040:0@lo:38:kworker.0
00000100:00080000:2.0:1767318472.664515:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318472.664518:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318472.664521:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379511680:0@lo:38:kworker.0
00000100:00080000:2.0:1767318472.664528:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318472.664530:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318472.664533:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379511936:0@lo:38:kworker.0
00000100:00100000:2.0:1767318472.664569:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379511168
00000100:00100000:2.0:1767318472.664572:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379511168
00000100:00100000:2.0:1767318472.664592:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808
00000100:00100000:2.0:1767318472.664596:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379511168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318472.664606:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318472.664631:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379511168:12345-0@lo:38:kworker.0 Request processed in 33us (516us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318472.664636:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808
00000100:00080000:2.0:1767318472.664656:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318472.664659:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318472.664662:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379511168:0@lo:38:kworker.0
00000100:00100000:1.0:1767318472.665771:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379511552:0@lo:400:kworker.0
00000100:00100000:3.0:1767318472.671457:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165
00000100:00100000:2.0:1767318473.175193:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379512064:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318473.175261:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318473.175431:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512064
00000100:00100000:3.0:1767318473.175441:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512064
00000100:00100000:3.0:1767318473.175501:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909
00000100:00100000:3.0:1767318473.175511:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379512064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318473.175545:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318473.175617:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379512064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (354us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318473.175624:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909
00010000:00010000:1.0:1767318473.175750:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318473.175820:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379512064:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318474.199096:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318475.225479:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318476.248931:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318476.759659:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318476.759680:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379512192:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318476.759776:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318476.759965:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512192
00000100:00100000:1.0:1767318476.759974:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512192
00000100:00100000:1.0:1767318476.760050:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910
00000100:00100000:1.0:1767318476.760061:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379512192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318476.760093:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318476.760141:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379512192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (364us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318476.760167:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910
00000100:00080000:2.0:1767318476.760437:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318476.760487:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379512192:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318477.271084:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318477.715589:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318477.715778:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318477.719767:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291863168
00000100:00100000:2.0:1767318477.719784:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291863168
00000100:00100000:2.0:1767318477.720205:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291863040
00000100:00100000:2.0:1767318477.720210:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291863040
00000100:00080000:0.0:1767318477.720261:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318477.720360:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3665
00000100:00100000:3.0:1767318477.720376:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291863168:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318477.720479:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291863168:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (4900us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318477.720486:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3665
00000100:00100000:3.0:1767318477.720506:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16188
00000100:00100000:3.0:1767318477.720510:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291863040:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318477.720532:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318477.720574:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291863040:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 62us (4796us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318477.720580:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16188
00000100:00080000:3.0:1767318477.784324:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318477.784335:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318477.784339:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318477.784342:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318477.784348:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318477.784366:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3375
00000100:00080000:3.0:1767318477.784371:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318477.784378:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318477.784420:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3b80 x1853164379512320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318477.784503:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379512320:0@lo:38:kworker.0
00000100:00100000:0.0:1767318477.784596:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318477.784742:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512320
00000100:00100000:2.0:1767318477.784751:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512320
00000100:00100000:2.0:1767318477.784792:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16189
00000100:00100000:2.0:1767318477.784810:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379512320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318477.784832:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318477.784936:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318477.784940:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318477.784943:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318477.784947:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3375
00000100:00080000:3.0:1767318477.784950:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318477.784954:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318477.784970:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2680 x1853164379512448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318477.789061:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379512448:0@lo:38:kworker.0
00000100:00100000:0.0:1767318477.789151:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318477.789295:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512448
00000100:00100000:1.0:1767318477.789305:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512448
00000100:00100000:1.0:1767318477.789362:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809
00000100:00100000:1.0:1767318477.789371:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379512448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318477.789395:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318477.789440:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379512448:12345-0@lo:38:kworker.0 Request processed in 68us (288us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318477.789447:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809
00000100:00100000:2.0:1767318477.790331:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379512320:12345-0@lo:38:kworker.0 Request processed in 5517us (5730us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318477.790344:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16189
00000100:00080000:3.0:1767318477.790651:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318477.790655:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318477.790659:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318477.790679:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3375
00000100:00080000:3.0:1767318477.790683:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318477.790688:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318477.791104:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379512704:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.791167:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318477.791221:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318477.791227:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379512576:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.791250:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318477.791293:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318477.791302:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379512832:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.791346:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318477.791391:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512704
00000100:00100000:1.0:1767318477.791398:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512704
00000100:00100000:1.0:1767318477.791455:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512576
00000100:00100000:1.0:1767318477.791458:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512576
00000100:00100000:1.0:1767318477.791479:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166
00000100:00100000:1.0:1767318477.791486:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379512704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.791536:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379512704:12345-0@lo:400:kworker.0 Request processed in 50us (369us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318477.791553:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166
00000100:00100000:1.0:1767318477.791571:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167
00000100:00100000:1.0:1767318477.791576:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379512576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.791606:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379512576:12345-0@lo:400:kworker.0 Request processed in 30us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318477.791612:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167
00000100:00080000:1.0:1767318477.791634:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318477.791664:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379512576:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.791675:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379512704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318477.792469:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0a80 x1853164379512960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318477.792501:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318477.792505:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318477.792508:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318477.792512:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3375
00000100:00080000:3.0:1767318477.792516:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318477.792521:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318477.792537:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2d80 x1853164379513216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318477.792656:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512832
00000100:00100000:2.0:1767318477.792663:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512832
00000100:00100000:2.0:1767318477.792724:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3666
00000100:00100000:2.0:1767318477.792732:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379512832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318477.792785:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379512832:12345-0@lo:400:kworker.0 Request processed in 55us (1438us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318477.792792:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3666
00000100:00080000:3.0:1767318477.793025:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318477.794757:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379513088:0@lo:400:kworker.0
00000100:00100000:1.0:1767318477.794833:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318477.796835:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318477.796858:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318477.796862:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379512320:0@lo:38:kworker.0
00000100:00100000:0.0:1767318477.796912:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379512960:0@lo:38:kworker.0
00000100:00100000:1.0:1767318477.798951:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379512832:0@lo:400:kworker.0
00000100:00100000:3.0:1767318477.799185:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318477.799221:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379513216:0@lo:38:kworker.0
00000100:00100000:3.0:1767318477.799273:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318477.799315:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318477.799320:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318477.799323:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379512448:0@lo:38:kworker.0
00000100:00100000:3.0:1767318477.799384:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513088
00000100:00100000:3.0:1767318477.799391:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513088
00000100:00100000:3.0:1767318477.799445:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379512960
00000100:00100000:3.0:1767318477.799448:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379512960
00000100:00100000:3.0:1767318477.799461:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513216
00000100:00100000:3.0:1767318477.799464:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513216
00000100:00100000:3.0:1767318477.799494:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3667
00000100:00100000:3.0:1767318477.799503:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379513088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318477.799560:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379513088:12345-0@lo:400:kworker.0 Request processed in 58us (4726us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318477.799566:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3667
00000100:00100000:3.0:1767318477.799583:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16190
00000100:00100000:3.0:1767318477.799587:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379512960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318477.799606:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318477.799642:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379512960:12345-0@lo:38:kworker.0 Request processed in 52us (472us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318477.799648:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16190
00000100:00100000:3.0:1767318477.799659:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16191
00000100:00100000:3.0:1767318477.799663:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379513216:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318477.799672:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318477.799706:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379513216:12345-0@lo:38:kworker.0 Request processed in 41us (433us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318477.799711:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16191
00000100:00080000:3.0:1767318477.799728:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318477.799747:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318477.799752:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318477.799755:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379512960:0@lo:38:kworker.0
00000100:00080000:3.0:1767318477.799764:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318477.799767:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318477.799770:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379513216:0@lo:38:kworker.0
00000100:00100000:1.0:1767318477.800069:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379513088:0@lo:400:kworker.0
00010000:00010000:0.0:1767318478.295615:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318478.295785:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318478.295807:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379513344:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318478.295893:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318478.296040:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513344
00000100:00100000:3.0:1767318478.296063:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513344
00000100:00100000:3.0:1767318478.296122:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911
00000100:00100000:3.0:1767318478.296131:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379513344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318478.296161:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318478.296222:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379513344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318478.296229:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911
00000100:00100000:0.0:1767318478.296431:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379513344:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318479.319444:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318480.344099:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318481.371952:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318481.879283:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318481.879313:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379513472:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318481.879391:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318481.879943:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513472
00000100:00100000:1.0:1767318481.879952:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513472
00000100:00100000:1.0:1767318481.880023:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912
00000100:00100000:1.0:1767318481.880033:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379513472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318481.880063:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318481.880127:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379513472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (735us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318481.880162:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912
00000100:00100000:0.0:1767318481.880346:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379513472:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318481.880346:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318482.391357:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318482.831426:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318482.831688:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291863424
00000100:00100000:2.0:1767318482.831698:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291863424
00000100:00100000:2.0:1767318482.831780:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3668
00000100:00100000:2.0:1767318482.831791:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291863424:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318482.832155:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291863424:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 366us (737us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318482.832164:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3668
00000100:00080000:3.0:1767318482.832643:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318482.833444:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318482.833713:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291863296
00000100:00100000:2.0:1767318482.833722:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291863296
00000100:00100000:2.0:1767318482.833971:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16192
00000100:00100000:2.0:1767318482.833979:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291863296:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318482.834013:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318482.834075:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291863296:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (634us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318482.834084:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16192
00000100:00080000:3.0:1767318482.903037:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318482.903048:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318482.903059:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318482.903062:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318482.903067:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318482.903075:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3380
00000100:00080000:3.0:1767318482.903080:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318482.903087:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318482.903125:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0a80 x1853164379513600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318482.903143:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318482.903146:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318482.903147:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318482.903151:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3380
00000100:00080000:3.0:1767318482.903154:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318482.903157:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318482.903181:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2680 x1853164379513728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318482.903251:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318482.903254:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318482.903256:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318482.903260:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3380
00000100:00080000:3.0:1767318482.903262:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318482.903266:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318482.903275:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1880 x1853164379514240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318482.903289:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318482.903292:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318482.903294:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318482.903297:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3380
00000100:00080000:3.0:1767318482.903299:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318482.903302:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318482.903322:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2d80 x1853164379514496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318482.903417:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379513984:0@lo:400:kworker.0
00000100:00100000:2.0:1767318482.903491:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318482.903556:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318482.903561:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379513856:0@lo:400:kworker.0
00000100:00100000:2.0:1767318482.903581:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318482.903612:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513984
00000100:00100000:2.0:1767318482.903619:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513984
00000100:00100000:2.0:1767318482.903668:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513856
00000100:00100000:2.0:1767318482.903671:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513856
00000100:00100000:2.0:1767318482.903692:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168
00000100:00100000:2.0:1767318482.903700:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379513984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318482.903750:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379513984:12345-0@lo:400:kworker.0 Request processed in 51us (259us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318482.903757:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168
00000100:00100000:2.0:1767318482.903773:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169
00000100:00100000:2.0:1767318482.903779:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379513856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318482.903817:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379513856:12345-0@lo:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318482.903822:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169
00000100:00080000:2.0:1767318482.903838:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318482.903901:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379513856:0@lo:400:kworker.0
00000100:00100000:2.0:1767318482.903912:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379513984:0@lo:400:kworker.0
00000100:00100000:0.0:1767318482.904278:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379514112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318482.904327:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318482.904355:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318482.904360:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379514368:0@lo:400:kworker.0
00000100:00100000:0.0:1767318482.904378:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318482.904484:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379513600:0@lo:38:kworker.0
00000100:00100000:0.0:1767318482.904506:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318482.911732:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379513728:0@lo:38:kworker.0
00000100:00100000:1.0:1767318482.911768:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379514112
00000100:00100000:1.0:1767318482.911777:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379514112
00000100:00100000:1.0:1767318482.912047:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379514368
00000100:00100000:1.0:1767318482.912052:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379514368
00000100:00100000:1.0:1767318482.912074:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513600
00000100:00100000:1.0:1767318482.912077:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513600
00000100:00100000:1.0:1767318482.912095:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3669
00000100:00100000:1.0:1767318482.912103:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379514112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318482.912168:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379514112:12345-0@lo:400:kworker.0 Request processed in 65us (7839us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318482.912176:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3669
00000100:00100000:1.0:1767318482.912197:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670
00000100:00100000:1.0:1767318482.912203:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379514368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318482.912230:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379514368:12345-0@lo:400:kworker.0 Request processed in 28us (7851us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318482.912236:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670
00000100:00100000:1.0:1767318482.912249:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16193
00000100:00100000:1.0:1767318482.912253:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379513600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318482.912272:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318482.912297:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379513600:12345-0@lo:38:kworker.0 Request processed in 43us (7790us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318482.912302:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16193
00000100:00080000:1.0:1767318482.912338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318482.912374:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379514368:0@lo:400:kworker.0
00000100:00100000:1.0:1767318482.912386:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379514112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318482.912928:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318482.912961:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379513728
00000100:00100000:1.0:1767318482.912966:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379513728
00000100:00100000:1.0:1767318482.913030:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810
00000100:00100000:1.0:1767318482.913035:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379513728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318482.913048:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318482.913080:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379513728:12345-0@lo:38:kworker.0 Request processed in 44us (153us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318482.913087:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810
00000100:00100000:0.0:1767318482.913916:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379514240:0@lo:38:kworker.0
00000100:00100000:0.0:1767318482.913966:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318482.914338:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379514496:0@lo:38:kworker.0
00000100:00100000:0.0:1767318482.914363:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318482.914411:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318482.914416:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318482.914420:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379513600:0@lo:38:kworker.0
00000100:00080000:0.0:1767318482.914430:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318482.914433:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318482.914436:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379513728:0@lo:38:kworker.0
00000100:00100000:2.0:1767318482.914749:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379514240
00000100:00100000:2.0:1767318482.914757:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379514240
00000100:00100000:2.0:1767318482.914795:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379514496
00000100:00100000:2.0:1767318482.914805:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379514496
00000100:00100000:2.0:1767318482.914842:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16194
00000100:00100000:2.0:1767318482.914849:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379514240:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318482.914889:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318482.914936:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379514240:12345-0@lo:38:kworker.0 Request processed in 85us (968us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318482.914943:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16194
00000100:00100000:2.0:1767318482.914959:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16195
00000100:00100000:2.0:1767318482.914962:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379514496:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318482.914972:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318482.914993:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379514496:12345-0@lo:38:kworker.0 Request processed in 29us (630us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318482.914998:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16195
00000100:00080000:0.0:1767318482.915359:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318482.915364:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318482.915367:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379514240:0@lo:38:kworker.0
00000100:00080000:0.0:1767318482.915375:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318482.915378:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318482.915380:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379514496:0@lo:38:kworker.0
00010000:00010000:2.0:1767318483.415077:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318483.415434:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318483.415454:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379514624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318483.415522:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318483.415605:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379514624
00000100:00100000:2.0:1767318483.415614:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379514624
00000100:00100000:2.0:1767318483.415668:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913
00000100:00100000:2.0:1767318483.415678:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379514624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318483.415707:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318483.415776:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379514624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (253us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318483.415785:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913
00000100:00100000:0.0:1767318483.415900:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379514624:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318484.439036:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318485.467231:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318486.487569:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318486.936263:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767318486.936331:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291863552 offset 0 length 520: 4
00000100:00100000:0.0:1767318486.936356:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318486.936451:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291863808
00000100:00100000:2.0:1767318486.936461:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291863808
00000100:00100000:2.0:1767318486.936522:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291863680
00000100:00100000:2.0:1767318486.936524:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291863680
00000100:00100000:2.0:1767318486.936542:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3671
00000100:00100000:2.0:1767318486.936551:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291863808:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318486.936620:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291863808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 71us (367us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318486.936628:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3671
00000100:00100000:2.0:1767318486.936643:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16196
00000100:00100000:2.0:1767318486.936648:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291863680:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318486.936666:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318486.936689:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291863680:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (332us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318486.936695:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16196
00000100:00080000:0.0:1767318486.936760:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318486.999767:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318486.999786:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379514752:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318486.999895:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318487.007421:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379514752
00000100:00100000:3.0:1767318487.007436:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379514752
00000100:00100000:3.0:1767318487.007570:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914
00000100:00100000:3.0:1767318487.007580:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379514752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318487.007611:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318487.007701:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379514752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (7832us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318487.007729:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914
00000100:00100000:1.0:1767318487.007939:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379514752:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318487.014523:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318487.512517:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318488.023004:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318462/real 1767318462]  req@ffff8b0f31c80000 x1853164379508352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318487 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318488.023039:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f31c80000 x1853164379508352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318487 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318488.023061:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318488.023085:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318488.023089:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379508352:0@lo:250:kworker.0
00000100:00080000:3.0:1767318488.023249:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318488.023253:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318488.023256:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318488.023269:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3364
00000100:00080000:3.0:1767318488.023272:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318488.023277:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318488.023308:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0e00 x1853164379514880/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318488.023366:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379514880:0@lo:250:kworker.0
00000400:00000100:0.0:1767318488.023406:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379514880 offset 0 length 520: 4
00000100:00080000:3.0:1767318488.023456:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318488.023460:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318488.023462:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318488.023466:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3385
00000100:00080000:3.0:1767318488.023468:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318488.023472:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318488.023504:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3b80 x1853164379515008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318488.023566:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379515008:0@lo:38:kworker.0
00000100:00100000:0.0:1767318488.023594:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318488.023668:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515008
00000100:00100000:1.0:1767318488.023676:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515008
00000100:00100000:1.0:1767318488.023712:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16197
00000100:00100000:1.0:1767318488.023718:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379515008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318488.023734:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318488.023775:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379515008:12345-0@lo:38:kworker.0 Request processed in 57us (180us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318488.023780:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16197
00000100:00080000:2.0:1767318488.023892:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318488.023895:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318488.023898:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379515008:0@lo:38:kworker.0
00000100:00080000:3.0:1767318488.024004:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318488.024008:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318488.024010:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318488.024014:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3385
00000100:00080000:3.0:1767318488.024016:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318488.024020:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318488.024036:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3100 x1853164379515136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318488.024090:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379515136:0@lo:38:kworker.0
00000100:00100000:2.0:1767318488.024119:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318488.024236:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318488.024239:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318488.024241:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318488.024245:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3385
00000100:00080000:3.0:1767318488.024248:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318488.024251:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318488.024271:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3b80 x1853164379515648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318488.024306:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379515264:0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024328:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318488.024345:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318488.024348:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379515392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024371:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318488.024410:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318488.024418:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379515520:0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024436:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318488.024454:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515520
00000100:00100000:0.0:1767318488.024461:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515520
00000100:00100000:0.0:1767318488.024494:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672
00000100:00100000:0.0:1767318488.024500:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379515520:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024538:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379515520:12345-0@lo:400:kworker.0 Request processed in 38us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318488.024545:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672
00000100:00080000:0.0:1767318488.024562:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318488.024578:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379515520:0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024604:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515264
00000100:00100000:0.0:1767318488.024606:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515264
00000100:00100000:0.0:1767318488.024621:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515392
00000100:00100000:0.0:1767318488.024622:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515392
00000100:00100000:0.0:1767318488.024636:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170
00000100:00100000:0.0:1767318488.024639:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379515264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024661:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379515264:12345-0@lo:400:kworker.0 Request processed in 21us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318488.024664:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170
00000100:00100000:0.0:1767318488.024671:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171
00000100:00100000:0.0:1767318488.024674:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379515392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024688:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379515392:12345-0@lo:400:kworker.0 Request processed in 14us (316us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318488.024691:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171
00000100:00080000:0.0:1767318488.024698:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318488.024707:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379515392:0@lo:400:kworker.0
00000100:00100000:0.0:1767318488.024713:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379515264:0@lo:400:kworker.0
00000100:00100000:1.0:1767318488.024796:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515136
00000100:00100000:1.0:1767318488.024799:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515136
00000100:00100000:1.0:1767318488.024821:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811
00000100:00100000:1.0:1767318488.024824:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379515136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318488.024834:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318488.024881:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379515648:0@lo:38:kworker.0
00000100:00100000:2.0:1767318488.024899:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318488.024913:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515648
00000100:00100000:2.0:1767318488.024916:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515648
00000100:00100000:2.0:1767318488.024929:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16198
00000100:00100000:2.0:1767318488.024932:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379515648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318488.024941:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318488.024964:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379515648:12345-0@lo:38:kworker.0 Request processed in 29us (62us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318488.024969:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16198
00000100:00080000:2.0:1767318488.024993:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318488.024997:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318488.025000:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379515648:0@lo:38:kworker.0
00000100:00080000:3.0:1767318488.025115:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318488.025119:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318488.025121:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318488.025125:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3385
00000100:00080000:3.0:1767318488.025127:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318488.025131:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318488.025153:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2d80 x1853164379515904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318488.025175:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318488.025181:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379515776:0@lo:400:kworker.0
00000100:00100000:3.0:1767318488.025201:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318488.025229:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515776
00000100:00100000:3.0:1767318488.025232:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515776
00000100:00100000:3.0:1767318488.025252:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673
00000100:00100000:3.0:1767318488.025256:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379515776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318488.025293:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379515776:12345-0@lo:400:kworker.0 Request processed in 36us (90us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318488.025302:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673
00000100:00080000:3.0:1767318488.025312:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318488.025325:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379515776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318488.025507:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379515136:12345-0@lo:38:kworker.0 Request processed in 680us (1387us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318488.025524:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811
00000100:00080000:2.0:1767318488.025576:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318488.025580:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318488.025582:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379515136:0@lo:38:kworker.0
00000100:00100000:2.0:1767318488.025595:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379515904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318488.025611:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318488.025677:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379515904
00000100:00100000:3.0:1767318488.025680:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379515904
00000100:00100000:3.0:1767318488.025721:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16199
00000100:00100000:3.0:1767318488.025725:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379515904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318488.025733:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318488.025801:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379515904:12345-0@lo:38:kworker.0 Request processed in 73us (186us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318488.025808:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16199
00000100:00080000:0.0:1767318488.025864:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318488.025893:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318488.025897:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379515904:0@lo:38:kworker.0
00010000:00010000:0.0:1767318488.535033:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318488.535285:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379516032:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318488.535361:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318488.535612:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516032
00000100:00100000:2.0:1767318488.535620:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516032
00000100:00100000:2.0:1767318488.535778:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915
00000100:00100000:2.0:1767318488.535788:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379516032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318488.535820:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318488.535892:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379516032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (530us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318488.535899:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915
00000100:00100000:0.0:1767318488.536086:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379516032:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318489.559343:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318490.583385:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318491.607152:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318492.048771:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318492.048823:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318492.048912:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291864064
00000100:00100000:0.0:1767318492.048924:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291864064
00000100:00080000:3.0:1767318492.049000:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318492.049020:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291863936
00000100:00100000:0.0:1767318492.049025:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291863936
00000100:00100000:1.0:1767318492.049046:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3674
00000100:00100000:1.0:1767318492.049060:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291864064:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318492.049104:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16200
00000100:00100000:0.0:1767318492.049121:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291863936:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:1.0:1767318492.049141:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291864064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (377us total) trans 0 rc 0/0
00010000:00020000:0.0:1767318492.049144:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318492.049154:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3674
00000100:00100000:0.0:1767318492.049184:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291863936:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 62us (358us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318492.049202:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16200
00000100:00100000:0.0:1767318492.119112:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379516160:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318492.119205:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318492.119524:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516160
00000100:00100000:2.0:1767318492.119534:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516160
00000100:00100000:2.0:1767318492.119622:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916
00000100:00100000:2.0:1767318492.119633:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379516160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318492.119667:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318492.119722:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379516160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (529us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318492.119730:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916
00000100:00100000:0.0:1767318492.119761:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379516160:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318492.126395:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318492.631226:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318493.145567:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318493.145581:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318493.145585:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318493.145608:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318493.145622:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318493.145630:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3390
00000100:00080000:0.0:1767318493.145635:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318493.145643:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318493.145686:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd500 x1853164379516288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318493.145718:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318493.145722:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318493.145725:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318493.145730:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3390
00000100:00080000:0.0:1767318493.145733:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318493.145738:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318493.145753:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fe680 x1853164379516416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318493.145821:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379516288:0@lo:38:kworker.0
00000100:00080000:0.0:1767318493.145837:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318493.145842:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318493.145844:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318493.145850:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3390
00000100:00080000:0.0:1767318493.145852:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318493.145857:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318493.145908:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ff100 x1853164379516928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318493.145931:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318493.145941:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318493.145943:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318493.145948:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3390
00000100:00080000:0.0:1767318493.145951:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318493.145955:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318493.145971:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd880 x1853164379517184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318493.145984:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318493.146022:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379517056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318493.146106:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318493.146109:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379516416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318493.146158:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318493.146162:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318493.146175:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379516800:0@lo:400:kworker.0
00000100:00100000:0.0:1767318493.146224:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318493.146226:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379516928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318493.146272:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318493.146337:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379516672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318493.146500:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379516544:0@lo:400:kworker.0
00000100:00100000:0.0:1767318493.146717:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516288
00000100:00100000:0.0:1767318493.146736:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516288
00000100:00100000:0.0:1767318493.146775:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517056
00000100:00100000:0.0:1767318493.146779:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517056
00000100:00100000:0.0:1767318493.146819:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516800
00000100:00100000:0.0:1767318493.146822:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516800
00000100:00100000:0.0:1767318493.146838:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516928
00000100:00100000:0.0:1767318493.146841:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516928
00000100:00100000:0.0:1767318493.146854:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675
00000100:00100000:0.0:1767318493.146863:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379517056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318493.154126:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318493.154791:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516416
00000100:00100000:1.0:1767318493.154801:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516416
00000100:00100000:1.0:1767318493.154845:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812
00000100:00100000:1.0:1767318493.154855:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379516416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318493.154900:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318493.154954:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379516416:12345-0@lo:38:kworker.0 Request processed in 99us (8795us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318493.154961:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812
00000100:00100000:1.0:1767318493.154990:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676
00000100:00100000:1.0:1767318493.155002:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379516800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318493.155052:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379516800:12345-0@lo:400:kworker.0 Request processed in 54us (8840us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318493.155058:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676
00000100:00100000:1.0:1767318493.155077:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16201
00000100:00100000:1.0:1767318493.155082:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379516288:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318493.155108:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318493.155156:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379516288:12345-0@lo:38:kworker.0 Request processed in 64us (9169us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318493.155162:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16201
00000100:00100000:1.0:1767318493.155176:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16202
00000100:00100000:1.0:1767318493.155180:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379516928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318493.155199:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318493.155232:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379516928:12345-0@lo:38:kworker.0 Request processed in 51us (8965us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318493.155238:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16202
00000100:00100000:1.0:1767318493.155257:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516672
00000100:00100000:1.0:1767318493.155261:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516672
00000100:00100000:1.0:1767318493.155311:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172
00000100:00100000:1.0:1767318493.155318:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379516672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318493.155352:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31fbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379516672:12345-0@lo:400:kworker.0 Request processed in 34us (1234us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318493.155357:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172
00000100:00100000:1.0:1767318493.155633:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379516800:0@lo:400:kworker.0
00000100:00100000:1.0:1767318493.155672:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379516672:0@lo:400:kworker.0
00000100:00080000:1.0:1767318493.155750:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318493.155757:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318493.155758:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318493.155772:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318493.155924:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318493.156149:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379516928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318493.156165:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379517184:0@lo:38:kworker.0
00000100:00100000:2.0:1767318493.156221:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318493.156251:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318493.156256:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318493.156260:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379516288:0@lo:38:kworker.0
00000100:00080000:2.0:1767318493.156273:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318493.156276:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318493.156280:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379516416:0@lo:38:kworker.0
00000100:00100000:3.0:1767318493.156371:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517184
00000100:00100000:3.0:1767318493.156378:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517184
00000100:00100000:3.0:1767318493.156423:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16203
00000100:00100000:3.0:1767318493.156431:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379517184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318493.156454:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318493.156497:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379517184:12345-0@lo:38:kworker.0 Request processed in 65us (284us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318493.156504:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16203
00000100:00080000:2.0:1767318493.156569:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318493.156573:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318493.156577:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379517184:0@lo:38:kworker.0
00000100:00100000:1.0:1767318493.162052:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379516544
00000100:00100000:1.0:1767318493.162068:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379516544
00000100:00100000:1.0:1767318493.162227:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173
00000100:00100000:1.0:1767318493.162239:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379516544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318493.162524:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379516544:12345-0@lo:400:kworker.0 Request processed in 287us (6599us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318493.162533:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173
00000100:00100000:1.0:1767318493.164362:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379517056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318493.164423:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379517056:12345-0@lo:400:kworker.0 Request processed in 17558us (18314us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318493.164435:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675
00000100:00100000:3.0:1767318493.165699:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379516544:0@lo:400:kworker.0
00010000:00010000:1.0:1767318493.656261:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318493.656475:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318493.656509:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379517312:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318493.656612:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318493.656771:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517312
00000100:00100000:2.0:1767318493.656782:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517312
00000100:00100000:2.0:1767318493.656852:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917
00000100:00100000:2.0:1767318493.656864:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379517312:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318493.656926:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318493.656990:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379517312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (377us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318493.656999:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917
00000100:00100000:3.0:1767318493.657150:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379517312:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318494.679347:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318495.705838:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318496.727350:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318497.168463:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318497.170273:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318497.182668:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291864320
00000100:00100000:1.0:1767318497.182672:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291864192
00000100:00100000:1.0:1767318497.182684:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291864192
00000100:00100000:2.0:1767318497.182684:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291864320
00000100:00100000:1.0:1767318497.182747:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16204
00000100:00100000:1.0:1767318497.182756:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291864192:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:2.0:1767318497.182773:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3677
00010000:00020000:1.0:1767318497.182783:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318497.182784:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291864320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318497.182854:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291864192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 97us (12589us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318497.182862:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16204
00000100:00080000:3.0:1767318497.182907:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318497.185115:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291864320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 2321us (16649us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318497.185130:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3677
00000100:00100000:0.0:1767318497.239260:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318497.239377:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379517440:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318497.239457:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318497.239638:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517440
00000100:00100000:1.0:1767318497.239648:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517440
00000100:00080000:3.0:1767318497.239702:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318497.239712:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918
00000100:00100000:1.0:1767318497.239724:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379517440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318497.239752:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318497.239845:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379517440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (387us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318497.239852:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918
00000100:00100000:0.0:1767318497.240082:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379517440:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318497.751303:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318498.264385:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318498.264395:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318498.264398:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318498.264411:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318498.264416:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318498.264426:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3395
00000100:00080000:3.0:1767318498.264516:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318498.264525:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318498.264569:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1c00 x1853164379517568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318498.264600:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318498.264604:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318498.264605:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318498.264609:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3395
00000100:00080000:3.0:1767318498.264611:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318498.264615:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318498.264628:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2a00 x1853164379517696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318498.264688:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318498.264692:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318498.264702:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318498.264706:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3395
00000100:00080000:3.0:1767318498.264708:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318498.264712:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318498.264723:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3100 x1853164379518208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318498.265088:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379517824:0@lo:400:kworker.0
00000100:00100000:2.0:1767318498.265123:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379517568:0@lo:38:kworker.0
00000100:00100000:0.0:1767318498.265222:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379517952:0@lo:400:kworker.0
00000100:00080000:3.0:1767318498.265297:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318498.265301:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318498.265303:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318498.265307:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3395
00000100:00080000:3.0:1767318498.265310:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318498.265314:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318498.265329:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1180 x1853164379518464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318498.265353:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379518336:0@lo:400:kworker.0
00000100:00100000:2.0:1767318498.275223:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318498.275232:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318498.275506:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318498.275541:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318498.275546:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517824
00000100:00100000:1.0:1767318498.275557:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517824
00000100:00100000:0.0:1767318498.275667:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379518080:0@lo:400:kworker.0
00000100:00100000:2.0:1767318498.275753:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379517696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318498.275795:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318498.275821:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379518208:0@lo:38:kworker.0
00000100:00100000:2.0:1767318498.275842:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318498.275864:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379518464:0@lo:38:kworker.0
00000100:00100000:2.0:1767318498.275933:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318498.275964:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517696
00000100:00100000:2.0:1767318498.275968:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517696
00000100:00100000:2.0:1767318498.276016:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813
00000100:00100000:2.0:1767318498.276022:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379517696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318498.276053:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318498.276108:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379517696:12345-0@lo:38:kworker.0 Request processed in 84us (311us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318498.276114:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813
00000100:00080000:2.0:1767318498.276153:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318498.276157:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318498.276161:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379517696:0@lo:38:kworker.0
00000100:00100000:2.0:1767318498.276209:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517568
00000100:00100000:2.0:1767318498.276212:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517568
00000100:00100000:2.0:1767318498.276228:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518336
00000100:00100000:2.0:1767318498.276230:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518336
00000100:00100000:2.0:1767318498.276333:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518208
00000100:00100000:2.0:1767318498.276337:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518208
00000100:00100000:2.0:1767318498.276345:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518464
00000100:00100000:2.0:1767318498.276346:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518464
00000100:00100000:2.0:1767318498.276354:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678
00000100:00100000:2.0:1767318498.276360:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379518336:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318498.276426:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379518336:12345-0@lo:400:kworker.0 Request processed in 45us (988us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318498.276433:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678
00000100:00100000:2.0:1767318498.276447:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16205
00000100:00100000:2.0:1767318498.276450:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379517568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318498.276461:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318498.276491:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379517568:12345-0@lo:38:kworker.0 Request processed in 39us (1277us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318498.276497:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16205
00000100:00100000:2.0:1767318498.276523:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16206
00000100:00100000:2.0:1767318498.276527:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379518208:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318498.276535:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318498.276555:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379518208:12345-0@lo:38:kworker.0 Request processed in 27us (712us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318498.276559:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16206
00000100:00100000:2.0:1767318498.276568:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16207
00000100:00100000:2.0:1767318498.276571:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379518464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318498.276578:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318498.276593:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379518464:12345-0@lo:38:kworker.0 Request processed in 21us (661us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318498.276597:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16207
00000100:00080000:2.0:1767318498.276613:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318498.276630:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318498.276634:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318498.276636:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379518464:0@lo:38:kworker.0
00000100:00080000:2.0:1767318498.276659:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318498.276663:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318498.276665:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379517568:0@lo:38:kworker.0
00000100:00080000:2.0:1767318498.276672:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318498.276674:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318498.276677:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379518208:0@lo:38:kworker.0
00000100:00100000:2.0:1767318498.276714:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379518336:0@lo:400:kworker.0
00000100:00100000:0.0:1767318498.277133:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318498.277230:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518080
00000100:00100000:2.0:1767318498.277235:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518080
00000100:00100000:3.0:1767318498.277532:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379517952
00000100:00100000:3.0:1767318498.277538:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379517952
00000100:00100000:2.0:1767318498.277576:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679
00000100:00100000:2.0:1767318498.277583:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379518080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318498.277615:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379518080:12345-0@lo:400:kworker.0 Request processed in 34us (482us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318498.277620:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679
00000100:00100000:2.0:1767318498.277647:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174
00000100:00100000:2.0:1767318498.277652:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379517824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318498.277675:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379517824:12345-0@lo:400:kworker.0 Request processed in 24us (2448us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318498.277679:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174
00000100:00100000:2.0:1767318498.277707:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379517824:0@lo:400:kworker.0
00000100:00100000:1.0:1767318498.278061:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379518080:0@lo:400:kworker.0
00000100:00080000:0.0:1767318498.278261:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318498.278268:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318498.278280:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175
00000100:00100000:3.0:1767318498.278291:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379517952:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318498.278446:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379517952:12345-0@lo:400:kworker.0 Request processed in 157us (2940us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318498.278453:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175
00000100:00100000:2.0:1767318498.278622:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379517952:0@lo:400:kworker.0
00010000:00010000:0.0:1767318498.775298:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318498.775961:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379518592:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318498.776038:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318498.776318:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518592
00000100:00100000:1.0:1767318498.776326:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518592
00000100:00100000:1.0:1767318498.776375:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919
00000100:00100000:1.0:1767318498.776384:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379518592:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318498.776414:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318498.776466:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379518592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318498.776473:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919
00000100:00100000:3.0:1767318498.776555:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379518592:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318499.801693:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318500.823391:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318501.847748:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318502.305755:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318502.305811:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318502.306047:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291864576
00000100:00100000:2.0:1767318502.306058:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291864576
00000100:00100000:2.0:1767318502.306137:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291864448
00000100:00100000:2.0:1767318502.306141:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291864448
00000100:00100000:2.0:1767318502.306173:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3680
00000100:00100000:2.0:1767318502.306182:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291864576:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318502.306256:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291864576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (510us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318502.306265:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3680
00000100:00100000:2.0:1767318502.306286:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16208
00000100:00100000:2.0:1767318502.306290:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291864448:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318502.306308:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318502.306335:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291864448:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (524us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318502.306341:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16208
00000100:00080000:1.0:1767318502.306564:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318502.362804:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318502.362824:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379518720:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318502.362969:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318502.363305:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518720
00000100:00100000:3.0:1767318502.363326:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518720
00000100:00100000:3.0:1767318502.363387:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920
00000100:00100000:3.0:1767318502.363395:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379518720:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318502.363420:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318502.363459:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379518720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (491us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318502.363464:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920
00000100:00100000:3.0:1767318502.363507:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379518720:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318502.363577:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318502.871063:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318503.384624:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318503.384634:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318503.384637:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318503.384641:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318503.384645:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318503.384653:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3400
00000100:00080000:2.0:1767318503.384657:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318503.384664:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318503.384703:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22a00 x1853164379518848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318503.385238:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318503.385243:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318503.385245:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318503.385250:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3400
00000100:00080000:2.0:1767318503.385254:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318503.385259:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318503.385275:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23800 x1853164379518976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318503.385333:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318503.385337:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318503.385338:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318503.385342:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3400
00000100:00080000:2.0:1767318503.385344:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318503.385347:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318503.385361:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20000 x1853164379519488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318503.385377:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318503.385380:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318503.385381:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318503.385384:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3400
00000100:00080000:2.0:1767318503.385387:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318503.385391:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318503.385400:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23b80 x1853164379519744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318503.385467:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379519616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.385542:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318503.385606:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318503.385613:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379519360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.385634:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318503.385665:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379519616
00000100:00100000:0.0:1767318503.385673:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379519616
00000100:00100000:0.0:1767318503.385719:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379519360
00000100:00100000:0.0:1767318503.385723:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379519360
00000100:00100000:1.0:1767318503.385730:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379519104:0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.385748:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681
00000100:00100000:0.0:1767318503.385755:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379519616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318503.385762:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318503.385787:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318503.385792:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379519232:0@lo:400:kworker.0
00000100:00100000:1.0:1767318503.385810:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318503.385819:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379519616:12345-0@lo:400:kworker.0 Request processed in 64us (276us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318503.385826:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681
00000100:00080000:1.0:1767318503.385840:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318503.385843:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682
00000100:00100000:0.0:1767318503.385850:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379519360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318503.385853:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379519104
00000100:00100000:1.0:1767318503.385856:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379519104
00000100:00100000:0.0:1767318503.385904:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379519360:12345-0@lo:400:kworker.0 Request processed in 55us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318503.385904:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176
00000100:00100000:0.0:1767318503.385910:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682
00000100:00100000:1.0:1767318503.385911:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379519104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.385934:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379518848:0@lo:38:kworker.0
00000100:00100000:1.0:1767318503.385942:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379519104:12345-0@lo:400:kworker.0 Request processed in 33us (179us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318503.385954:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176
00000100:00100000:0.0:1767318503.385956:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318503.385968:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379519232
00000100:00100000:0.0:1767318503.385969:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379518976:0@lo:38:kworker.0
00000100:00100000:1.0:1767318503.385971:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379519232
00000100:00100000:0.0:1767318503.385990:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318503.385996:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177
00000100:00100000:1.0:1767318503.386001:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379519232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.386010:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379519488:0@lo:38:kworker.0
00000100:00100000:1.0:1767318503.386029:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379519232:12345-0@lo:400:kworker.0 Request processed in 27us (218us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318503.386035:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177
00000100:00100000:0.0:1767318503.386054:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318503.386055:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318503.386068:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379519744:0@lo:38:kworker.0
00000100:00100000:1.0:1767318503.386079:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379519232:0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.386087:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318503.386088:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379519104:0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.386111:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518976
00000100:00100000:0.0:1767318503.386115:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518976
00000100:00100000:1.0:1767318503.386132:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379518848
00000100:00100000:1.0:1767318503.386135:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379518848
00000100:00100000:0.0:1767318503.386146:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814
00000100:00100000:1.0:1767318503.386149:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379519488
00000100:00100000:0.0:1767318503.386150:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379518976:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318503.386151:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379519488
00000100:00100000:1.0:1767318503.386157:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379519744
00000100:00100000:1.0:1767318503.386159:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379519744
00000100:00100000:1.0:1767318503.386166:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16209
00010000:00020000:0.0:1767318503.386167:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318503.386170:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379518848:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318503.386199:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379518976:12345-0@lo:38:kworker.0 Request processed in 47us (208us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318503.386205:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814
00000100:00100000:0.0:1767318503.386231:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16210
00000100:00100000:0.0:1767318503.386236:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379519488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318503.386247:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318503.386273:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379519488:12345-0@lo:38:kworker.0 Request processed in 35us (219us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318503.386279:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16210
00000100:00100000:0.0:1767318503.386291:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16211
00000100:00100000:0.0:1767318503.386295:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379519744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318503.386303:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318503.386326:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379519744:12345-0@lo:38:kworker.0 Request processed in 29us (237us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318503.386331:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16211
00000100:00080000:0.0:1767318503.386360:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318503.386364:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318503.386368:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379518976:0@lo:38:kworker.0
00000100:00080000:0.0:1767318503.386375:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318503.386378:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318503.386381:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379519488:0@lo:38:kworker.0
00000100:00080000:0.0:1767318503.386388:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318503.386390:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318503.386393:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379519744:0@lo:38:kworker.0
00000100:00100000:0.0:1767318503.386464:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379519360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318503.386473:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379519616:0@lo:400:kworker.0
00010000:00020000:1.0:1767318503.386594:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318503.386644:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379518848:12345-0@lo:38:kworker.0 Request processed in 472us (686us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318503.386651:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16209
00000100:00080000:0.0:1767318503.386904:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318503.386909:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318503.386911:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379518848:0@lo:38:kworker.0
00000100:00100000:1.0:1767318503.895224:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379519872:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318503.895313:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318503.895444:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379519872
00000100:00100000:2.0:1767318503.895456:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379519872
00000100:00100000:2.0:1767318503.895505:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921
00000100:00100000:2.0:1767318503.895515:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379519872:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318503.895542:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318503.895599:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379519872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318503.895606:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921
00000100:00100000:1.0:1767318503.895693:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379519872:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318503.896489:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318504.919027:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318505.943283:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318506.968857:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318507.415239:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318507.415349:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318507.415688:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291864832
00000100:00100000:2.0:1767318507.415702:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291864832
00000100:00100000:2.0:1767318507.415792:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291864704
00000100:00100000:2.0:1767318507.415796:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291864704
00000100:00100000:2.0:1767318507.415819:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3683
00000100:00100000:2.0:1767318507.415831:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291864832:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318507.415986:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291864832:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 157us (762us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318507.415995:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3683
00000100:00100000:2.0:1767318507.416019:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16212
00000100:00100000:2.0:1767318507.416023:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291864704:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318507.416049:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318507.416077:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291864704:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (728us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318507.416094:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16212
00000100:00080000:0.0:1767318507.417482:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318507.480054:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318507.480091:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379520000:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318507.480204:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318507.480605:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520000
00000100:00100000:1.0:1767318507.480618:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520000
00000100:00100000:1.0:1767318507.480713:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922
00000100:00100000:1.0:1767318507.480724:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379520000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318507.480771:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318507.480846:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379520000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (641us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318507.480866:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922
00000100:00100000:1.0:1767318507.480969:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379520000:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318507.481429:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318507.991372:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318508.503654:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318508.503672:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318508.503678:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318508.503685:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318508.503691:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318508.503703:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3405
00000100:00080000:2.0:1767318508.503711:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318508.503721:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318508.505237:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20380 x1853164379520128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318508.505276:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318508.505282:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318508.505286:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318508.505294:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3405
00000100:00080000:2.0:1767318508.505299:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318508.505306:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318508.505328:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22d80 x1853164379520256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318508.505488:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379520384:0@lo:400:kworker.0
00000100:00100000:3.0:1767318508.505637:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318508.505846:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520384
00000100:00100000:1.0:1767318508.505860:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520384
00000100:00100000:1.0:1767318508.505998:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178
00000100:00100000:1.0:1767318508.506009:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379520384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.506209:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379520128:0@lo:38:kworker.0
00000100:00100000:0.0:1767318508.506253:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318508.506281:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379520256:0@lo:38:kworker.0
00000100:00100000:0.0:1767318508.506306:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318508.506348:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379520512:0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.506378:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318508.506415:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520256
00000100:00100000:0.0:1767318508.506420:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520256
00000100:00100000:0.0:1767318508.506448:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815
00000100:00100000:0.0:1767318508.506454:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379520256:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318508.506484:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318508.506524:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379520256:12345-0@lo:38:kworker.0 Request processed in 69us (216us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318508.506531:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815
00000100:00100000:0.0:1767318508.506573:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520128
00000100:00100000:0.0:1767318508.506577:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520128
00000100:00100000:0.0:1767318508.506602:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16213
00000100:00100000:0.0:1767318508.506638:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379520128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318508.506652:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318508.506682:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379520128:12345-0@lo:38:kworker.0 Request processed in 45us (429us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318508.506689:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16213
00000100:00080000:0.0:1767318508.506737:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318508.506744:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318508.506747:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379520128:0@lo:38:kworker.0
00000100:00080000:0.0:1767318508.506759:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318508.506763:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318508.506766:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379520256:0@lo:38:kworker.0
00000100:00100000:0.0:1767318508.506834:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520512
00000100:00100000:0.0:1767318508.506839:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520512
00000100:00100000:0.0:1767318508.506916:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179
00000100:00100000:0.0:1767318508.506925:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379520512:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.506970:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379520512:12345-0@lo:400:kworker.0 Request processed in 47us (591us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318508.506977:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179
00000100:00100000:0.0:1767318508.507016:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379520512:0@lo:400:kworker.0
00000100:00080000:0.0:1767318508.507037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318508.524827:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379520640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.524950:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318508.525050:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318508.525056:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318508.525061:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318508.525068:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3405
00000100:00080000:2.0:1767318508.525083:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318508.525091:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318508.525124:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22300 x1853164379520768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318508.531883:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318508.531923:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379520896:0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.532146:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318508.532283:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520640
00000100:00100000:0.0:1767318508.532296:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520640
00000100:00100000:0.0:1767318508.532374:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520896
00000100:00100000:0.0:1767318508.532377:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520896
00000100:00100000:0.0:1767318508.532412:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684
00000100:00100000:0.0:1767318508.532422:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379520640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.534303:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379520640:12345-0@lo:400:kworker.0 Request processed in 1867us (9339us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318508.534324:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684
00000100:00100000:0.0:1767318508.534377:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685
00000100:00100000:0.0:1767318508.534394:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379520896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.534443:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379520896:12345-0@lo:400:kworker.0 Request processed in 57us (2298us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318508.534449:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685
00000100:00080000:0.0:1767318508.534520:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318508.536172:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318508.536190:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318508.536195:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318508.536204:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3405
00000100:00080000:2.0:1767318508.536210:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318508.536220:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318508.536309:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21880 x1853164379521024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318508.536784:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379520768:0@lo:38:kworker.0
00000100:00100000:0.0:1767318508.536909:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318508.536954:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379521024:0@lo:38:kworker.0
00000100:00100000:2.0:1767318508.538239:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379520768
00000100:00100000:2.0:1767318508.538262:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379520768
00000100:00100000:2.0:1767318508.538353:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16214
00000100:00100000:2.0:1767318508.538365:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379520768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318508.538403:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318508.538504:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379520768:12345-0@lo:38:kworker.0 Request processed in 140us (1594us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318508.538512:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16214
00000100:00100000:0.0:1767318508.538745:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318508.538835:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318508.538842:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318508.538848:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379520768:0@lo:38:kworker.0
00000100:00100000:0.0:1767318508.538905:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521024
00000100:00100000:0.0:1767318508.538910:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521024
00000100:00100000:0.0:1767318508.538945:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16215
00000100:00100000:0.0:1767318508.538950:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379521024:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318508.538963:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318508.540113:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379520384:12345-0@lo:400:kworker.0 Request processed in 34096us (34467us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318508.540131:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178
00000100:00100000:1.0:1767318508.540245:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379520896:0@lo:400:kworker.0
00000100:00100000:1.0:1767318508.540266:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379520640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318508.540335:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379521024:12345-0@lo:38:kworker.0 Request processed in 1382us (3354us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318508.540345:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16215
00000100:00080000:2.0:1767318508.540709:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318508.540718:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318508.540721:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379521024:0@lo:38:kworker.0
00000100:00100000:3.0:1767318508.542262:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379520384:0@lo:400:kworker.0
00010000:00010000:0.0:1767318509.015171:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318509.018605:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379521152:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318509.018733:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318509.018990:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521152
00000100:00100000:3.0:1767318509.019002:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521152
00000100:00100000:3.0:1767318509.019088:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923
00000100:00100000:3.0:1767318509.019102:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379521152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318509.019163:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318509.019243:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379521152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (511us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318509.019252:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923
00000100:00100000:0.0:1767318509.020684:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379521152:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318510.039086:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318511.070826:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318511.512365:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318511.512543:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865216
00000100:00100000:0.0:1767318511.512557:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865216
00000400:00000100:3.0:1767318511.512655:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291864960 offset 0 length 520: 4
00000100:00100000:3.0:1767318511.512678:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318511.513335:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865088
00000100:00100000:0.0:1767318511.513341:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865088
00000100:00100000:0.0:1767318511.513367:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3686
00000100:00100000:0.0:1767318511.513380:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291865216:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318511.513447:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16216
00000100:00100000:2.0:1767318511.513457:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291865088:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318511.513484:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318511.513494:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291865216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 116us (1141us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318511.513504:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3686
00000100:00100000:2.0:1767318511.513539:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291865088:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 81us (858us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318511.513549:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16216
00000100:00080000:1.0:1767318511.515746:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318512.089702:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318512.599636:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379521280:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318512.599727:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318512.600367:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521280
00000100:00100000:2.0:1767318512.600380:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521280
00000100:00100000:2.0:1767318512.600457:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924
00000100:00100000:2.0:1767318512.600469:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379521280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318512.600508:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767318512.600541:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318512.600576:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379521280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (848us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318512.600584:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924
00000100:00100000:3.0:1767318512.600619:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379521280:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318513.111696:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318513.623107:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318513.623121:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318513.623126:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318513.623130:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318513.623136:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318513.623146:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3410
00000100:00080000:3.0:1767318513.623152:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318513.623160:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318513.623211:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3100 x1853164379521408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318513.623244:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318513.623249:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318513.623251:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318513.623255:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3410
00000100:00080000:3.0:1767318513.623258:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318513.623262:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318513.623276:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1c00 x1853164379521536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318513.623359:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318513.623363:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318513.623365:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318513.623369:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3410
00000100:00080000:3.0:1767318513.623372:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318513.623393:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318513.623408:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164379522048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318513.623425:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318513.623428:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318513.623430:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318513.623433:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3410
00000100:00080000:3.0:1767318513.623436:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318513.623440:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318513.623449:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45500 x1853164379522304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318513.623502:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379522176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.623901:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379521664:0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.623982:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318513.624088:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318513.624095:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379521792:0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.624118:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318513.624151:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521664
00000100:00100000:1.0:1767318513.624159:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521664
00000100:00100000:1.0:1767318513.624207:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521792
00000100:00100000:1.0:1767318513.624209:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521792
00000100:00100000:1.0:1767318513.624244:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180
00000100:00100000:1.0:1767318513.624255:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379521664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.624522:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379521664:12345-0@lo:400:kworker.0 Request processed in 261us (531us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318513.624538:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180
00000100:00100000:1.0:1767318513.624576:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181
00000100:00100000:1.0:1767318513.624588:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379521792:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.624623:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379521792:12345-0@lo:400:kworker.0 Request processed in 40us (503us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318513.624628:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181
00000100:00100000:1.0:1767318513.624694:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379521792:0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.624782:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379521664:0@lo:400:kworker.0
00000100:00100000:3.0:1767318513.624921:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318513.624973:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379522176
00000100:00100000:3.0:1767318513.624977:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379522176
00000100:00100000:1.0:1767318513.625042:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379521920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.625086:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318513.625114:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687
00000100:00100000:3.0:1767318513.625128:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379522176:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318513.625211:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379521408:0@lo:38:kworker.0
00000100:00100000:3.0:1767318513.625296:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379522176:12345-0@lo:400:kworker.0 Request processed in 171us (376us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318513.625304:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687
00000100:00080000:0.0:1767318513.631074:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318513.631089:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318513.631184:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379522176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318513.637603:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318513.640216:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521920
00000100:00100000:3.0:1767318513.640237:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521920
00000100:00100000:3.0:1767318513.640343:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688
00000100:00100000:3.0:1767318513.640357:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379521920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318513.640610:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379521920:12345-0@lo:400:kworker.0 Request processed in 256us (15523us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318513.640636:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688
00000100:00100000:3.0:1767318513.640656:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521408
00000100:00100000:3.0:1767318513.640660:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521408
00000100:00100000:3.0:1767318513.640685:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16217
00000100:00100000:3.0:1767318513.640691:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379521408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318513.640718:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318513.641432:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379521536:0@lo:38:kworker.0
00000100:00080000:0.0:1767318513.651394:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318513.651835:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379521920:0@lo:400:kworker.0
00000100:00100000:3.0:1767318513.655058:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379521408:12345-0@lo:38:kworker.0 Request processed in 14317us (17413us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318513.655078:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16217
00000100:00100000:1.0:1767318513.656541:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318513.656668:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379522048:0@lo:38:kworker.0
00000100:00100000:1.0:1767318513.656730:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318513.656766:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379522304:0@lo:38:kworker.0
00000100:00100000:1.0:1767318513.656790:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318513.656837:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318513.656842:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318513.656845:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379521408:0@lo:38:kworker.0
00000100:00100000:2.0:1767318513.661072:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379522048
00000100:00100000:2.0:1767318513.661095:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379522048
00000100:00100000:2.0:1767318513.661159:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379522304
00000100:00100000:2.0:1767318513.661163:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379522304
00000100:00100000:2.0:1767318513.661196:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16218
00000100:00100000:2.0:1767318513.661208:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379522048:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318513.661242:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318513.661377:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379522048:12345-0@lo:38:kworker.0 Request processed in 169us (4643us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318513.661385:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16218
00000100:00100000:2.0:1767318513.661411:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16219
00000100:00100000:2.0:1767318513.661417:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379522304:12345-0@lo:38:kworker.0
00000100:00080000:1.0:1767318513.661432:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00010000:00020000:2.0:1767318513.661441:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318513.661451:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318513.661460:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379522048:0@lo:38:kworker.0
00000100:00100000:2.0:1767318513.661488:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379522304:12345-0@lo:38:kworker.0 Request processed in 68us (4695us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318513.661489:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318513.661503:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318513.661509:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16219
00000100:00100000:1.0:1767318513.661514:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379522304:0@lo:38:kworker.0
00000100:00100000:3.0:1767318513.663071:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379521536
00000100:00100000:3.0:1767318513.663086:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379521536
00000100:00100000:3.0:1767318513.663132:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816
00000100:00100000:3.0:1767318513.663141:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379521536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318513.663165:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318513.663275:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379521536:12345-0@lo:38:kworker.0 Request processed in 134us (6743us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318513.663283:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816
00000100:00080000:1.0:1767318513.664712:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318513.664726:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318513.664734:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379521536:0@lo:38:kworker.0
00000100:00100000:3.0:1767318514.140946:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318514.140978:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379522432:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318514.141083:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1767318514.141962:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318514.141986:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379522432
00000100:00100000:2.0:1767318514.141996:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379522432
00000100:00100000:2.0:1767318514.142080:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925
00000100:00100000:2.0:1767318514.142090:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379522432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318514.142130:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318514.142213:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379522432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1128us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318514.142222:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925
00000100:00100000:1.0:1767318514.142401:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379522432:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318514.711091:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318488/real 1767318488]  req@ffff8b0f1c0b0e00 x1853164379514880/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318513 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318514.711145:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f1c0b0e00 x1853164379514880/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318513 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318514.711174:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318514.711254:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318514.711259:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379514880:0@lo:250:kworker.0
00000100:00080000:3.0:1767318514.713250:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318514.713264:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318514.713269:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318514.713277:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3390
00000100:00080000:3.0:1767318514.713284:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318514.713293:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318514.715510:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47b80 x1853164379522560/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318514.715713:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379522560:0@lo:250:kworker.0
00000400:00000100:1.0:1767318514.715815:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379522560 offset 0 length 520: 4
00000100:00080000:3.0:1767318514.715933:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318514.715938:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318514.715942:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318514.715947:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3416
00000100:00080000:3.0:1767318514.715951:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318514.715958:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318514.716000:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45c00 x1853164379522688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318514.724838:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379522688:0@lo:38:kworker.0
00000100:00100000:1.0:1767318514.724962:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318514.725431:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379522688
00000100:00100000:0.0:1767318514.725441:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379522688
00000100:00100000:0.0:1767318514.725501:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16220
00000100:00100000:0.0:1767318514.725529:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379522688:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318514.725558:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318514.725607:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379522688:12345-0@lo:38:kworker.0 Request processed in 78us (646us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318514.725614:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16220
00000100:00080000:1.0:1767318514.726478:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318514.726489:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318514.726494:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379522688:0@lo:38:kworker.0
00000100:00080000:3.0:1767318514.726607:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318514.726613:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318514.726617:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318514.726630:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3416
00000100:00080000:3.0:1767318514.726634:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318514.726641:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318514.726703:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45180 x1853164379522816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318514.726785:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379522944:0@lo:400:kworker.0
00000100:00100000:2.0:1767318514.726838:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318514.726917:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318514.726921:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318514.726923:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318514.726927:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3416
00000100:00080000:3.0:1767318514.726929:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318514.726933:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318514.726955:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47100 x1853164379523328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318514.727033:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379523456:0@lo:400:kworker.0
00000100:00100000:0.0:1767318514.727068:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318514.727103:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379522944
00000100:00100000:0.0:1767318514.727109:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379522944
00000100:00100000:0.0:1767318514.727166:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182
00000100:00100000:0.0:1767318514.727175:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379522944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318514.727253:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379522816:0@lo:38:kworker.0
00000100:00100000:1.0:1767318514.727285:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318514.727306:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379523328:0@lo:38:kworker.0
00000100:00100000:1.0:1767318514.727330:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318514.727385:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379523200:0@lo:400:kworker.0
00000100:00100000:1.0:1767318514.727411:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318514.727432:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318514.727437:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379523072:0@lo:400:kworker.0
00000100:00100000:1.0:1767318514.727460:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318514.727493:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523456
00000100:00100000:1.0:1767318514.727497:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523456
00000100:00100000:1.0:1767318514.727526:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523328
00000100:00100000:1.0:1767318514.727528:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523328
00000100:00100000:1.0:1767318514.727541:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523200
00000100:00100000:1.0:1767318514.727543:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523200
00000100:00100000:1.0:1767318514.727561:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689
00000100:00100000:1.0:1767318514.727566:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379523456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318514.727605:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379523456:12345-0@lo:400:kworker.0 Request processed in 38us (535us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318514.727612:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689
00000100:00100000:1.0:1767318514.727664:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379523456:0@lo:400:kworker.0
00000100:00100000:1.0:1767318514.727685:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690
00000100:00100000:1.0:1767318514.727691:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379523200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318514.727724:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379523200:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318514.727730:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690
00000100:00100000:1.0:1767318514.727742:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16221
00000100:00100000:1.0:1767318514.727746:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379523328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318514.727763:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318514.727794:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379523328:12345-0@lo:38:kworker.0 Request processed in 46us (463us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318514.727800:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16221
00000100:00100000:1.0:1767318514.727823:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379523200:0@lo:400:kworker.0
00000100:00080000:1.0:1767318514.727841:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318514.727845:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318514.727848:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379523328:0@lo:38:kworker.0
00000100:00100000:1.0:1767318514.727904:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379522816
00000100:00100000:1.0:1767318514.727908:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379522816
00000100:00100000:1.0:1767318514.727931:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817
00000100:00100000:1.0:1767318514.727936:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379522816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318514.727946:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318514.727976:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379522816:12345-0@lo:38:kworker.0 Request processed in 39us (690us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318514.727982:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817
00000100:00100000:1.0:1767318514.729718:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523072
00000100:00100000:1.0:1767318514.729811:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523072
00000100:00100000:1.0:1767318514.729896:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183
00000100:00100000:1.0:1767318514.729907:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379523072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318514.730260:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379523072:12345-0@lo:400:kworker.0 Request processed in 355us (2797us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318514.730270:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183
00000100:00080000:1.0:1767318514.730314:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318514.732294:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379523072:0@lo:400:kworker.0
00000100:00080000:1.0:1767318514.732525:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318514.732532:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318514.732536:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379522816:0@lo:38:kworker.0
00000100:00080000:3.0:1767318514.737309:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318514.737323:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318514.737328:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318514.737338:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3416
00000100:00080000:3.0:1767318514.737344:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318514.737352:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318514.737418:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47480 x1853164379523584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318514.738779:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379522944:12345-0@lo:400:kworker.0 Request processed in 11593us (11928us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318514.739276:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182
00000100:00100000:1.0:1767318514.747179:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379523584:0@lo:38:kworker.0
00000100:00100000:1.0:1767318514.747294:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318514.748804:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523584
00000100:00100000:0.0:1767318514.748820:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523584
00000100:00100000:0.0:1767318514.748916:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16222
00000100:00100000:0.0:1767318514.748927:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379523584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318514.748957:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318514.749300:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379523584:12345-0@lo:38:kworker.0 Request processed in 373us (2005us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318514.749308:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16222
00000100:00080000:0.0:1767318514.749374:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318514.749379:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318514.749383:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379523584:0@lo:38:kworker.0
00000100:00100000:2.0:1767318514.755150:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379522944:0@lo:400:kworker.0
00010000:00010000:0.0:1767318515.159242:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318516.186969:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318516.626532:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318516.626695:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318516.627661:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865472
00000100:00100000:3.0:1767318516.627687:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865472
00000100:00100000:3.0:1767318516.627850:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865344
00000100:00100000:3.0:1767318516.627854:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865344
00000100:00080000:0.0:1767318516.627903:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318516.628175:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3691
00000100:00100000:1.0:1767318516.628192:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291865472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318516.628299:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291865472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 112us (1781us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318516.628309:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3691
00000100:00100000:1.0:1767318516.628331:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16223
00000100:00100000:1.0:1767318516.628336:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291865344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318516.628361:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318516.628386:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291865344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (1692us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318516.628414:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16223
00010000:00010000:0.0:1767318517.207149:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318517.719436:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318517.719471:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379523712:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318517.719581:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318517.719838:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523712
00000100:00100000:2.0:1767318517.719850:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523712
00000100:00100000:2.0:1767318517.719957:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926
00000100:00100000:2.0:1767318517.719978:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379523712:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318517.720046:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318517.720110:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379523712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (528us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318517.720120:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926
00000100:00080000:3.0:1767318517.720310:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318517.720361:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379523712:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318518.231387:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318519.255537:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318519.255563:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379523840:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318519.255641:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318519.255802:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523840
00000100:00100000:3.0:1767318519.255811:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523840
00000100:00100000:3.0:1767318519.255900:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927
00000100:00100000:3.0:1767318519.255911:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379523840:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318519.255947:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318519.256009:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379523840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (367us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318519.256040:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927
00000100:00080000:2.0:1767318519.256153:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318519.256195:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379523840:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318519.256591:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318519.768613:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318519.768621:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318519.768624:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318519.768628:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318519.768632:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318519.768640:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3417
00000100:00080000:0.0:1767318519.768644:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318519.768650:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318519.768698:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e2d80 x1853164379523968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318519.768730:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318519.768734:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318519.768735:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318519.768739:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3417
00000100:00080000:0.0:1767318519.768742:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318519.768746:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318519.768760:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3100 x1853164379524096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318519.768805:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379524224:0@lo:400:kworker.0
00000100:00080000:0.0:1767318519.768829:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318519.768839:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318519.768840:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318519.768844:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3417
00000100:00080000:0.0:1767318519.768846:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318519.768849:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318519.768897:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e1180 x1853164379524608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318519.768905:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318519.768916:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318519.768919:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318519.768920:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318519.768923:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3417
00000100:00080000:0.0:1767318519.768925:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318519.768929:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318519.768938:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379524736:0@lo:400:kworker.0
00000100:00100000:0.0:1767318519.768979:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318519.768990:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379524352:0@lo:400:kworker.0
00000100:00100000:0.0:1767318519.769014:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524224
00000100:00100000:3.0:1767318519.769014:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318519.769020:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524224
00000100:00100000:3.0:1767318519.769032:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318519.769036:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379524480:0@lo:400:kworker.0
00000100:00100000:3.0:1767318519.769054:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318519.769067:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524352
00000100:00100000:0.0:1767318519.769070:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524352
00000100:00100000:3.0:1767318519.769086:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524736
00000100:00100000:3.0:1767318519.769089:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524736
00000100:00100000:0.0:1767318519.769091:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184
00000100:00100000:0.0:1767318519.769099:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379524224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318519.769112:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524480
00000100:00100000:3.0:1767318519.769114:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524480
00000100:00100000:3.0:1767318519.769131:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692
00000100:00100000:3.0:1767318519.769136:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379524736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318519.769151:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379524224:12345-0@lo:400:kworker.0 Request processed in 52us (246us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318519.769170:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184
00000100:00100000:3.0:1767318519.769175:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379524736:12345-0@lo:400:kworker.0 Request processed in 40us (205us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318519.769181:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692
00000100:00100000:3.0:1767318519.769192:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693
00000100:00100000:3.0:1767318519.769198:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379524480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318519.769220:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379524224:0@lo:400:kworker.0
00000100:00100000:3.0:1767318519.769226:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379524480:12345-0@lo:400:kworker.0 Request processed in 29us (171us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318519.769231:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693
00000100:00100000:0.0:1767318519.769255:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379524736:0@lo:400:kworker.0
00000100:00100000:3.0:1767318519.769255:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379524480:0@lo:400:kworker.0
00000100:00100000:0.0:1767318519.769271:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185
00000100:00100000:0.0:1767318519.769278:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379524352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318519.769317:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379524352:12345-0@lo:400:kworker.0 Request processed in 39us (301us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318519.769322:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185
00000100:00100000:0.0:1767318519.769347:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3800 x1853164379524864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318519.769398:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379524352:0@lo:400:kworker.0
00000100:00100000:1.0:1767318519.769952:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379523968:0@lo:38:kworker.0
00000100:00100000:1.0:1767318519.770002:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318519.770021:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379524096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318519.770044:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318519.770068:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379524608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318519.770089:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318519.770111:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379523968
00000100:00100000:1.0:1767318519.770116:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379523968
00000100:00100000:1.0:1767318519.770143:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524608
00000100:00100000:1.0:1767318519.770146:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524608
00000100:00100000:1.0:1767318519.770176:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16224
00000100:00100000:1.0:1767318519.770181:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379523968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318519.770213:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318519.770259:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379523968:12345-0@lo:38:kworker.0 Request processed in 76us (255us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318519.770262:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524096
00000100:00100000:1.0:1767318519.770267:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16224
00000100:00100000:1.0:1767318519.770291:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16225
00000100:00100000:3.0:1767318519.770296:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524096
00000100:00100000:1.0:1767318519.770297:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379524608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318519.770315:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318519.770345:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379524608:12345-0@lo:38:kworker.0 Request processed in 47us (254us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318519.770351:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16225
00000100:00100000:3.0:1767318519.770370:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818
00000100:00100000:3.0:1767318519.770380:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379524096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318519.770403:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318519.770404:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318519.770415:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318519.770430:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379524608:0@lo:38:kworker.0
00000100:00100000:1.0:1767318519.770437:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379524864:0@lo:38:kworker.0
00000100:00100000:1.0:1767318519.770480:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318519.770514:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379524096:12345-0@lo:38:kworker.0 Request processed in 131us (465us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318519.770522:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524864
00000100:00100000:3.0:1767318519.770527:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818
00000100:00100000:1.0:1767318519.770532:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524864
00000100:00100000:1.0:1767318519.770567:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16226
00000100:00100000:1.0:1767318519.770572:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379524864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318519.770586:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318519.770617:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379524864:12345-0@lo:38:kworker.0 Request processed in 44us (137us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318519.770623:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16226
00000100:00080000:1.0:1767318519.770651:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318519.770656:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318519.770660:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379524864:0@lo:38:kworker.0
00000100:00080000:1.0:1767318519.770700:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318519.770705:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318519.770708:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379523968:0@lo:38:kworker.0
00000100:00080000:1.0:1767318519.770720:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318519.770724:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318519.770728:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379524096:0@lo:38:kworker.0
00000100:00080000:2.0:1767318519.771424:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318519.771430:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318520.284087:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318521.303862:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318521.746045:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318521.746230:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318521.748420:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865728
00000100:00100000:2.0:1767318521.748440:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865728
00000100:00100000:2.0:1767318521.748560:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865600
00000100:00100000:2.0:1767318521.748565:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865600
00000100:00100000:2.0:1767318521.748599:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3694
00000100:00100000:2.0:1767318521.748611:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291865728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767318521.749282:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318521.749329:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16227
00000100:00100000:3.0:1767318521.749337:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291865600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318521.749364:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318521.749462:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291865600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 123us (3231us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318521.749470:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16227
00000100:00100000:2.0:1767318521.752425:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291865728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 3799us (6379us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318521.752446:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3694
00010000:00010000:2.0:1767318522.327502:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318522.839358:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318522.839378:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379524992:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318522.839493:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318522.839958:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379524992
00000100:00100000:1.0:1767318522.839970:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379524992
00000100:00080000:3.0:1767318522.840096:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318522.840144:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928
00000100:00100000:1.0:1767318522.840183:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379524992:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318522.840224:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318522.840301:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379524992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (806us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318522.840310:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928
00000100:00100000:3.0:1767318522.840403:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379524992:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318523.355324:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318524.375883:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379525120:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318524.375976:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318524.376111:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379525120
00000100:00100000:0.0:1767318524.376120:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379525120
00000100:00100000:0.0:1767318524.376181:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929
00000100:00100000:0.0:1767318524.376190:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379525120:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318524.376218:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318524.376264:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379525120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (286us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318524.376271:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929
00010000:00010000:3.0:1767318524.376347:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318524.376553:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318524.376591:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379525120:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318524.887891:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318524.887903:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318524.887907:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318524.887910:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318524.887915:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318524.887923:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3422
00000100:00080000:2.0:1767318524.887938:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318524.887946:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318524.887988:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23b80 x1853164379525248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318524.888020:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318524.888024:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318524.888026:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318524.888030:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3422
00000100:00080000:2.0:1767318524.888032:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318524.888036:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318524.888049:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20000 x1853164379525376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318524.888116:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318524.888119:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318524.888121:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318524.888124:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3422
00000100:00080000:2.0:1767318524.888127:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318524.888130:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318524.888141:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164379525888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318524.888156:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318524.888159:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318524.888161:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318524.888164:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3422
00000100:00080000:2.0:1767318524.888166:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318524.888170:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318524.888179:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21880 x1853164379526144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318524.888207:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379525760:0@lo:400:kworker.0
00000100:00100000:2.0:1767318524.888276:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318524.888412:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379526016:0@lo:400:kworker.0
00000100:00100000:0.0:1767318524.888442:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318524.888488:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318524.888505:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379525504:0@lo:400:kworker.0
00000100:00100000:0.0:1767318524.888533:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318524.888568:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379525760
00000100:00100000:0.0:1767318524.888576:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379525760
00000100:00100000:0.0:1767318524.888627:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526016
00000100:00100000:0.0:1767318524.888644:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526016
00000100:00100000:0.0:1767318524.888671:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695
00000100:00100000:0.0:1767318524.888681:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379525760:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318524.888730:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379525760:12345-0@lo:400:kworker.0 Request processed in 50us (454us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318524.888737:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695
00000100:00100000:0.0:1767318524.888753:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696
00000100:00100000:0.0:1767318524.888758:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379526016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318524.888787:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379526016:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318524.888793:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696
00000100:00100000:0.0:1767318524.888831:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379526016:0@lo:400:kworker.0
00000100:00080000:0.0:1767318524.888897:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318524.889070:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379525760:0@lo:400:kworker.0
00000100:00100000:2.0:1767318524.889082:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318524.889088:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379525632:0@lo:400:kworker.0
00000100:00100000:2.0:1767318524.889113:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318524.889665:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379525248:0@lo:38:kworker.0
00000100:00100000:1.0:1767318524.889701:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318524.889730:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379525376:0@lo:38:kworker.0
00000100:00100000:1.0:1767318524.889751:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318524.889774:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379525888:0@lo:38:kworker.0
00000100:00100000:1.0:1767318524.889794:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318524.889812:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379526144:0@lo:38:kworker.0
00000100:00100000:1.0:1767318524.889832:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318524.889863:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379525504
00000100:00100000:1.0:1767318524.889883:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379525504
00000100:00100000:1.0:1767318524.889920:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379525632
00000100:00100000:1.0:1767318524.889940:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379525632
00000100:00100000:1.0:1767318524.889963:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186
00000100:00100000:1.0:1767318524.889968:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379525504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318524.890012:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379525504:12345-0@lo:400:kworker.0 Request processed in 43us (1477us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318524.890018:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186
00000100:00100000:1.0:1767318524.890034:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187
00000100:00100000:1.0:1767318524.890040:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379525632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318524.890071:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379525632:12345-0@lo:400:kworker.0 Request processed in 31us (957us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318524.890086:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187
00000100:00100000:1.0:1767318524.890107:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379525248
00000100:00100000:1.0:1767318524.890111:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379525248
00000100:00100000:1.0:1767318524.890128:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379525888
00000100:00100000:1.0:1767318524.890131:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379525888
00000100:00100000:1.0:1767318524.890136:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526144
00000100:00100000:1.0:1767318524.890138:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526144
00000100:00100000:1.0:1767318524.890146:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16228
00000100:00100000:1.0:1767318524.890150:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379525248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318524.890167:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318524.890200:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379525248:12345-0@lo:38:kworker.0 Request processed in 48us (498us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318524.890205:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16228
00000100:00100000:1.0:1767318524.890217:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16229
00000100:00100000:1.0:1767318524.890221:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379525888:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318524.890231:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318524.890252:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379525888:12345-0@lo:38:kworker.0 Request processed in 30us (457us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318524.890258:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16229
00000100:00100000:1.0:1767318524.890269:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16230
00000100:00100000:1.0:1767318524.890272:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379526144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318524.890281:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318524.890435:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379525632:0@lo:400:kworker.0
00000100:00080000:2.0:1767318524.890488:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318524.891443:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379526144:12345-0@lo:38:kworker.0 Request processed in 1164us (1605us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318524.891453:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16230
00000100:00100000:3.0:1767318524.891907:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379525376
00000100:00100000:3.0:1767318524.891916:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379525376
00000100:00100000:3.0:1767318524.891960:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819
00000100:00100000:3.0:1767318524.891967:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379525376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318524.891985:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318524.892063:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379525376:12345-0@lo:38:kworker.0 Request processed in 95us (2310us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318524.892069:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819
00000100:00100000:2.0:1767318524.897908:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379525504:0@lo:400:kworker.0
00000100:00080000:1.0:1767318524.909601:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318524.909614:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318524.909620:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379525248:0@lo:38:kworker.0
00000100:00080000:1.0:1767318524.909636:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318524.909639:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318524.909642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379525376:0@lo:38:kworker.0
00000100:00080000:1.0:1767318524.909654:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318524.909657:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318524.909660:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379525888:0@lo:38:kworker.0
00000100:00080000:1.0:1767318524.909669:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318524.909673:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318524.909675:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379526144:0@lo:38:kworker.0
00010000:00010000:0.0:1767318525.399056:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318526.424307:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318526.867501:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318526.867667:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865856
00000100:00100000:3.0:1767318526.867677:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865856
00000100:00100000:3.0:1767318526.867727:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16231
00000100:00100000:3.0:1767318526.867735:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291865856:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318526.867758:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318526.867925:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291865856:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 188us (433us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318526.867933:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16231
00000100:00100000:0.0:1767318526.874472:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318526.876466:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291865984
00000100:00100000:2.0:1767318526.876483:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291865984
00000100:00100000:2.0:1767318526.876624:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3697
00000100:00100000:2.0:1767318526.876636:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291865984:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318526.876724:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291865984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (2336us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318526.876733:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3697
00000100:00080000:0.0:1767318526.876792:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318527.447865:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318527.959797:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318527.959823:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379526272:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318527.959927:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318527.960040:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526272
00000100:00100000:2.0:1767318527.960048:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526272
00000100:00100000:2.0:1767318527.960111:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930
00000100:00100000:2.0:1767318527.960121:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379526272:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318527.960162:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318527.960207:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379526272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (280us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318527.960214:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930
00000100:00080000:0.0:1767318527.960361:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318527.960404:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379526272:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318528.471090:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318529.495048:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318529.495602:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379526400:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318529.495690:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318529.495804:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526400
00000100:00100000:1.0:1767318529.495815:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526400
00000100:00100000:1.0:1767318529.495924:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931
00000100:00100000:1.0:1767318529.495934:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f302f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379526400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318529.495962:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767318529.496036:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318529.496711:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f302f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379526400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 777us (1019us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318529.496721:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931
00000100:00100000:3.0:1767318529.501771:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379526400:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318530.007062:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318530.007074:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318530.007079:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318530.007083:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318530.007088:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318530.007098:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3427
00000100:00080000:2.0:1767318530.007103:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318530.007110:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318530.007216:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20700 x1853164379526528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318530.007247:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318530.007251:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318530.007253:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318530.007257:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3427
00000100:00080000:2.0:1767318530.007260:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318530.007264:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318530.007278:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21c00 x1853164379526656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318530.007370:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379526784:0@lo:400:kworker.0
00000100:00100000:3.0:1767318530.007447:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318530.007554:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318530.007558:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318530.007560:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318530.007565:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3427
00000100:00080000:2.0:1767318530.007568:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318530.007571:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318530.007582:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23480 x1853164379527168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318530.007583:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379526528:0@lo:38:kworker.0
00000100:00100000:1.0:1767318530.007614:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318530.007635:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379526656:0@lo:38:kworker.0
00000100:00100000:1.0:1767318530.007676:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318530.007684:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526784
00000100:00100000:0.0:1767318530.007692:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526784
00000100:00100000:1.0:1767318530.007700:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379527168:0@lo:38:kworker.0
00000100:00100000:1.0:1767318530.007719:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318530.007745:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188
00000100:00100000:0.0:1767318530.007759:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379526784:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.008938:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526528
00000100:00100000:1.0:1767318530.008950:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526528
00000100:00100000:1.0:1767318530.008981:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527168
00000100:00100000:1.0:1767318530.008983:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527168
00000100:00100000:1.0:1767318530.009002:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16232
00000100:00100000:1.0:1767318530.009009:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379526528:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318530.009029:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318530.009089:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379526528:12345-0@lo:38:kworker.0 Request processed in 79us (1472us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318530.009096:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16232
00000100:00100000:1.0:1767318530.009117:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16233
00000100:00100000:1.0:1767318530.009120:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379527168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318530.009130:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318530.009153:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379527168:12345-0@lo:38:kworker.0 Request processed in 31us (1433us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318530.009159:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16233
00000100:00080000:1.0:1767318530.009202:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318530.009207:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318530.009211:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379527168:0@lo:38:kworker.0
00000100:00080000:1.0:1767318530.009222:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318530.009225:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318530.009228:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379526528:0@lo:38:kworker.0
00000100:00100000:1.0:1767318530.009287:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379526912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.009450:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318530.009478:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318530.009484:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379527040:0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.009507:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318530.009740:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527040
00000100:00100000:1.0:1767318530.009746:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527040
00000100:00100000:1.0:1767318530.009785:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698
00000100:00100000:1.0:1767318530.009793:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379527040:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.009836:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379527040:12345-0@lo:400:kworker.0 Request processed in 44us (327us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318530.009842:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698
00000100:00100000:1.0:1767318530.009862:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526912
00000100:00100000:1.0:1767318530.009866:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526912
00000100:00100000:1.0:1767318530.009933:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189
00000100:00100000:1.0:1767318530.009941:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379526912:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.009971:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379526912:12345-0@lo:400:kworker.0 Request processed in 32us (521us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318530.009978:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189
00000100:00100000:1.0:1767318530.010009:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379527040:0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.010020:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379526912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.010073:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379526656
00000100:00100000:1.0:1767318530.010077:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379526656
00000100:00100000:1.0:1767318530.010104:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820
00000100:00100000:1.0:1767318530.010109:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379526656:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318530.010132:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318530.010168:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379526656:12345-0@lo:38:kworker.0 Request processed in 58us (2491us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318530.010174:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820
00000100:00080000:1.0:1767318530.010205:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318530.010209:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318530.010212:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379526656:0@lo:38:kworker.0
00000100:00100000:1.0:1767318530.010233:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379527296:0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.010261:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318530.010289:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527296
00000100:00100000:1.0:1767318530.010292:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527296
00000100:00100000:1.0:1767318530.010317:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699
00000100:00100000:1.0:1767318530.010323:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379527296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318530.010356:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379527296:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318530.010361:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699
00000100:00100000:1.0:1767318530.010386:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379527296:0@lo:400:kworker.0
00000100:00080000:1.0:1767318530.010414:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318530.010418:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318530.015706:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318530.015720:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318530.015725:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318530.015734:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3427
00000100:00080000:2.0:1767318530.015740:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318530.015750:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318530.015804:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21f80 x1853164379527424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318530.018121:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379526784:12345-0@lo:400:kworker.0 Request processed in 10357us (10661us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318530.018135:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188
00000100:00100000:1.0:1767318530.020054:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379527424:0@lo:38:kworker.0
00000100:00100000:1.0:1767318530.020144:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318530.020973:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527424
00000100:00100000:2.0:1767318530.020984:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527424
00000100:00100000:2.0:1767318530.021034:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16234
00000100:00100000:2.0:1767318530.021043:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379527424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318530.021068:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318530.021137:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379527424:12345-0@lo:38:kworker.0 Request processed in 94us (993us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318530.021143:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16234
00000100:00080000:0.0:1767318530.021368:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318530.021374:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318530.021378:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379527424:0@lo:38:kworker.0
00000100:00100000:3.0:1767318530.021646:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379526784:0@lo:400:kworker.0
00010000:00010000:2.0:1767318530.519219:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318531.546044:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318531.985970:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318531.986022:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318531.986487:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291866240
00000100:00100000:3.0:1767318531.986498:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291866240
00000100:00100000:3.0:1767318531.986591:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291866112
00000100:00100000:3.0:1767318531.986595:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291866112
00000100:00100000:3.0:1767318531.986620:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3700
00000100:00100000:3.0:1767318531.986631:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291866240:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318531.986706:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291866240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (748us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318531.986729:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3700
00000100:00100000:3.0:1767318531.986747:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16235
00000100:00100000:3.0:1767318531.986752:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291866112:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318531.986773:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318531.986818:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291866112:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 64us (794us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318531.986826:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16235
00000100:00080000:1.0:1767318531.986900:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767318532.567905:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318533.079535:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379527552:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318533.079607:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318533.079898:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527552
00000100:00100000:1.0:1767318533.079918:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527552
00000100:00100000:1.0:1767318533.079984:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932
00000100:00100000:1.0:1767318533.079993:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379527552:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318533.080021:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318533.080116:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318533.081996:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379527552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1997us (2382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318533.082009:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932
00000100:00100000:3.0:1767318533.082277:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379527552:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318533.591198:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318534.618900:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318534.618926:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379527680:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318534.618997:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1767318534.619219:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318534.621648:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527680
00000100:00100000:0.0:1767318534.621666:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527680
00000100:00100000:0.0:1767318534.621830:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933
00000100:00100000:0.0:1767318534.621851:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379527680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318534.621903:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318534.621989:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379527680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (2990us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318534.621997:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933
00000100:00100000:3.0:1767318534.622671:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379527680:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318534.623888:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318535.130267:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318535.130280:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318535.130284:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318535.130288:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318535.130293:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318535.130301:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3432
00000100:00080000:2.0:1767318535.130306:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318535.130311:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318535.130355:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21880 x1853164379527808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318535.130388:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318535.130392:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318535.130394:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318535.130397:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3432
00000100:00080000:2.0:1767318535.130399:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318535.130402:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318535.130414:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164379527936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318535.130472:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318535.130475:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318535.130476:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318535.130480:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3432
00000100:00080000:2.0:1767318535.130482:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318535.130486:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318535.130494:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20380 x1853164379528320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318535.130514:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318535.130517:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318535.130518:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318535.130521:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3432
00000100:00080000:2.0:1767318535.130523:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318535.130526:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318535.130534:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20e00 x1853164379528576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318535.130559:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379528192:0@lo:400:kworker.0
00000100:00100000:2.0:1767318535.130625:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318535.130688:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318535.130694:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379528448:0@lo:400:kworker.0
00000100:00100000:2.0:1767318535.130716:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318535.130757:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379528192
00000100:00100000:2.0:1767318535.130764:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379528192
00000100:00100000:2.0:1767318535.130816:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379528448
00000100:00100000:2.0:1767318535.130819:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379528448
00000100:00100000:2.0:1767318535.130856:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701
00000100:00100000:2.0:1767318535.130865:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379528192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318535.130938:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379528192:12345-0@lo:400:kworker.0 Request processed in 73us (312us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318535.130945:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701
00000100:00100000:2.0:1767318535.130962:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702
00000100:00100000:2.0:1767318535.130968:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379528448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318535.130993:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379528448:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318535.130999:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702
00000100:00080000:2.0:1767318535.131025:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318535.131055:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379528448:0@lo:400:kworker.0
00000100:00100000:2.0:1767318535.131065:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379528192:0@lo:400:kworker.0
00000100:00100000:0.0:1767318535.131226:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318535.131236:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379528064:0@lo:400:kworker.0
00000100:00100000:0.0:1767318535.131272:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318535.131678:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379527808:0@lo:38:kworker.0
00000100:00100000:1.0:1767318535.131710:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318535.131743:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379527936:0@lo:38:kworker.0
00000100:00100000:1.0:1767318535.131765:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318535.131794:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379528320:0@lo:38:kworker.0
00000100:00100000:1.0:1767318535.131815:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318535.131828:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379528576:0@lo:38:kworker.0
00000100:00100000:1.0:1767318535.131889:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318535.131963:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527936
00000100:00100000:0.0:1767318535.131968:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527936
00000100:00100000:0.0:1767318535.131997:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821
00000100:00100000:0.0:1767318535.132003:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379527936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318535.132022:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318535.132061:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379527936:12345-0@lo:38:kworker.0 Request processed in 56us (293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318535.132080:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821
00000100:00080000:0.0:1767318535.132112:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318535.132117:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318535.132120:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379527936:0@lo:38:kworker.0
00000100:00100000:3.0:1767318535.132554:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379527808
00000100:00100000:3.0:1767318535.132559:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379527808
00000100:00100000:3.0:1767318535.132589:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379528320
00000100:00100000:3.0:1767318535.132593:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379528320
00000100:00100000:3.0:1767318535.132605:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379528576
00000100:00100000:3.0:1767318535.132607:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379528576
00000100:00100000:3.0:1767318535.132620:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16236
00000100:00100000:3.0:1767318535.132625:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379527808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318535.132636:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318535.132683:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379527808:12345-0@lo:38:kworker.0 Request processed in 57us (973us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318535.132689:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16236
00000100:00100000:3.0:1767318535.132701:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16237
00000100:00100000:3.0:1767318535.132705:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379528320:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318535.132714:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318535.132749:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379528320:12345-0@lo:38:kworker.0 Request processed in 42us (933us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318535.132754:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16237
00000100:00100000:3.0:1767318535.132765:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16238
00000100:00100000:3.0:1767318535.132768:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379528576:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318535.132776:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318535.132797:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379528576:12345-0@lo:38:kworker.0 Request processed in 28us (930us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318535.132802:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16238
00000100:00080000:3.0:1767318535.132825:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318535.132829:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318535.132851:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379527808:0@lo:38:kworker.0
00000100:00080000:3.0:1767318535.132862:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318535.132865:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318535.132893:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379528320:0@lo:38:kworker.0
00000100:00080000:3.0:1767318535.132902:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318535.132905:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318535.132908:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379528576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318535.133332:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379528064
00000100:00100000:2.0:1767318535.133338:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379528064
00000100:00100000:2.0:1767318535.133403:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190
00000100:00100000:2.0:1767318535.133411:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379528064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318535.133470:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379528064:12345-0@lo:400:kworker.0 Request processed in 60us (2197us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318535.133476:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190
00000100:00100000:0.0:1767318535.133570:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379528064:0@lo:400:kworker.0
00000100:00080000:1.0:1767318535.135652:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318535.639063:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318536.664390:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318537.113062:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318537.113108:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767318537.113136:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291866624 offset 0 length 520: 4
00000100:00100000:3.0:1767318537.113169:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291866496
00000100:00100000:3.0:1767318537.113181:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291866496
00000100:00100000:3.0:1767318537.113248:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291866368
00000100:00100000:3.0:1767318537.113252:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291866368
00000100:00100000:3.0:1767318537.113269:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3703
00000100:00100000:3.0:1767318537.113279:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291866496:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318537.113356:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291866496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318537.113364:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3703
00000100:00100000:3.0:1767318537.113382:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16239
00000100:00100000:3.0:1767318537.113387:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291866368:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318537.113407:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318537.113435:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291866368:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (327us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318537.113442:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16239
00000100:00080000:1.0:1767318537.113561:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318537.687113:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318538.199261:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318538.199280:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379528704:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318538.199372:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318538.199502:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379528704
00000100:00100000:2.0:1767318538.199511:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379528704
00000100:00100000:2.0:1767318538.199595:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934
00000100:00100000:2.0:1767318538.199606:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379528704:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318538.199631:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767318538.199641:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318538.199696:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379528704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (323us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318538.199703:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934
00000100:00100000:1.0:1767318538.199741:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379528704:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318538.713300:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318539.223050:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318514/real 1767318514]  req@ffff8b0e03c47b80 x1853164379522560/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318539.223092:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e03c47b80 x1853164379522560/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318539.223107:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318539.223131:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318539.223154:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379522560:0@lo:250:kworker.0
00000100:00080000:0.0:1767318539.223203:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318539.223209:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318539.223213:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318539.223218:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3417
00000100:00080000:0.0:1767318539.223221:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318539.223228:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318539.223259:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e0e00 x1853164379528832/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318539.223286:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318539.223290:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318539.223292:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318539.223296:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3437
00000100:00080000:0.0:1767318539.223298:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318539.223302:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318539.223325:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e2680 x1853164379528960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318539.223334:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767318539.223347:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379528832:0@lo:250:kworker.0
00000100:00080000:0.0:1767318539.223348:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318539.223352:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318539.223357:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3437
00000100:00080000:0.0:1767318539.223360:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318539.223364:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318539.223379:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e1c00 x1853164379529088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000400:00000100:3.0:1767318539.223424:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379528832 offset 0 length 520: 4
00000100:00100000:2.0:1767318539.223449:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:0.0:1767318539.223460:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767318539.223464:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379529216:0@lo:400:kworker.0
00000100:00080000:0.0:1767318539.223465:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318539.223470:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318539.223475:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3437
00000100:00080000:0.0:1767318539.223477:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318539.223484:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318539.223491:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379528960:0@lo:38:kworker.0
00000100:00100000:0.0:1767318539.223501:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3100 x1853164379529600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318539.223521:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318539.223524:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318539.223526:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318539.223529:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3437
00000100:00080000:0.0:1767318539.223532:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318539.223536:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318539.223544:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3800 x1853164379529856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318539.223566:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379529472:0@lo:400:kworker.0
00000100:00100000:2.0:1767318539.224305:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318539.224312:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318539.224355:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379529728:0@lo:400:kworker.0
00000100:00100000:3.0:1767318539.224358:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379529088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318539.224384:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318539.224414:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318539.224422:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379529344:0@lo:400:kworker.0
00000100:00100000:3.0:1767318539.224438:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379529600:0@lo:38:kworker.0
00000100:00100000:2.0:1767318539.224451:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318539.224471:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318539.224503:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379529856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318539.224507:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529216
00000100:00100000:2.0:1767318539.224516:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529216
00000100:00100000:0.0:1767318539.224527:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379528960
00000100:00100000:3.0:1767318539.224532:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318539.224533:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379528960
00000100:00100000:2.0:1767318539.224561:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529344
00000100:00100000:2.0:1767318539.224565:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529344
00000100:00100000:0.0:1767318539.224569:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529728
00000100:00100000:0.0:1767318539.224574:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529728
00000100:00100000:3.0:1767318539.224575:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529600
00000100:00100000:3.0:1767318539.224581:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529600
00000100:00100000:2.0:1767318539.224598:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191
00000100:00100000:3.0:1767318539.224609:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529856
00000100:00100000:2.0:1767318539.224610:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379529216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318539.224614:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529856
00000100:00100000:3.0:1767318539.224629:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16240
00000100:00100000:3.0:1767318539.224635:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379528960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318539.224655:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318539.224664:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379529216:12345-0@lo:400:kworker.0 Request processed in 56us (360us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318539.224673:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191
00000100:00100000:0.0:1767318539.224678:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704
00000100:00100000:0.0:1767318539.224689:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379529728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318539.224701:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379528960:12345-0@lo:38:kworker.0 Request processed in 63us (392us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318539.224710:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192
00000100:00100000:3.0:1767318539.224712:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16240
00000100:00100000:2.0:1767318539.224723:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379529344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318539.224733:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16241
00000100:00100000:3.0:1767318539.224751:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379529600:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318539.224757:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379529344:12345-0@lo:400:kworker.0 Request processed in 36us (305us total) trans 0 rc 0/0
00010000:00020000:3.0:1767318539.224763:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318539.224767:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192
00000100:00100000:0.0:1767318539.224806:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379529728:12345-0@lo:400:kworker.0 Request processed in 108us (410us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318539.224814:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704
00000100:00100000:2.0:1767318539.224826:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379529344:0@lo:400:kworker.0
00000100:00100000:0.0:1767318539.224832:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16242
00000100:00100000:0.0:1767318539.224838:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379529856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318539.224850:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318539.224955:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529088
00000100:00100000:1.0:1767318539.224961:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529088
00000100:00100000:1.0:1767318539.224983:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822
00000100:00100000:1.0:1767318539.224993:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379529088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318539.225060:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318539.225530:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379529600:12345-0@lo:38:kworker.0 Request processed in 789us (1058us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318539.225539:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16241
00000100:00100000:2.0:1767318539.225561:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379529728:0@lo:400:kworker.0
00000100:00100000:0.0:1767318539.225578:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379529856:12345-0@lo:38:kworker.0 Request processed in 736us (1046us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318539.225584:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379529216:0@lo:400:kworker.0
00000100:00080000:3.0:1767318539.225600:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318539.225607:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318539.225611:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379529600:0@lo:38:kworker.0
00000100:00080000:3.0:1767318539.225621:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318539.225624:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318539.225627:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379529856:0@lo:38:kworker.0
00000100:00080000:3.0:1767318539.225637:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318539.225640:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318539.225644:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379528960:0@lo:38:kworker.0
00000100:00080000:2.0:1767318539.225646:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318539.225654:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318539.225670:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16242
00000100:00100000:1.0:1767318539.225754:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379529088:12345-0@lo:38:kworker.0 Request processed in 758us (1339us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318539.225792:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318539.225854:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822
00000100:00100000:2.0:1767318539.225914:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529472
00000100:00100000:2.0:1767318539.225919:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529472
00000100:00080000:1.0:1767318539.225954:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318539.225999:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705
00000100:00100000:2.0:1767318539.226007:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379529472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318539.226054:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379529472:12345-0@lo:400:kworker.0 Request processed in 49us (263us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318539.226061:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705
00000100:00100000:1.0:1767318539.226090:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379529472:0@lo:400:kworker.0
00000100:00080000:3.0:1767318539.226496:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318539.226501:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318539.226504:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379529088:0@lo:38:kworker.0
00010000:00010000:0.0:1767318539.735055:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318539.735634:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318539.735668:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379529984:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318539.735770:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318539.735839:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379529984
00000100:00100000:3.0:1767318539.735859:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379529984
00000100:00100000:3.0:1767318539.735944:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935
00000100:00100000:3.0:1767318539.735956:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379529984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318539.735998:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318539.736063:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379529984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (292us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318539.736071:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935
00000100:00100000:0.0:1767318539.736123:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379529984:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318540.759159:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318541.783830:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318542.223478:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318542.223528:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318542.223623:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291866880
00000100:00100000:2.0:1767318542.223633:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291866880
00000100:00100000:1.0:1767318542.223664:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291866752
00000100:00100000:2.0:1767318542.223717:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3706
00000100:00100000:2.0:1767318542.223727:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291866880:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318542.223740:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291866752
00000100:00100000:2.0:1767318542.223812:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291866880:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (343us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318542.223895:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16243
00000100:00080000:0.0:1767318542.223903:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318542.223904:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291866752:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318542.223926:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318542.223957:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291866752:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (429us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318542.224276:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3706
00000100:00100000:1.0:1767318542.226822:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16243
00010000:00010000:2.0:1767318542.807007:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318543.319180:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379530112:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318543.319250:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318543.319432:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379530112
00000100:00100000:2.0:1767318543.319448:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379530112
00000100:00100000:2.0:1767318543.319514:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936
00000100:00100000:2.0:1767318543.319525:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379530112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318543.319564:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318543.319619:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379530112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (367us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318543.319626:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936
00000100:00100000:1.0:1767318543.319655:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379530112:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318543.319683:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767318543.831037:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318544.343447:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318544.343468:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318544.343470:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318544.343474:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318544.343478:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318544.343486:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3441
00000100:00080000:0.0:1767318544.343492:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318544.343498:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318544.343532:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e0000 x1853164379530240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318544.343559:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318544.343563:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318544.343565:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318544.343569:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3441
00000100:00080000:0.0:1767318544.343571:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318544.343574:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318544.343584:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e2680 x1853164379530368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318544.343652:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318544.343688:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379530240:0@lo:38:kworker.0
00000100:00100000:3.0:1767318544.343760:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318544.343830:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379530368:0@lo:38:kworker.0
00000100:00100000:3.0:1767318544.343852:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318544.343907:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379530368
00000100:00100000:3.0:1767318544.343914:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379530368
00000100:00100000:3.0:1767318544.343947:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823
00000100:00100000:3.0:1767318544.343953:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379530368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318544.343984:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318544.344021:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379530368:12345-0@lo:38:kworker.0 Request processed in 67us (167us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318544.344028:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823
00000100:00100000:3.0:1767318544.344059:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379530240
00000100:00100000:3.0:1767318544.344062:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379530240
00000100:00100000:3.0:1767318544.344080:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16244
00000100:00100000:3.0:1767318544.344093:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379530240:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318544.344102:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318544.344124:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379530240:12345-0@lo:38:kworker.0 Request processed in 39us (365us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318544.344130:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16244
00000100:00080000:3.0:1767318544.344159:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318544.344163:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318544.344166:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379530240:0@lo:38:kworker.0
00000100:00080000:3.0:1767318544.344174:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318544.344177:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318544.344180:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379530368:0@lo:38:kworker.0
00000100:00080000:0.0:1767318544.344728:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318544.344732:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318544.344734:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318544.344738:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3441
00000100:00080000:0.0:1767318544.344741:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318544.344745:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318544.344769:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e2d80 x1853164379530880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318544.344828:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379530752:0@lo:400:kworker.0
00000100:00100000:3.0:1767318544.344858:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318544.344893:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318544.344898:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379530624:0@lo:400:kworker.0
00000100:00100000:3.0:1767318544.344919:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318544.344943:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379530752
00000100:00100000:3.0:1767318544.344947:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379530752
00000100:00100000:3.0:1767318544.344980:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707
00000100:00100000:3.0:1767318544.344987:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379530752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318544.345035:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379530752:12345-0@lo:400:kworker.0 Request processed in 49us (176us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318544.345041:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707
00000100:00080000:3.0:1767318544.345057:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318544.345077:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379530752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318544.346419:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379530880:0@lo:38:kworker.0
00000100:00100000:1.0:1767318544.346515:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318544.346561:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379530880
00000100:00100000:1.0:1767318544.346567:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379530880
00000100:00100000:1.0:1767318544.346598:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16245
00000100:00100000:1.0:1767318544.346603:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379530880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318544.346622:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318544.346660:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379530880:12345-0@lo:38:kworker.0 Request processed in 55us (145us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318544.346677:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16245
00000100:00080000:1.0:1767318544.346718:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318544.346723:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318544.346726:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379530880:0@lo:38:kworker.0
00000100:00100000:1.0:1767318544.346782:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379530624
00000100:00100000:1.0:1767318544.346786:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379530624
00000100:00100000:1.0:1767318544.346831:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193
00000100:00100000:1.0:1767318544.346839:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379530624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318544.346903:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379530624:12345-0@lo:400:kworker.0 Request processed in 66us (1983us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318544.346910:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193
00000100:00100000:3.0:1767318544.347763:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379530624:0@lo:400:kworker.0
00000100:00080000:3.0:1767318544.347784:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318544.349828:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379531008:0@lo:400:kworker.0
00000100:00100000:2.0:1767318544.350106:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318544.350148:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379530496:0@lo:400:kworker.0
00000100:00100000:2.0:1767318544.350236:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318544.350414:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318544.350420:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318544.350423:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318544.350428:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3441
00000100:00080000:0.0:1767318544.350432:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318544.350437:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318544.350465:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3100 x1853164379531136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318544.350713:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379530496
00000100:00100000:3.0:1767318544.350721:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379530496
00000100:00100000:3.0:1767318544.350807:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194
00000100:00100000:3.0:1767318544.350817:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379530496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318544.350900:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379530496:12345-0@lo:400:kworker.0 Request processed in 85us (663us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318544.350907:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194
00000100:00100000:0.0:1767318544.350969:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379530496:0@lo:400:kworker.0
00000100:00100000:1.0:1767318544.352933:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531008
00000100:00100000:1.0:1767318544.352944:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531008
00000100:00100000:1.0:1767318544.354937:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708
00000100:00100000:1.0:1767318544.354959:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379531008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318544.355055:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379531008:12345-0@lo:400:kworker.0 Request processed in 104us (4949us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318544.355063:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708
00000100:00100000:0.0:1767318544.355176:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379531008:0@lo:400:kworker.0
00000100:00100000:0.0:1767318544.355233:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379531136:0@lo:38:kworker.0
00000100:00100000:0.0:1767318544.355273:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318544.355404:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318544.358388:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531136
00000100:00100000:2.0:1767318544.358405:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531136
00000100:00100000:2.0:1767318544.358461:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16246
00000100:00100000:2.0:1767318544.358469:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379531136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318544.358493:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318544.358570:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379531136:12345-0@lo:38:kworker.0 Request processed in 101us (3296us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318544.358577:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16246
00000100:00080000:2.0:1767318544.358627:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318544.358633:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318544.358637:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379531136:0@lo:38:kworker.0
00010000:00010000:2.0:1767318544.855469:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318544.855622:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379531264:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318544.855801:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318544.855919:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531264
00000100:00100000:3.0:1767318544.855927:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531264
00000100:00100000:3.0:1767318544.855989:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937
00000100:00100000:3.0:1767318544.855998:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379531264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318544.856027:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318544.861931:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379531264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1117us (1313us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318544.861956:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937
00000100:00100000:2.0:1767318544.862128:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379531264:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318545.879831:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318546.904985:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318547.353495:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318547.353639:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291867008
00000100:00100000:3.0:1767318547.353649:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291867008
00000100:00100000:3.0:1767318547.353699:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16247
00000100:00100000:3.0:1767318547.353707:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291867008:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318547.353747:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318547.353818:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291867008:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 110us (335us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318547.353826:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16247
00000100:00100000:3.0:1767318547.359497:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318547.361024:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291867136
00000100:00100000:1.0:1767318547.361035:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291867136
00000100:00100000:1.0:1767318547.361118:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3709
00000100:00100000:1.0:1767318547.361129:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291867136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318547.361463:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291867136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 335us (1974us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318547.361489:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3709
00000100:00080000:3.0:1767318547.361966:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318547.927144:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318548.440329:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318548.440342:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379531392:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318548.440403:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318548.440452:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531392
00000100:00100000:3.0:1767318548.440458:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531392
00000100:00100000:3.0:1767318548.440494:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938
00000100:00100000:3.0:1767318548.440500:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379531392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318548.440522:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318548.440551:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379531392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (148us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318548.440660:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938
00000100:00080000:3.0:1767318548.440676:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318548.440706:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379531392:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318548.951476:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318549.463781:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318549.463793:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318549.463796:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318549.463800:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318549.463804:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318549.463812:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3446
00000100:00080000:3.0:1767318549.463817:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318549.463823:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318549.463886:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a14700 x1853164379531520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318549.463912:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318549.463916:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318549.463918:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318549.463922:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3446
00000100:00080000:3.0:1767318549.463925:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318549.463928:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318549.463942:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a15180 x1853164379531648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318549.463998:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318549.464001:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318549.464015:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318549.464019:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3446
00000100:00080000:3.0:1767318549.464022:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318549.464025:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318549.464038:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a17800 x1853164379532160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318549.464060:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318549.464062:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318549.464064:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318549.464067:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3446
00000100:00080000:3.0:1767318549.464069:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318549.464073:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318549.464082:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a15500 x1853164379532416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318549.464364:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379531776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318549.464430:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318549.464493:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318549.464499:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379532288:0@lo:400:kworker.0
00000100:00100000:1.0:1767318549.464523:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318549.464555:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532288
00000100:00100000:1.0:1767318549.464561:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532288
00000100:00100000:1.0:1767318549.464611:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710
00000100:00100000:1.0:1767318549.464620:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379532288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318549.464670:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379532288:12345-0@lo:400:kworker.0 Request processed in 51us (145us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318549.464677:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710
00000100:00100000:1.0:1767318549.464731:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379532288:0@lo:400:kworker.0
00000100:00100000:0.0:1767318549.464895:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379531520:0@lo:38:kworker.0
00000100:00100000:0.0:1767318549.464924:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.464938:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379531648:0@lo:38:kworker.0
00000100:00100000:0.0:1767318549.464969:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.464988:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379532160:0@lo:38:kworker.0
00000100:00100000:0.0:1767318549.465006:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.465022:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379532416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318549.465039:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.465072:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531520
00000100:00100000:0.0:1767318549.465076:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531520
00000100:00100000:0.0:1767318549.465092:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532160
00000100:00100000:0.0:1767318549.465095:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532160
00000100:00100000:0.0:1767318549.465103:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532416
00000100:00100000:0.0:1767318549.465105:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532416
00000100:00100000:0.0:1767318549.465114:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16248
00000100:00100000:0.0:1767318549.465118:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379531520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318549.465139:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318549.465171:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379531520:12345-0@lo:38:kworker.0 Request processed in 51us (247us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318549.465177:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16248
00000100:00100000:0.0:1767318549.465188:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16249
00000100:00100000:0.0:1767318549.465192:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379532160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318549.465201:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318549.465221:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379532160:12345-0@lo:38:kworker.0 Request processed in 28us (213us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318549.465226:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16249
00000100:00100000:0.0:1767318549.465236:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16250
00000100:00100000:0.0:1767318549.465240:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379532416:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318549.465248:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318549.465266:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379532416:12345-0@lo:38:kworker.0 Request processed in 24us (226us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318549.465272:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16250
00000100:00080000:0.0:1767318549.465292:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318549.465296:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318549.465299:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379531520:0@lo:38:kworker.0
00000100:00080000:0.0:1767318549.465315:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318549.465318:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318549.465322:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379532160:0@lo:38:kworker.0
00000100:00080000:0.0:1767318549.465328:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318549.465331:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318549.465334:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379532416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318549.465361:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379531904:0@lo:400:kworker.0
00000100:00100000:0.0:1767318549.465384:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.465401:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318549.465407:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379532032:0@lo:400:kworker.0
00000100:00100000:0.0:1767318549.465444:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.465461:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532032
00000100:00100000:0.0:1767318549.465464:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532032
00000100:00100000:0.0:1767318549.465489:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711
00000100:00100000:0.0:1767318549.465495:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379532032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318549.465521:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379532032:12345-0@lo:400:kworker.0 Request processed in 26us (77us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318549.465528:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711
00000100:00100000:0.0:1767318549.465553:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379532032:0@lo:400:kworker.0
00000100:00100000:3.0:1767318549.465902:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531776
00000100:00100000:3.0:1767318549.465907:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531776
00000100:00100000:2.0:1767318549.465916:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531904
00000100:00100000:2.0:1767318549.465922:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531904
00000100:00100000:3.0:1767318549.465947:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195
00000100:00100000:3.0:1767318549.465954:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379531776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318549.465969:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196
00000100:00100000:2.0:1767318549.465979:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379531904:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318549.466003:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379531776:12345-0@lo:400:kworker.0 Request processed in 49us (1573us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318549.466011:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195
00000100:00100000:2.0:1767318549.466030:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379531904:12345-0@lo:400:kworker.0 Request processed in 52us (644us total) trans 0 rc 0/0
00000100:00080000:3.0:1767318549.466031:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318549.466037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318549.466041:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196
00000100:00100000:3.0:1767318549.466051:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379531648
00000100:00100000:3.0:1767318549.466055:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379531648
00000100:00100000:2.0:1767318549.466083:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379531904:0@lo:400:kworker.0
00000100:00100000:3.0:1767318549.466084:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824
00000100:00100000:3.0:1767318549.466093:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379531648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318549.466111:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318549.466139:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379531776:0@lo:400:kworker.0
00000100:00100000:3.0:1767318549.466158:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379531648:12345-0@lo:38:kworker.0 Request processed in 60us (1182us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318549.466166:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824
00000100:00080000:2.0:1767318549.466188:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318549.466193:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318549.466197:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379531648:0@lo:38:kworker.0
00010000:00010000:0.0:1767318549.975238:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318549.975866:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379532544:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318549.975957:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318549.976320:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532544
00000100:00100000:0.0:1767318549.976329:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532544
00000100:00100000:0.0:1767318549.976375:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939
00000100:00100000:0.0:1767318549.976385:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379532544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318549.976424:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318549.976492:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379532544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (535us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318549.976500:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939
00000100:00100000:2.0:1767318549.976688:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379532544:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318551.006189:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318552.030647:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318552.467437:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318552.467489:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318552.467842:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291867264
00000100:00100000:3.0:1767318552.467852:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291867264
00000100:00100000:3.0:1767318552.467922:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291867392
00000100:00100000:3.0:1767318552.467926:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291867392
00000100:00100000:3.0:1767318552.467969:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3712
00000100:00100000:3.0:1767318552.467980:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291867392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318552.468073:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291867392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 94us (582us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318552.468081:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3712
00000100:00100000:3.0:1767318552.468097:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16251
00000100:00100000:3.0:1767318552.468101:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291867264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318552.468120:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318552.468146:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291867264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (730us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318552.468152:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16251
00000100:00080000:3.0:1767318552.468408:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318553.047848:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318553.559828:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379532672:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318553.559942:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318553.560741:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532672
00000100:00100000:3.0:1767318553.560751:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532672
00000100:00100000:3.0:1767318553.560824:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940
00000100:00100000:3.0:1767318553.560842:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379532672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318553.560891:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318553.560974:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379532672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (1031us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318553.560983:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940
00000100:00080000:0.0:1767318553.562904:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318553.562974:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379532672:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318554.072437:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318554.583650:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318554.583703:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318554.583707:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318554.583711:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318554.583717:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318554.583728:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3451
00000100:00080000:3.0:1767318554.583734:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318554.583743:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318554.583797:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a16680 x1853164379532800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318554.583830:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318554.583834:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318554.583836:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318554.583841:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3451
00000100:00080000:3.0:1767318554.583844:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318554.583848:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318554.583865:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a14e00 x1853164379532928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318554.583996:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379533056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318554.584088:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318554.584328:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533056
00000100:00100000:2.0:1767318554.584337:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533056
00000100:00100000:2.0:1767318554.584396:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197
00000100:00100000:2.0:1767318554.584417:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379533056:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318554.584482:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379533056:12345-0@lo:400:kworker.0 Request processed in 77us (393us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318554.584490:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197
00000100:00100000:2.0:1767318554.584534:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379533056:0@lo:400:kworker.0
00000100:00080000:3.0:1767318554.584587:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318554.584592:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318554.584596:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767318554.584598:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379533312:0@lo:400:kworker.0
00000100:00080000:3.0:1767318554.584626:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3451
00000100:00080000:3.0:1767318554.584630:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318554.584638:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318554.584646:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318554.584684:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318554.584691:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379533184:0@lo:400:kworker.0
00000100:00100000:2.0:1767318554.584714:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318554.584738:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533312
00000100:00100000:2.0:1767318554.584742:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533312
00000100:00100000:2.0:1767318554.584780:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713
00000100:00100000:2.0:1767318554.584786:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379533312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318554.584994:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a14380 x1853164379533440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318554.585002:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533184
00000100:00100000:1.0:1767318554.585011:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533184
00000100:00080000:3.0:1767318554.585039:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318554.585044:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318554.585047:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318554.585053:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3451
00000100:00100000:1.0:1767318554.585054:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198
00000100:00080000:3.0:1767318554.585058:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318554.585067:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379533184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318554.585104:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379533184:12345-0@lo:400:kworker.0 Request processed in 41us (389us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318554.585111:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198
00000100:00100000:1.0:1767318554.585165:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318554.585186:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379533568:0@lo:400:kworker.0
00000100:00100000:1.0:1767318554.585211:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318554.585233:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533568
00000100:00100000:1.0:1767318554.585237:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533568
00000100:00100000:1.0:1767318554.585262:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714
00000100:00100000:1.0:1767318554.585269:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379533568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318554.585314:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379533568:12345-0@lo:400:kworker.0 Request processed in 46us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318554.585320:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714
00000100:00100000:1.0:1767318554.585348:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379533568:0@lo:400:kworker.0
00000100:00100000:1.0:1767318554.585389:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379533184:0@lo:400:kworker.0
00000100:00100000:2.0:1767318554.585855:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379533312:12345-0@lo:400:kworker.0 Request processed in 1068us (1219us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318554.585863:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713
00000100:00080000:3.0:1767318554.586307:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318554.586349:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a14000 x1853164379533696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318554.586618:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379533312:0@lo:400:kworker.0
00000100:00100000:0.0:1767318554.586711:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379532800:0@lo:38:kworker.0
00000100:00100000:0.0:1767318554.586755:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318554.586789:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379532928:0@lo:38:kworker.0
00000100:00100000:0.0:1767318554.586825:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318554.586861:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379533440:0@lo:38:kworker.0
00000100:00100000:0.0:1767318554.586911:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318554.586926:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379533696:0@lo:38:kworker.0
00000100:00100000:0.0:1767318554.586946:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318554.586980:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532800
00000100:00100000:0.0:1767318554.586985:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532800
00000100:00100000:0.0:1767318554.587010:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533440
00000100:00100000:0.0:1767318554.587012:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533440
00000100:00100000:0.0:1767318554.587024:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533696
00000100:00100000:0.0:1767318554.587026:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533696
00000100:00100000:0.0:1767318554.587035:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16252
00000100:00100000:0.0:1767318554.587040:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379532800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318554.587058:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318554.587096:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379532800:12345-0@lo:38:kworker.0 Request processed in 55us (340us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318554.587114:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16252
00000100:00100000:0.0:1767318554.587129:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16253
00000100:00100000:0.0:1767318554.587133:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379533440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318554.587143:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318554.587165:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379533440:12345-0@lo:38:kworker.0 Request processed in 31us (254us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318554.587170:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16253
00000100:00100000:0.0:1767318554.587181:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16254
00000100:00100000:0.0:1767318554.587184:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379533696:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318554.587192:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318554.587211:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379533696:12345-0@lo:38:kworker.0 Request processed in 25us (264us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318554.587216:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16254
00000100:00080000:0.0:1767318554.587239:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318554.587243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318554.587260:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318554.587265:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318554.587268:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379532800:0@lo:38:kworker.0
00000100:00080000:0.0:1767318554.587275:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318554.587279:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318554.587281:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379533440:0@lo:38:kworker.0
00000100:00080000:0.0:1767318554.587288:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318554.587291:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318554.587293:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379533696:0@lo:38:kworker.0
00000100:00100000:3.0:1767318554.588707:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379532928
00000100:00100000:3.0:1767318554.588725:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379532928
00000100:00100000:3.0:1767318554.588798:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825
00000100:00100000:3.0:1767318554.588808:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379532928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318554.588835:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318554.589471:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379532928:12345-0@lo:38:kworker.0 Request processed in 661us (2641us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318554.589482:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825
00000100:00080000:0.0:1767318554.590095:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318554.590103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318554.590108:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379532928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318555.097585:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379533824:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318555.097719:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318555.098115:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533824
00000100:00100000:3.0:1767318555.098128:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533824
00010000:00010000:1.0:1767318555.098162:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318555.098213:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941
00000100:00100000:3.0:1767318555.098227:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379533824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318555.098289:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318555.098378:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379533824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (658us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318555.098386:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941
00000100:00100000:1.0:1767318555.098539:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379533824:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318556.119560:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318557.143318:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318557.594977:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318557.595160:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318557.599027:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291867520
00000100:00100000:0.0:1767318557.599047:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291867520
00000100:00100000:0.0:1767318557.599108:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291867648
00000100:00100000:2.0:1767318557.599785:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16255
00000100:00100000:2.0:1767318557.599798:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291867520:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318557.599829:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318557.601903:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291867520:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2090us (6924us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318557.601919:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16255
00000100:00100000:0.0:1767318557.603827:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291867648
00000100:00100000:0.0:1767318557.603967:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3715
00000100:00100000:0.0:1767318557.603979:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291867648:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318557.604075:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291867648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (8915us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318557.604084:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3715
00000100:00080000:2.0:1767318557.604298:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318558.174806:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318558.680669:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318558.680694:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379533952:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318558.680791:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318558.681494:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379533952
00000100:00100000:3.0:1767318558.681507:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379533952
00000100:00100000:3.0:1767318558.681605:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942
00000100:00100000:3.0:1767318558.681625:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379533952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318558.681664:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318558.681736:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379533952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (945us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318558.681745:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942
00000100:00100000:0.0:1767318558.681940:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379533952:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318558.682636:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318559.191686:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318559.703386:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318559.703400:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318559.703404:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318559.703409:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318559.703414:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318559.703424:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3456
00000100:00080000:2.0:1767318559.703430:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318559.703441:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318559.703494:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571500 x1853164379534080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318559.703522:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318559.703526:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318559.703528:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318559.703532:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3456
00000100:00080000:2.0:1767318559.703546:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318559.703550:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318559.703565:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570380 x1853164379534208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318559.703658:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318559.703662:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318559.703665:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318559.703669:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3456
00000100:00080000:2.0:1767318559.703672:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318559.703676:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318559.703689:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573100 x1853164379534720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318559.703705:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318559.703708:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318559.703710:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318559.703714:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3456
00000100:00080000:2.0:1767318559.703716:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318559.703721:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318559.703732:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573800 x1853164379534976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318559.703778:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379534464:0@lo:400:kworker.0
00000100:00100000:2.0:1767318559.703866:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318559.703963:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318559.703969:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379534592:0@lo:400:kworker.0
00000100:00100000:2.0:1767318559.703998:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318559.704396:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379534848:0@lo:400:kworker.0
00000100:00100000:3.0:1767318559.704434:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318559.704469:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318559.704476:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379534336:0@lo:400:kworker.0
00000100:00100000:3.0:1767318559.704500:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318559.704976:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534592
00000100:00100000:2.0:1767318559.704985:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534592
00000100:00100000:2.0:1767318559.705049:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534848
00000100:00100000:2.0:1767318559.705052:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534848
00000100:00100000:2.0:1767318559.705077:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716
00000100:00100000:2.0:1767318559.705086:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379534592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318559.705152:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379534592:12345-0@lo:400:kworker.0 Request processed in 67us (1153us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318559.705160:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716
00000100:00100000:2.0:1767318559.705179:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717
00000100:00100000:2.0:1767318559.705186:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379534848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318559.705216:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379534848:12345-0@lo:400:kworker.0 Request processed in 31us (781us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318559.705222:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717
00000100:00100000:2.0:1767318559.705269:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379534592:0@lo:400:kworker.0
00000100:00080000:3.0:1767318559.705567:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318559.705594:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379534848:0@lo:400:kworker.0
00000100:00100000:1.0:1767318559.705808:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534464
00000100:00100000:1.0:1767318559.705813:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534464
00000100:00100000:1.0:1767318559.705866:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534336
00000100:00100000:1.0:1767318559.705901:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534336
00000100:00100000:1.0:1767318559.705939:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199
00000100:00100000:1.0:1767318559.705947:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379534464:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318559.705994:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379534464:12345-0@lo:400:kworker.0 Request processed in 49us (2129us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318559.705999:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199
00000100:00100000:1.0:1767318559.706012:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200
00000100:00100000:1.0:1767318559.706016:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379534336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318559.706054:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379534336:12345-0@lo:400:kworker.0 Request processed in 38us (1554us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318559.706058:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200
00000100:00100000:1.0:1767318559.706088:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379534464:0@lo:400:kworker.0
00000100:00080000:3.0:1767318559.706601:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318559.706645:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379534336:0@lo:400:kworker.0
00000100:00100000:0.0:1767318559.706987:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379534080:0@lo:38:kworker.0
00000100:00100000:0.0:1767318559.707031:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318559.707053:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379534208:0@lo:38:kworker.0
00000100:00100000:0.0:1767318559.707077:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318559.707112:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379534720:0@lo:38:kworker.0
00000100:00100000:0.0:1767318559.707135:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318559.707155:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379534976:0@lo:38:kworker.0
00000100:00100000:0.0:1767318559.707195:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318559.707229:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534080
00000100:00100000:0.0:1767318559.707234:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534080
00000100:00100000:0.0:1767318559.707260:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534720
00000100:00100000:0.0:1767318559.707263:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534720
00000100:00100000:0.0:1767318559.707271:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534976
00000100:00100000:0.0:1767318559.707273:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534976
00000100:00100000:0.0:1767318559.707284:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16256
00000100:00100000:0.0:1767318559.707289:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379534080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318559.708028:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318559.708087:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379534080:12345-0@lo:38:kworker.0 Request processed in 795us (1054us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318559.708094:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16256
00000100:00100000:0.0:1767318559.708116:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16257
00000100:00100000:0.0:1767318559.708120:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379534720:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318559.708133:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318559.708158:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379534720:12345-0@lo:38:kworker.0 Request processed in 36us (1020us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318559.708164:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16257
00000100:00100000:0.0:1767318559.708176:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16258
00000100:00100000:0.0:1767318559.708180:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379534976:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318559.708190:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318559.708213:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379534976:12345-0@lo:38:kworker.0 Request processed in 32us (1018us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318559.708219:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16258
00000100:00080000:0.0:1767318559.708268:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318559.708285:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318559.708289:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379534080:0@lo:38:kworker.0
00000100:00080000:0.0:1767318559.708302:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318559.708306:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318559.708309:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379534720:0@lo:38:kworker.0
00000100:00080000:0.0:1767318559.708316:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318559.708319:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318559.708322:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379534976:0@lo:38:kworker.0
00000100:00100000:3.0:1767318559.708837:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379534208
00000100:00100000:3.0:1767318559.708843:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379534208
00000100:00100000:3.0:1767318559.708893:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826
00000100:00100000:3.0:1767318559.708897:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379534208:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318559.708912:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318559.708963:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379534208:12345-0@lo:38:kworker.0 Request processed in 65us (1884us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318559.708968:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826
00000100:00080000:0.0:1767318559.709957:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318559.709964:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318559.709968:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379534208:0@lo:38:kworker.0
00010000:00010000:0.0:1767318560.220200:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318560.220479:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318560.220518:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379535104:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318560.220618:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318560.221083:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379535104
00000100:00100000:3.0:1767318560.221095:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379535104
00000100:00100000:3.0:1767318560.221168:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943
00000100:00100000:3.0:1767318560.221180:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379535104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318560.221234:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318560.221326:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379535104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (707us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318560.221334:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943
00000100:00100000:0.0:1767318560.221494:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379535104:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318561.242726:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767318561.681945:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291867776 offset 0 length 520: 4
00000100:00100000:0.0:1767318561.682027:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318561.682214:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291867904
00000100:00100000:1.0:1767318561.682228:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291867904
00000100:00100000:1.0:1767318561.682291:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16259
00000100:00100000:1.0:1767318561.682302:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291867904:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318561.682333:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318561.682424:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291867904:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 121us (395us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318561.682433:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16259
00000100:00100000:3.0:1767318561.682954:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318561.683198:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868032
00000100:00100000:1.0:1767318561.683207:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868032
00000100:00100000:1.0:1767318561.683280:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3718
00000100:00100000:1.0:1767318561.683289:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291868032:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318561.683362:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291868032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (417us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318561.683369:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3718
00000100:00080000:3.0:1767318561.683408:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318562.263886:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318563.287235:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318563.800493:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379535232:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318563.800627:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318563.800909:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379535232
00000100:00100000:3.0:1767318563.800920:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379535232
00000100:00080000:0.0:1767318563.801006:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318563.801018:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944
00000100:00100000:3.0:1767318563.801038:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379535232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318563.801080:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318563.801155:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379535232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (538us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318563.801167:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944
00000100:00100000:0.0:1767318563.801249:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379535232:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318564.312155:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318564.823193:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318564.823204:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318564.823207:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318564.823236:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318564.823242:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318564.823250:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3462
00000100:00080000:3.0:1767318564.823256:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318564.823263:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318564.823299:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a14700 x1853164379535360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318564.823324:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318564.823329:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318564.823331:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318564.823336:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3462
00000100:00080000:3.0:1767318564.823340:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767318564.823350:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318539/real 1767318539]  req@ffff8b0f1c0e0e00 x1853164379528832/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318564.823350:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318564.823385:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a14a80 x1853164379535488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318564.823411:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f1c0e0e00 x1853164379528832/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318564.823455:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379535360:0@lo:38:kworker.0
00000100:00080000:3.0:1767318564.823471:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318564.823475:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318564.823478:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318564.823481:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3462
00000100:00080000:3.0:1767318564.823485:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318564.823488:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318564.823504:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a16a00 x1853164379536000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318564.823521:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318564.823531:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318564.823533:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318564.823538:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3462
00000100:00080000:3.0:1767318564.823541:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318564.823545:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318564.823553:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318564.823570:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a14000 x1853164379536256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318564.823623:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379535872:0@lo:400:kworker.0
00000100:00100000:0.0:1767318564.823683:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379535488:0@lo:38:kworker.0
00000100:00100000:0.0:1767318564.823717:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318564.823742:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318564.823767:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318564.823772:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379528832:0@lo:250:kworker.0
00000100:00100000:0.0:1767318564.823800:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379536000:0@lo:38:kworker.0
00000100:00100000:0.0:1767318564.823825:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318564.823845:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379536256:0@lo:38:kworker.0
00000100:00100000:0.0:1767318564.823866:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318564.823929:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379535744:0@lo:400:kworker.0
00000100:00100000:0.0:1767318564.823961:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318564.823999:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379535360
00000100:00100000:0.0:1767318564.824009:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379535360
00000100:00100000:0.0:1767318564.824049:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16260
00000100:00100000:0.0:1767318564.824058:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379535360:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318564.824084:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318564.824133:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379535360:12345-0@lo:38:kworker.0 Request processed in 75us (582us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318564.824140:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16260
00000100:00100000:0.0:1767318564.824159:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379536000
00000100:00100000:0.0:1767318564.824163:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379536000
00000100:00100000:0.0:1767318564.824178:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379536256
00000100:00100000:0.0:1767318564.824180:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379536256
00000100:00100000:0.0:1767318564.824361:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16261
00000100:00100000:0.0:1767318564.824366:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379536000:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318564.824378:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318564.824424:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379536000:12345-0@lo:38:kworker.0 Request processed in 55us (596us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318564.824434:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16261
00000100:00100000:0.0:1767318564.824448:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16262
00000100:00100000:0.0:1767318564.824452:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379536256:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318564.824461:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318564.824489:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379536256:12345-0@lo:38:kworker.0 Request processed in 34us (620us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318564.824495:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16262
00000100:00080000:0.0:1767318564.824572:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318564.824577:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318564.824586:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379536000:0@lo:38:kworker.0
00000100:00100000:3.0:1767318564.824595:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318564.824608:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318564.824616:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318564.824620:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379536256:0@lo:38:kworker.0
00000100:00100000:3.0:1767318564.824690:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379535872
00000100:00100000:3.0:1767318564.824701:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379535872
00000100:00100000:1.0:1767318564.824716:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379536128:0@lo:400:kworker.0
00000100:00100000:3.0:1767318564.824766:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719
00000100:00100000:3.0:1767318564.824779:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379535872:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318564.824809:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379535488
00000100:00100000:2.0:1767318564.824817:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379535488
00000100:00080000:0.0:1767318564.824849:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318564.824854:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318564.824858:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379535360:0@lo:38:kworker.0
00000100:00080000:0.0:1767318564.824947:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318564.824977:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379535744
00000100:00100000:0.0:1767318564.824981:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379535744
00000100:00100000:0.0:1767318564.825029:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201
00000100:00100000:0.0:1767318564.825037:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379535744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318564.825090:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379535744:12345-0@lo:400:kworker.0 Request processed in 54us (1128us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318564.825105:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201
00000100:00100000:0.0:1767318564.825129:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379535616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318564.825161:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318564.825350:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379535744:0@lo:400:kworker.0
00000100:00080000:0.0:1767318564.825367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318564.825375:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379535616
00000100:00100000:0.0:1767318564.825378:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379535616
00000100:00100000:0.0:1767318564.825403:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202
00000100:00100000:0.0:1767318564.825409:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379535616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318564.825444:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379535616:12345-0@lo:400:kworker.0 Request processed in 35us (282us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318564.825450:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202
00000100:00100000:0.0:1767318564.825475:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379535616:0@lo:400:kworker.0
00000100:00080000:0.0:1767318564.825526:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318564.825532:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318564.825535:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318564.825540:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3441
00000100:00080000:0.0:1767318564.825544:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318564.825549:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318564.825588:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f347b80 x1853164379536384/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318564.825627:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379536384:0@lo:250:kworker.0
00000400:00000100:0.0:1767318564.825652:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379536384 offset 0 length 520: 4
00000100:00100000:2.0:1767318564.825963:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827
00000100:00100000:2.0:1767318564.825969:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379535488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318564.825988:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318564.826035:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379535488:12345-0@lo:38:kworker.0 Request processed in 65us (2317us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318564.826041:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827
00000100:00080000:2.0:1767318564.826075:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318564.826080:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318564.826083:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379535488:0@lo:38:kworker.0
00000100:00100000:1.0:1767318564.829019:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318564.838369:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379536128
00000100:00100000:0.0:1767318564.838418:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379536128
00000100:00100000:0.0:1767318564.838618:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720
00000100:00100000:0.0:1767318564.838633:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379536128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318564.839196:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379535872:12345-0@lo:400:kworker.0 Request processed in 14164us (14357us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318564.839216:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719
00000100:00100000:0.0:1767318564.839315:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379536128:12345-0@lo:400:kworker.0 Request processed in 130us (9751us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318564.839328:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720
00000100:00080000:1.0:1767318564.839430:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318564.839498:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379536128:0@lo:400:kworker.0
00000100:00100000:1.0:1767318564.839592:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379535872:0@lo:400:kworker.0
00000100:00100000:0.0:1767318565.335220:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379536512:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318565.335337:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318565.335652:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379536512
00000100:00100000:3.0:1767318565.335663:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379536512
00000100:00100000:3.0:1767318565.335796:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945
00000100:00100000:3.0:1767318565.335807:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379536512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318565.335845:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00010000:00010000:2.0:1767318565.335946:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318565.336028:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379536512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 202us (670us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318565.336038:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945
00000100:00100000:2.0:1767318565.336704:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379536512:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318566.363990:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318566.804422:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318566.804511:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318566.806055:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868160
00000100:00100000:0.0:1767318566.806074:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868160
00000100:00100000:0.0:1767318566.806139:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868288
00000100:00100000:0.0:1767318566.806142:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868288
00000100:00100000:0.0:1767318566.806226:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3721
00000100:00100000:0.0:1767318566.806239:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291868288:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318566.806345:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291868288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (1834us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318566.806354:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3721
00000100:00100000:0.0:1767318566.806375:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16263
00000100:00100000:0.0:1767318566.806380:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291868160:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318566.806408:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318566.806435:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291868160:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (2024us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318566.806442:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16263
00000100:00080000:3.0:1767318566.807536:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318567.383937:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318568.409941:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318568.919377:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379536640:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318568.919485:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318568.920107:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379536640
00000100:00100000:3.0:1767318568.920121:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379536640
00000100:00100000:3.0:1767318568.920232:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946
00000100:00100000:3.0:1767318568.920248:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379536640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318568.920440:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318568.920544:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379536640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 299us (1057us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318568.920554:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946
00000100:00100000:2.0:1767318568.920834:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379536640:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318568.922190:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318569.431474:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318569.946281:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318569.946296:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318569.946299:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318569.946303:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318569.946308:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318569.946319:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3467
00000100:00080000:2.0:1767318569.946324:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318569.946334:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318569.946384:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572a00 x1853164379536768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318569.946428:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318569.946434:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318569.946436:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318569.946440:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3467
00000100:00080000:2.0:1767318569.946443:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318569.946447:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318569.946462:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572680 x1853164379536896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318569.946670:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379537024:0@lo:400:kworker.0
00000100:00100000:1.0:1767318569.946781:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318569.946917:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379537152:0@lo:400:kworker.0
00000100:00100000:1.0:1767318569.946947:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318569.947089:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537024
00000100:00100000:0.0:1767318569.947101:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537024
00000100:00100000:0.0:1767318569.947166:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537152
00000100:00100000:0.0:1767318569.947169:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537152
00000100:00100000:0.0:1767318569.947207:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203
00000100:00100000:0.0:1767318569.947217:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379537024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318569.947283:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379537024:12345-0@lo:400:kworker.0 Request processed in 67us (501us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318569.947291:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203
00000100:00100000:0.0:1767318569.947310:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204
00000100:00100000:0.0:1767318569.947316:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379537152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318569.947349:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379537152:12345-0@lo:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318569.947355:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204
00000100:00080000:0.0:1767318569.947381:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318569.947417:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379537024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318569.947447:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379537152:0@lo:400:kworker.0
00000100:00100000:3.0:1767318569.948101:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379536768:0@lo:38:kworker.0
00000100:00080000:2.0:1767318569.948462:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318569.948468:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318569.948471:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318569.948477:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3467
00000100:00080000:2.0:1767318569.948482:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318569.948488:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318569.948507:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571500 x1853164379537408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318569.948552:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318569.948556:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318569.948558:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318569.948563:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3467
00000100:00080000:2.0:1767318569.948818:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767318569.948832:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318569.948833:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318569.948861:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571c00 x1853164379537664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318569.949125:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379536896:0@lo:38:kworker.0
00000100:00100000:1.0:1767318569.949162:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379537280:0@lo:400:kworker.0
00000100:00100000:3.0:1767318569.949180:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318569.949237:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318569.949276:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379537408:0@lo:38:kworker.0
00000100:00100000:1.0:1767318569.949305:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379536768
00000100:00100000:3.0:1767318569.949314:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318569.949316:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379536768
00000100:00100000:3.0:1767318569.949341:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379537664:0@lo:38:kworker.0
00000100:00100000:1.0:1767318569.949360:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537280
00000100:00100000:1.0:1767318569.949367:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537280
00000100:00100000:3.0:1767318569.949374:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318569.949421:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537408
00000100:00100000:3.0:1767318569.949436:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537664
00000100:00100000:1.0:1767318569.949438:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537408
00000100:00100000:3.0:1767318569.949452:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537664
00000100:00100000:1.0:1767318569.949463:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722
00000100:00100000:1.0:1767318569.949476:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379537280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318569.949501:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16264
00000100:00100000:3.0:1767318569.949511:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379536768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318569.949545:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318569.949573:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379537280:12345-0@lo:400:kworker.0 Request processed in 98us (336us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318569.949582:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722
00000100:00100000:1.0:1767318569.949620:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16265
00000100:00100000:3.0:1767318569.949620:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379536768:12345-0@lo:38:kworker.0 Request processed in 106us (801us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318569.949633:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379537408:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318569.949642:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16264
00010000:00020000:1.0:1767318569.949659:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318569.949673:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16266
00000100:00100000:3.0:1767318569.949700:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379537664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318569.949716:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318569.949730:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379537408:12345-0@lo:38:kworker.0 Request processed in 95us (414us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318569.949739:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16265
00000100:00100000:3.0:1767318569.949767:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379537664:12345-0@lo:38:kworker.0 Request processed in 65us (394us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318569.949777:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16266
00000100:00100000:1.0:1767318569.949803:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379537280:0@lo:400:kworker.0
00000100:00100000:3.0:1767318569.949819:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379536896
00000100:00100000:3.0:1767318569.949826:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379536896
00000100:00100000:3.0:1767318569.949865:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828
00000100:00100000:3.0:1767318569.949910:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379536896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318569.949923:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318569.949973:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379536896:12345-0@lo:38:kworker.0 Request processed in 63us (793us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318569.949980:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828
00000100:00080000:3.0:1767318569.950036:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318569.950043:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318569.950050:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379537408:0@lo:38:kworker.0
00000100:00080000:3.0:1767318569.950062:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318569.950065:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318569.950068:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379537664:0@lo:38:kworker.0
00000100:00080000:3.0:1767318569.950078:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318569.950082:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318569.950085:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379536768:0@lo:38:kworker.0
00000100:00080000:3.0:1767318569.950101:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318569.950108:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318569.950110:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379537536:0@lo:400:kworker.0
00000100:00100000:3.0:1767318569.950128:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379536896:0@lo:38:kworker.0
00000100:00100000:0.0:1767318569.950176:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318569.954781:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537536
00000100:00080000:3.0:1767318569.954785:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318569.954802:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537536
00000100:00100000:0.0:1767318569.964466:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723
00000100:00100000:0.0:1767318569.964487:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379537536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318569.965206:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379537536:12345-0@lo:400:kworker.0 Request processed in 722us (15029us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318569.965238:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723
00000100:00100000:0.0:1767318569.965313:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379537536:0@lo:400:kworker.0
00000100:00080000:3.0:1767318569.966238:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767318570.459468:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318570.459654:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318570.459695:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379537792:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318570.459798:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318570.459988:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537792
00000100:00100000:3.0:1767318570.460000:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537792
00000100:00100000:3.0:1767318570.460074:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947
00000100:00100000:3.0:1767318570.460086:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379537792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318570.460129:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318570.460199:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379537792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (400us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318570.460207:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947
00000100:00100000:0.0:1767318570.463028:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379537792:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318571.479230:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318571.922750:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318571.923407:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868416
00000100:00100000:1.0:1767318571.923417:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868416
00000100:00100000:1.0:1767318571.923477:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16267
00000100:00100000:1.0:1767318571.923485:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291868416:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318571.923524:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318571.923721:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291868416:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 235us (979us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318571.923730:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16267
00000100:00100000:0.0:1767318571.928835:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318571.928937:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868544
00000100:00100000:1.0:1767318571.928945:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868544
00000100:00100000:1.0:1767318571.929021:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3724
00000100:00100000:1.0:1767318571.929028:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291868544:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318571.929120:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291868544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (292us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318571.929128:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3724
00000100:00080000:3.0:1767318571.929349:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318572.503114:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318573.527037:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318574.042386:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318574.042414:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379537920:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318574.042495:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318574.042645:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379537920
00000100:00100000:2.0:1767318574.042655:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379537920
00000100:00100000:2.0:1767318574.042738:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948
00000100:00100000:2.0:1767318574.042748:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379537920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318574.042780:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318574.042832:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379537920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (335us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318574.042840:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948
00000100:00100000:1.0:1767318574.042937:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379537920:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318574.043076:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767318574.551802:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318575.064262:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318575.064272:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318575.064275:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318575.064279:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318575.064284:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318575.064291:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3472
00000100:00080000:2.0:1767318575.064296:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318575.064302:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318575.064344:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571f80 x1853164379538048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318575.064368:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318575.064372:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318575.064374:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318575.064377:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3472
00000100:00080000:2.0:1767318575.064380:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318575.064383:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318575.064395:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572680 x1853164379538176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318575.064463:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318575.064467:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318575.064481:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318575.064485:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3472
00000100:00080000:2.0:1767318575.064488:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318575.064491:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318575.064503:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573100 x1853164379538688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318575.064520:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318575.064523:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318575.064525:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318575.064528:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3472
00000100:00080000:2.0:1767318575.064531:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318575.064536:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318575.064549:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570380 x1853164379538944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318575.064567:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379538304:0@lo:400:kworker.0
00000100:00100000:2.0:1767318575.064580:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379538560:0@lo:400:kworker.0
00000100:00100000:2.0:1767318575.064652:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318575.064720:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318575.064724:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318575.064730:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379538432:0@lo:400:kworker.0
00000100:00100000:1.0:1767318575.064762:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318575.064766:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318575.064773:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379538816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318575.064804:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318575.064808:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538304
00000100:00100000:2.0:1767318575.064818:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538304
00000100:00100000:1.0:1767318575.064839:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538432
00000100:00100000:1.0:1767318575.064845:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538432
00000100:00100000:2.0:1767318575.064867:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205
00000100:00100000:2.0:1767318575.064900:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379538304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318575.064908:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206
00000100:00100000:1.0:1767318575.064918:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379538432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318575.064965:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379538304:12345-0@lo:400:kworker.0 Request processed in 67us (241us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318575.064969:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379538432:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318575.064978:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205
00000100:00100000:1.0:1767318575.064991:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206
00000100:00100000:1.0:1767318575.065025:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538560
00000100:00100000:2.0:1767318575.065028:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379538304:0@lo:400:kworker.0
00000100:00100000:1.0:1767318575.065029:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538560
00000100:00100000:3.0:1767318575.065056:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379538048:0@lo:38:kworker.0
00000100:00100000:1.0:1767318575.065063:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538816
00000100:00100000:2.0:1767318575.065064:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379538432:0@lo:400:kworker.0
00000100:00100000:1.0:1767318575.065068:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538816
00000100:00100000:3.0:1767318575.065090:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318575.065095:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318575.065100:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538048
00000100:00080000:2.0:1767318575.065101:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318575.065106:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538048
00000100:00100000:3.0:1767318575.065117:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379538176:0@lo:38:kworker.0
00000100:00100000:1.0:1767318575.065129:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725
00000100:00100000:1.0:1767318575.065138:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379538560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318575.065152:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318575.065188:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379538688:0@lo:38:kworker.0
00000100:00100000:1.0:1767318575.065189:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379538560:12345-0@lo:400:kworker.0 Request processed in 51us (534us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318575.065201:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726
00000100:00100000:1.0:1767318575.065212:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725
00000100:00100000:2.0:1767318575.065213:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379538816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318575.065215:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318575.065232:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379538944:0@lo:38:kworker.0
00000100:00100000:1.0:1767318575.065234:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538688
00000100:00100000:1.0:1767318575.065239:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538688
00000100:00100000:2.0:1767318575.065253:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379538816:12345-0@lo:400:kworker.0 Request processed in 43us (448us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318575.065255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318575.065260:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726
00000100:00100000:1.0:1767318575.065267:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538944
00000100:00100000:1.0:1767318575.065272:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538944
00000100:00100000:2.0:1767318575.065279:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16268
00000100:00100000:3.0:1767318575.065282:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379538176
00000100:00100000:2.0:1767318575.065284:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379538048:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318575.065286:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379538176
00000100:00100000:1.0:1767318575.065293:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16269
00010000:00020000:2.0:1767318575.065302:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318575.065312:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829
00000100:00100000:1.0:1767318575.065315:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379538688:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318575.065322:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379538176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318575.065330:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318575.065335:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379538048:12345-0@lo:38:kworker.0 Request processed in 49us (245us total) trans 0 rc -19/-19
00010000:00020000:3.0:1767318575.065358:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318575.065366:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379538688:12345-0@lo:38:kworker.0 Request processed in 52us (150us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318575.065374:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16269
00000100:00100000:1.0:1767318575.065391:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16270
00000100:00100000:1.0:1767318575.065397:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379538944:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318575.065401:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379538176:12345-0@lo:38:kworker.0 Request processed in 75us (244us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767318575.065410:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318575.065415:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829
00000100:00100000:1.0:1767318575.065458:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379538944:12345-0@lo:38:kworker.0 Request processed in 61us (201us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767318575.065462:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767318575.065476:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16270
00000100:00080000:3.0:1767318575.065484:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318575.065491:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379538048:0@lo:38:kworker.0
00000100:00080000:3.0:1767318575.065510:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318575.065515:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318575.065520:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379538176:0@lo:38:kworker.0
00000100:00100000:1.0:1767318575.065525:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379538560:0@lo:400:kworker.0
00000100:00080000:3.0:1767318575.065540:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318575.065546:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318575.065550:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379538688:0@lo:38:kworker.0
00000100:00080000:3.0:1767318575.065566:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318575.065571:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318575.065575:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379538944:0@lo:38:kworker.0
00000100:00100000:3.0:1767318575.065623:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379538816:0@lo:400:kworker.0
00000100:00100000:2.0:1767318575.066634:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16268
00010000:00010000:1.0:1767318575.575174:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318575.575823:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318575.575842:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379539072:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318575.575932:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318575.576829:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539072
00000100:00100000:3.0:1767318575.576840:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539072
00000100:00100000:3.0:1767318575.576923:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949
00000100:00100000:3.0:1767318575.576934:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379539072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318575.576970:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318575.577041:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379539072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (1108us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318575.577064:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949
00000100:00100000:1.0:1767318575.577164:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379539072:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318576.599208:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318577.039990:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318577.040048:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318577.040238:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868800
00000100:00100000:1.0:1767318577.040251:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868800
00000100:00100000:1.0:1767318577.040347:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868672
00000100:00100000:1.0:1767318577.040358:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868672
00000100:00100000:1.0:1767318577.040383:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3727
00000100:00100000:1.0:1767318577.040395:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291868800:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318577.040489:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291868800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 95us (526us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318577.040512:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3727
00000100:00100000:1.0:1767318577.040535:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16271
00000100:00100000:1.0:1767318577.040541:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291868672:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318577.040568:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318577.040595:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291868672:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (547us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318577.040601:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16271
00000100:00080000:3.0:1767318577.040961:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318577.623089:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318578.647359:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318579.163302:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379539200:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318579.163394:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318579.163596:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539200
00000100:00100000:0.0:1767318579.163605:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539200
00000100:00100000:0.0:1767318579.163686:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950
00000100:00100000:0.0:1767318579.163696:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379539200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318579.163726:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318579.163789:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379539200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (394us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318579.163797:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950
00000100:00080000:3.0:1767318579.163918:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318579.164014:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379539200:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318579.671244:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318580.183164:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318580.183173:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318580.183189:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318580.183194:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318580.183199:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318580.183208:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318580.183213:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318580.183223:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318580.183270:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f135180 x1853164379539328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318580.183297:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318580.183301:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318580.183303:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318580.183322:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318580.183325:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318580.183329:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318580.183346:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f136300 x1853164379539456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318580.184008:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318580.184012:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318580.184014:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318580.184018:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318580.184021:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318580.184025:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318580.184038:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f135500 x1853164379539968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318580.184057:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318580.184060:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318580.184062:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318580.184065:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3477
00000100:00080000:1.0:1767318580.184067:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318580.184071:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318580.184081:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f137800 x1853164379540224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318580.184114:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379539840:0@lo:400:kworker.0
00000100:00100000:1.0:1767318580.184234:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318580.184298:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318580.184315:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379539712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318580.184346:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.184529:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379539328:0@lo:38:kworker.0
00000100:00100000:0.0:1767318580.184618:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379540096:0@lo:400:kworker.0
00000100:00100000:2.0:1767318580.184696:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379539584:0@lo:400:kworker.0
00000100:00100000:3.0:1767318580.186693:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.186757:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379539456:0@lo:38:kworker.0
00000100:00100000:3.0:1767318580.186786:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.186808:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379539968:0@lo:38:kworker.0
00000100:00100000:3.0:1767318580.186826:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.186842:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379540224:0@lo:38:kworker.0
00000100:00100000:3.0:1767318580.186859:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.186922:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539840
00000100:00100000:3.0:1767318580.186930:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539840
00000100:00100000:3.0:1767318580.186980:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539328
00000100:00100000:3.0:1767318580.186983:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539328
00000100:00100000:3.0:1767318580.186995:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539968
00000100:00100000:3.0:1767318580.186997:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539968
00000100:00100000:3.0:1767318580.187003:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540224
00000100:00100000:3.0:1767318580.187005:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540224
00000100:00100000:3.0:1767318580.187016:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728
00000100:00100000:3.0:1767318580.187025:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379539840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318580.187075:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379539840:12345-0@lo:400:kworker.0 Request processed in 51us (2894us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318580.187082:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728
00000100:00100000:3.0:1767318580.187113:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16272
00000100:00100000:3.0:1767318580.187117:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379539328:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318580.187136:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318580.187168:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379539328:12345-0@lo:38:kworker.0 Request processed in 49us (481us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318580.187173:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16272
00000100:00100000:3.0:1767318580.187202:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16273
00000100:00100000:3.0:1767318580.187206:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379539968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318580.187215:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318580.187240:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379539968:12345-0@lo:38:kworker.0 Request processed in 32us (412us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318580.187245:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16273
00000100:00100000:3.0:1767318580.187254:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16274
00000100:00100000:3.0:1767318580.187258:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379540224:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318580.187267:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318580.187292:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379540224:12345-0@lo:38:kworker.0 Request processed in 32us (431us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318580.187297:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16274
00000100:00100000:3.0:1767318580.187315:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539456
00000100:00100000:3.0:1767318580.187318:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539456
00000100:00100000:3.0:1767318580.187336:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830
00000100:00100000:3.0:1767318580.187340:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379539456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318580.187348:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318580.187389:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379539456:12345-0@lo:38:kworker.0 Request processed in 47us (602us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318580.187404:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830
00000100:00080000:3.0:1767318580.187431:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318580.188106:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318580.188113:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318580.188118:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379539328:0@lo:38:kworker.0
00000100:00080000:3.0:1767318580.188136:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318580.188139:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318580.188142:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379539456:0@lo:38:kworker.0
00000100:00080000:3.0:1767318580.188150:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318580.188152:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318580.188155:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379539968:0@lo:38:kworker.0
00000100:00080000:3.0:1767318580.188163:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318580.188166:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318580.188168:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379540224:0@lo:38:kworker.0
00000100:00100000:3.0:1767318580.188296:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539712
00000100:00100000:3.0:1767318580.188301:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539712
00000100:00100000:3.0:1767318580.188432:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207
00000100:00100000:3.0:1767318580.188442:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379539712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318580.188625:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379539712:12345-0@lo:400:kworker.0 Request processed in 185us (4277us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318580.188631:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207
00000100:00080000:3.0:1767318580.188653:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318580.188797:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.189073:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540096
00000100:00100000:3.0:1767318580.189078:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540096
00000100:00100000:3.0:1767318580.189124:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729
00000100:00100000:3.0:1767318580.189144:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379540096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318580.189198:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379540096:12345-0@lo:400:kworker.0 Request processed in 56us (402us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318580.189204:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729
00000100:00080000:0.0:1767318580.189669:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318580.189704:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379540096:0@lo:400:kworker.0
00000100:00100000:1.0:1767318580.196735:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379539712:0@lo:400:kworker.0
00000100:00100000:1.0:1767318580.196756:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379539840:0@lo:400:kworker.0
00000100:00100000:2.0:1767318580.196979:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.198606:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379539584
00000100:00100000:3.0:1767318580.198620:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379539584
00000100:00100000:3.0:1767318580.198686:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208
00000100:00100000:3.0:1767318580.198696:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379539584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318580.198796:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379539584:12345-0@lo:400:kworker.0 Request processed in 101us (1817us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318580.198805:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208
00000100:00100000:2.0:1767318580.198918:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379539584:0@lo:400:kworker.0
00010000:00010000:1.0:1767318580.695359:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318580.695553:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379540352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318580.695646:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318580.695950:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540352
00000100:00100000:3.0:1767318580.695961:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540352
00000100:00100000:3.0:1767318580.696022:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951
00000100:00100000:3.0:1767318580.696032:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379540352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318580.696062:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318580.696123:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379540352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (477us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318580.696131:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951
00000100:00100000:3.0:1767318580.696186:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379540352:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318581.719110:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318582.159581:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318582.159954:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291869056
00000100:00100000:3.0:1767318582.159968:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291869056
00000100:00100000:3.0:1767318582.160109:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3730
00000100:00100000:3.0:1767318582.160123:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291869056:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318582.160210:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291869056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (643us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318582.160233:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3730
00000100:00080000:0.0:1767318582.160291:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318582.164523:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318582.164638:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291868928
00000100:00100000:3.0:1767318582.164650:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291868928
00000100:00100000:3.0:1767318582.164763:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16275
00000100:00100000:3.0:1767318582.164775:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291868928:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318582.164803:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318582.164915:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291868928:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 141us (402us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318582.164924:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16275
00010000:00010000:3.0:1767318582.743568:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318583.767525:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318584.281978:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379540480:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318584.282061:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318584.282237:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540480
00000100:00100000:1.0:1767318584.282247:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540480
00000100:00100000:1.0:1767318584.282326:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952
00000100:00100000:1.0:1767318584.282337:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379540480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318584.282368:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318584.282866:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318584.288451:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379540480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6104us (6378us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318584.288468:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952
00000100:00100000:2.0:1767318584.300716:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379540480:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318584.791198:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318585.303933:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318585.303945:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318585.303948:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318585.303952:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318585.303956:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318585.303965:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3482
00000100:00080000:3.0:1767318585.303969:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318585.303977:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318585.304021:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d180 x1853164379540608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318585.304050:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318585.304061:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318585.304064:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318585.304067:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3482
00000100:00080000:3.0:1767318585.304086:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318585.304089:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318585.304103:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c380 x1853164379540736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318585.304165:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318585.304168:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318585.304170:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318585.304173:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3482
00000100:00080000:3.0:1767318585.304176:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318585.304179:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318585.304188:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ce00 x1853164379541248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318585.304202:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318585.304205:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318585.304207:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318585.304210:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3482
00000100:00080000:3.0:1767318585.304212:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318585.304216:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318585.304224:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164379541504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318585.304248:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379540992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318585.304318:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318585.304395:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318585.304401:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379541120:0@lo:400:kworker.0
00000100:00100000:3.0:1767318585.304435:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318585.304474:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379541120
00000100:00100000:3.0:1767318585.304481:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379541120
00000100:00100000:3.0:1767318585.304546:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731
00000100:00100000:3.0:1767318585.304555:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379541120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318585.304612:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379541120:12345-0@lo:400:kworker.0 Request processed in 59us (176us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318585.304619:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731
00000100:00100000:3.0:1767318585.304657:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379541120:0@lo:400:kworker.0
00000100:00100000:0.0:1767318585.304930:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379540608:0@lo:38:kworker.0
00000100:00100000:0.0:1767318585.304963:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318585.304988:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379540736:0@lo:38:kworker.0
00000100:00100000:0.0:1767318585.305013:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318585.305049:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379541248:0@lo:38:kworker.0
00000100:00100000:0.0:1767318585.305071:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318585.305084:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379541504:0@lo:38:kworker.0
00000100:00100000:0.0:1767318585.305102:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318585.305132:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540736
00000100:00100000:0.0:1767318585.305137:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540736
00000100:00100000:0.0:1767318585.305162:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831
00000100:00100000:0.0:1767318585.305167:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379540736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318585.305187:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318585.305222:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379540736:12345-0@lo:38:kworker.0 Request processed in 54us (209us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318585.305228:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831
00000100:00100000:0.0:1767318585.305247:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540608
00000100:00100000:0.0:1767318585.305250:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540608
00000100:00100000:0.0:1767318585.305267:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379541248
00000100:00100000:0.0:1767318585.305269:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379541248
00000100:00100000:0.0:1767318585.305280:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379541504
00000100:00100000:0.0:1767318585.305282:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379541504
00000100:00100000:0.0:1767318585.305291:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16276
00000100:00100000:0.0:1767318585.305296:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379540608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318585.305306:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318585.305330:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379540608:12345-0@lo:38:kworker.0 Request processed in 33us (366us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318585.305336:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16276
00000100:00100000:0.0:1767318585.305347:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16277
00000100:00100000:0.0:1767318585.305350:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379541248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318585.305358:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318585.305398:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379541248:12345-0@lo:38:kworker.0 Request processed in 46us (326us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318585.305404:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16277
00000100:00100000:0.0:1767318585.305415:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16278
00000100:00100000:0.0:1767318585.305418:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379541504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318585.305428:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318585.305448:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379541504:12345-0@lo:38:kworker.0 Request processed in 28us (346us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318585.305453:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16278
00000100:00080000:0.0:1767318585.305479:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318585.305500:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318585.305506:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318585.305509:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379540608:0@lo:38:kworker.0
00000100:00080000:0.0:1767318585.305518:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318585.305521:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318585.305523:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379540736:0@lo:38:kworker.0
00000100:00080000:0.0:1767318585.305542:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318585.305546:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318585.305549:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379541248:0@lo:38:kworker.0
00000100:00080000:0.0:1767318585.305557:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318585.305560:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318585.305562:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379541504:0@lo:38:kworker.0
00000100:00100000:2.0:1767318585.305679:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379541376:0@lo:400:kworker.0
00000100:00100000:2.0:1767318585.305716:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318585.305749:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318585.305763:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379540864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318585.305787:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318585.306016:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379541376
00000100:00100000:3.0:1767318585.306022:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379541376
00000100:00100000:0.0:1767318585.306123:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540992
00000100:00100000:0.0:1767318585.306127:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540992
00000100:00100000:1.0:1767318585.306189:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379540864
00000100:00100000:1.0:1767318585.306194:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379540864
00000100:00100000:1.0:1767318585.306224:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209
00000100:00100000:1.0:1767318585.306230:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379540864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318585.306280:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379540864:12345-0@lo:400:kworker.0 Request processed in 50us (491us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318585.306287:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209
00000100:00100000:1.0:1767318585.306343:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379540864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318585.306431:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732
00000100:00100000:3.0:1767318585.306437:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379541376:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318585.306472:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379541376:12345-0@lo:400:kworker.0 Request processed in 36us (755us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318585.306477:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732
00000100:00100000:1.0:1767318585.309578:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379541376:0@lo:400:kworker.0
00000100:00080000:2.0:1767318585.310653:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318585.310665:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318585.311071:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210
00000100:00100000:0.0:1767318585.311089:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379540992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318585.311204:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379540992:12345-0@lo:400:kworker.0 Request processed in 123us (6885us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318585.311211:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210
00000100:00100000:3.0:1767318585.314553:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379540992:0@lo:400:kworker.0
00000100:00100000:0.0:1767318585.815385:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318585.815414:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379541632:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318585.815502:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318585.815636:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379541632
00000100:00100000:3.0:1767318585.815645:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379541632
00000100:00100000:3.0:1767318585.815702:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953
00000100:00100000:3.0:1767318585.815712:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379541632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318585.815744:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318585.815813:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379541632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (310us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318585.815822:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953
00000100:00100000:0.0:1767318585.815988:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379541632:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318585.816101:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318586.839232:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767318587.280253:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291869184 offset 0 length 520: 4
00000100:00100000:2.0:1767318587.280483:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318587.280571:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318587.283006:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291869312
00000100:00100000:1.0:1767318587.283052:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291869312
00000100:00100000:1.0:1767318587.283097:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291869440
00000100:00100000:1.0:1767318587.283101:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291869440
00000100:00100000:1.0:1767318587.283154:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3733
00000100:00100000:1.0:1767318587.283166:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291869440:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318587.283253:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291869440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (2680us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318587.283260:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3733
00000100:00100000:1.0:1767318587.283283:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16279
00000100:00100000:1.0:1767318587.283287:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291869312:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318587.283309:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318587.283335:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291869312:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (2853us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318587.283340:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16279
00000100:00080000:1.0:1767318587.283369:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318587.868767:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318588.889765:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318589.399048:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318564/real 1767318564]  req@ffff8b0f2f347b80 x1853164379536384/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318589 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318589.399081:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f347b80 x1853164379536384/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318589 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318589.399102:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318589.399114:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318589.399117:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f347b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379536384:0@lo:250:kworker.0
00000100:00080000:3.0:1767318589.399266:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318589.399273:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318589.399277:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318589.399282:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3467
00000100:00080000:3.0:1767318589.399287:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318589.399295:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318589.399336:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f800 x1853164379541760/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318589.399384:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318589.399387:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318589.399389:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318589.399393:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3487
00000100:00080000:3.0:1767318589.399396:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318589.399400:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318589.399421:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d500 x1853164379541888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318589.399430:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318589.399434:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318589.399436:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318589.399441:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3487
00000100:00080000:3.0:1767318589.399444:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318589.399448:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318589.399461:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ea00 x1853164379542016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318589.399524:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318589.399545:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318589.399547:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318589.399552:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3487
00000100:00080000:3.0:1767318589.399554:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318589.399558:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318589.399570:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c380 x1853164379542528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318589.399586:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318589.399589:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318589.399591:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318589.399594:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3487
00000100:00080000:3.0:1767318589.399596:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318589.399600:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318589.399611:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e84e00 x1853164379542784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318589.399640:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379542272:0@lo:400:kworker.0
00000100:00100000:3.0:1767318589.399720:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318589.399796:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318589.399803:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379542144:0@lo:400:kworker.0
00000100:00100000:3.0:1767318589.399826:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318589.399856:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379542400:0@lo:400:kworker.0
00000100:00100000:3.0:1767318589.399924:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318589.399948:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318589.399953:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379542656:0@lo:400:kworker.0
00000100:00100000:1.0:1767318589.399972:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542272
00000100:00100000:3.0:1767318589.399974:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318589.399982:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542272
00000100:00100000:3.0:1767318589.400010:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542400
00000100:00100000:3.0:1767318589.400013:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542400
00000100:00100000:1.0:1767318589.400042:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542144
00000100:00100000:3.0:1767318589.400042:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542656
00000100:00100000:1.0:1767318589.400044:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542144
00000100:00100000:3.0:1767318589.400045:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542656
00000100:00100000:1.0:1767318589.400069:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211
00000100:00100000:3.0:1767318589.400069:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734
00000100:00100000:3.0:1767318589.400077:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379542400:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318589.400078:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379542272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318589.400128:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379542272:12345-0@lo:400:kworker.0 Request processed in 52us (408us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318589.400128:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379542400:12345-0@lo:400:kworker.0 Request processed in 51us (203us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318589.400136:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211
00000100:00100000:3.0:1767318589.400136:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734
00000100:00100000:3.0:1767318589.400151:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735
00000100:00100000:1.0:1767318589.400152:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212
00000100:00100000:1.0:1767318589.400158:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379542144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318589.400158:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379542656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318589.400183:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379542656:12345-0@lo:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318589.400187:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379542144:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318589.400189:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735
00000100:00100000:1.0:1767318589.400193:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212
00000100:00080000:1.0:1767318589.400207:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318589.400212:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318589.400214:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318589.400220:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379542656:0@lo:400:kworker.0
00000100:00100000:3.0:1767318589.400229:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379542400:0@lo:400:kworker.0
00000100:00100000:1.0:1767318589.400239:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379541760:0@lo:250:kworker.0
00000400:00000100:1.0:1767318589.400261:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379541760 offset 0 length 520: 4
00000100:00100000:3.0:1767318589.400267:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379542144:0@lo:400:kworker.0
00000100:00100000:3.0:1767318589.400276:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379542272:0@lo:400:kworker.0
00000100:00100000:1.0:1767318589.400278:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379541888:0@lo:38:kworker.0
00000100:00100000:1.0:1767318589.400298:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318589.400317:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379542016:0@lo:38:kworker.0
00000100:00100000:3.0:1767318589.400327:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379541888
00000100:00100000:3.0:1767318589.400330:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379541888
00000100:00100000:1.0:1767318589.400351:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318589.400362:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16280
00000100:00100000:3.0:1767318589.400366:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379541888:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318589.400367:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379542528:0@lo:38:kworker.0
00010000:00020000:3.0:1767318589.400385:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318589.400386:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318589.400402:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379542784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318589.400413:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379541888:12345-0@lo:38:kworker.0 Request processed in 46us (115us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318589.400420:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318589.400427:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16280
00000100:00100000:3.0:1767318589.400437:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542528
00000100:00100000:3.0:1767318589.400440:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542528
00000100:00080000:1.0:1767318589.400441:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318589.400445:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318589.400448:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379541888:0@lo:38:kworker.0
00000100:00100000:3.0:1767318589.400451:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542784
00000100:00100000:3.0:1767318589.400453:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542784
00000100:00100000:3.0:1767318589.400462:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16281
00000100:00100000:1.0:1767318589.400466:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16282
00000100:00100000:3.0:1767318589.400466:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379542528:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318589.400470:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379542784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318589.400475:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767318589.400478:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318589.400555:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542016
00000100:00100000:0.0:1767318589.400560:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542016
00000100:00100000:0.0:1767318589.411360:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832
00000100:00100000:0.0:1767318589.411381:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379542016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318589.411408:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318589.411516:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379542016:12345-0@lo:38:kworker.0 Request processed in 138us (11162us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318589.411525:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832
00000100:00080000:0.0:1767318589.411673:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318589.411700:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318589.411705:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379542016:0@lo:38:kworker.0
00000100:00080000:0.0:1767318589.411721:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318589.411725:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318589.411728:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379542528:0@lo:38:kworker.0
00000100:00080000:0.0:1767318589.411739:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318589.411742:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318589.411745:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379542784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318589.416221:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379542528:12345-0@lo:38:kworker.0 Request processed in 34us (114us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318589.416240:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16281
00000100:00100000:2.0:1767318589.421760:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379542912:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318589.421916:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318589.424663:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379542912
00000100:00100000:3.0:1767318589.424682:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379542912
00000100:00100000:3.0:1767318589.424787:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954
00000100:00100000:3.0:1767318589.424799:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379542912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318589.424844:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318589.424978:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379542912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 181us (3063us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318589.424986:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954
00000100:00100000:1.0:1767318589.424989:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379542784:12345-0@lo:38:kworker.0 Request processed in 7641us (7692us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318589.425024:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16282
00000100:00100000:2.0:1767318589.425036:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379542912:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318589.911238:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318590.935271:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379543040:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318590.935359:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318590.935455:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543040
00000100:00100000:3.0:1767318590.935462:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543040
00000100:00100000:3.0:1767318590.935509:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955
00000100:00100000:3.0:1767318590.935518:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379543040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318590.935550:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318590.935613:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379543040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (253us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318590.935621:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955
00000100:00100000:3.0:1767318590.935675:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379543040:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318590.937273:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318591.960706:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318592.405612:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318592.405671:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318592.406561:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291869696
00000100:00100000:0.0:1767318592.406577:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291869696
00000100:00100000:0.0:1767318592.406687:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291869568
00000100:00100000:0.0:1767318592.406691:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291869568
00000100:00100000:0.0:1767318592.406719:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3736
00000100:00100000:0.0:1767318592.406734:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291869696:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318592.406792:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16283
00000100:00100000:2.0:1767318592.406799:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291869568:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318592.406826:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318592.406835:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291869696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (1237us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318592.406844:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3736
00000100:00100000:2.0:1767318592.406856:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291869568:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (1185us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318592.406862:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16283
00000100:00080000:1.0:1767318592.407521:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318592.984726:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318594.008473:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318594.521587:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318594.521599:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318594.521603:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318594.521618:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318594.521623:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318594.521632:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3491
00000100:00080000:2.0:1767318594.521637:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318594.521643:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318594.521685:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609500 x1853164379543168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318594.521712:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318594.521717:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318594.521719:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318594.521724:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3491
00000100:00080000:2.0:1767318594.521726:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318594.521731:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318594.521748:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164379543296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318594.521845:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379543424:0@lo:400:kworker.0
00000100:00100000:1.0:1767318594.521951:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318594.522143:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318594.522157:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379543680:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318594.522188:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318594.522242:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379543552:0@lo:400:kworker.0
00000100:00100000:3.0:1767318594.522267:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318594.522324:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543680
00000100:00100000:3.0:1767318594.522332:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543680
00000100:00100000:3.0:1767318594.522386:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956
00000100:00100000:3.0:1767318594.522397:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379543680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318594.522428:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318594.522473:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379543680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (283us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318594.522480:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956
00000100:00100000:3.0:1767318594.522527:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379543680:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318594.522556:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543424
00000100:00100000:3.0:1767318594.522559:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543424
00000100:00100000:3.0:1767318594.522579:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543552
00000100:00100000:3.0:1767318594.522581:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543552
00000100:00100000:3.0:1767318594.522598:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213
00000100:00100000:3.0:1767318594.522603:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379543424:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318594.522678:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379543168:0@lo:38:kworker.0
00000100:00100000:0.0:1767318594.522758:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318594.522780:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379543296:0@lo:38:kworker.0
00000100:00100000:0.0:1767318594.522801:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318594.522835:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543296
00000100:00100000:0.0:1767318594.522838:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543296
00000100:00100000:0.0:1767318594.522859:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833
00000100:00100000:0.0:1767318594.522864:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379543296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318594.522912:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318594.522946:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379543296:12345-0@lo:38:kworker.0 Request processed in 80us (142us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318594.522952:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833
00000100:00080000:0.0:1767318594.522983:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318594.522988:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318594.522991:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379543296:0@lo:38:kworker.0
00000100:00100000:0.0:1767318594.523024:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214
00000100:00100000:0.0:1767318594.523033:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379543552:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318594.523068:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379543552:12345-0@lo:400:kworker.0 Request processed in 37us (800us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318594.523073:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214
00000100:00080000:0.0:1767318594.523091:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318594.523095:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318594.523128:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543168
00000100:00100000:0.0:1767318594.523132:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543168
00000100:00100000:0.0:1767318594.523151:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16284
00000100:00100000:0.0:1767318594.523155:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379543168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318594.523165:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318594.523194:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379543168:12345-0@lo:38:kworker.0 Request processed in 37us (436us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318594.523201:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16284
00000100:00080000:0.0:1767318594.523227:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318594.523231:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318594.523234:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379543168:0@lo:38:kworker.0
00000100:00100000:0.0:1767318594.523274:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379543552:0@lo:400:kworker.0
00000100:00080000:2.0:1767318594.526167:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318594.526174:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318594.526178:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318594.526185:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3491
00000100:00080000:2.0:1767318594.526189:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318594.526195:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318594.526216:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573100 x1853164379543936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318594.526244:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318594.526248:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318594.526249:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318594.526253:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3491
00000100:00080000:2.0:1767318594.526255:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318594.526273:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318594.526472:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379543808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318594.526537:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318594.526591:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543808
00000100:00100000:0.0:1767318594.526599:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543808
00000100:00100000:0.0:1767318594.526662:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737
00000100:00100000:0.0:1767318594.526672:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379543808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318594.526720:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379543808:12345-0@lo:400:kworker.0 Request processed in 51us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318594.526728:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737
00000100:00080000:0.0:1767318594.526759:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318594.526795:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379543808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318594.526835:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379543936:0@lo:38:kworker.0
00000100:00100000:0.0:1767318594.526861:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318594.526905:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379543936
00000100:00100000:0.0:1767318594.526909:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379543936
00000100:00100000:0.0:1767318594.526927:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16285
00000100:00100000:0.0:1767318594.526932:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379543936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318594.526950:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318594.526983:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379543936:12345-0@lo:38:kworker.0 Request processed in 50us (121us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318594.526989:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16285
00000100:00080000:0.0:1767318594.527010:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318594.527015:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318594.527018:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379543936:0@lo:38:kworker.0
00000100:00100000:0.0:1767318594.527058:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318594.527068:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379544064:0@lo:400:kworker.0
00000100:00100000:0.0:1767318594.527093:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318594.527115:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544064
00000100:00100000:0.0:1767318594.527118:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544064
00000100:00100000:0.0:1767318594.527145:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738
00000100:00100000:0.0:1767318594.527152:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379544064:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318594.527183:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379544064:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318594.527190:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738
00000100:00080000:0.0:1767318594.527204:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318594.527219:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379544064:0@lo:400:kworker.0
00000100:00100000:2.0:1767318594.527739:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571f80 x1853164379544192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318594.527910:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379543424:12345-0@lo:400:kworker.0 Request processed in 5303us (5956us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318594.527933:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213
00000100:00100000:0.0:1767318594.532951:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379544192:0@lo:38:kworker.0
00000100:00100000:0.0:1767318594.533037:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318594.533269:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544192
00000100:00100000:2.0:1767318594.533277:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544192
00000100:00100000:2.0:1767318594.533335:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16286
00000100:00100000:2.0:1767318594.533343:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379544192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318594.533367:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318594.533426:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379544192:12345-0@lo:38:kworker.0 Request processed in 83us (389us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318594.533433:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16286
00000100:00080000:3.0:1767318594.533524:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318594.533530:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318594.533534:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379544192:0@lo:38:kworker.0
00000100:00100000:1.0:1767318594.534143:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379543424:0@lo:400:kworker.0
00010000:00010000:2.0:1767318595.031573:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318596.055972:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318596.056437:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318596.056462:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379544320:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318596.056542:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318596.057237:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544320
00000100:00100000:3.0:1767318596.057247:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544320
00000100:00100000:3.0:1767318596.057330:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957
00000100:00100000:3.0:1767318596.057340:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379544320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318596.057379:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318596.057447:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379544320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (904us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318596.057455:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957
00000100:00080000:0.0:1767318596.057510:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318596.057801:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379544320:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318597.081061:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318597.522205:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318597.522911:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318597.522950:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291869952
00000100:00100000:3.0:1767318597.522961:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291869952
00000100:00100000:3.0:1767318597.523047:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291869824
00000100:00100000:3.0:1767318597.523051:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291869824
00000100:00100000:3.0:1767318597.523069:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3739
00000100:00100000:3.0:1767318597.523080:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291869952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318597.523129:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16287
00000100:00100000:2.0:1767318597.523136:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291869824:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318597.523156:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318597.523156:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291869952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (962us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318597.523176:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3739
00000100:00100000:2.0:1767318597.523182:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291869824:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (274us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318597.523187:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16287
00000100:00080000:1.0:1767318597.523329:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318598.103429:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318599.127099:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318599.639016:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318599.639027:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318599.639030:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318599.639033:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318599.639037:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318599.639045:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318599.639051:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318599.639059:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318599.639113:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572a00 x1853164379544448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318599.639139:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318599.639143:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318599.639145:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318599.639149:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318599.639152:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318599.639156:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318599.639177:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571f80 x1853164379544576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318599.639244:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318599.639256:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318599.639257:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318599.639261:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318599.639264:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318599.639267:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318599.639277:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573800 x1853164379545088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318599.639292:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318599.639295:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318599.639297:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318599.639300:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3496
00000100:00080000:2.0:1767318599.639303:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318599.639306:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318599.639315:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd180 x1853164379545344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318599.639552:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379544832:0@lo:400:kworker.0
00000100:00100000:1.0:1767318599.639632:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318599.639715:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318599.639722:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379544704:0@lo:400:kworker.0
00000100:00100000:1.0:1767318599.639748:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318599.639822:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544832
00000100:00100000:2.0:1767318599.639830:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544832
00000100:00100000:2.0:1767318599.639909:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544704
00000100:00100000:2.0:1767318599.639913:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544704
00000100:00100000:2.0:1767318599.639933:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215
00000100:00100000:2.0:1767318599.639942:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379544832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318599.640007:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379544832:12345-0@lo:400:kworker.0 Request processed in 65us (374us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318599.640014:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215
00000100:00100000:2.0:1767318599.640030:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216
00000100:00100000:2.0:1767318599.640036:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379544704:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318599.640062:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379544704:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318599.640067:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216
00000100:00100000:0.0:1767318599.640827:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379545216:0@lo:400:kworker.0
00000100:00100000:0.0:1767318599.640921:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318599.640949:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318599.640955:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379544960:0@lo:400:kworker.0
00000100:00100000:0.0:1767318599.640977:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318599.641017:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545216
00000100:00100000:0.0:1767318599.641022:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545216
00000100:00100000:0.0:1767318599.641057:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544960
00000100:00100000:0.0:1767318599.641059:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544960
00000100:00100000:0.0:1767318599.641081:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740
00000100:00100000:0.0:1767318599.641087:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379545216:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318599.641151:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379545216:12345-0@lo:400:kworker.0 Request processed in 63us (229us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318599.641158:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740
00000100:00100000:0.0:1767318599.641174:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741
00000100:00100000:0.0:1767318599.641179:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379544960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318599.641205:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379544960:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318599.641211:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741
00000100:00100000:0.0:1767318599.641264:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379544960:0@lo:400:kworker.0
00000100:00100000:0.0:1767318599.641277:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379545216:0@lo:400:kworker.0
00000100:00100000:3.0:1767318599.641427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379544448:0@lo:38:kworker.0
00000100:00100000:3.0:1767318599.641456:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318599.641478:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379544576:0@lo:38:kworker.0
00000100:00100000:3.0:1767318599.641497:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318599.641530:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379545088:0@lo:38:kworker.0
00000100:00100000:3.0:1767318599.641553:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318599.641570:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379545344:0@lo:38:kworker.0
00000100:00100000:3.0:1767318599.641589:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318599.641617:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544448
00000100:00100000:3.0:1767318599.641621:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544448
00000100:00100000:3.0:1767318599.641641:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545088
00000100:00100000:3.0:1767318599.641644:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545088
00000100:00100000:3.0:1767318599.641651:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545344
00000100:00100000:3.0:1767318599.641653:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545344
00000100:00100000:3.0:1767318599.641661:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16288
00000100:00100000:3.0:1767318599.641666:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379544448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318599.641687:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318599.641719:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379544448:12345-0@lo:38:kworker.0 Request processed in 51us (262us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318599.641725:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16288
00000100:00100000:3.0:1767318599.641737:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16289
00000100:00100000:3.0:1767318599.641741:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379545088:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318599.641748:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318599.641766:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379545088:12345-0@lo:38:kworker.0 Request processed in 24us (212us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318599.641771:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16289
00000100:00100000:3.0:1767318599.641781:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16290
00000100:00100000:3.0:1767318599.641785:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379545344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318599.641794:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318599.641815:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379545344:12345-0@lo:38:kworker.0 Request processed in 29us (225us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318599.641827:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16290
00000100:00100000:3.0:1767318599.641848:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379544576
00000100:00100000:3.0:1767318599.641852:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379544576
00000100:00100000:3.0:1767318599.641893:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834
00000100:00100000:3.0:1767318599.641897:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379544576:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318599.641907:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318599.641932:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379544576:12345-0@lo:38:kworker.0 Request processed in 34us (435us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318599.641937:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834
00000100:00080000:3.0:1767318599.641972:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318599.641976:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318599.641979:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379544448:0@lo:38:kworker.0
00000100:00080000:3.0:1767318599.642002:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318599.642005:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318599.642007:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379544576:0@lo:38:kworker.0
00000100:00080000:3.0:1767318599.642013:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318599.642016:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318599.642018:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379545088:0@lo:38:kworker.0
00000100:00080000:3.0:1767318599.642025:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318599.642027:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318599.642029:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379545344:0@lo:38:kworker.0
00000100:00080000:1.0:1767318599.642395:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318599.642402:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318599.642405:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318599.642456:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379544704:0@lo:400:kworker.0
00000100:00100000:1.0:1767318599.642469:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379544832:0@lo:400:kworker.0
00000100:00100000:1.0:1767318599.643329:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318599.643359:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379545472:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318599.643409:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318599.643502:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545472
00000100:00100000:2.0:1767318599.643509:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545472
00000100:00100000:2.0:1767318599.643569:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958
00000100:00100000:2.0:1767318599.643577:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379545472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318599.643605:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318599.643651:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379545472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (241us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318599.643657:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958
00000100:00100000:1.0:1767318599.643732:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379545472:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318600.152628:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318601.175780:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318601.176340:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318601.176367:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379545600:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318601.176446:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318601.176529:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545600
00000100:00100000:2.0:1767318601.176538:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545600
00000100:00100000:2.0:1767318601.176615:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959
00000100:00100000:2.0:1767318601.176624:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379545600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318601.176655:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318601.176702:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379545600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (255us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318601.176709:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959
00000100:00100000:2.0:1767318601.176758:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379545600:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318601.177063:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318602.200906:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318602.640343:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318602.640385:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318602.640451:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291870080
00000100:00100000:0.0:1767318602.640461:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291870080
00000100:00100000:0.0:1767318602.640500:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291870208
00000100:00100000:0.0:1767318602.640502:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291870208
00000100:00100000:0.0:1767318602.640542:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3742
00000100:00100000:0.0:1767318602.640551:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291870208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318602.640559:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16291
00000100:00100000:1.0:1767318602.640570:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291870080:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318602.640594:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318602.640634:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291870208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (244us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318602.640635:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291870080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 64us (302us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318602.640651:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3742
00000100:00080000:3.0:1767318602.640735:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318602.644165:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16291
00010000:00010000:2.0:1767318603.224633:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318604.247259:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318604.759095:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318604.759107:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318604.759112:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318604.759119:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318604.759126:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318604.759138:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3502
00000100:00080000:2.0:1767318604.759143:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318604.759153:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318604.759229:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdf80 x1853164379545728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318604.759258:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318604.759261:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318604.759264:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318604.759268:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3502
00000100:00080000:2.0:1767318604.759270:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318604.759274:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318604.759288:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce680 x1853164379545856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318604.759298:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379545728:0@lo:38:kworker.0
00000100:00080000:2.0:1767318604.759383:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318604.759386:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318604.759387:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318604.759391:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3502
00000100:00080000:2.0:1767318604.759393:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318604.759397:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318604.759410:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcfb80 x1853164379546368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318604.759426:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318604.759429:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318604.759431:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318604.759435:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3502
00000100:00080000:2.0:1767318604.759437:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318604.759442:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318604.759452:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd500 x1853164379546624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318604.759467:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318604.759494:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379546240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318604.759618:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379545984:0@lo:400:kworker.0
00000100:00100000:2.0:1767318604.759667:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318604.759724:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318604.759730:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379546496:0@lo:400:kworker.0
00000100:00100000:2.0:1767318604.759753:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318604.759793:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545728
00000100:00100000:2.0:1767318604.759802:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545728
00000100:00100000:2.0:1767318604.759836:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379546240
00000100:00100000:2.0:1767318604.759839:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379546240
00000100:00100000:2.0:1767318604.759907:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379546496
00000100:00100000:2.0:1767318604.759911:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379546496
00000100:00100000:2.0:1767318604.759942:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743
00000100:00100000:2.0:1767318604.759953:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379546240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318604.760020:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379546240:12345-0@lo:400:kworker.0 Request processed in 68us (352us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318604.760027:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743
00000100:00100000:2.0:1767318604.760051:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744
00000100:00100000:2.0:1767318604.760058:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379546496:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318604.760086:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379546496:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318604.760091:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744
00000100:00100000:2.0:1767318604.760103:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16292
00000100:00100000:2.0:1767318604.760108:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379545728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318604.760131:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318604.760159:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379545728:12345-0@lo:38:kworker.0 Request processed in 49us (694us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318604.760165:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16292
00000100:00100000:2.0:1767318604.760218:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379546496:0@lo:400:kworker.0
00000100:00100000:2.0:1767318604.760231:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379546240:0@lo:400:kworker.0
00000100:00080000:2.0:1767318604.760275:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318604.760731:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379546112:0@lo:400:kworker.0
00000100:00100000:0.0:1767318604.760777:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318604.760972:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318604.760980:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379546752:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318604.761010:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318604.761076:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379546752
00000100:00100000:0.0:1767318604.761083:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379546752
00000100:00100000:0.0:1767318604.761136:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960
00000100:00100000:0.0:1767318604.761143:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379546752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318604.761173:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318604.761228:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379546752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (217us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318604.761235:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960
00000100:00080000:0.0:1767318604.761260:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318604.761287:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379546752:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318604.761699:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318604.761707:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318604.761710:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379545728:0@lo:38:kworker.0
00000100:00100000:3.0:1767318604.761734:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379545856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318604.761780:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318604.761818:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379546368:0@lo:38:kworker.0
00000100:00100000:3.0:1767318604.761845:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318604.761860:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545856
00000100:00100000:3.0:1767318604.761896:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379546624:0@lo:38:kworker.0
00000100:00100000:3.0:1767318604.761925:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318604.761934:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379546112
00000100:00100000:2.0:1767318604.761941:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379546112
00000100:00100000:3.0:1767318604.761977:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379546368
00000100:00100000:3.0:1767318604.761982:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379546368
00000100:00100000:2.0:1767318604.762006:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217
00000100:00100000:3.0:1767318604.762015:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379546624
00000100:00100000:2.0:1767318604.762016:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379546112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318604.762020:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379546624
00000100:00100000:3.0:1767318604.762042:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16293
00000100:00100000:3.0:1767318604.762047:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379546368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318604.762066:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318604.762089:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379546112:12345-0@lo:400:kworker.0 Request processed in 74us (1310us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318604.762097:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217
00000100:00100000:3.0:1767318604.762115:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379546368:12345-0@lo:38:kworker.0 Request processed in 65us (268us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318604.762124:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16293
00000100:00080000:2.0:1767318604.762130:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318604.762140:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16294
00000100:00100000:3.0:1767318604.762145:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379546624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318604.762155:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318604.762159:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379546112:0@lo:400:kworker.0
00000100:00100000:3.0:1767318604.762185:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379546624:12345-0@lo:38:kworker.0 Request processed in 37us (259us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318604.762192:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16294
00000100:00080000:2.0:1767318604.762235:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318604.762241:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318604.762245:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379546368:0@lo:38:kworker.0
00000100:00080000:2.0:1767318604.762257:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318604.762261:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318604.762264:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379546624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318604.770393:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318604.771125:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379545984
00000100:00100000:2.0:1767318604.771139:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545984
00000100:00100000:2.0:1767318604.771223:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218
00000100:00100000:2.0:1767318604.771235:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379545984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318604.771336:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379545984:12345-0@lo:400:kworker.0 Request processed in 104us (955us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318604.771354:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218
00000100:00100000:1.0:1767318604.771676:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379545984:0@lo:400:kworker.0
00000100:00100000:0.0:1767318604.778683:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379545856
00000100:00100000:0.0:1767318604.778797:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835
00000100:00100000:0.0:1767318604.778807:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379545856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318604.778843:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318604.778992:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379545856:12345-0@lo:38:kworker.0 Request processed in 185us (17221us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318604.778999:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835
00000100:00080000:2.0:1767318604.780594:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318604.780608:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318604.780614:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379545856:0@lo:38:kworker.0
00010000:00010000:1.0:1767318605.271163:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318606.295548:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318606.295574:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379546880:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318606.295650:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318606.295826:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379546880
00000100:00100000:2.0:1767318606.295838:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379546880
00010000:00010000:0.0:1767318606.295846:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318606.296129:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318606.297583:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961
00000100:00100000:2.0:1767318606.297605:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379546880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318606.297656:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318606.297776:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379546880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (2125us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318606.297784:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961
00000100:00100000:3.0:1767318606.301242:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379546880:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318607.321282:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318607.761853:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318607.762552:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291870336
00000100:00100000:0.0:1767318607.762569:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291870336
00000100:00100000:0.0:1767318607.762638:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16295
00000100:00100000:0.0:1767318607.762649:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291870336:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318607.762672:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318607.762757:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291870336:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 108us (928us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318607.762779:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16295
00000100:00100000:2.0:1767318607.767597:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318607.767708:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291870464
00000100:00100000:3.0:1767318607.767723:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291870464
00000100:00100000:3.0:1767318607.767995:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3745
00000100:00100000:3.0:1767318607.768012:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291870464:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318607.768127:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291870464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 119us (546us total) trans 0 rc 0/0
00000100:00080000:0.0:1767318607.768499:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318607.772520:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3745
00010000:00010000:2.0:1767318608.344100:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318609.369135:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318609.879856:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318609.879910:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379547008:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318609.880022:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318609.880110:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547008
00000100:00100000:2.0:1767318609.880129:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547008
00000100:00100000:2.0:1767318609.880231:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962
00000100:00100000:2.0:1767318609.880241:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379547008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318609.880276:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318609.880377:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379547008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (356us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318609.880385:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962
00000100:00080000:0.0:1767318609.880414:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318609.880463:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379547008:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318609.880925:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318609.880932:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318609.880935:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318609.880940:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318609.880945:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318609.880952:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3507
00000100:00080000:1.0:1767318609.880957:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318609.880963:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318609.881024:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7b480 x1853164379547136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318609.881108:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379547136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318609.881179:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318609.881328:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547136
00000100:00100000:0.0:1767318609.881345:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547136
00000100:00100000:0.0:1767318609.881387:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16296
00000100:00100000:0.0:1767318609.881393:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379547136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318609.881413:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318609.881464:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379547136:12345-0@lo:38:kworker.0 Request processed in 70us (285us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318609.881472:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16296
00000100:00080000:3.0:1767318609.881687:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318609.881693:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318609.881697:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379547136:0@lo:38:kworker.0
00000100:00080000:1.0:1767318609.881948:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318609.881955:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318609.881959:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318609.881965:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3507
00000100:00080000:1.0:1767318609.882048:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318609.882308:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318609.882344:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7aa00 x1853164379547264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318609.882443:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318609.882447:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318609.882449:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318609.882453:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3507
00000100:00080000:1.0:1767318609.882456:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318609.882460:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318609.882471:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78380 x1853164379547648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318609.882489:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318609.882493:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318609.882495:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318609.882498:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3507
00000100:00080000:1.0:1767318609.882501:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318609.882505:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318609.882540:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7ad80 x1853164379547904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318609.882582:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379547520:0@lo:400:kworker.0
00000100:00100000:1.0:1767318609.882648:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318609.882697:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318609.882702:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379547776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318609.882725:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318609.882763:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547520
00000100:00100000:1.0:1767318609.882771:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547520
00000100:00100000:1.0:1767318609.882850:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547776
00000100:00100000:1.0:1767318609.882853:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547776
00000100:00100000:1.0:1767318609.882908:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746
00000100:00100000:1.0:1767318609.882917:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379547520:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318609.882991:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379547520:12345-0@lo:400:kworker.0 Request processed in 75us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318609.883000:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746
00000100:00100000:1.0:1767318609.883024:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747
00000100:00100000:1.0:1767318609.883030:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379547776:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318609.883069:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379547776:12345-0@lo:400:kworker.0 Request processed in 38us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318609.883075:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747
00000100:00080000:1.0:1767318609.883102:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318609.883144:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379547776:0@lo:400:kworker.0
00000100:00100000:1.0:1767318609.883164:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379547520:0@lo:400:kworker.0
00000100:00100000:2.0:1767318609.883590:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379547392:0@lo:400:kworker.0
00000100:00100000:2.0:1767318609.883685:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318609.883836:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379547264:0@lo:38:kworker.0
00000100:00100000:3.0:1767318609.883914:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318609.883950:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379547648:0@lo:38:kworker.0
00000100:00100000:3.0:1767318609.883977:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318609.884000:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379547904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318609.884247:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547264
00000100:00100000:2.0:1767318609.884256:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547264
00000100:00100000:2.0:1767318609.884294:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836
00000100:00100000:2.0:1767318609.884301:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379547264:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318609.884322:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318609.884373:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379547264:12345-0@lo:38:kworker.0 Request processed in 71us (458us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318609.884381:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836
00000100:00100000:2.0:1767318609.884421:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547648
00000100:00100000:2.0:1767318609.884425:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547648
00000100:00100000:2.0:1767318609.884446:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16297
00000100:00100000:2.0:1767318609.884450:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379547648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318609.884460:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318609.884485:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379547648:12345-0@lo:38:kworker.0 Request processed in 34us (508us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318609.884492:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16297
00000100:00100000:3.0:1767318609.884643:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318609.884693:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318609.884699:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318609.884702:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379547264:0@lo:38:kworker.0
00000100:00080000:3.0:1767318609.884711:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318609.884714:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318609.884717:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379547648:0@lo:38:kworker.0
00000100:00100000:2.0:1767318609.885076:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547904
00000100:00100000:2.0:1767318609.885081:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547904
00000100:00100000:2.0:1767318609.885110:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16298
00000100:00100000:2.0:1767318609.885115:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379547904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318609.885126:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318609.885179:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379547904:12345-0@lo:38:kworker.0 Request processed in 63us (536us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318609.885185:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16298
00000100:00080000:3.0:1767318609.885488:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318609.885492:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318609.885496:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379547904:0@lo:38:kworker.0
00000100:00100000:1.0:1767318609.886945:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379547392
00000100:00100000:1.0:1767318609.887334:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379547392
00000100:00100000:1.0:1767318609.887518:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219
00000100:00100000:1.0:1767318609.887542:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379547392:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318609.887693:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379547392:12345-0@lo:400:kworker.0 Request processed in 144us (3998us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318609.887702:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219
00000100:00100000:2.0:1767318609.889561:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379547392:0@lo:400:kworker.0
00000100:00080000:0.0:1767318609.892461:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318610.392139:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318611.415403:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379548032:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318611.415486:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318611.415739:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379548032
00000100:00100000:2.0:1767318611.415754:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379548032
00000100:00100000:2.0:1767318611.415833:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963
00000100:00100000:2.0:1767318611.415845:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379548032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318611.415922:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318611.416004:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379548032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (517us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318611.416012:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963
00010000:00010000:2.0:1767318611.416049:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318611.416104:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379548032:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318611.418915:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318611.857490:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767318611.857551:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291870592 offset 0 length 520: 4
00000100:00100000:2.0:1767318611.857583:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318611.857705:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291870848
00000100:00100000:3.0:1767318611.857719:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291870848
00000100:00100000:3.0:1767318611.857821:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291870720
00000100:00100000:3.0:1767318611.857824:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291870720
00000100:00100000:3.0:1767318611.857847:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3748
00000100:00100000:3.0:1767318611.857858:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291870848:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318611.857999:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291870848:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 142us (529us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318611.858007:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3748
00000100:00100000:3.0:1767318611.858027:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16299
00000100:00100000:3.0:1767318611.858032:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291870720:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318611.858058:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318611.858082:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291870720:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (499us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318611.858111:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16299
00000100:00080000:0.0:1767318611.858276:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318612.442405:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318613.463103:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318614.489704:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318614.999057:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318589/real 1767318589]  req@ffff8b0e0729f800 x1853164379541760/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318614 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318614.999116:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0729f800 x1853164379541760/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318614 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318614.999143:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318614.999154:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318614.999159:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379541760:0@lo:250:kworker.0
00000100:00080000:2.0:1767318614.999305:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318614.999313:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318614.999317:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318614.999322:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3491
00000100:00080000:2.0:1767318614.999327:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318614.999335:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318614.999383:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcce00 x1853164379548160/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318614.999419:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318614.999424:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318614.999426:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318614.999430:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3512
00000100:00080000:2.0:1767318614.999432:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318614.999436:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318614.999457:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164379548288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318614.999467:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318614.999470:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318614.999472:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318614.999476:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3512
00000100:00080000:2.0:1767318614.999479:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318614.999483:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318614.999497:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164379548416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318614.999567:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318614.999570:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318614.999572:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318614.999576:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3512
00000100:00080000:2.0:1767318614.999578:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318614.999583:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318614.999596:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd180 x1853164379548928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318614.999613:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318614.999617:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318614.999620:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318614.999625:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3512
00000100:00080000:2.0:1767318614.999628:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318614.999633:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318614.999648:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379548544:0@lo:400:kworker.0
00000100:00100000:2.0:1767318614.999648:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5df80 x1853164379549184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318614.999693:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379549056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318614.999751:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318614.999751:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318614.999759:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379548672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318614.999858:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379548544
00000100:00100000:3.0:1767318614.999891:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379548544
00000100:00100000:3.0:1767318614.999965:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220
00000100:00100000:3.0:1767318614.999977:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379548544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318615.013802:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318615.013833:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379549312:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318615.013937:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318615.013998:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549056
00000100:00100000:2.0:1767318615.014008:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549056
00000100:00100000:2.0:1767318615.015188:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749
00000100:00100000:2.0:1767318615.015208:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379549056:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318615.015309:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379549056:12345-0@lo:400:kworker.0 Request processed in 110us (15565us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318615.015317:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749
00000100:00100000:2.0:1767318615.015356:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549312
00000100:00100000:2.0:1767318615.015363:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549312
00000100:00100000:2.0:1767318615.015397:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964
00000100:00100000:2.0:1767318615.015405:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7017:x1853164379549312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318615.015434:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318615.015472:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7017:x1853164379549312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (1535us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318615.015478:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964
00000100:00100000:2.0:1767318615.015544:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379549312:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318615.015560:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379549056:0@lo:400:kworker.0
00000100:00100000:2.0:1767318615.015761:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379548160:0@lo:250:kworker.0
00000400:00000100:2.0:1767318615.015798:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379548160 offset 0 length 520: 4
00000100:00100000:2.0:1767318615.015827:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379548288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318615.015854:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318615.015901:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379548416:0@lo:38:kworker.0
00000100:00100000:2.0:1767318615.015932:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318615.015953:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379548928:0@lo:38:kworker.0
00000100:00100000:2.0:1767318615.015974:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318615.015994:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379549184:0@lo:38:kworker.0
00000100:00100000:2.0:1767318615.016015:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318615.016054:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379548288
00000100:00100000:2.0:1767318615.016058:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379548288
00000100:00100000:2.0:1767318615.016078:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379548928
00000100:00100000:2.0:1767318615.016081:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379548928
00000100:00100000:2.0:1767318615.016092:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549184
00000100:00100000:2.0:1767318615.016095:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549184
00000100:00100000:2.0:1767318615.016118:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16300
00000100:00100000:2.0:1767318615.016124:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379548288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318615.016145:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318615.016180:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379548288:12345-0@lo:38:kworker.0 Request processed in 55us (326us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318615.016187:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16300
00000100:00100000:2.0:1767318615.016200:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16301
00000100:00100000:2.0:1767318615.016205:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379548928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318615.016215:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318615.016237:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379548928:12345-0@lo:38:kworker.0 Request processed in 31us (262us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318615.016243:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16301
00000100:00100000:2.0:1767318615.016254:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16302
00000100:00100000:2.0:1767318615.016258:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379549184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318615.016267:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318615.016288:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379549184:12345-0@lo:38:kworker.0 Request processed in 29us (273us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318615.016294:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16302
00000100:00080000:2.0:1767318615.016329:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318615.016335:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318615.016339:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379548288:0@lo:38:kworker.0
00000100:00080000:2.0:1767318615.016348:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318615.016351:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318615.016353:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379548928:0@lo:38:kworker.0
00000100:00080000:2.0:1767318615.016360:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318615.016364:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318615.016367:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379549184:0@lo:38:kworker.0
00000100:00080000:2.0:1767318615.016405:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318615.016412:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318615.016453:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379548800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318615.016481:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318615.016510:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379548800
00000100:00100000:2.0:1767318615.016514:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379548800
00000100:00100000:2.0:1767318615.016549:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750
00000100:00100000:2.0:1767318615.016556:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379548800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318615.016596:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379548800:12345-0@lo:400:kworker.0 Request processed in 39us (114us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318615.016602:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750
00000100:00080000:2.0:1767318615.016616:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318615.016634:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379548800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318615.016679:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379548416
00000100:00100000:2.0:1767318615.016684:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379548416
00000100:00100000:2.0:1767318615.016706:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837
00000100:00100000:2.0:1767318615.016710:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f080bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379548416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318615.016721:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318615.016751:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f080bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379548416:12345-0@lo:38:kworker.0 Request processed in 40us (819us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318615.016757:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837
00000100:00080000:2.0:1767318615.017035:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318615.017040:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318615.017043:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379548416:0@lo:38:kworker.0
00000100:00100000:0.0:1767318615.018234:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318615.020721:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379548544:12345-0@lo:400:kworker.0 Request processed in 20729us (20960us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318615.020743:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220
00000100:00100000:3.0:1767318615.020789:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379548672
00000100:00100000:3.0:1767318615.020800:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379548672
00000100:00100000:3.0:1767318615.020904:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221
00000100:00100000:3.0:1767318615.020916:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379548672:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318615.020985:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379548672:12345-0@lo:400:kworker.0 Request processed in 73us (2758us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318615.020992:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221
00000100:00100000:1.0:1767318615.021279:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379548544:0@lo:400:kworker.0
00000100:00080000:0.0:1767318615.021582:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318615.021623:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379548672:0@lo:400:kworker.0
00010000:00010000:2.0:1767318615.514628:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318616.536799:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318616.539771:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318616.539818:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379549440:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318616.540141:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318616.540298:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549440
00000100:00100000:3.0:1767318616.540310:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549440
00000100:00100000:3.0:1767318616.540383:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965
00000100:00100000:3.0:1767318616.540394:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379549440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318616.540439:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318616.540506:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379549440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (365us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318616.540516:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965
00000100:00100000:2.0:1767318616.540791:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379549440:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318616.980128:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318616.980298:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318616.980968:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291871104
00000100:00100000:1.0:1767318616.980984:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291871104
00000100:00100000:1.0:1767318616.981211:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291870976
00000100:00100000:1.0:1767318616.981216:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291870976
00000100:00100000:1.0:1767318616.981244:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3751
00000100:00100000:1.0:1767318616.981257:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291871104:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318616.981392:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16303
00000100:00100000:2.0:1767318616.981399:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291870976:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318616.981427:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318616.981513:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291870976:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 112us (1213us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318616.981521:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16303
00000100:00100000:1.0:1767318616.982003:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291871104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 748us (1891us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318616.982012:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3751
00000100:00080000:0.0:1767318616.982522:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318617.559247:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318618.583476:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318619.607341:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318620.119392:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318620.119403:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318620.119406:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318620.119411:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318620.119416:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318620.119425:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3517
00000100:00080000:1.0:1767318620.119451:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318620.119471:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318620.119532:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78000 x1853164379549568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318620.119563:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318620.119567:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318620.119569:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318620.119573:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3517
00000100:00080000:1.0:1767318620.119575:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318620.119580:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318620.119593:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79500 x1853164379549824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318620.119613:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379549696:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318620.119649:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318620.119652:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318620.119655:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318620.119658:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3517
00000100:00080000:1.0:1767318620.119661:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318620.119664:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318620.119678:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b480 x1853164379550336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318620.119692:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318620.119695:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318620.119697:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318620.119700:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3517
00000100:00080000:1.0:1767318620.119709:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318620.119713:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318620.119724:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448380 x1853164379550592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318620.119725:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318620.119808:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379550464:0@lo:400:kworker.0
00000100:00100000:3.0:1767318620.119838:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318620.119858:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318620.119863:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379550208:0@lo:400:kworker.0
00000100:00100000:3.0:1767318620.119906:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318620.119932:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379549568:0@lo:38:kworker.0
00000100:00100000:3.0:1767318620.119938:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549696
00000100:00100000:3.0:1767318620.119947:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549696
00000100:00100000:1.0:1767318620.119961:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318620.119982:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379549824:0@lo:38:kworker.0
00000100:00100000:1.0:1767318620.120003:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318620.120025:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379550336:0@lo:38:kworker.0
00000100:00100000:1.0:1767318620.120043:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318620.120073:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379550592:0@lo:38:kworker.0
00000100:00100000:1.0:1767318620.120094:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318620.120120:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966
00000100:00100000:1.0:1767318620.120122:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379549952:0@lo:400:kworker.0
00000100:00100000:3.0:1767318620.120131:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379549696:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318620.120145:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318620.120165:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318620.120170:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379550080:0@lo:400:kworker.0
00000100:00100000:1.0:1767318620.120192:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318620.120218:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550464
00000100:00100000:1.0:1767318620.120221:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550464
00000100:00100000:1.0:1767318620.120256:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550208
00000100:00100000:1.0:1767318620.120259:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550208
00000100:00100000:1.0:1767318620.120275:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549568
00000100:00100000:1.0:1767318620.120278:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549568
00000100:00100000:1.0:1767318620.120288:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550336
00000100:00100000:1.0:1767318620.120291:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550336
00000100:00100000:1.0:1767318620.120297:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550592
00000100:00100000:1.0:1767318620.120300:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550592
00002000:00000024:3.0:1767318620.120300:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318620.120320:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752
00000100:00100000:1.0:1767318620.120325:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379550464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318620.120353:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379549696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 223us (628us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318620.120355:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379550464:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318620.120362:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752
00000100:00100000:3.0:1767318620.120362:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966
00000100:00100000:1.0:1767318620.120385:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753
00000100:00100000:1.0:1767318620.120392:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379550208:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318620.120421:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379550208:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318620.120426:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753
00000100:00100000:1.0:1767318620.120438:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16304
00000100:00100000:1.0:1767318620.120442:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379549568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318620.120463:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318620.120498:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379549568:12345-0@lo:38:kworker.0 Request processed in 53us (534us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318620.120504:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16304
00000100:00100000:1.0:1767318620.120516:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16305
00000100:00100000:1.0:1767318620.120520:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379550336:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318620.120529:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318620.120553:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379550336:12345-0@lo:38:kworker.0 Request processed in 32us (509us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318620.120559:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16305
00000100:00100000:1.0:1767318620.120570:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16306
00000100:00100000:1.0:1767318620.120574:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379550592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318620.120583:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318620.120614:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379550592:12345-0@lo:38:kworker.0 Request processed in 38us (518us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318620.120619:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16306
00000100:00100000:1.0:1767318620.120640:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549824
00000100:00100000:1.0:1767318620.120644:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549824
00000100:00100000:1.0:1767318620.120667:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838
00000100:00100000:1.0:1767318620.120672:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379549824:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318620.120681:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318620.120708:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379549824:12345-0@lo:38:kworker.0 Request processed in 35us (703us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318620.120714:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838
00000100:00100000:1.0:1767318620.120743:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379549952
00000100:00100000:1.0:1767318620.120747:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379549952
00000100:00080000:3.0:1767318620.120766:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318620.120769:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550080
00000100:00100000:1.0:1767318620.120771:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550080
00000100:00080000:3.0:1767318620.120771:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318620.120788:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222
00000100:00100000:1.0:1767318620.120795:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223
00000100:00100000:3.0:1767318620.120796:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379549952:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318620.120800:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379550080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318620.120967:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379550208:0@lo:400:kworker.0
00000100:00100000:2.0:1767318620.120981:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379550464:0@lo:400:kworker.0
00000100:00100000:2.0:1767318620.120997:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379549696:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318620.121136:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318620.121212:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318620.121218:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318620.121220:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379549568:0@lo:38:kworker.0
00000100:00080000:2.0:1767318620.121230:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318620.121233:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318620.121235:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379549824:0@lo:38:kworker.0
00000100:00080000:2.0:1767318620.121243:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318620.121246:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318620.121248:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379550336:0@lo:38:kworker.0
00000100:00080000:2.0:1767318620.121256:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318620.121260:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318620.121262:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379550592:0@lo:38:kworker.0
00000100:00100000:1.0:1767318620.121970:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379550080:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318620.121986:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223
00000100:00100000:3.0:1767318620.124176:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379549952:12345-0@lo:400:kworker.0 Request processed in 3367us (4014us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318620.124194:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222
00000100:00100000:2.0:1767318620.125848:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379550080:0@lo:400:kworker.0
00000100:00100000:2.0:1767318620.125910:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379549952:0@lo:400:kworker.0
00010000:00010000:2.0:1767318620.631206:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318621.655384:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379550720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318621.655501:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318621.655660:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550720
00000100:00100000:3.0:1767318621.655672:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550720
00000100:00100000:3.0:1767318621.655740:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967
00000100:00100000:3.0:1767318621.655752:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379550720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318621.655793:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318621.655907:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379550720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (405us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318621.655916:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967
00010000:00010000:3.0:1767318621.656223:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318621.656394:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379550720:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318622.095738:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318622.095867:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318622.096193:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291871360
00000100:00100000:1.0:1767318622.096207:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291871360
00000100:00100000:1.0:1767318622.096305:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291871232
00000100:00100000:1.0:1767318622.096309:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291871232
00000100:00100000:1.0:1767318622.096336:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3754
00000100:00100000:1.0:1767318622.096350:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291871360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318622.096454:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291871360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (833us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318622.096486:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3754
00000100:00080000:3.0:1767318622.096808:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318622.096849:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16307
00000100:00100000:3.0:1767318622.096856:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291871232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318622.096905:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318622.096938:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291871232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 82us (1071us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318622.096945:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16307
00010000:00010000:3.0:1767318622.679421:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318623.703247:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318624.727619:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318625.239190:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318625.239215:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379550848:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318625.239311:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318625.239522:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318625.239604:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318625.239608:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318625.239613:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318625.239618:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318625.239625:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3522
00000100:00080000:3.0:1767318625.239630:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318625.239638:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318625.239667:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379550976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318625.239715:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318625.239719:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318625.239721:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318625.239726:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3522
00000100:00080000:3.0:1767318625.239729:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318625.239733:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318625.239750:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04000 x1853164379551104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318625.239797:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318625.239800:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318625.239802:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318625.239806:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3522
00000100:00080000:3.0:1767318625.239809:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318625.239813:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318625.239829:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04380 x1853164379551616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318625.239846:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318625.239849:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318625.239850:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318625.239854:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3522
00000100:00080000:3.0:1767318625.239856:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318625.239860:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318625.239897:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05180 x1853164379551872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318625.239940:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379551360:0@lo:400:kworker.0
00000100:00100000:3.0:1767318625.240000:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318625.240091:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318625.240097:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379551232:0@lo:400:kworker.0
00000100:00100000:3.0:1767318625.240121:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318625.240158:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379551360
00000100:00100000:3.0:1767318625.240167:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379551360
00000100:00100000:3.0:1767318625.240234:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379551232
00000100:00100000:3.0:1767318625.240238:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379551232
00000100:00100000:3.0:1767318625.240265:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224
00000100:00100000:3.0:1767318625.240276:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379551360:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318625.240337:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379551360:12345-0@lo:400:kworker.0 Request processed in 62us (336us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318625.240347:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224
00000100:00100000:3.0:1767318625.240365:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225
00000100:00100000:3.0:1767318625.240371:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379551232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318625.240399:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379551232:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318625.240406:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225
00000100:00080000:3.0:1767318625.240426:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318625.240431:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318625.240471:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379551232:0@lo:400:kworker.0
00000100:00100000:3.0:1767318625.240483:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379551360:0@lo:400:kworker.0
00000100:00100000:3.0:1767318625.240531:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379550976:0@lo:38:kworker.0
00000100:00100000:3.0:1767318625.240562:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318625.240593:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379551104:0@lo:38:kworker.0
00000100:00100000:3.0:1767318625.240615:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318625.240639:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379551616:0@lo:38:kworker.0
00000100:00100000:3.0:1767318625.240660:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318625.240676:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379551872:0@lo:38:kworker.0
00000100:00100000:3.0:1767318625.240803:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318625.240839:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550976
00000100:00100000:3.0:1767318625.240843:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550976
00000100:00100000:3.0:1767318625.240863:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379551616
00000100:00100000:3.0:1767318625.240898:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379551616
00000100:00100000:3.0:1767318625.240913:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379551872
00000100:00100000:3.0:1767318625.240917:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379551872
00000100:00100000:3.0:1767318625.240932:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16308
00000100:00100000:3.0:1767318625.240938:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379550976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318625.240963:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318625.241002:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379550976:12345-0@lo:38:kworker.0 Request processed in 63us (439us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318625.241009:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16308
00000100:00100000:3.0:1767318625.241033:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16309
00000100:00100000:3.0:1767318625.241038:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379551616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318625.241047:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318625.241074:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379551616:12345-0@lo:38:kworker.0 Request processed in 35us (413us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318625.241080:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16309
00000100:00100000:3.0:1767318625.241091:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16310
00000100:00100000:3.0:1767318625.241095:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379551872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318625.241115:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318625.241138:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379551872:12345-0@lo:38:kworker.0 Request processed in 42us (443us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318625.241144:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16310
00000100:00080000:3.0:1767318625.241175:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318625.241181:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318625.241184:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379550976:0@lo:38:kworker.0
00000100:00080000:3.0:1767318625.241192:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318625.241195:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318625.241198:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379551616:0@lo:38:kworker.0
00000100:00080000:3.0:1767318625.241204:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318625.241208:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318625.241211:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379551872:0@lo:38:kworker.0
00000100:00100000:3.0:1767318625.241258:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379551104
00000100:00100000:3.0:1767318625.241261:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379551104
00000100:00100000:3.0:1767318625.241282:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839
00000100:00100000:3.0:1767318625.241286:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379551104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318625.241297:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318625.241328:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379551104:12345-0@lo:38:kworker.0 Request processed in 40us (711us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318625.241335:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839
00000100:00080000:3.0:1767318625.241355:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318625.241359:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318625.241363:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379551104:0@lo:38:kworker.0
00000100:00100000:2.0:1767318625.241510:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379551488:0@lo:400:kworker.0
00000100:00100000:2.0:1767318625.241540:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318625.241564:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318625.241570:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379551744:0@lo:400:kworker.0
00000100:00100000:2.0:1767318625.241592:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318625.241617:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379551488
00000100:00100000:2.0:1767318625.241621:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379551488
00000100:00100000:2.0:1767318625.241655:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379551744
00000100:00100000:2.0:1767318625.241658:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379551744
00000100:00100000:2.0:1767318625.241675:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755
00000100:00100000:2.0:1767318625.241681:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379551488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318625.241720:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379551488:12345-0@lo:400:kworker.0 Request processed in 39us (179us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318625.241729:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755
00000100:00100000:2.0:1767318625.241744:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756
00000100:00100000:2.0:1767318625.241750:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379551744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318625.241775:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379551744:12345-0@lo:400:kworker.0 Request processed in 25us (181us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318625.241780:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756
00000100:00080000:2.0:1767318625.241795:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318625.241815:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379551744:0@lo:400:kworker.0
00000100:00100000:2.0:1767318625.241832:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379551488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318625.242151:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379550848
00000100:00100000:0.0:1767318625.242157:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379550848
00000100:00100000:0.0:1767318625.242234:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968
00000100:00100000:0.0:1767318625.242244:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379550848:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318625.242271:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318625.242327:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379550848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (3016us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318625.242334:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968
00000100:00100000:2.0:1767318625.242399:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379550848:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318625.751232:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318626.775282:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379552000:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318626.775284:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318626.775407:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318626.775892:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552000
00000100:00100000:0.0:1767318626.775906:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552000
00000100:00100000:0.0:1767318626.775991:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969
00000100:00100000:0.0:1767318626.776013:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379552000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318626.776056:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318626.778910:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379552000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2894us (3489us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318626.778930:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969
00000100:00100000:1.0:1767318626.789619:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379552000:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318627.230169:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318627.234221:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291871616
00000100:00100000:0.0:1767318627.234242:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291871616
00000100:00100000:0.0:1767318627.234788:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3757
00000100:00100000:0.0:1767318627.234803:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291871616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318627.234956:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291871616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 156us (4802us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318627.234965:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3757
00000100:00080000:2.0:1767318627.236312:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318627.240123:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318627.240738:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291871488
00000100:00100000:1.0:1767318627.240754:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291871488
00000100:00100000:1.0:1767318627.240826:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16311
00000100:00100000:1.0:1767318627.240837:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291871488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318627.241140:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318627.243056:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291871488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2202us (2938us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318627.243075:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16311
00010000:00010000:3.0:1767318627.799959:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318628.824206:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318629.847215:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318630.359407:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318630.359421:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318630.359424:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318630.359436:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318630.359441:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318630.359451:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3527
00000100:00080000:2.0:1767318630.359458:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318630.359468:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318630.359527:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5c000 x1853164379552128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318630.359703:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379552256:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318630.359804:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318630.360014:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552256
00000100:00100000:3.0:1767318630.360025:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552256
00000100:00100000:1.0:1767318630.360071:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379552128:0@lo:38:kworker.0
00000100:00100000:3.0:1767318630.360111:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970
00000100:00100000:1.0:1767318630.360114:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318630.360126:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379552256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318630.360165:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767318630.360166:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318630.360172:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318630.360175:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318630.360180:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3527
00000100:00080000:2.0:1767318630.360183:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318630.360188:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318630.360210:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5ed80 x1853164379552384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318630.360235:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379552256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (429us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318630.360244:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970
00000100:00080000:3.0:1767318630.360301:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318630.360321:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552128
00000100:00100000:3.0:1767318630.360324:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552128
00000100:00100000:3.0:1767318630.360346:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16312
00000100:00100000:3.0:1767318630.360351:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379552128:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318630.360381:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318630.360943:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379552384:0@lo:38:kworker.0
00000100:00100000:0.0:1767318630.360985:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379552256:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318630.360997:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318630.361043:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552384
00000100:00100000:0.0:1767318630.361049:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552384
00000100:00100000:0.0:1767318630.361080:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840
00000100:00100000:0.0:1767318630.361085:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379552384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318630.361098:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318630.361105:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318630.361108:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318630.361111:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318630.361115:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3527
00000100:00080000:2.0:1767318630.361119:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318630.361124:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318630.361132:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379552384:12345-0@lo:38:kworker.0 Request processed in 47us (135us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318630.361138:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840
00000100:00100000:2.0:1767318630.361140:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7ad80 x1853164379552768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318630.361164:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767318630.361167:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379552640:0@lo:400:kworker.0
00000100:00080000:2.0:1767318630.361168:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318630.361169:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318630.361173:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3527
00000100:00080000:2.0:1767318630.361176:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318630.361179:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318630.361190:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79500 x1853164379553024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318630.361217:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379552512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318630.361251:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318630.361296:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318630.361310:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379552896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318630.361335:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318630.361360:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552896
00000100:00100000:2.0:1767318630.361364:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552896
00000100:00100000:2.0:1767318630.361506:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758
00000100:00100000:2.0:1767318630.361515:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379552896:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318630.361562:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379552896:12345-0@lo:400:kworker.0 Request processed in 49us (226us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318630.361568:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758
00000100:00080000:2.0:1767318630.361587:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318630.361607:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379552896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318630.361665:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552512
00000100:00100000:2.0:1767318630.361668:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552512
00000100:00100000:2.0:1767318630.361704:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226
00000100:00100000:2.0:1767318630.361709:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379552512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318630.361744:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379552512:12345-0@lo:400:kworker.0 Request processed in 35us (492us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318630.361751:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226
00000100:00080000:2.0:1767318630.361769:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318630.361784:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379552512:0@lo:400:kworker.0
00000100:00100000:0.0:1767318630.362157:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318630.362214:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552640
00000100:00100000:2.0:1767318630.362219:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552640
00000100:00100000:2.0:1767318630.362251:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759
00000100:00100000:2.0:1767318630.362257:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379552640:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318630.362299:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379552640:12345-0@lo:400:kworker.0 Request processed in 41us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318630.362370:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759
00000100:00080000:2.0:1767318630.362389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318630.362499:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379552640:0@lo:400:kworker.0
00000100:00100000:3.0:1767318630.364471:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379552128:12345-0@lo:38:kworker.0 Request processed in 4108us (4347us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318630.364489:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16312
00000100:00080000:1.0:1767318630.364683:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318630.364691:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318630.364695:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379552128:0@lo:38:kworker.0
00000100:00100000:1.0:1767318630.364735:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379552768:0@lo:38:kworker.0
00000100:00100000:1.0:1767318630.364830:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318630.366216:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379553024:0@lo:38:kworker.0
00000100:00100000:1.0:1767318630.366281:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318630.369324:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318630.369343:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318630.369350:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379552384:0@lo:38:kworker.0
00000100:00100000:3.0:1767318630.369434:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379552768
00000100:00100000:3.0:1767318630.369444:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379552768
00000100:00100000:2.0:1767318630.369479:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553024
00000100:00100000:2.0:1767318630.369486:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553024
00000100:00100000:3.0:1767318630.369554:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16313
00000100:00100000:3.0:1767318630.369564:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379552768:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318630.369566:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16314
00000100:00100000:2.0:1767318630.369577:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379553024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318630.369598:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767318630.369601:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318630.369699:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379553024:12345-0@lo:38:kworker.0 Request processed in 121us (3417us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318630.369707:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16314
00000100:00080000:0.0:1767318630.369834:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318630.369841:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318630.369845:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379553024:0@lo:38:kworker.0
00000100:00100000:3.0:1767318630.369932:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379552768:12345-0@lo:38:kworker.0 Request processed in 368us (5101us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318630.369933:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318630.369937:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318630.369940:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379552768:0@lo:38:kworker.0
00000100:00100000:3.0:1767318630.369961:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16313
00010000:00010000:2.0:1767318630.873016:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318631.895608:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318631.895744:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318631.895764:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379553152:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318631.895898:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318631.896155:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553152
00000100:00100000:3.0:1767318631.896167:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553152
00000100:00100000:3.0:1767318631.896239:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971
00000100:00100000:3.0:1767318631.896264:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379553152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318631.896310:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318631.896380:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379553152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (482us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318631.896389:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971
00000100:00100000:1.0:1767318631.896583:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379553152:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318632.339516:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318632.339620:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318632.339764:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291871872
00000100:00100000:1.0:1767318632.339764:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291871744
00000100:00100000:0.0:1767318632.339777:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291871872
00000100:00100000:1.0:1767318632.339777:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291871744
00000100:00100000:1.0:1767318632.339851:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3760
00000100:00100000:1.0:1767318632.339866:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291871872:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767318632.339893:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318632.340001:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291871872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 139us (384us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318632.345238:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16315
00000100:00100000:0.0:1767318632.345261:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291871744:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318632.345298:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318632.345415:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291871744:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 159us (7211us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318632.345452:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16315
00000100:00100000:1.0:1767318632.359813:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3760
00010000:00010000:2.0:1767318632.919398:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318633.946445:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318634.968422:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318635.481450:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379553280:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318635.481581:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318635.481646:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553280
00000100:00100000:2.0:1767318635.481658:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553280
00000100:00080000:0.0:1767318635.481714:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318635.481749:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972
00000100:00100000:2.0:1767318635.481761:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379553280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318635.481800:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318635.481855:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379553280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (287us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318635.481863:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972
00000100:00100000:1.0:1767318635.481999:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379553280:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318635.482691:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318635.482698:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318635.482701:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318635.482706:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318635.482711:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318635.482718:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3532
00000100:00080000:3.0:1767318635.482723:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318635.482728:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318635.482766:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04380 x1853164379553408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318635.482798:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318635.482803:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318635.482805:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318635.482832:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3532
00000100:00080000:3.0:1767318635.482835:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318635.482839:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318635.482854:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04000 x1853164379553536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318635.482943:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318635.482948:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318635.482951:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318635.482955:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3532
00000100:00080000:3.0:1767318635.482958:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767318635.482960:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379553664:0@lo:400:kworker.0
00000100:00100000:0.0:1767318635.483018:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318635.483079:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553664
00000100:00100000:0.0:1767318635.483085:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553664
00000100:00080000:3.0:1767318635.483127:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318635.483141:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227
00000100:00100000:3.0:1767318635.483148:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164379553920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318635.483153:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379553664:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318635.483180:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318635.483185:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318635.483187:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318635.483192:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3532
00000100:00080000:3.0:1767318635.483196:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318635.483202:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318635.483211:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379553664:12345-0@lo:400:kworker.0 Request processed in 62us (192us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318635.483219:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c700 x1853164379554176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318635.483222:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227
00000100:00100000:3.0:1767318635.483255:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379554048:0@lo:400:kworker.0
00000100:00100000:0.0:1767318635.483272:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379553664:0@lo:400:kworker.0
00000100:00080000:0.0:1767318635.483294:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318635.483300:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318635.483336:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318635.483351:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379553792:0@lo:400:kworker.0
00000100:00100000:3.0:1767318635.483378:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318635.483519:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379554048
00000100:00100000:3.0:1767318635.483524:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379554048
00000100:00100000:3.0:1767318635.483562:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553792
00000100:00100000:3.0:1767318635.483565:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553792
00000100:00100000:3.0:1767318635.483588:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761
00000100:00100000:3.0:1767318635.483595:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379554048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318635.483635:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379554048:12345-0@lo:400:kworker.0 Request processed in 41us (338us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318635.483642:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761
00000100:00100000:3.0:1767318635.483668:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379554048:0@lo:400:kworker.0
00000100:00100000:3.0:1767318635.483684:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762
00000100:00100000:3.0:1767318635.483690:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379553792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318635.483719:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379553792:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318635.483725:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762
00000100:00100000:3.0:1767318635.483742:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379553792:0@lo:400:kworker.0
00000100:00100000:1.0:1767318635.483823:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379553408:0@lo:38:kworker.0
00000100:00100000:1.0:1767318635.483854:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318635.483902:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379553536:0@lo:38:kworker.0
00000100:00100000:1.0:1767318635.483935:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318635.483957:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379553920:0@lo:38:kworker.0
00000100:00100000:3.0:1767318635.484086:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553408
00000100:00100000:3.0:1767318635.484091:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553408
00000100:00100000:3.0:1767318635.484109:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16316
00000100:00100000:3.0:1767318635.484113:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379553408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318635.484134:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318635.484163:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379553408:12345-0@lo:38:kworker.0 Request processed in 49us (308us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318635.484170:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16316
00000100:00100000:1.0:1767318635.484259:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318635.484278:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379554176:0@lo:38:kworker.0
00000100:00100000:1.0:1767318635.484295:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318635.484318:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318635.484324:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318635.484327:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379553408:0@lo:38:kworker.0
00000100:00100000:2.0:1767318635.484399:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553920
00000100:00100000:2.0:1767318635.484404:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553920
00000100:00100000:2.0:1767318635.484428:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379554176
00000100:00100000:2.0:1767318635.484430:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379554176
00000100:00100000:2.0:1767318635.484440:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16317
00000100:00100000:2.0:1767318635.484445:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379553920:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318635.484455:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318635.484493:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379553920:12345-0@lo:38:kworker.0 Request processed in 48us (234us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318635.484499:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16317
00000100:00100000:2.0:1767318635.484511:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16318
00000100:00100000:2.0:1767318635.484515:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379554176:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318635.484524:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318635.484542:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379554176:12345-0@lo:38:kworker.0 Request processed in 26us (246us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318635.484547:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16318
00000100:00100000:2.0:1767318635.484567:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379553536
00000100:00100000:2.0:1767318635.484570:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379553536
00000100:00100000:2.0:1767318635.484593:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841
00000100:00100000:2.0:1767318635.484597:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379553536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318635.484607:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318635.484630:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379553536:12345-0@lo:38:kworker.0 Request processed in 31us (694us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318635.484635:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841
00000100:00080000:1.0:1767318635.484792:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318635.484797:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318635.484800:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379553536:0@lo:38:kworker.0
00000100:00080000:1.0:1767318635.484807:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318635.484810:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318635.484813:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379553920:0@lo:38:kworker.0
00000100:00080000:1.0:1767318635.484820:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318635.484823:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318635.484826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379554176:0@lo:38:kworker.0
00000100:00080000:0.0:1767318635.484948:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318635.993650:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318636.436030:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767318636.436145:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291872000 offset 0 length 520: 4
00000100:00100000:0.0:1767318636.436171:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318636.436375:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291872256
00000100:00100000:1.0:1767318636.436387:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291872256
00000100:00100000:2.0:1767318636.438416:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291872128
00000100:00100000:2.0:1767318636.438435:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291872128
00000100:00100000:2.0:1767318636.438481:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3763
00000100:00100000:2.0:1767318636.438496:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291872256:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318636.438646:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291872256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 153us (2630us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318636.438655:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3763
00000100:00100000:2.0:1767318636.438684:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16319
00000100:00100000:2.0:1767318636.438689:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291872128:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318636.438714:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318636.438745:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291872128:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (2573us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318636.438752:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16319
00000100:00080000:0.0:1767318636.439614:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318637.015270:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318637.015525:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379554304:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318637.015649:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318637.015924:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379554304
00000100:00100000:2.0:1767318637.015935:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379554304
00000100:00100000:2.0:1767318637.016020:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973
00000100:00100000:2.0:1767318637.016032:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379554304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318637.016074:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318637.016128:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379554304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (479us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318637.016136:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973
00000100:00080000:1.0:1767318637.016338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318637.016389:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379554304:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318638.039404:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318639.064273:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318640.088623:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318640.599104:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318615/real 1767318615]  req@ffff8b0e0cfcce00 x1853164379548160/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318640 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318640.599184:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0cfcce00 x1853164379548160/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318640 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318640.599209:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318640.599221:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318640.599225:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379548160:0@lo:250:kworker.0
00000100:00080000:3.0:1767318640.599379:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318640.599386:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318640.599390:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318640.599396:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3517
00000100:00080000:3.0:1767318640.599400:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318640.599408:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318640.599447:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e300 x1853164379554432/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318640.599464:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318640.599468:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318640.599470:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318640.599474:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3537
00000100:00080000:3.0:1767318640.599476:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318640.599480:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318640.599494:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c380 x1853164379554560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318640.599504:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318640.599507:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318640.599509:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318640.599512:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3537
00000100:00080000:3.0:1767318640.599515:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318640.599518:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318640.599530:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379554688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318640.599610:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318640.599613:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318640.599615:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318640.599619:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3537
00000100:00080000:3.0:1767318640.599621:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318640.599625:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318640.599636:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9df80 x1853164379555200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318640.599651:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318640.599655:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318640.599656:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318640.599660:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3537
00000100:00080000:3.0:1767318640.599663:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318640.599667:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318640.599683:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d500 x1853164379555456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318640.599717:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379554816:0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.599804:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318640.599931:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318640.599937:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379555328:0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.599965:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318640.599994:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379555072:0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600019:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318640.600049:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318640.600054:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379554944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600080:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318640.600114:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379554816
00000100:00100000:3.0:1767318640.600123:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379554816
00000100:00100000:3.0:1767318640.600185:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379554944
00000100:00100000:3.0:1767318640.600189:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379554944
00000100:00100000:3.0:1767318640.600213:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228
00000100:00100000:3.0:1767318640.600224:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379554816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600285:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379554816:12345-0@lo:400:kworker.0 Request processed in 64us (481us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318640.600294:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228
00000100:00100000:3.0:1767318640.600312:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229
00000100:00100000:3.0:1767318640.600324:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379554944:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600356:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379554944:12345-0@lo:400:kworker.0 Request processed in 38us (275us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318640.600362:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229
00000100:00100000:3.0:1767318640.600381:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555328
00000100:00100000:3.0:1767318640.600385:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555328
00000100:00100000:3.0:1767318640.600412:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555072
00000100:00100000:3.0:1767318640.600414:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555072
00000100:00100000:3.0:1767318640.600433:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764
00000100:00100000:3.0:1767318640.600439:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379555328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600469:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379555328:12345-0@lo:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318640.600475:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764
00000100:00100000:3.0:1767318640.600485:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765
00000100:00100000:3.0:1767318640.600492:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379555072:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600527:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379555072:12345-0@lo:400:kworker.0 Request processed in 37us (507us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318640.600534:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765
00000100:00080000:3.0:1767318640.600561:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318640.600567:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318640.600570:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318640.600613:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379554944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600624:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379555072:0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600650:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379555328:0@lo:400:kworker.0
00000100:00100000:3.0:1767318640.600660:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379554816:0@lo:400:kworker.0
00000100:00100000:2.0:1767318640.603423:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318640.603452:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379555584:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318640.603537:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318640.603804:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379554432:0@lo:250:kworker.0
00000400:00000100:1.0:1767318640.603835:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379554432 offset 0 length 520: 4
00000100:00100000:1.0:1767318640.603856:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379554560:0@lo:38:kworker.0
00000100:00100000:1.0:1767318640.603905:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318640.603932:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379554688:0@lo:38:kworker.0
00000100:00100000:1.0:1767318640.603953:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318640.603972:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379555200:0@lo:38:kworker.0
00000100:00100000:1.0:1767318640.603989:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318640.604003:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379555456:0@lo:38:kworker.0
00000100:00100000:1.0:1767318640.604022:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318640.604053:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379554688
00000100:00100000:1.0:1767318640.604063:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379554688
00000100:00100000:1.0:1767318640.604102:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842
00000100:00100000:2.0:1767318640.604233:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379554560
00000100:00100000:2.0:1767318640.604237:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379554560
00000100:00100000:2.0:1767318640.604270:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555200
00000100:00100000:2.0:1767318640.604273:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555200
00000100:00100000:2.0:1767318640.604285:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555456
00000100:00100000:2.0:1767318640.604287:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555456
00000100:00100000:2.0:1767318640.604302:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16320
00000100:00100000:2.0:1767318640.604307:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379554560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318640.604342:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318640.604392:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379554560:12345-0@lo:38:kworker.0 Request processed in 84us (486us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318640.604399:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16320
00000100:00100000:2.0:1767318640.604417:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16321
00000100:00100000:2.0:1767318640.604421:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379555200:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318640.604430:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318640.604447:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379555200:12345-0@lo:38:kworker.0 Request processed in 25us (458us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318640.604453:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16321
00000100:00100000:2.0:1767318640.604461:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16322
00000100:00100000:2.0:1767318640.604465:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379555456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318640.604473:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318640.604490:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379555456:12345-0@lo:38:kworker.0 Request processed in 24us (466us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318640.604495:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16322
00000100:00100000:1.0:1767318640.605242:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379554688:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318640.605459:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555584
00000100:00100000:0.0:1767318640.605468:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555584
00000100:00100000:0.0:1767318640.605515:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974
00000100:00100000:0.0:1767318640.605522:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379555584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318640.605558:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318640.605630:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379555584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (2092us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318640.605652:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974
00000100:00100000:0.0:1767318640.605724:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379555584:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318640.605781:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318640.605789:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318640.605793:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379554560:0@lo:38:kworker.0
00000100:00080000:0.0:1767318640.605804:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318640.605808:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318640.605811:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379555200:0@lo:38:kworker.0
00000100:00080000:0.0:1767318640.605820:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318640.605823:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318640.605826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379555456:0@lo:38:kworker.0
00010000:00020000:1.0:1767318640.605990:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318640.606041:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379554688:12345-0@lo:38:kworker.0 Request processed in 1930us (2086us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318640.606050:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842
00000100:00080000:0.0:1767318640.606858:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318640.606867:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318640.606911:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379554688:0@lo:38:kworker.0
00010000:00010000:2.0:1767318641.123178:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318641.552520:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318641.552583:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318641.552715:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291872384
00000100:00100000:3.0:1767318641.552729:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291872384
00000100:00100000:3.0:1767318641.552790:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291872512
00000100:00100000:3.0:1767318641.552794:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291872512
00000100:00080000:3.0:1767318641.552830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318641.552916:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3766
00000100:00100000:3.0:1767318641.552930:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291872512:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318641.553033:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291872512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (447us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318641.553043:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3766
00000100:00100000:3.0:1767318641.553066:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16323
00000100:00100000:3.0:1767318641.553071:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291872384:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318641.553099:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318641.553129:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291872384:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (629us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318641.553157:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16323
00000100:00100000:3.0:1767318642.135761:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318642.135798:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379555712:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318642.135931:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318642.136093:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555712
00000100:00100000:2.0:1767318642.136105:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555712
00000100:00100000:2.0:1767318642.136206:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975
00000100:00100000:2.0:1767318642.136219:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379555712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318642.136265:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318642.136328:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379555712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (396us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318642.136336:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975
00000100:00100000:2.0:1767318642.136400:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379555712:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318642.136611:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767318642.137336:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318643.160652:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318644.184425:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318645.213334:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318645.719060:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318645.719075:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318645.719079:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318645.719084:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318645.719089:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318645.719099:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3543
00000100:00080000:3.0:1767318645.719106:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318645.719115:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318645.719178:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7800 x1853164379555840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318645.719199:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318645.719203:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318645.719205:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318645.719209:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3543
00000100:00080000:3.0:1767318645.719212:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318645.719217:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318645.719238:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379555840:0@lo:38:kworker.0
00000100:00100000:3.0:1767318645.719244:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6680 x1853164379555968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318645.719351:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318645.719366:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318645.719369:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318645.719371:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318645.719375:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3543
00000100:00080000:3.0:1767318645.719377:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318645.719380:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318645.719391:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4e00 x1853164379556480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318645.719414:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318645.719418:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318645.719420:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318645.719424:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3543
00000100:00080000:3.0:1767318645.719426:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318645.719431:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318645.719443:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379555968:0@lo:38:kworker.0
00000100:00100000:3.0:1767318645.719446:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5880 x1853164379556736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318645.719475:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379556608:0@lo:400:kworker.0
00000100:00100000:0.0:1767318645.719482:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318645.719513:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318645.719516:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379556480:0@lo:38:kworker.0
00000100:00100000:2.0:1767318645.719597:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379556096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318645.719656:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379556352:0@lo:400:kworker.0
00000100:00100000:1.0:1767318645.719679:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555968
00000100:00100000:1.0:1767318645.719690:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555968
00000100:00100000:1.0:1767318645.719734:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843
00000100:00100000:1.0:1767318645.719744:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379555968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318645.719767:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318645.719822:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318645.719864:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379556736:0@lo:38:kworker.0
00000100:00100000:0.0:1767318645.719943:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318645.719979:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379556224:0@lo:400:kworker.0
00000100:00100000:0.0:1767318645.720008:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318645.720039:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379555840
00000100:00100000:0.0:1767318645.720043:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379555840
00000100:00100000:0.0:1767318645.720066:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556608
00000100:00100000:0.0:1767318645.720068:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556608
00000100:00100000:0.0:1767318645.720109:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556480
00000100:00100000:0.0:1767318645.720112:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556480
00000100:00100000:0.0:1767318645.720120:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556736
00000100:00100000:0.0:1767318645.720122:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556736
00000100:00100000:0.0:1767318645.720131:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767
00000100:00100000:0.0:1767318645.720138:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379556608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318645.720185:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379556608:12345-0@lo:400:kworker.0 Request processed in 47us (672us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318645.720194:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767
00000100:00100000:0.0:1767318645.720215:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16324
00000100:00100000:0.0:1767318645.720219:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379555840:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318645.720231:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318645.720257:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379555840:12345-0@lo:38:kworker.0 Request processed in 36us (908us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318645.720263:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16324
00000100:00100000:0.0:1767318645.720275:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16325
00000100:00100000:0.0:1767318645.720279:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379556480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318645.720288:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318645.720388:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379556480:12345-0@lo:38:kworker.0 Request processed in 107us (565us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318645.720402:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16325
00000100:00100000:0.0:1767318645.720415:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16326
00000100:00100000:0.0:1767318645.720419:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379556736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318645.720444:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318645.720471:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379556736:12345-0@lo:38:kworker.0 Request processed in 50us (527us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318645.720476:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16326
00000100:00100000:0.0:1767318645.720502:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556224
00000100:00100000:0.0:1767318645.720506:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556224
00000100:00100000:0.0:1767318645.720550:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230
00000100:00100000:0.0:1767318645.720558:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379556224:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318645.720595:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379556224:12345-0@lo:400:kworker.0 Request processed in 39us (587us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318645.720602:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230
00000100:00080000:0.0:1767318645.720620:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318645.720625:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318645.720668:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379556224:0@lo:400:kworker.0
00000100:00080000:0.0:1767318645.720699:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318645.720703:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318645.720706:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379556736:0@lo:38:kworker.0
00000100:00080000:0.0:1767318645.720716:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318645.720719:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318645.720722:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379556480:0@lo:38:kworker.0
00000100:00080000:0.0:1767318645.720730:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318645.720741:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318645.720744:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379555840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318645.720811:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379556608:0@lo:400:kworker.0
00000100:00100000:0.0:1767318645.720822:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318645.720842:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379556864:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318645.720897:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318645.720935:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556864
00000100:00100000:0.0:1767318645.720939:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556864
00000100:00100000:0.0:1767318645.720978:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976
00000100:00100000:0.0:1767318645.720985:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379556864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318645.721011:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318645.721051:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379556864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (154us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318645.721057:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976
00000100:00080000:0.0:1767318645.721072:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318645.721094:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379556864:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318645.722504:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318645.723009:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556096
00000100:00100000:0.0:1767318645.723021:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556096
00000100:00100000:3.0:1767318645.723911:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318645.723995:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556352
00000100:00100000:3.0:1767318645.724001:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556352
00000100:00100000:3.0:1767318645.724149:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768
00000100:00100000:3.0:1767318645.724159:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379556352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318645.724248:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379556352:12345-0@lo:400:kworker.0 Request processed in 90us (341us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318645.724257:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768
00000100:00080000:3.0:1767318645.724288:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318645.724483:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379556352:0@lo:400:kworker.0
00000100:00100000:0.0:1767318645.724901:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231
00000100:00100000:0.0:1767318645.724915:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379556096:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318645.724989:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379556096:12345-0@lo:400:kworker.0 Request processed in 79us (2492us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318645.724996:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231
00000100:00100000:3.0:1767318645.725614:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379556096:0@lo:400:kworker.0
00000100:00100000:1.0:1767318645.725931:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379555968:12345-0@lo:38:kworker.0 Request processed in 6184us (6447us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318645.725944:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843
00000100:00080000:0.0:1767318645.726171:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318645.726178:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318645.726200:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379555968:0@lo:38:kworker.0
00010000:00010000:3.0:1767318646.231335:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318646.676034:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318646.676237:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318646.682307:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291872768
00000100:00100000:3.0:1767318646.682328:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291872768
00000100:00100000:3.0:1767318646.682446:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291872640
00000100:00100000:3.0:1767318646.682451:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291872640
00000100:00100000:3.0:1767318646.682498:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3769
00000100:00100000:3.0:1767318646.682513:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291872768:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767318646.686002:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318646.686100:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16327
00000100:00100000:1.0:1767318646.686114:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291872640:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318646.686151:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318646.686802:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291872768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4279us (10770us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318646.686816:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3769
00000100:00100000:1.0:1767318646.692342:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291872640:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2675us (12550us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318646.692365:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16327
00000100:00100000:3.0:1767318647.255171:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318647.255201:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379556992:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318647.255283:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767318647.255451:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318647.255462:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379556992
00000100:00100000:2.0:1767318647.255474:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379556992
00000100:00100000:2.0:1767318647.255544:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977
00000100:00100000:2.0:1767318647.255554:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379556992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318647.255590:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318647.255602:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318647.255654:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379556992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318647.255662:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977
00000100:00100000:3.0:1767318647.255769:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379556992:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318648.279394:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318649.303313:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318650.327804:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318650.839482:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318650.839498:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318650.839502:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318650.839534:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318650.839540:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318650.839551:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3548
00000100:00080000:3.0:1767318650.839558:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318650.839571:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318650.839643:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164379557120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318650.839727:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379557120:0@lo:38:kworker.0
00000100:00100000:2.0:1767318650.839851:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318650.840005:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318650.840010:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318650.840012:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318650.840017:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3548
00000100:00080000:3.0:1767318650.840021:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318650.840026:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318650.840046:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6d80 x1853164379557248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318650.840257:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379557376:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318650.840307:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318650.840365:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379557376
00000100:00100000:0.0:1767318650.840377:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379557376
00000100:00100000:0.0:1767318650.840455:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978
00000100:00100000:0.0:1767318650.840465:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379557376:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318650.840507:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318650.840558:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379557376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (250us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318650.840567:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978
00000100:00100000:0.0:1767318650.840621:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379557376:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318650.843051:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318650.843102:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379557120
00000100:00100000:1.0:1767318650.843123:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379557120
00000100:00100000:1.0:1767318650.843218:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16328
00000100:00100000:1.0:1767318650.843229:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379557120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318650.843261:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318650.846944:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379557248:0@lo:38:kworker.0
00000100:00100000:2.0:1767318650.847097:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318650.847291:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379557248
00000100:00100000:0.0:1767318650.847305:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379557248
00000100:00100000:0.0:1767318650.847367:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844
00000100:00100000:0.0:1767318650.847378:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379557248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318650.847410:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318650.847474:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379557248:12345-0@lo:38:kworker.0 Request processed in 97us (376us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318650.847482:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844
00000100:00080000:3.0:1767318650.848722:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318650.848729:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318650.848734:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318650.848742:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3548
00000100:00080000:3.0:1767318650.848759:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318650.848767:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318650.848808:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6300 x1853164379557760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318650.848848:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318650.848894:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318650.848896:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318650.848901:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3548
00000100:00080000:3.0:1767318650.848904:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318650.848910:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318650.848936:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6680 x1853164379558016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318650.848988:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379557632:0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849063:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318650.849112:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318650.849118:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379557504:0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849150:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318650.849186:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379557888:0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849209:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318650.849248:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379557632
00000100:00100000:3.0:1767318650.849256:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379557632
00000100:00100000:3.0:1767318650.849330:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379557888
00000100:00100000:3.0:1767318650.849333:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379557888
00000100:00100000:3.0:1767318650.849362:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770
00000100:00100000:3.0:1767318650.849371:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379557632:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849432:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379557632:12345-0@lo:400:kworker.0 Request processed in 60us (368us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318650.849440:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770
00000100:00100000:3.0:1767318650.849457:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771
00000100:00100000:3.0:1767318650.849463:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379557888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849491:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379557888:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318650.849504:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771
00000100:00100000:3.0:1767318650.849564:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379557888:0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849597:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379557632:0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849637:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379557504
00000100:00100000:3.0:1767318650.849641:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379557504
00000100:00100000:3.0:1767318650.849672:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232
00000100:00100000:3.0:1767318650.849678:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379557504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318650.849715:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379557504:12345-0@lo:400:kworker.0 Request processed in 37us (564us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318650.849721:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232
00000100:00100000:3.0:1767318650.849742:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379557504:0@lo:400:kworker.0
00000100:00080000:0.0:1767318650.850928:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318650.850939:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318650.852546:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379557120:12345-0@lo:38:kworker.0 Request processed in 9303us (12680us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318650.852563:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16328
00000100:00080000:2.0:1767318650.855139:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318650.855160:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318650.855166:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379557120:0@lo:38:kworker.0
00000100:00100000:2.0:1767318650.855223:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379557760:0@lo:38:kworker.0
00000100:00100000:2.0:1767318650.855325:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318650.855372:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379558016:0@lo:38:kworker.0
00000100:00100000:2.0:1767318650.855397:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318650.855434:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318650.855439:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318650.855442:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379557248:0@lo:38:kworker.0
00000100:00100000:1.0:1767318650.855497:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379557760
00000100:00100000:1.0:1767318650.855505:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379557760
00000100:00100000:3.0:1767318650.855530:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558016
00000100:00100000:3.0:1767318650.855534:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558016
00000100:00100000:1.0:1767318650.855633:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16329
00000100:00100000:1.0:1767318650.855643:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379557760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318650.855673:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318650.855739:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379557760:12345-0@lo:38:kworker.0 Request processed in 96us (413us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318650.855746:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16329
00000100:00100000:1.0:1767318650.855770:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16330
00000100:00100000:1.0:1767318650.855774:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379558016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318650.855793:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318650.855817:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379558016:12345-0@lo:38:kworker.0 Request processed in 41us (418us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318650.855824:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16330
00000100:00080000:2.0:1767318650.855908:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318650.855913:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318650.856057:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379557760:0@lo:38:kworker.0
00000100:00080000:2.0:1767318650.856071:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318650.856074:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318650.856077:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379558016:0@lo:38:kworker.0
00010000:00010000:1.0:1767318651.351368:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318651.801538:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318651.801603:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318651.803967:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291872896
00000100:00100000:1.0:1767318651.803988:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291872896
00000100:00100000:1.0:1767318651.804068:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291873024
00000100:00100000:1.0:1767318651.804073:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291873024
00000100:00100000:1.0:1767318651.804154:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3772
00000100:00100000:1.0:1767318651.804169:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291873024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318651.804306:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291873024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 140us (2701us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318651.804315:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3772
00000100:00100000:1.0:1767318651.804357:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16331
00000100:00100000:1.0:1767318651.804362:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291872896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318651.804418:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318651.804450:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291872896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 86us (2928us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318651.804458:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16331
00000100:00080000:0.0:1767318651.804975:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318652.375187:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318652.375225:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379558144:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318652.375325:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1767318652.375796:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318652.376176:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558144
00000100:00100000:2.0:1767318652.376187:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558144
00000100:00100000:2.0:1767318652.376365:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979
00000100:00100000:2.0:1767318652.376378:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379558144:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318652.376419:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318652.376429:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318652.376504:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379558144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (1178us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318652.376513:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979
00000100:00100000:0.0:1767318652.376582:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379558144:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318653.399074:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318654.424002:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318655.447164:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318655.959173:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379558272:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318655.959264:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318655.959390:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558272
00000100:00100000:2.0:1767318655.959407:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558272
00000100:00100000:2.0:1767318655.959548:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980
00000100:00100000:2.0:1767318655.959566:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379558272:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318655.959592:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318655.959599:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318655.959603:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318655.959607:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318655.959611:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318655.959618:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3553
00000100:00080000:1.0:1767318655.959623:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318655.959631:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318655.959661:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162a300 x1853164379558400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318655.959683:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00002000:00000024:2.0:1767318655.959686:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318655.959688:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318655.959690:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318655.959694:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3553
00000100:00080000:1.0:1767318655.959696:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318655.959699:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318655.959709:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628e00 x1853164379558528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318655.959765:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318655.959791:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318655.959793:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318655.959798:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3553
00000100:00080000:1.0:1767318655.959801:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318655.959806:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318655.959824:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162b100 x1853164379558912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318655.959850:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318655.959854:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318655.959857:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318655.959864:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3553
00000100:00080000:1.0:1767318655.959901:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767318655.959907:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379558272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 344us (638us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318655.959922:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980
00000100:00100000:2.0:1767318655.959961:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379558400:0@lo:38:kworker.0
00000100:00100000:2.0:1767318655.960005:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318655.960028:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318655.960042:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379558528:0@lo:38:kworker.0
00000100:00100000:0.0:1767318655.960058:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379558784:0@lo:400:kworker.0
00000100:00100000:2.0:1767318655.960079:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318655.960127:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318655.960130:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379558912:0@lo:38:kworker.0
00000100:00100000:3.0:1767318655.960221:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558400
00000100:00100000:3.0:1767318655.960231:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558400
00000100:00100000:3.0:1767318655.960269:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558784
00000100:00100000:3.0:1767318655.960272:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558784
00000100:00100000:3.0:1767318655.960318:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773
00000100:00100000:3.0:1767318655.960328:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379558784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318655.960395:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318655.960403:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379559040:0@lo:400:kworker.0
00000100:00080000:1.0:1767318655.960436:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318655.960452:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162ad80 x1853164379559168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318655.960484:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379558656:0@lo:400:kworker.0
00000100:00100000:2.0:1767318655.960585:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318655.961473:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379559168:0@lo:38:kworker.0
00000100:00100000:2.0:1767318655.961533:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318655.961598:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558912
00000100:00100000:2.0:1767318655.961606:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558912
00000100:00100000:2.0:1767318655.961645:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559168
00000100:00100000:2.0:1767318655.961648:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559168
00000100:00100000:2.0:1767318655.961662:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16332
00000100:00100000:2.0:1767318655.961670:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379558400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318655.961796:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318655.961853:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379558400:12345-0@lo:38:kworker.0 Request processed in 182us (1848us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318655.961862:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16332
00000100:00100000:2.0:1767318655.961902:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16333
00000100:00100000:2.0:1767318655.961906:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379558912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318655.961916:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318655.961939:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379558912:12345-0@lo:38:kworker.0 Request processed in 32us (1356us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318655.961945:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16333
00000100:00100000:2.0:1767318655.961960:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16334
00000100:00100000:2.0:1767318655.961964:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379559168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318655.961973:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318655.961995:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379559168:12345-0@lo:38:kworker.0 Request processed in 29us (462us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318655.962000:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16334
00000100:00080000:2.0:1767318655.962044:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318655.962050:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318655.962054:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379559168:0@lo:38:kworker.0
00000100:00080000:2.0:1767318655.962067:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318655.962071:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318655.962074:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379558400:0@lo:38:kworker.0
00000100:00080000:2.0:1767318655.962085:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318655.962088:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318655.962092:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379558912:0@lo:38:kworker.0
00000100:00080000:2.0:1767318655.962163:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318655.963931:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379558272:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318655.964005:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558528
00000100:00100000:2.0:1767318655.964015:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558528
00000100:00100000:2.0:1767318655.964073:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845
00000100:00100000:2.0:1767318655.964081:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379558528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318655.964104:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318655.964188:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379558528:12345-0@lo:38:kworker.0 Request processed in 106us (4111us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318655.964196:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845
00000100:00080000:2.0:1767318655.964233:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318655.964239:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318655.964242:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379558528:0@lo:38:kworker.0
00000100:00100000:3.0:1767318655.965384:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379558784:12345-0@lo:400:kworker.0 Request processed in 5048us (5253us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318655.965399:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773
00000100:00100000:0.0:1767318655.965624:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318655.965697:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379558784:0@lo:400:kworker.0
00000100:00100000:3.0:1767318655.966038:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559040
00000100:00100000:3.0:1767318655.966047:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559040
00000100:00100000:3.0:1767318655.966124:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774
00000100:00100000:3.0:1767318655.966133:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379559040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318655.966196:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379559040:12345-0@lo:400:kworker.0 Request processed in 64us (573us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318655.966204:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774
00000100:00100000:0.0:1767318655.966308:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379559040:0@lo:400:kworker.0
00000100:00080000:2.0:1767318655.967106:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318655.967320:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318655.972548:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379558656
00000100:00100000:0.0:1767318655.972562:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379558656
00000100:00100000:0.0:1767318655.972697:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233
00000100:00100000:0.0:1767318655.972710:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379558656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318655.972852:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379558656:12345-0@lo:400:kworker.0 Request processed in 146us (5533us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318655.972861:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233
00000100:00100000:1.0:1767318655.973556:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379558656:0@lo:400:kworker.0
00000100:00080000:2.0:1767318655.976834:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767318656.471200:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318656.920708:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318656.921128:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291873280
00000100:00100000:0.0:1767318656.921148:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291873280
00000100:00100000:2.0:1767318656.921260:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318656.921326:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291873152
00000100:00100000:1.0:1767318656.921333:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291873152
00000100:00100000:1.0:1767318656.921388:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16335
00000100:00100000:1.0:1767318656.921397:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291873152:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318656.921425:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318656.921533:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291873152:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 135us (274us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318656.921556:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16335
00000100:00100000:0.0:1767318656.921710:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3775
00000100:00100000:0.0:1767318656.921720:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291873280:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318656.922265:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291873280:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 545us (1573us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318656.922274:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3775
00000100:00080000:3.0:1767318656.923600:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318657.495849:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379559296:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318657.495977:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318657.496051:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559296
00000100:00100000:3.0:1767318657.496062:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559296
00000100:00100000:3.0:1767318657.496147:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981
00000100:00100000:3.0:1767318657.496159:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379559296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318657.496196:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318657.496268:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379559296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (290us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318657.496277:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981
00000100:00080000:1.0:1767318657.496281:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318657.496641:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318657.497229:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379559296:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318658.519098:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318659.551907:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318660.567147:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318661.080147:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379559424:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318661.080234:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318661.080520:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.080526:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318661.080544:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.080549:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.080552:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.080557:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3558
00000100:00080000:0.0:1767318661.080561:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.080568:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318661.080618:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04e00 x1853164379559552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318661.080648:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.080652:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.080654:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.080658:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3558
00000100:00080000:0.0:1767318661.080661:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.080665:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318661.080679:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164379559680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318661.080726:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.080730:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.080732:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.080735:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3558
00000100:00080000:0.0:1767318661.080738:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.080741:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318661.080752:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebe680 x1853164379560064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318661.080799:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318661.080802:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318661.080804:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318661.080808:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3558
00000100:00080000:0.0:1767318661.080810:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318661.080815:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318661.080827:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164379560320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318661.080851:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379559808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.080910:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318661.080939:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318661.080945:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379559936:0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.080968:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318661.081256:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559424
00000100:00100000:2.0:1767318661.081265:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559424
00000100:00100000:0.0:1767318661.081284:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559808
00000100:00100000:0.0:1767318661.081288:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559808
00000100:00100000:2.0:1767318661.081315:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982
00000100:00100000:2.0:1767318661.081323:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379559424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318661.081352:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318661.081406:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379559424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1171us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318661.081413:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982
00000100:00100000:0.0:1767318661.081496:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234
00000100:00100000:0.0:1767318661.081503:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379559808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.081540:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379559808:12345-0@lo:400:kworker.0 Request processed in 37us (629us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318661.081546:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234
00000100:00100000:0.0:1767318661.081584:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379559808:0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.081777:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379560192:0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.081815:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318661.082966:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559936
00000100:00100000:0.0:1767318661.082977:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559936
00000100:00080000:1.0:1767318661.083256:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318661.083263:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318661.083284:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379559552:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.083352:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.083394:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379559680:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.083420:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.083456:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379560064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.083478:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.083496:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379560320:0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.083514:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318661.083545:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379560192
00000100:00100000:1.0:1767318661.083550:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379560192
00000100:00100000:1.0:1767318661.083610:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559552
00000100:00100000:1.0:1767318661.083613:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559552
00000100:00100000:1.0:1767318661.083624:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379560064
00000100:00100000:1.0:1767318661.083626:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379560064
00000100:00100000:1.0:1767318661.083632:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379560320
00000100:00100000:1.0:1767318661.083634:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379560320
00000100:00100000:1.0:1767318661.083646:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776
00000100:00100000:1.0:1767318661.083654:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379560192:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.083716:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379559680
00000100:00100000:3.0:1767318661.083720:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379559680
00000100:00100000:1.0:1767318661.083730:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379560192:12345-0@lo:400:kworker.0 Request processed in 78us (1915us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318661.083737:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776
00000100:00100000:3.0:1767318661.083739:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846
00000100:00100000:3.0:1767318661.083743:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379559680:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318661.083755:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16336
00000100:00100000:1.0:1767318661.083758:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379559552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318661.083761:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767318661.083766:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318661.083791:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379559552:12345-0@lo:38:kworker.0 Request processed in 30us (438us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318661.083797:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16336
00000100:00100000:1.0:1767318661.083809:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16337
00000100:00100000:1.0:1767318661.083813:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379560064:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318661.083821:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318661.083832:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16338
00000100:00100000:2.0:1767318661.083837:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379560320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318661.083846:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318661.084207:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777
00000100:00100000:0.0:1767318661.084219:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379559936:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318661.084271:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379559936:12345-0@lo:400:kworker.0 Request processed in 56us (3301us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318661.084277:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777
00000100:00100000:0.0:1767318661.085026:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379559936:0@lo:400:kworker.0
00000100:00080000:0.0:1767318661.085092:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318661.085125:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379559424:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318661.085259:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379560192:0@lo:400:kworker.0
00000100:00100000:3.0:1767318661.089659:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379559680:12345-0@lo:38:kworker.0 Request processed in 5902us (6225us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318661.089679:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846
00000100:00100000:1.0:1767318661.090995:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379560064:12345-0@lo:38:kworker.0 Request processed in 7165us (7500us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318661.091007:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16337
00000100:00080000:0.0:1767318661.096423:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.096437:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318661.096442:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379559552:0@lo:38:kworker.0
00000100:00080000:0.0:1767318661.096466:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.096470:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318661.096473:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379559680:0@lo:38:kworker.0
00000100:00100000:2.0:1767318661.096476:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379560320:12345-0@lo:38:kworker.0 Request processed in 12635us (12958us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318661.096482:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.096485:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318661.096487:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16338
00000100:00100000:0.0:1767318661.096488:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379560064:0@lo:38:kworker.0
00000100:00080000:0.0:1767318661.096497:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318661.096499:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318661.096502:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379560320:0@lo:38:kworker.0
00010000:00010000:2.0:1767318661.591305:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318662.045954:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767318662.046007:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291873408 offset 0 length 520: 4
00000100:00100000:1.0:1767318662.046037:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318662.046260:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291873664
00000100:00100000:2.0:1767318662.046276:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291873664
00000100:00080000:0.0:1767318662.046372:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318662.046377:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291873536
00000100:00100000:2.0:1767318662.046382:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291873536
00000100:00100000:2.0:1767318662.046415:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3778
00000100:00100000:2.0:1767318662.046428:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291873664:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318662.046443:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16339
00000100:00100000:0.0:1767318662.046452:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291873536:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318662.046479:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318662.046552:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291873664:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 111us (594us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318662.046560:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3778
00000100:00100000:0.0:1767318662.047291:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291873536:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 833us (1246us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318662.047302:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16339
00010000:00010000:3.0:1767318662.615178:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318662.615390:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379560448:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318662.615476:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318662.615907:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379560448
00000100:00100000:3.0:1767318662.615916:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379560448
00000100:00100000:3.0:1767318662.616003:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983
00000100:00100000:3.0:1767318662.616015:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379560448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318662.616054:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318662.616120:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379560448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (643us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318662.616129:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983
00000100:00100000:0.0:1767318662.616216:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379560448:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318663.639198:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318664.663208:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318665.175401:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318640/real 1767318640]  req@ffff8b0f08e9e300 x1853164379554432/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318665 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318665.175440:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f08e9e300 x1853164379554432/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318665 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318665.175455:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318665.175486:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318665.175512:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379554432:0@lo:250:kworker.0
00000100:00080000:2.0:1767318665.175608:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318665.175614:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318665.175617:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318665.175621:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3543
00000100:00080000:2.0:1767318665.175625:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318665.175633:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318665.175681:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eca80 x1853164379560576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318665.175704:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318665.175708:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318665.175710:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318665.175714:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3563
00000100:00080000:2.0:1767318665.175716:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318665.175721:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318665.175741:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7e680 x1853164379560704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318665.175749:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318665.175751:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318665.175753:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318665.175757:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3563
00000100:00080000:2.0:1767318665.175759:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318665.175762:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318665.175774:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7ea00 x1853164379560832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318665.175849:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318665.175853:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318665.175855:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318665.175858:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3563
00000100:00080000:2.0:1767318665.175860:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318665.175864:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318665.175904:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164379561344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318665.175919:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318665.175922:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318665.175925:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318665.175928:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3563
00000100:00080000:2.0:1767318665.175930:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318665.175935:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318665.175948:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1bb80 x1853164379561600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318665.175978:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379561216:0@lo:400:kworker.0
00000100:00100000:2.0:1767318665.176050:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318665.176111:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318665.176117:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379561472:0@lo:400:kworker.0
00000100:00100000:2.0:1767318665.176138:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318665.176170:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561216
00000100:00100000:2.0:1767318665.176177:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561216
00000100:00100000:2.0:1767318665.176233:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561472
00000100:00100000:2.0:1767318665.176235:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561472
00000100:00100000:2.0:1767318665.176256:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779
00000100:00100000:2.0:1767318665.176264:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379561216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318665.176315:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379561216:12345-0@lo:400:kworker.0 Request processed in 52us (264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318665.176323:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779
00000100:00100000:3.0:1767318665.176623:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780
00000100:00100000:3.0:1767318665.176641:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379561472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318665.176695:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379561472:12345-0@lo:400:kworker.0 Request processed in 64us (555us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318665.176701:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780
00000100:00100000:1.0:1767318665.176769:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379560576:0@lo:250:kworker.0
00000400:00000100:1.0:1767318665.176797:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379560576 offset 0 length 520: 4
00000100:00100000:1.0:1767318665.176819:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379560704:0@lo:38:kworker.0
00000100:00100000:1.0:1767318665.176839:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318665.176856:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379560832:0@lo:38:kworker.0
00000100:00100000:1.0:1767318665.176917:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318665.176937:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379561344:0@lo:38:kworker.0
00000100:00100000:1.0:1767318665.176956:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318665.176970:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379561600:0@lo:38:kworker.0
00000100:00100000:1.0:1767318665.176992:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318665.177027:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379560704
00000100:00100000:1.0:1767318665.177033:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379560704
00000100:00100000:1.0:1767318665.177051:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561344
00000100:00100000:1.0:1767318665.177053:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561344
00000100:00100000:1.0:1767318665.177060:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561600
00000100:00100000:1.0:1767318665.177063:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561600
00000100:00100000:1.0:1767318665.177070:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16340
00000100:00100000:1.0:1767318665.177075:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379560704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318665.177096:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318665.177135:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379560704:12345-0@lo:38:kworker.0 Request processed in 58us (294us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318665.177141:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16340
00000100:00100000:1.0:1767318665.177160:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16341
00000100:00100000:1.0:1767318665.177164:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379561344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318665.177193:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318665.177218:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379561344:12345-0@lo:38:kworker.0 Request processed in 52us (260us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318665.177222:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16341
00000100:00100000:1.0:1767318665.177234:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16342
00000100:00100000:1.0:1767318665.177238:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379561600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318665.177246:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318665.177266:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379561600:12345-0@lo:38:kworker.0 Request processed in 26us (273us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318665.177271:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16342
00000100:00080000:1.0:1767318665.177308:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318665.177314:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318665.177317:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379560704:0@lo:38:kworker.0
00000100:00080000:1.0:1767318665.177327:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318665.177330:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318665.177332:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379561344:0@lo:38:kworker.0
00000100:00080000:1.0:1767318665.177339:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318665.177342:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318665.177345:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379561600:0@lo:38:kworker.0
00000100:00100000:1.0:1767318665.177415:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379561472:0@lo:400:kworker.0
00000100:00100000:1.0:1767318665.177428:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379561216:0@lo:400:kworker.0
00000100:00100000:1.0:1767318665.177458:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379560832
00000100:00100000:1.0:1767318665.177463:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379560832
00000100:00100000:1.0:1767318665.177492:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847
00000100:00100000:1.0:1767318665.177497:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379560832:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318665.177506:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318665.177537:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379560832:12345-0@lo:38:kworker.0 Request processed in 39us (618us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318665.177544:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847
00000100:00100000:1.0:1767318665.177565:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379561088:0@lo:400:kworker.0
00000100:00100000:1.0:1767318665.177593:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318665.177615:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318665.177622:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379560960:0@lo:400:kworker.0
00000100:00100000:1.0:1767318665.177642:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318665.177690:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318665.177694:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318665.177697:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379560832:0@lo:38:kworker.0
00000100:00100000:1.0:1767318665.177722:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561088
00000100:00100000:1.0:1767318665.177726:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561088
00000100:00100000:1.0:1767318665.177762:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379560960
00000100:00100000:1.0:1767318665.177765:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379560960
00000100:00100000:1.0:1767318665.177785:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235
00000100:00100000:1.0:1767318665.177791:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379561088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318665.177830:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379561088:12345-0@lo:400:kworker.0 Request processed in 39us (236us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318665.177836:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235
00000100:00100000:1.0:1767318665.177848:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236
00000100:00100000:1.0:1767318665.177853:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379560960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318665.177898:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379560960:12345-0@lo:400:kworker.0 Request processed in 45us (255us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318665.177911:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236
00000100:00100000:1.0:1767318665.177940:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379560960:0@lo:400:kworker.0
00000100:00100000:1.0:1767318665.177949:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379561088:0@lo:400:kworker.0
00000100:00080000:0.0:1767318665.178243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318665.178249:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318665.178252:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318665.687704:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318666.202116:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318666.202155:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379561728:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318666.202246:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318666.202477:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561728
00000100:00100000:3.0:1767318666.202488:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561728
00000100:00100000:3.0:1767318666.202553:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984
00000100:00100000:3.0:1767318666.202565:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379561728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318666.202621:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318666.202717:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379561728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (469us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318666.202726:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984
00000100:00100000:1.0:1767318666.202982:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379561728:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318666.712601:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318667.154982:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318667.155046:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318667.155508:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291873920
00000100:00100000:3.0:1767318667.155520:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291873920
00000100:00100000:3.0:1767318667.155616:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291873792
00000100:00100000:3.0:1767318667.155620:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291873792
00000100:00100000:3.0:1767318667.155654:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3781
00000100:00100000:3.0:1767318667.155667:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291873920:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318667.155754:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291873920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (786us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318667.155763:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3781
00000100:00100000:3.0:1767318667.155782:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16343
00000100:00100000:3.0:1767318667.155787:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291873792:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318667.155810:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318667.155834:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291873792:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (789us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318667.155840:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16343
00000100:00080000:1.0:1767318667.155909:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318667.735250:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318667.735268:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379561856:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318667.735331:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318667.735393:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561856
00000100:00100000:2.0:1767318667.735400:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561856
00000100:00100000:2.0:1767318667.735446:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985
00000100:00100000:2.0:1767318667.735453:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379561856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318667.735479:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318667.735508:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379561856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (177us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318667.735513:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985
00000100:00100000:2.0:1767318667.735561:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379561856:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318667.735742:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767318667.735956:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318668.759329:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318669.784816:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318670.295188:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318670.295196:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318670.295199:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318670.295203:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318670.295208:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318670.295216:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3567
00000100:00080000:1.0:1767318670.295220:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318670.295227:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318670.295264:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4380 x1853164379561984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318670.295285:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318670.295288:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318670.295290:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318670.295294:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3567
00000100:00080000:1.0:1767318670.295315:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318670.295320:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318670.295380:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379561984:0@lo:38:kworker.0
00000100:00100000:3.0:1767318670.295447:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318670.295640:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4e00 x1853164379562112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318670.295698:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318670.295702:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318670.295704:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318670.295708:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3567
00000100:00080000:1.0:1767318670.295710:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318670.295714:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318670.295808:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7800 x1853164379562624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318670.295826:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318670.295830:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318670.295831:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318670.295834:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3567
00000100:00080000:1.0:1767318670.295837:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318670.295840:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318670.295967:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5f80 x1853164379562880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318670.295969:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379562112:0@lo:38:kworker.0
00000100:00100000:3.0:1767318670.296020:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318670.296049:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379562624:0@lo:38:kworker.0
00000100:00100000:3.0:1767318670.296069:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318670.296116:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379562496:0@lo:400:kworker.0
00000100:00100000:3.0:1767318670.296136:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318670.296154:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318670.296159:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379562752:0@lo:400:kworker.0
00000100:00100000:3.0:1767318670.296175:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318670.296199:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379561984
00000100:00100000:3.0:1767318670.296207:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379561984
00000100:00100000:3.0:1767318670.296235:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379562624
00000100:00100000:3.0:1767318670.296237:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379562624
00000100:00100000:3.0:1767318670.296246:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379562496
00000100:00100000:3.0:1767318670.296248:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379562496
00000100:00100000:1.0:1767318670.296523:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379562368:0@lo:400:kworker.0
00000100:00100000:1.0:1767318670.296557:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318670.296580:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318670.296585:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379562240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318670.296631:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318670.296660:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379562368
00000100:00100000:1.0:1767318670.296664:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379562368
00000100:00100000:0.0:1767318670.296743:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379562752
00000100:00100000:0.0:1767318670.296748:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379562752
00000100:00100000:2.0:1767318670.296818:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379562112
00000100:00100000:2.0:1767318670.296823:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379562112
00000100:00100000:2.0:1767318670.296851:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848
00000100:00100000:2.0:1767318670.296858:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379562112:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318670.296901:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318670.296947:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379562112:12345-0@lo:38:kworker.0 Request processed in 88us (926us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318670.296955:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848
00000100:00100000:2.0:1767318670.296981:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16344
00000100:00100000:2.0:1767318670.296985:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379561984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318670.296995:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318670.297020:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379561984:12345-0@lo:38:kworker.0 Request processed in 33us (1573us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318670.297026:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16344
00000100:00100000:2.0:1767318670.297042:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16345
00000100:00100000:2.0:1767318670.297046:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379562624:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318670.297056:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318670.297078:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379562624:12345-0@lo:38:kworker.0 Request processed in 30us (1007us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318670.297084:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16345
00000100:00100000:1.0:1767318670.298560:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379562240
00000100:00100000:1.0:1767318670.298575:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379562240
00000100:00100000:1.0:1767318670.298628:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237
00000100:00100000:1.0:1767318670.298638:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379562368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318670.298643:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782
00000100:00100000:3.0:1767318670.298652:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379562496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318670.302829:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379562368:12345-0@lo:400:kworker.0 Request processed in 4181us (6259us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318670.302846:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237
00000100:00100000:1.0:1767318670.302996:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238
00000100:00100000:1.0:1767318670.303010:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379562240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318670.303064:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379562240:12345-0@lo:400:kworker.0 Request processed in 61us (6433us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318670.303069:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238
00000100:00100000:1.0:1767318670.303135:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379562240:0@lo:400:kworker.0
00000100:00100000:1.0:1767318670.303149:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379562368:0@lo:400:kworker.0
00000100:00100000:0.0:1767318670.304658:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783
00000100:00100000:0.0:1767318670.304671:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379562752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318670.304769:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379562752:12345-0@lo:400:kworker.0 Request processed in 100us (8591us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318670.304776:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783
00000100:00100000:0.0:1767318670.304832:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379562752:0@lo:400:kworker.0
00000100:00100000:0.0:1767318670.305344:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379562880:0@lo:38:kworker.0
00000100:00100000:0.0:1767318670.305399:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318670.305438:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318670.305444:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318670.305448:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379562112:0@lo:38:kworker.0
00000100:00080000:0.0:1767318670.305460:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318670.305464:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318670.305466:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379562624:0@lo:38:kworker.0
00000100:00080000:0.0:1767318670.305499:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318670.305503:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318670.305506:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379561984:0@lo:38:kworker.0
00000100:00100000:0.0:1767318670.305538:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379562880
00000100:00100000:0.0:1767318670.305544:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379562880
00000100:00100000:0.0:1767318670.305570:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16346
00000100:00100000:0.0:1767318670.305574:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379562880:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318670.305595:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318670.305645:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379562880:12345-0@lo:38:kworker.0 Request processed in 68us (245us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318670.305651:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16346
00000100:00080000:0.0:1767318670.305674:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318670.305678:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318670.305680:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379562880:0@lo:38:kworker.0
00000100:00100000:3.0:1767318670.306802:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379562496:12345-0@lo:400:kworker.0 Request processed in 8147us (10659us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318670.306814:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782
00000100:00100000:0.0:1767318670.307278:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379562496:0@lo:400:kworker.0
00000100:00080000:2.0:1767318670.308532:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318670.308542:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318670.308547:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767318670.808991:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318671.319463:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379563008:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318671.319542:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318671.319619:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563008
00000100:00100000:0.0:1767318671.319628:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563008
00000100:00100000:0.0:1767318671.319685:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986
00000100:00100000:0.0:1767318671.319695:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379563008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318671.319726:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318671.319784:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379563008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (242us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318671.319792:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986
00000100:00100000:1.0:1767318671.319988:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379563008:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318671.831090:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318672.271738:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318672.271852:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318672.280576:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291874048
00000100:00100000:3.0:1767318672.280630:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291874048
00000100:00100000:2.0:1767318672.280892:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291874176
00000100:00100000:2.0:1767318672.280898:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291874176
00000100:00100000:2.0:1767318672.280973:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3784
00000100:00100000:2.0:1767318672.280985:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291874176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318672.281221:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16347
00000100:00100000:1.0:1767318672.281228:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291874048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318672.281252:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318672.281344:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291874048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 113us (9618us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318672.281369:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16347
00000100:00100000:2.0:1767318672.281697:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291874176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 713us (9843us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318672.281704:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3784
00000100:00080000:3.0:1767318672.285405:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767318672.856038:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318672.859997:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318672.860021:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379563136:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318672.860096:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318672.862317:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563136
00000100:00100000:2.0:1767318672.862336:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563136
00000100:00100000:2.0:1767318672.862424:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987
00000100:00100000:2.0:1767318672.862435:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379563136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318672.862472:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318672.862571:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379563136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (2475us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318672.862589:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987
00000100:00080000:3.0:1767318672.862716:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318672.862808:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379563136:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318673.881088:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318674.904070:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318675.415161:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318675.415174:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318675.415197:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318675.415201:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318675.415206:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318675.415215:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3572
00000100:00080000:3.0:1767318675.415220:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318675.415229:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318675.415267:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164379563264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318675.415299:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318675.415303:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318675.415305:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318675.415309:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3572
00000100:00080000:3.0:1767318675.415312:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318675.415316:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318675.415331:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e300 x1853164379563392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318675.415387:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379563264:0@lo:38:kworker.0
00000100:00080000:3.0:1767318675.415412:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318675.415418:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318675.415420:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318675.415425:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3572
00000100:00080000:3.0:1767318675.415428:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318675.415432:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318675.415447:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c380 x1853164379563904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318675.415482:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318675.415486:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318675.415488:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318675.415492:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3572
00000100:00080000:3.0:1767318675.415495:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318675.415500:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318675.415516:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318675.415521:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ea00 x1853164379564160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318675.415574:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379563776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318675.415613:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379563392:0@lo:38:kworker.0
00000100:00100000:0.0:1767318675.415642:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318675.415669:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379563904:0@lo:38:kworker.0
00000100:00100000:0.0:1767318675.415693:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318675.415724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379564160:0@lo:38:kworker.0
00000100:00100000:2.0:1767318675.415727:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563392
00000100:00100000:2.0:1767318675.415738:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563392
00000100:00100000:0.0:1767318675.415750:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318675.415791:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563264
00000100:00100000:0.0:1767318675.415799:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563264
00000100:00100000:2.0:1767318675.415801:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849
00000100:00100000:2.0:1767318675.415811:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379563392:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318675.415832:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563904
00000100:00100000:0.0:1767318675.415838:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563904
00010000:00020000:2.0:1767318675.415849:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318675.415852:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564160
00000100:00100000:0.0:1767318675.415856:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564160
00000100:00100000:0.0:1767318675.415901:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16348
00000100:00100000:0.0:1767318675.415909:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379563264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318675.415930:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318675.416013:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379563520:0@lo:400:kworker.0
00000100:00100000:0.0:1767318675.416658:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379563264:12345-0@lo:38:kworker.0 Request processed in 745us (1142us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318675.416669:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16348
00000100:00100000:0.0:1767318675.416694:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16349
00000100:00100000:0.0:1767318675.416698:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379563904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318675.416711:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318675.416741:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379563904:12345-0@lo:38:kworker.0 Request processed in 41us (1049us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318675.416747:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16349
00000100:00100000:0.0:1767318675.416758:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16350
00000100:00100000:0.0:1767318675.416780:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379564160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318675.416791:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318675.416819:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379564160:12345-0@lo:38:kworker.0 Request processed in 38us (1069us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318675.416825:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16350
00000100:00080000:0.0:1767318675.416899:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318675.416905:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318675.416909:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379563904:0@lo:38:kworker.0
00000100:00080000:0.0:1767318675.416920:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318675.416924:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318675.416927:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379564160:0@lo:38:kworker.0
00000100:00080000:0.0:1767318675.416935:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318675.416938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318675.416941:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379563264:0@lo:38:kworker.0
00000100:00080000:0.0:1767318675.416951:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318675.416954:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318675.416957:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379563392:0@lo:38:kworker.0
00000100:00100000:2.0:1767318675.418709:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379563392:12345-0@lo:38:kworker.0 Request processed in 2888us (3056us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318675.418726:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849
00000100:00100000:2.0:1767318675.418806:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379564032:0@lo:400:kworker.0
00000100:00100000:2.0:1767318675.418863:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318675.419204:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379563648:0@lo:400:kworker.0
00000100:00100000:0.0:1767318675.419276:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318675.419845:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563648
00000100:00100000:0.0:1767318675.419857:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563648
00000100:00100000:0.0:1767318675.419966:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239
00000100:00100000:0.0:1767318675.419978:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379563648:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318675.420070:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564032
00000100:00100000:2.0:1767318675.420080:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564032
00000100:00100000:2.0:1767318675.420138:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785
00000100:00100000:2.0:1767318675.420148:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379564032:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318675.420323:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379564032:12345-0@lo:400:kworker.0 Request processed in 177us (1459us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318675.420332:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785
00000100:00100000:2.0:1767318675.420375:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379564032:0@lo:400:kworker.0
00000100:00080000:2.0:1767318675.420485:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318675.420490:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318675.421483:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379563648:12345-0@lo:400:kworker.0 Request processed in 1500us (2202us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318675.421516:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239
00000100:00100000:2.0:1767318675.422053:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379563648:0@lo:400:kworker.0
00000100:00100000:1.0:1767318675.423529:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318675.423529:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318675.423638:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563776
00000100:00100000:2.0:1767318675.423647:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563776
00000100:00100000:2.0:1767318675.423713:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786
00000100:00100000:2.0:1767318675.423724:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379563776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318675.424267:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379563520
00000100:00100000:0.0:1767318675.424283:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379563520
00000100:00100000:2.0:1767318675.425154:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379563776:12345-0@lo:400:kworker.0 Request processed in 1427us (1643us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318675.425243:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786
00000100:00080000:3.0:1767318675.425667:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318675.425676:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240
00000100:00080000:3.0:1767318675.425678:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318675.425700:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379563520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318675.425741:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379563776:0@lo:400:kworker.0
00000100:00100000:0.0:1767318675.425804:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379563520:12345-0@lo:400:kworker.0 Request processed in 114us (2299us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318675.425814:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240
00000100:00100000:3.0:1767318675.425847:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379563520:0@lo:400:kworker.0
00010000:00010000:3.0:1767318675.927451:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318676.440717:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318676.440739:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379564288:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318676.440807:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318676.441434:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564288
00000100:00100000:0.0:1767318676.441444:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564288
00000100:00100000:0.0:1767318676.441501:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988
00000100:00100000:0.0:1767318676.441511:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379564288:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318676.441558:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318676.441616:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379564288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (808us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318676.441623:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988
00000100:00100000:1.0:1767318676.445132:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379564288:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318676.951242:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318677.394536:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318677.394615:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318677.394720:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291874432
00000100:00100000:1.0:1767318677.394732:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291874432
00000100:00100000:1.0:1767318677.394822:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291874304
00000100:00100000:1.0:1767318677.394825:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291874304
00000100:00100000:1.0:1767318677.394844:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3787
00000100:00100000:1.0:1767318677.394855:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291874432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318677.394976:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291874432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (452us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318677.394984:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3787
00000100:00100000:1.0:1767318677.395008:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16351
00000100:00100000:1.0:1767318677.395013:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291874304:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318677.395049:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318677.395076:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291874304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 62us (461us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318677.395083:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16351
00000100:00080000:2.0:1767318677.395339:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318677.976755:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379564416:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318677.976894:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1767318677.978771:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318677.979417:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564416
00000100:00100000:3.0:1767318677.979431:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564416
00000100:00100000:3.0:1767318677.979530:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989
00000100:00100000:3.0:1767318677.979551:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379564416:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318677.979593:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767318677.979712:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318677.980126:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379564416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 577us (3256us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318677.980136:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989
00000100:00100000:1.0:1767318677.980246:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379564416:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318678.999801:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318680.023266:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318680.536240:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318680.536254:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318680.536258:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318680.536263:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318680.536268:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318680.536278:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3577
00000100:00080000:1.0:1767318680.536284:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318680.536293:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318680.536345:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5c00 x1853164379564544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318680.536377:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318680.536381:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318680.536383:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318680.536388:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3577
00000100:00080000:1.0:1767318680.536391:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318680.536395:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318680.536406:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5f80 x1853164379564672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318680.536485:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318680.536488:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318680.536509:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318680.536522:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3577
00000100:00080000:1.0:1767318680.536525:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318680.536529:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318680.536543:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6d80 x1853164379565184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318680.536560:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318680.536564:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318680.536565:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318680.536569:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3577
00000100:00080000:1.0:1767318680.536572:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318680.536576:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318680.536585:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7ea00 x1853164379565440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318680.536625:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379565312:0@lo:400:kworker.0
00000100:00100000:1.0:1767318680.536704:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318680.536773:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318680.536779:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379565056:0@lo:400:kworker.0
00000100:00100000:1.0:1767318680.536801:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318680.537090:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565312
00000100:00100000:0.0:1767318680.537101:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565312
00000100:00100000:0.0:1767318680.537170:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565056
00000100:00100000:0.0:1767318680.537173:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565056
00000100:00100000:0.0:1767318680.537198:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788
00000100:00100000:0.0:1767318680.537209:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379565312:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318680.537280:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379565312:12345-0@lo:400:kworker.0 Request processed in 71us (574us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318680.537288:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788
00000100:00100000:0.0:1767318680.537306:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789
00000100:00100000:0.0:1767318680.537312:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379565056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318680.537344:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379565056:12345-0@lo:400:kworker.0 Request processed in 33us (542us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318680.537350:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789
00000100:00100000:0.0:1767318680.537379:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379564544:0@lo:38:kworker.0
00000100:00100000:0.0:1767318680.537404:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318680.537424:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379564672:0@lo:38:kworker.0
00000100:00100000:0.0:1767318680.537446:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318680.537465:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379565184:0@lo:38:kworker.0
00000100:00100000:0.0:1767318680.537482:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318680.537493:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379565440:0@lo:38:kworker.0
00000100:00100000:0.0:1767318680.537521:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318680.537548:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564672
00000100:00100000:0.0:1767318680.537552:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564672
00000100:00100000:0.0:1767318680.537571:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850
00000100:00100000:0.0:1767318680.537576:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379564672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318680.537599:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318680.537646:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379564672:12345-0@lo:38:kworker.0 Request processed in 68us (198us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318680.537652:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850
00000100:00100000:0.0:1767318680.537666:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564544
00000100:00100000:0.0:1767318680.537669:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564544
00000100:00100000:0.0:1767318680.537684:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565184
00000100:00100000:0.0:1767318680.537687:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565184
00000100:00100000:0.0:1767318680.537696:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565440
00000100:00100000:0.0:1767318680.537698:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565440
00000100:00100000:0.0:1767318680.537707:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16352
00000100:00100000:0.0:1767318680.537718:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379564544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318680.537728:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318680.537751:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379564544:12345-0@lo:38:kworker.0 Request processed in 33us (347us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318680.537757:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16352
00000100:00100000:0.0:1767318680.537767:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16353
00000100:00100000:0.0:1767318680.537771:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379565184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318680.537779:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318680.537796:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379565184:12345-0@lo:38:kworker.0 Request processed in 24us (313us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318680.537801:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16353
00000100:00100000:0.0:1767318680.537810:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16354
00000100:00100000:0.0:1767318680.537813:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379565440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318680.537821:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318680.537836:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379565440:12345-0@lo:38:kworker.0 Request processed in 22us (326us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318680.537841:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16354
00000100:00080000:0.0:1767318680.537909:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318680.537914:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318680.537918:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379564544:0@lo:38:kworker.0
00000100:00080000:0.0:1767318680.538062:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318680.538065:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318680.538068:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379564672:0@lo:38:kworker.0
00000100:00080000:0.0:1767318680.538075:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318680.538083:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318680.538086:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379565184:0@lo:38:kworker.0
00000100:00080000:0.0:1767318680.538094:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318680.538097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318680.538100:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379565440:0@lo:38:kworker.0
00000100:00100000:0.0:1767318680.538142:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379565056:0@lo:400:kworker.0
00000100:00100000:0.0:1767318680.538152:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379565312:0@lo:400:kworker.0
00000100:00100000:2.0:1767318680.538326:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379564928:0@lo:400:kworker.0
00000100:00100000:2.0:1767318680.538369:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318680.538398:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318680.538404:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379564800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318680.538424:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318680.538498:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564928
00000100:00100000:0.0:1767318680.538503:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564928
00000100:00100000:0.0:1767318680.538558:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241
00000100:00100000:0.0:1767318680.538564:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379564928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318680.538599:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379564928:12345-0@lo:400:kworker.0 Request processed in 35us (230us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318680.538605:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241
00000100:00100000:3.0:1767318680.538726:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379564800
00000100:00100000:3.0:1767318680.538731:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379564800
00000100:00100000:3.0:1767318680.538759:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242
00000100:00100000:3.0:1767318680.538765:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379564800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318680.538803:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379564800:12345-0@lo:400:kworker.0 Request processed in 38us (377us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318680.538809:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242
00000100:00080000:1.0:1767318680.544096:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318680.544110:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318680.544115:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318680.544270:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379564800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318680.544289:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379564928:0@lo:400:kworker.0
00010000:00010000:3.0:1767318681.047333:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318681.559317:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379565568:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318681.559440:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318681.559786:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565568
00000100:00100000:0.0:1767318681.559797:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565568
00000100:00100000:0.0:1767318681.559893:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990
00000100:00100000:0.0:1767318681.559905:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379565568:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318681.559943:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318681.560001:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379565568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (561us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318681.560010:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990
00000100:00100000:3.0:1767318681.560258:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379565568:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318682.072099:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318682.519719:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318682.519849:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291874560
00000100:00100000:0.0:1767318682.519860:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291874560
00000100:00100000:0.0:1767318682.519947:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16355
00000100:00100000:0.0:1767318682.519971:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291874560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318682.520010:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318682.520085:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291874560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 114us (376us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318682.520093:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16355
00000100:00100000:3.0:1767318682.520721:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318682.521115:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291874688
00000100:00100000:1.0:1767318682.521123:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291874688
00000100:00100000:1.0:1767318682.521214:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3790
00000100:00100000:1.0:1767318682.521225:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291874688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318682.521392:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291874688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (602us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318682.521402:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3790
00000100:00080000:3.0:1767318682.521909:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318683.095709:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318683.097012:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379565696:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318683.097143:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318683.097269:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565696
00000100:00100000:3.0:1767318683.097285:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565696
00000100:00100000:3.0:1767318683.097401:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991
00000100:00100000:3.0:1767318683.097415:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379565696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318683.097468:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318683.097597:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318683.110592:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379565696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13163us (13430us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318683.110611:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991
00000100:00100000:0.0:1767318683.116509:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379565696:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318684.121789:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318685.144364:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318685.655693:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318685.655710:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318685.655714:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318685.655720:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318685.655726:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318685.655739:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3582
00000100:00080000:1.0:1767318685.655746:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318685.655757:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318685.655824:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dca80 x1853164379565824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318685.655857:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318685.655861:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318685.655864:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318685.655888:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3582
00000100:00080000:1.0:1767318685.655891:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318685.655897:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318685.655913:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379565952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318685.655993:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318685.656016:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318685.656019:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318685.656023:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3582
00000100:00080000:1.0:1767318685.656026:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318685.656030:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318685.656045:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379566464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318685.656064:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318685.656068:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318685.656070:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318685.656074:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3582
00000100:00080000:1.0:1767318685.656077:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318685.656081:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318685.656094:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddf80 x1853164379566720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318685.656128:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379566336:0@lo:400:kworker.0
00000100:00100000:1.0:1767318685.656236:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318685.656313:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318685.656319:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379566592:0@lo:400:kworker.0
00000100:00100000:1.0:1767318685.656342:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318685.656562:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379566080:0@lo:400:kworker.0
00000100:00100000:2.0:1767318685.656604:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318685.656646:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318685.656652:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379566208:0@lo:400:kworker.0
00000100:00100000:2.0:1767318685.656675:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318685.656758:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566080
00000100:00100000:3.0:1767318685.656770:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566080
00000100:00100000:3.0:1767318685.656863:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566208
00000100:00100000:3.0:1767318685.656891:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566208
00000100:00100000:3.0:1767318685.656922:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243
00000100:00100000:3.0:1767318685.656933:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379566080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318685.657008:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379566080:12345-0@lo:400:kworker.0 Request processed in 77us (403us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318685.657017:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243
00000100:00100000:3.0:1767318685.657038:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244
00000100:00100000:3.0:1767318685.657044:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379566208:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318685.657073:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379566208:12345-0@lo:400:kworker.0 Request processed in 29us (397us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318685.657078:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244
00000100:00100000:3.0:1767318685.657138:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379566208:0@lo:400:kworker.0
00000100:00100000:3.0:1767318685.657150:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379566080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318685.657935:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566336
00000100:00100000:0.0:1767318685.657947:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566336
00000100:00100000:0.0:1767318685.658002:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566592
00000100:00100000:0.0:1767318685.658006:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566592
00000100:00100000:0.0:1767318685.658034:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791
00000100:00100000:0.0:1767318685.658043:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379566336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318685.658115:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379566336:12345-0@lo:400:kworker.0 Request processed in 74us (1879us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318685.658123:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791
00000100:00100000:0.0:1767318685.658139:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792
00000100:00100000:0.0:1767318685.658145:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379566592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318685.659324:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379565824:0@lo:38:kworker.0
00000100:00100000:3.0:1767318685.659759:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318685.660535:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379566592:12345-0@lo:400:kworker.0 Request processed in 2373us (4175us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318685.660551:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792
00000100:00100000:0.0:1767318685.660601:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565824
00000100:00100000:0.0:1767318685.660611:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565824
00000100:00100000:0.0:1767318685.660659:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16356
00000100:00100000:0.0:1767318685.660666:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379565824:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318685.660712:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318685.660780:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379565824:12345-0@lo:38:kworker.0 Request processed in 114us (1023us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318685.660788:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16356
00000100:00100000:0.0:1767318685.660889:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379566592:0@lo:400:kworker.0
00000100:00100000:0.0:1767318685.660908:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379566336:0@lo:400:kworker.0
00000100:00080000:2.0:1767318685.662045:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318685.662057:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318685.662060:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318685.667600:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318685.667616:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318685.667622:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379565824:0@lo:38:kworker.0
00000100:00100000:3.0:1767318685.667635:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379565952:0@lo:38:kworker.0
00000100:00100000:3.0:1767318685.667692:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318685.667741:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379566464:0@lo:38:kworker.0
00000100:00100000:3.0:1767318685.667763:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318685.667785:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379566720:0@lo:38:kworker.0
00000100:00100000:3.0:1767318685.667818:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318685.668158:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379565952
00000100:00100000:2.0:1767318685.668165:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379565952
00000100:00100000:2.0:1767318685.668215:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851
00000100:00100000:2.0:1767318685.668222:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379565952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318685.668244:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318685.668288:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379565952:12345-0@lo:38:kworker.0 Request processed in 66us (596us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318685.668296:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851
00000100:00080000:3.0:1767318685.669509:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318685.669518:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318685.669523:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379565952:0@lo:38:kworker.0
00000100:00100000:0.0:1767318685.669568:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566464
00000100:00100000:0.0:1767318685.669584:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566464
00000100:00100000:0.0:1767318685.669648:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566720
00000100:00100000:0.0:1767318685.669653:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566720
00000100:00100000:0.0:1767318685.669689:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16357
00000100:00100000:0.0:1767318685.669698:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379566464:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318685.669729:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318685.669837:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379566464:12345-0@lo:38:kworker.0 Request processed in 138us (2071us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318685.669850:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16357
00000100:00100000:3.0:1767318685.669861:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16358
00000100:00100000:3.0:1767318685.669924:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379566720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318685.669946:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318685.671247:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318685.671255:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318685.671260:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379566464:0@lo:38:kworker.0
00000100:00100000:2.0:1767318685.673015:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379566720:12345-0@lo:38:kworker.0 Request processed in 3082us (5184us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318685.673034:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16358
00000100:00080000:3.0:1767318685.674522:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318685.674534:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318685.674540:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379566720:0@lo:38:kworker.0
00010000:00010000:2.0:1767318686.167118:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767318686.607662:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291874816 offset 0 length 520: 4
00000100:00100000:3.0:1767318686.607741:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318686.608668:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291874944
00000100:00100000:2.0:1767318686.608684:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291874944
00000100:00100000:2.0:1767318686.608765:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16359
00000100:00100000:2.0:1767318686.608776:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291874944:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318686.608808:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318686.608957:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291874944:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 180us (1216us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318686.608966:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16359
00000100:00100000:0.0:1767318686.615621:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318686.615734:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875072
00000100:00100000:2.0:1767318686.615746:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875072
00000100:00100000:2.0:1767318686.615846:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3793
00000100:00100000:2.0:1767318686.615859:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291875072:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767318686.616186:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318686.616464:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291875072:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 597us (847us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318686.616476:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3793
00000100:00100000:3.0:1767318686.681674:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379566848:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318686.681779:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318686.682777:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566848
00000100:00100000:0.0:1767318686.682793:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566848
00000100:00100000:0.0:1767318686.682892:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992
00000100:00100000:0.0:1767318686.682905:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379566848:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318686.682947:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318686.683041:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379566848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (1261us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318686.683050:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992
00000100:00100000:3.0:1767318686.683400:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379566848:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318687.191221:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318688.218141:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318688.218370:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379566976:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318688.218491:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318688.218637:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379566976
00000100:00100000:3.0:1767318688.218646:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379566976
00000100:00100000:3.0:1767318688.218712:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993
00000100:00100000:3.0:1767318688.218722:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379566976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318688.218758:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318688.218808:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379566976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (317us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318688.218816:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993
00000100:00100000:1.0:1767318688.221300:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379566976:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318688.229467:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767318689.244742:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318690.263344:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318690.775366:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318690.775378:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318690.775382:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318690.775386:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318690.775390:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318690.775399:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3588
00000100:00080000:1.0:1767318690.775404:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318690.775410:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318690.775462:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df800 x1853164379567104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318690.775489:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318690.775492:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318690.775494:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318690.775498:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3588
00000100:00080000:1.0:1767318690.775501:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318690.775504:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318690.775518:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379567232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318690.775764:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379567360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.775847:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318690.776001:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318690.776009:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379567488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.776037:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318690.776227:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379567360
00000100:00100000:0.0:1767318690.776235:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379567360
00000100:00100000:0.0:1767318690.776297:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379567488
00000100:00100000:0.0:1767318690.776301:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379567488
00000100:00100000:0.0:1767318690.776324:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245
00000100:00100000:0.0:1767318690.776333:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379567360:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318690.776449:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318690.776454:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318690.776537:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318690.776541:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318690.776543:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318690.776547:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3588
00000100:00080000:1.0:1767318690.776550:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318690.776554:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318690.776731:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318665/real 1767318665]  req@ffff8b0e0a2eca80 x1853164379560576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318690 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318690.776758:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0a2eca80 x1853164379560576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318690 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318690.776773:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379567104:0@lo:38:kworker.0
00000100:00100000:3.0:1767318690.776816:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318690.776848:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379567232:0@lo:38:kworker.0
00000100:00100000:3.0:1767318690.776887:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318690.776922:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318690.777016:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318690.777020:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379560576:0@lo:250:kworker.0
00000100:00100000:2.0:1767318690.777170:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379567616:0@lo:400:kworker.0
00000100:00100000:2.0:1767318690.777199:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318690.777357:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379567360:12345-0@lo:400:kworker.0 Request processed in 1025us (1509us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318690.777366:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245
00000100:00100000:0.0:1767318690.777386:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246
00000100:00100000:0.0:1767318690.777394:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379567488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.777432:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379567488:12345-0@lo:400:kworker.0 Request processed in 40us (1395us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318690.777439:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246
00000100:00100000:0.0:1767318690.777457:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379567104
00000100:00100000:0.0:1767318690.777462:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379567104
00000100:00100000:0.0:1767318690.777484:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379567616
00000100:00100000:0.0:1767318690.777487:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379567616
00000100:00100000:0.0:1767318690.777516:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794
00000100:00100000:0.0:1767318690.777522:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379567616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.777554:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379567616:12345-0@lo:400:kworker.0 Request processed in 33us (354us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318690.777573:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794
00000100:00100000:1.0:1767318690.777694:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379567744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318690.777721:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318690.777725:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318690.777727:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318690.777731:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3588
00000100:00080000:1.0:1767318690.777734:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318690.777738:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318690.777751:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dca80 x1853164379568000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318690.777765:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318690.777769:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318690.777770:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318690.777773:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3567
00000100:00080000:1.0:1767318690.777775:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318690.777779:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318690.777789:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc000 x1853164379568128/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318690.777811:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379567872:0@lo:400:kworker.0
00000100:00100000:1.0:1767318690.777839:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318690.777888:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379567872
00000100:00100000:1.0:1767318690.777892:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379567872
00000100:00100000:1.0:1767318690.777919:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795
00000100:00100000:1.0:1767318690.777925:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379567872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.779135:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16360
00000100:00100000:0.0:1767318690.779144:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379567104:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318690.779165:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318690.779226:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379567104:12345-0@lo:38:kworker.0 Request processed in 80us (2407us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318690.779234:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16360
00000100:00100000:0.0:1767318690.779319:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379567488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.779335:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379567360:0@lo:400:kworker.0
00000100:00080000:0.0:1767318690.779415:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318690.779454:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379567616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.779491:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379567232
00000100:00100000:0.0:1767318690.779497:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379567232
00000100:00100000:0.0:1767318690.779532:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852
00000100:00100000:0.0:1767318690.779536:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379567232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318690.779546:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318690.779574:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379567232:12345-0@lo:38:kworker.0 Request processed in 37us (2687us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318690.779580:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852
00000100:00100000:1.0:1767318690.779707:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379567872:12345-0@lo:400:kworker.0 Request processed in 1780us (1865us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318690.779730:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795
00000100:00100000:1.0:1767318690.779771:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379567872:0@lo:400:kworker.0
00000100:00100000:0.0:1767318690.810260:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379567744:0@lo:38:kworker.0
00000100:00100000:0.0:1767318690.810350:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318690.810402:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379568000:0@lo:38:kworker.0
00000100:00100000:0.0:1767318690.810437:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318690.810604:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379568128:0@lo:250:kworker.0
00000400:00000100:0.0:1767318690.810629:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379568128 offset 0 length 520: 4
00000100:00080000:0.0:1767318690.810680:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318690.810686:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318690.810690:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379567104:0@lo:38:kworker.0
00000100:00080000:0.0:1767318690.810704:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318690.810707:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318690.810710:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379567232:0@lo:38:kworker.0
00000100:00100000:2.0:1767318690.821852:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379567744
00000100:00100000:2.0:1767318690.821882:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379567744
00000100:00100000:2.0:1767318690.821944:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379568000
00000100:00100000:2.0:1767318690.821947:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379568000
00000100:00100000:2.0:1767318690.821987:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16361
00000100:00100000:2.0:1767318690.821996:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379567744:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318690.822018:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318690.822284:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379567744:12345-0@lo:38:kworker.0 Request processed in 288us (11933us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318690.822292:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16361
00000100:00100000:2.0:1767318690.822309:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16362
00000100:00100000:2.0:1767318690.822312:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379568000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318690.822322:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318690.822344:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379568000:12345-0@lo:38:kworker.0 Request processed in 31us (11907us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318690.822350:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16362
00000100:00080000:2.0:1767318690.822393:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318690.822398:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318690.822402:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379567744:0@lo:38:kworker.0
00000100:00080000:2.0:1767318690.822412:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318690.822416:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318690.822448:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379568000:0@lo:38:kworker.0
00010000:00010000:1.0:1767318691.288058:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318691.726963:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318691.727254:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875328
00000100:00100000:0.0:1767318691.727265:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875328
00000100:00100000:0.0:1767318691.727353:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3796
00000100:00100000:0.0:1767318691.727364:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291875328:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318691.727455:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291875328:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (501us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318691.727464:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3796
00000100:00080000:2.0:1767318691.727801:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318691.733857:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318691.734815:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875200
00000100:00100000:0.0:1767318691.734827:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875200
00000100:00100000:0.0:1767318691.735042:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16363
00000100:00100000:0.0:1767318691.735054:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291875200:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318691.735079:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318691.735157:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291875200:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 104us (1309us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318691.744118:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16363
00000100:00100000:0.0:1767318691.800540:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379568256:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318691.800637:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318691.800690:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379568256
00000100:00100000:0.0:1767318691.800698:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379568256
00000100:00100000:0.0:1767318691.800747:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994
00000100:00100000:0.0:1767318691.800756:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379568256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318691.800785:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318691.800839:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379568256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (201us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318691.800846:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994
00000100:00100000:0.0:1767318691.800916:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379568256:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318692.311538:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318693.335208:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318693.335233:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379568384:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318693.335418:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318693.335458:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379568384
00000100:00100000:0.0:1767318693.335469:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379568384
00000100:00100000:0.0:1767318693.335549:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995
00000100:00100000:0.0:1767318693.335562:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379568384:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318693.335753:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:0.0:1767318693.335983:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318693.336038:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379568384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 479us (728us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318693.336046:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995
00000100:00100000:3.0:1767318693.336089:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379568384:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318693.336571:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318694.359180:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318695.383227:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318695.895044:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318695.895200:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318695.895205:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318695.895209:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318695.895216:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318695.895227:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3593
00000100:00080000:1.0:1767318695.895233:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318695.895243:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318695.895399:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379568512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318695.895479:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379568512:0@lo:38:kworker.0
00000100:00100000:2.0:1767318695.895593:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318695.895840:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379568512
00000100:00100000:0.0:1767318695.895852:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379568512
00000100:00100000:0.0:1767318695.895936:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16364
00000100:00100000:0.0:1767318695.895945:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379568512:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318695.895970:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318695.899523:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318695.899534:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318695.899538:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318695.899545:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3593
00000100:00080000:1.0:1767318695.899550:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318695.899558:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318695.899611:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164379568640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318695.899702:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379568640:0@lo:38:kworker.0
00000100:00100000:2.0:1767318695.899949:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318695.900084:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379568640
00000100:00100000:3.0:1767318695.900095:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379568640
00000100:00100000:3.0:1767318695.900141:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853
00000100:00100000:3.0:1767318695.900150:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379568640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318695.900173:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318695.900224:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379568640:12345-0@lo:38:kworker.0 Request processed in 74us (275us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318695.900247:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853
00000100:00100000:0.0:1767318695.900627:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379568512:12345-0@lo:38:kworker.0 Request processed in 4680us (5031us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318695.900637:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16364
00000100:00100000:0.0:1767318695.900857:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379568768:0@lo:400:kworker.0
00000100:00100000:0.0:1767318695.901300:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318695.901458:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318695.901464:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318695.901469:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379568512:0@lo:38:kworker.0
00000100:00080000:2.0:1767318695.901498:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318695.901502:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318695.901505:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379568640:0@lo:38:kworker.0
00000100:00100000:2.0:1767318695.901632:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379568896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318695.901658:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318695.901768:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318695.901782:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318695.901786:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318695.901792:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3593
00000100:00080000:1.0:1767318695.901796:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318695.901802:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318695.901825:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dca80 x1853164379569152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318695.901846:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318695.901849:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318695.901851:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318695.901854:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3593
00000100:00080000:1.0:1767318695.901856:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318695.901860:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318695.901884:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379569408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318695.901926:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379569280:0@lo:400:kworker.0
00000100:00100000:1.0:1767318695.901956:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318695.902285:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569280
00000100:00100000:0.0:1767318695.902293:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569280
00000100:00100000:0.0:1767318695.902349:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797
00000100:00100000:0.0:1767318695.902359:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379569280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318695.902416:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379569280:12345-0@lo:400:kworker.0 Request processed in 59us (459us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318695.902423:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797
00000100:00080000:0.0:1767318695.902466:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318695.902480:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379569152:0@lo:38:kworker.0
00000100:00100000:0.0:1767318695.902511:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318695.902527:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379569408:0@lo:38:kworker.0
00000100:00100000:0.0:1767318695.902547:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318695.902572:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569152
00000100:00100000:0.0:1767318695.902575:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569152
00000100:00100000:0.0:1767318695.902593:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569408
00000100:00100000:0.0:1767318695.902596:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569408
00000100:00100000:0.0:1767318695.902611:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16365
00000100:00100000:0.0:1767318695.902616:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379569152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318695.902635:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318695.902666:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379569152:12345-0@lo:38:kworker.0 Request processed in 48us (154us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318695.902672:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16365
00000100:00100000:0.0:1767318695.902684:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16366
00000100:00100000:0.0:1767318695.902688:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379569408:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318695.902696:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318695.902730:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379569408:12345-0@lo:38:kworker.0 Request processed in 40us (181us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318695.902735:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16366
00000100:00080000:0.0:1767318695.902763:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318695.902766:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318695.902769:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379569152:0@lo:38:kworker.0
00000100:00080000:0.0:1767318695.902776:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318695.902779:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318695.902781:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379569408:0@lo:38:kworker.0
00000100:00100000:0.0:1767318695.902827:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379569024:0@lo:400:kworker.0
00000100:00100000:0.0:1767318695.902851:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318695.902914:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569024
00000100:00100000:0.0:1767318695.902918:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569024
00000100:00100000:0.0:1767318695.902943:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798
00000100:00100000:0.0:1767318695.902948:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379569024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318695.902995:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379569024:12345-0@lo:400:kworker.0 Request processed in 32us (129us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318695.903001:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798
00000100:00100000:1.0:1767318695.903402:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379569280:0@lo:400:kworker.0
00000100:00100000:0.0:1767318695.904316:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379569024:0@lo:400:kworker.0
00000100:00080000:1.0:1767318695.904395:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318695.904511:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379568768
00000100:00100000:3.0:1767318695.904519:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379568768
00000100:00080000:1.0:1767318695.904638:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318695.904679:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379568896
00000100:00100000:3.0:1767318695.904684:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379568896
00000100:00080000:1.0:1767318695.904739:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318695.904858:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247
00000100:00100000:2.0:1767318695.904899:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379568768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318695.905424:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379568768:12345-0@lo:400:kworker.0 Request processed in 556us (4123us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318695.905434:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247
00000100:00100000:2.0:1767318695.905457:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248
00000100:00100000:2.0:1767318695.905464:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379568896:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318695.905503:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379568896:12345-0@lo:400:kworker.0 Request processed in 40us (3843us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318695.905513:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248
00000100:00100000:1.0:1767318695.905644:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379568768:0@lo:400:kworker.0
00000100:00100000:3.0:1767318695.905829:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379568896:0@lo:400:kworker.0
00010000:00010000:1.0:1767318696.407471:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318696.850154:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318696.850794:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875584
00000100:00100000:0.0:1767318696.850809:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875584
00000100:00100000:0.0:1767318696.850979:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3799
00000100:00100000:0.0:1767318696.850992:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291875584:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318696.851269:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291875584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 279us (1127us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318696.851295:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3799
00000100:00080000:1.0:1767318696.853358:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318696.856069:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318696.857001:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875456
00000100:00100000:0.0:1767318696.857018:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875456
00000100:00100000:0.0:1767318696.857673:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16367
00000100:00100000:0.0:1767318696.857684:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291875456:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318696.857709:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318696.857806:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291875456:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 122us (1749us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318696.857815:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16367
00000100:00100000:3.0:1767318696.919463:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379569536:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318696.919565:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318696.919748:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569536
00000100:00100000:1.0:1767318696.919758:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569536
00000100:00100000:1.0:1767318696.919831:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996
00000100:00100000:1.0:1767318696.919839:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379569536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318696.919893:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318696.928135:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379569536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8282us (8557us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318696.928157:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996
00000100:00100000:3.0:1767318696.928336:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379569536:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318697.431398:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318698.455131:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318698.455196:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379569664:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318698.455274:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318698.455499:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569664
00000100:00100000:1.0:1767318698.455509:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569664
00000100:00080000:0.0:1767318698.455642:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318698.455682:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997
00000100:00100000:1.0:1767318698.455694:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379569664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318698.455726:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318698.455782:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379569664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (508us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318698.455790:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997
00000100:00100000:0.0:1767318698.455896:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379569664:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318699.480572:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318700.503808:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318701.015241:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318701.015253:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318701.015256:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318701.015260:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318701.015265:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318701.015273:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3598
00000100:00080000:3.0:1767318701.015278:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318701.015285:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318701.015341:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680a80 x1853164379569792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318701.015373:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318701.015376:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318701.015378:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318701.015383:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3598
00000100:00080000:3.0:1767318701.015403:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318701.015407:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318701.015428:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e0380 x1853164379569920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318701.015497:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318701.015500:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318701.015502:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318701.015506:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3598
00000100:00080000:3.0:1767318701.015509:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318701.015513:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318701.015524:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3480 x1853164379570432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318701.015538:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318701.015542:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318701.015543:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318701.015547:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3598
00000100:00080000:3.0:1767318701.015550:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318701.015555:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318701.015568:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ce00 x1853164379570688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318701.015603:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379570304:0@lo:400:kworker.0
00000100:00100000:3.0:1767318701.015681:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318701.015832:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570304
00000100:00100000:2.0:1767318701.015840:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379570048:0@lo:400:kworker.0
00000100:00100000:0.0:1767318701.015841:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570304
00000100:00100000:0.0:1767318701.015936:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800
00000100:00100000:0.0:1767318701.015947:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379570304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318701.016070:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318701.016078:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379570560:0@lo:400:kworker.0
00000100:00100000:1.0:1767318701.016138:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379570176:0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.018236:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.018353:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570048
00000100:00100000:2.0:1767318701.018366:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570048
00000100:00100000:2.0:1767318701.018439:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249
00000100:00100000:2.0:1767318701.018451:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379570048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.018515:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379570048:12345-0@lo:400:kworker.0 Request processed in 66us (285us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318701.018523:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249
00000100:00100000:2.0:1767318701.018588:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379570048:0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.018703:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379569792:0@lo:38:kworker.0
00000100:00100000:2.0:1767318701.018743:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.018762:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379569920:0@lo:38:kworker.0
00000100:00100000:2.0:1767318701.018789:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.023423:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379570432:0@lo:38:kworker.0
00000100:00100000:2.0:1767318701.023500:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.023531:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379570688:0@lo:38:kworker.0
00000100:00100000:2.0:1767318701.023556:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.023608:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569792
00000100:00100000:2.0:1767318701.023616:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569792
00000100:00100000:2.0:1767318701.023648:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570432
00000100:00100000:2.0:1767318701.023651:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570432
00000100:00100000:2.0:1767318701.023664:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570688
00000100:00100000:2.0:1767318701.023667:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570688
00000100:00100000:2.0:1767318701.023681:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16368
00000100:00100000:2.0:1767318701.023689:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379569792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318701.023715:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318701.023762:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379569792:12345-0@lo:38:kworker.0 Request processed in 73us (5018us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318701.023769:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16368
00000100:00100000:2.0:1767318701.023786:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16369
00000100:00100000:2.0:1767318701.023791:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379570432:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318701.023816:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318701.023841:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379570432:12345-0@lo:38:kworker.0 Request processed in 49us (341us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318701.023847:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16369
00000100:00100000:2.0:1767318701.023858:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16370
00000100:00100000:2.0:1767318701.023862:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379570688:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318701.023890:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318701.023912:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379570688:12345-0@lo:38:kworker.0 Request processed in 48us (355us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318701.023918:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16370
00000100:00080000:2.0:1767318701.023954:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318701.023960:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318701.023963:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379569792:0@lo:38:kworker.0
00000100:00080000:2.0:1767318701.023972:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318701.023975:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318701.023978:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379570432:0@lo:38:kworker.0
00000100:00080000:2.0:1767318701.023988:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318701.023991:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318701.023993:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379570688:0@lo:38:kworker.0
00000100:00100000:2.0:1767318701.024047:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379569920
00000100:00100000:2.0:1767318701.024051:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379569920
00000100:00100000:2.0:1767318701.024081:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854
00000100:00100000:2.0:1767318701.024086:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379569920:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318701.024097:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318701.024133:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379569920:12345-0@lo:38:kworker.0 Request processed in 45us (5342us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318701.024139:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854
00000100:00080000:2.0:1767318701.024163:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318701.024168:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318701.024171:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379569920:0@lo:38:kworker.0
00000100:00080000:2.0:1767318701.024221:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318701.024227:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318701.026149:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379570304:12345-0@lo:400:kworker.0 Request processed in 10191us (10455us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318701.026167:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800
00000100:00100000:3.0:1767318701.026349:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318701.026418:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379570304:0@lo:400:kworker.0
00000100:00100000:0.0:1767318701.026507:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570560
00000100:00100000:0.0:1767318701.026514:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570560
00000100:00100000:0.0:1767318701.026592:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801
00000100:00100000:0.0:1767318701.026601:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379570560:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318701.026657:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379570560:12345-0@lo:400:kworker.0 Request processed in 58us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318701.026687:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801
00000100:00100000:3.0:1767318701.026845:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379570560:0@lo:400:kworker.0
00000100:00080000:2.0:1767318701.026921:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318701.027050:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318701.027105:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570176
00000100:00100000:2.0:1767318701.027120:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570176
00000100:00100000:2.0:1767318701.027179:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250
00000100:00100000:2.0:1767318701.027186:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379570176:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318701.027233:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379570176:12345-0@lo:400:kworker.0 Request processed in 47us (184us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318701.027240:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250
00000100:00100000:1.0:1767318701.027290:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379570176:0@lo:400:kworker.0
00000100:00080000:0.0:1767318701.027293:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318701.527469:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318701.974828:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318701.974919:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875840
00000100:00100000:2.0:1767318701.974931:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875840
00000100:00100000:3.0:1767318701.974964:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318701.975003:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875712
00000100:00100000:2.0:1767318701.975006:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875712
00000100:00100000:2.0:1767318701.975023:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3802
00000100:00100000:2.0:1767318701.975035:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291875840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767318701.975072:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318701.975142:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291875840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (342us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318701.975372:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16371
00000100:00100000:3.0:1767318701.975379:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291875712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318701.975414:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318701.975462:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291875712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 82us (497us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318701.975471:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16371
00000100:00100000:2.0:1767318701.979562:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3802
00000100:00100000:1.0:1767318702.048817:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318702.048853:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379570816:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318702.048990:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318702.049119:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570816
00000100:00100000:3.0:1767318702.049128:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570816
00000100:00100000:3.0:1767318702.049197:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998
00000100:00100000:3.0:1767318702.049207:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379570816:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318702.049243:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318702.049392:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379570816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 186us (401us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318702.049399:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998
00000100:00100000:1.0:1767318702.049511:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379570816:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318702.568225:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318703.576401:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318703.576430:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379570944:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318703.576440:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318703.576528:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318703.576604:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379570944
00000100:00100000:1.0:1767318703.576614:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379570944
00000100:00100000:1.0:1767318703.576701:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999
00000100:00100000:1.0:1767318703.576713:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379570944:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318703.576745:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318703.576798:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379570944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (271us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318703.576809:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999
00000100:00100000:3.0:1767318703.576849:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379570944:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318703.577761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318704.600002:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318705.624862:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318706.135086:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318706.135795:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318706.135799:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318706.135803:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318706.135807:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318706.135816:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3603
00000100:00080000:2.0:1767318706.135822:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318706.135830:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318706.142778:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46a00 x1853164379571072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318706.142834:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318706.142839:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318706.142842:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318706.142848:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3603
00000100:00080000:2.0:1767318706.142854:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318706.142861:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318706.142925:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45500 x1853164379571200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318706.142997:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318706.143000:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318706.143002:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318706.143007:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3603
00000100:00080000:2.0:1767318706.143009:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318706.143012:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318706.143025:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e1f80 x1853164379571712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318706.143042:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318706.143045:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318706.143047:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318706.143051:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3603
00000100:00080000:2.0:1767318706.143053:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318706.143058:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318706.143067:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e0380 x1853164379571968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318706.143155:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379571456:0@lo:400:kworker.0
00000100:00100000:1.0:1767318706.143253:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318706.143334:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318706.143341:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379571328:0@lo:400:kworker.0
00000100:00100000:1.0:1767318706.143366:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318706.143543:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571456
00000100:00100000:2.0:1767318706.143552:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571456
00000100:00100000:2.0:1767318706.143654:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571328
00000100:00100000:2.0:1767318706.143658:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571328
00000100:00100000:2.0:1767318706.143685:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251
00000100:00100000:2.0:1767318706.143694:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379571456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318706.143755:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379571456:12345-0@lo:400:kworker.0 Request processed in 61us (502us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318706.143763:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251
00000100:00100000:2.0:1767318706.143780:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252
00000100:00100000:2.0:1767318706.143787:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379571328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318706.143815:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379571328:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318706.143820:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252
00000100:00080000:0.0:1767318706.143899:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318706.143904:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318706.143992:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379571328:0@lo:400:kworker.0
00000100:00100000:1.0:1767318706.144004:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379571456:0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.144099:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379571584:0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.144138:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.144181:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318706.144187:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379571840:0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.144226:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.144271:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379571072:0@lo:38:kworker.0
00000100:00100000:3.0:1767318706.144305:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.144333:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379571200:0@lo:38:kworker.0
00000100:00100000:3.0:1767318706.144357:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.144384:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379571712:0@lo:38:kworker.0
00000100:00100000:3.0:1767318706.144407:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.144425:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379571968:0@lo:38:kworker.0
00000100:00100000:3.0:1767318706.144445:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318706.144474:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571200
00000100:00100000:3.0:1767318706.144478:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571200
00000100:00100000:3.0:1767318706.144502:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855
00000100:00100000:3.0:1767318706.144507:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379571200:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318706.144526:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318706.144560:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379571200:12345-0@lo:38:kworker.0 Request processed in 52us (203us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318706.144567:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855
00000100:00100000:3.0:1767318706.144584:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571584
00000100:00100000:3.0:1767318706.144588:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571584
00000100:00100000:3.0:1767318706.144616:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571840
00000100:00100000:3.0:1767318706.144619:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571840
00000100:00100000:3.0:1767318706.144633:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571072
00000100:00100000:3.0:1767318706.144635:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571072
00000100:00100000:3.0:1767318706.144642:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571712
00000100:00100000:3.0:1767318706.144644:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571712
00000100:00100000:3.0:1767318706.144651:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379571968
00000100:00100000:3.0:1767318706.144653:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379571968
00000100:00100000:3.0:1767318706.144673:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803
00000100:00100000:3.0:1767318706.144680:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379571584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.144721:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379571584:12345-0@lo:400:kworker.0 Request processed in 42us (581us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318706.144726:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803
00000100:00100000:3.0:1767318706.144738:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804
00000100:00100000:3.0:1767318706.144744:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379571840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.144769:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379571840:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318706.144774:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804
00000100:00100000:3.0:1767318706.144784:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16372
00000100:00100000:3.0:1767318706.144788:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379571072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318706.144797:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318706.144816:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379571072:12345-0@lo:38:kworker.0 Request processed in 27us (511us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318706.144821:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16372
00000100:00100000:3.0:1767318706.144830:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16373
00000100:00100000:3.0:1767318706.144833:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379571712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318706.144841:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318706.144859:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379571712:12345-0@lo:38:kworker.0 Request processed in 25us (452us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318706.144864:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16373
00000100:00100000:3.0:1767318706.144910:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16374
00000100:00100000:3.0:1767318706.144913:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379571968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318706.144921:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318706.146327:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379571968:12345-0@lo:38:kworker.0 Request processed in 1405us (1875us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318706.146340:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16374
00000100:00100000:3.0:1767318706.146415:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379571840:0@lo:400:kworker.0
00000100:00100000:3.0:1767318706.146429:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379571584:0@lo:400:kworker.0
00000100:00080000:3.0:1767318706.146477:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318706.146484:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318706.146487:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379571072:0@lo:38:kworker.0
00000100:00080000:3.0:1767318706.146500:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318706.146503:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318706.146505:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379571200:0@lo:38:kworker.0
00000100:00080000:3.0:1767318706.146516:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318706.146519:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318706.146522:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379571712:0@lo:38:kworker.0
00000100:00080000:3.0:1767318706.146530:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318706.146533:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318706.146535:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379571968:0@lo:38:kworker.0
00000100:00080000:0.0:1767318706.146825:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318706.647247:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318707.087167:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318707.087290:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318707.087593:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291876096
00000100:00100000:3.0:1767318707.087608:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291876096
00000100:00100000:3.0:1767318707.087766:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291875968
00000100:00100000:3.0:1767318707.087771:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291875968
00000100:00100000:3.0:1767318707.087795:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3805
00000100:00100000:3.0:1767318707.087811:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291876096:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318707.087957:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291876096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 138us (791us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318707.087983:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3805
00000100:00100000:3.0:1767318707.088006:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16375
00000100:00100000:3.0:1767318707.088011:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291875968:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318707.088035:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318707.088062:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291875968:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 50us (773us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318707.088070:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16375
00000100:00080000:0.0:1767318707.097248:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318707.161130:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318707.161149:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379572096:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318707.161239:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318707.161973:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572096
00000100:00100000:3.0:1767318707.161984:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572096
00000100:00100000:3.0:1767318707.162038:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000
00000100:00100000:3.0:1767318707.162047:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f302f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379572096:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318707.162076:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318707.162149:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f302f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379572096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (908us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318707.162157:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000
00000100:00100000:0.0:1767318707.162485:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379572096:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318707.674299:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318708.695821:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379572224:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318708.695936:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318708.696285:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572224
00000100:00100000:3.0:1767318708.696298:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572224
00000100:00100000:3.0:1767318708.696375:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001
00000100:00100000:3.0:1767318708.696384:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379572224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318708.696420:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767318708.699081:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318708.699700:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318708.703480:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379572224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7085us (7531us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318708.703497:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001
00000100:00100000:0.0:1767318708.715463:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379572224:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318709.720167:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318710.743064:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318711.255134:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318711.255144:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318711.255147:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318711.255151:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318711.255155:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318711.255162:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3608
00000100:00080000:2.0:1767318711.255167:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318711.255173:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318711.255226:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3480 x1853164379572352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318711.255284:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318711.255288:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318711.255290:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318711.255294:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3608
00000100:00080000:2.0:1767318711.255296:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318711.255348:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318711.255362:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e1c00 x1853164379572480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318711.255425:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379572608:0@lo:400:kworker.0
00000100:00100000:1.0:1767318711.255497:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318711.255640:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572608
00000100:00100000:3.0:1767318711.255648:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572608
00000100:00100000:3.0:1767318711.255721:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253
00000100:00100000:3.0:1767318711.255732:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379572608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318711.256120:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379572352:0@lo:38:kworker.0
00000100:00100000:0.0:1767318711.256157:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318711.256181:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379572480:0@lo:38:kworker.0
00000100:00100000:0.0:1767318711.256203:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318711.256253:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572480
00000100:00100000:0.0:1767318711.256258:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572480
00000100:00100000:0.0:1767318711.256284:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856
00000100:00100000:0.0:1767318711.256289:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379572480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318711.256306:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318711.256341:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379572480:12345-0@lo:38:kworker.0 Request processed in 50us (137us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318711.256348:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856
00000100:00080000:0.0:1767318711.256396:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318711.256401:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318711.256405:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379572480:0@lo:38:kworker.0
00000100:00100000:0.0:1767318711.256452:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572352
00000100:00100000:0.0:1767318711.256455:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572352
00000100:00100000:0.0:1767318711.256478:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16376
00000100:00100000:0.0:1767318711.256483:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379572352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318711.256494:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318711.256524:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379572352:12345-0@lo:38:kworker.0 Request processed in 40us (366us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318711.256531:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16376
00000100:00080000:0.0:1767318711.256556:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318711.256560:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318711.256563:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379572352:0@lo:38:kworker.0
00000100:00100000:0.0:1767318711.256600:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379572736:0@lo:400:kworker.0
00000100:00100000:0.0:1767318711.256626:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318711.256653:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572736
00000100:00100000:0.0:1767318711.256657:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572736
00000100:00100000:0.0:1767318711.256684:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254
00000100:00100000:0.0:1767318711.256691:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379572736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318711.256725:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379572736:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318711.256731:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254
00000100:00100000:0.0:1767318711.256760:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379572736:0@lo:400:kworker.0
00000100:00080000:0.0:1767318711.256784:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318711.256795:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318711.260048:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318711.260055:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318711.260060:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318711.260068:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3608
00000100:00080000:2.0:1767318711.260072:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318711.260078:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318711.260099:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e0e00 x1853164379572992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318711.260126:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318711.260129:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318711.260131:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318711.260134:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3608
00000100:00080000:2.0:1767318711.260137:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318711.260141:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318711.260151:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0e3480 x1853164379573248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318711.260189:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379573120:0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.260263:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318711.260300:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318711.260306:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379572864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.260329:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318711.260363:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379573120
00000100:00100000:2.0:1767318711.260369:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379573120
00000100:00100000:2.0:1767318711.260420:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572864
00000100:00100000:2.0:1767318711.260423:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572864
00000100:00100000:2.0:1767318711.260453:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806
00000100:00100000:2.0:1767318711.260461:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379573120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.260510:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379573120:12345-0@lo:400:kworker.0 Request processed in 48us (245us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318711.260517:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806
00000100:00100000:2.0:1767318711.260535:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807
00000100:00100000:2.0:1767318711.260541:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379572864:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.260568:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379572864:12345-0@lo:400:kworker.0 Request processed in 26us (237us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318711.260573:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807
00000100:00080000:2.0:1767318711.260606:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318711.260637:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379572864:0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.260648:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379573120:0@lo:400:kworker.0
00000100:00100000:2.0:1767318711.260675:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379572992:0@lo:38:kworker.0
00000100:00100000:2.0:1767318711.260699:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318711.260715:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379573248:0@lo:38:kworker.0
00000100:00100000:2.0:1767318711.260733:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318711.260758:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379572992
00000100:00100000:2.0:1767318711.260761:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379572992
00000100:00100000:2.0:1767318711.260778:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379573248
00000100:00100000:2.0:1767318711.260781:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379573248
00000100:00100000:2.0:1767318711.260795:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16377
00000100:00100000:2.0:1767318711.260800:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379572992:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318711.260818:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318711.260850:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379572992:12345-0@lo:38:kworker.0 Request processed in 48us (148us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318711.260856:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16377
00000100:00100000:2.0:1767318711.260867:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16378
00000100:00100000:2.0:1767318711.260896:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379573248:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318711.260906:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318711.260929:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379573248:12345-0@lo:38:kworker.0 Request processed in 32us (195us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318711.260934:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16378
00000100:00080000:2.0:1767318711.260963:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318711.260968:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318711.260971:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379572992:0@lo:38:kworker.0
00000100:00080000:2.0:1767318711.260979:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318711.260982:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318711.260985:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379573248:0@lo:38:kworker.0
00000100:00100000:3.0:1767318711.265748:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379572608:12345-0@lo:400:kworker.0 Request processed in 10007us (10239us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318711.265764:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253
00000100:00100000:1.0:1767318711.266715:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379572608:0@lo:400:kworker.0
00010000:00010000:1.0:1767318711.773331:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318712.208814:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767318712.209022:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291876224 offset 0 length 520: 4
00000100:00100000:1.0:1767318712.209050:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318712.213436:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291876480
00000100:00100000:2.0:1767318712.213455:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291876480
00000100:00100000:2.0:1767318712.213568:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291876352
00000100:00100000:2.0:1767318712.213572:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291876352
00000100:00080000:0.0:1767318712.213678:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318712.213766:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3808
00000100:00100000:1.0:1767318712.213779:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291876480:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318712.213894:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291876480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (5092us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318712.213902:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3808
00000100:00100000:2.0:1767318712.214421:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16379
00000100:00100000:2.0:1767318712.214429:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291876352:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318712.214452:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318712.214590:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291876352:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 150us (5529us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318712.214598:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16379
00000100:00100000:1.0:1767318712.279194:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379573376:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318712.279280:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318712.279639:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379573376
00000100:00100000:0.0:1767318712.279649:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379573376
00000100:00100000:0.0:1767318712.279705:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002
00000100:00100000:0.0:1767318712.279717:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379573376:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318712.279750:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318712.279946:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379573376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 231us (665us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318712.279955:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002
00000100:00100000:1.0:1767318712.280408:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379573376:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318712.791175:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318713.815677:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379573504:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318713.815759:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318713.815912:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379573504
00000100:00100000:2.0:1767318713.815921:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379573504
00000100:00100000:2.0:1767318713.815993:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003
00000100:00100000:2.0:1767318713.816013:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379573504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318713.816049:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318713.816100:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379573504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (340us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318713.816108:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003
00000100:00080000:0.0:1767318713.816921:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318713.816979:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379573504:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318713.817967:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318714.839186:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318715.351137:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318690/real 1767318690]  req@ffff8b0e0e0dc000 x1853164379568128/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318715 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318715.351172:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0e0dc000 x1853164379568128/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318715 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318715.351191:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318715.351250:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318715.351255:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379568128:0@lo:250:kworker.0
00000100:00080000:1.0:1767318715.351816:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318715.351822:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318715.351825:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318715.351830:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3593
00000100:00080000:1.0:1767318715.351834:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318715.351861:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318715.351918:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379573632/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318715.351985:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379573632:0@lo:250:kworker.0
00000400:00000100:0.0:1767318715.352034:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379573632 offset 0 length 520: 4
00000100:00080000:1.0:1767318715.352102:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318715.352106:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318715.352108:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318715.352113:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3613
00000100:00080000:1.0:1767318715.352115:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318715.352120:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318715.352136:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dca80 x1853164379573760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318715.354458:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379573760:0@lo:38:kworker.0
00000100:00100000:0.0:1767318715.354616:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318715.354953:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318715.354958:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318715.354962:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318715.354967:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3613
00000100:00080000:1.0:1767318715.354971:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318715.354977:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318715.355008:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc000 x1853164379573888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318715.355077:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318715.355080:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318715.355082:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318715.355096:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3613
00000100:00080000:1.0:1767318715.355099:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318715.355102:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318715.355123:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46680 x1853164379574400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318715.355140:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318715.355143:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318715.355145:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767318715.355320:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379573888:0@lo:38:kworker.0
00000100:00100000:0.0:1767318715.355363:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318715.355385:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379574400:0@lo:38:kworker.0
00000100:00100000:0.0:1767318715.355408:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318715.355425:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3613
00000100:00080000:1.0:1767318715.355428:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318715.355432:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318715.355447:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46a00 x1853164379574656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318715.355474:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379574144:0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.355518:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318715.355545:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318715.355550:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379574016:0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.355571:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318715.355599:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379574272:0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.355627:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379574528:0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.355667:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574144
00000100:00100000:1.0:1767318715.355674:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574144
00000100:00100000:1.0:1767318715.355736:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574016
00000100:00100000:1.0:1767318715.355740:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574016
00000100:00100000:1.0:1767318715.355764:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255
00000100:00100000:1.0:1767318715.355772:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379574144:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.355821:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379574144:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318715.355837:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255
00000100:00100000:1.0:1767318715.355857:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256
00000100:00100000:1.0:1767318715.355864:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379574016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.355917:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379574016:12345-0@lo:400:kworker.0 Request processed in 54us (345us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318715.355924:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256
00000100:00080000:1.0:1767318715.355941:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318715.355945:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318715.355975:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379574016:0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.355985:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379574144:0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.356025:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379573888
00000100:00100000:1.0:1767318715.356029:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379573888
00000100:00100000:1.0:1767318715.356048:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857
00000100:00100000:1.0:1767318715.356052:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379573888:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318715.356069:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318715.356113:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379573888:12345-0@lo:38:kworker.0 Request processed in 57us (748us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318715.356118:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857
00000100:00100000:0.0:1767318715.358442:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379574656:0@lo:38:kworker.0
00000100:00100000:0.0:1767318715.358509:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318715.358863:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379573760
00000100:00100000:3.0:1767318715.358895:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379573760
00000100:00100000:3.0:1767318715.358929:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574400
00000100:00100000:3.0:1767318715.358932:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574400
00000100:00100000:3.0:1767318715.358953:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16380
00000100:00100000:3.0:1767318715.358960:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379573760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318715.358982:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318715.359030:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379573760:12345-0@lo:38:kworker.0 Request processed in 69us (4414us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318715.359037:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16380
00000100:00100000:3.0:1767318715.359054:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16381
00000100:00100000:3.0:1767318715.359058:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379574400:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318715.359067:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318715.359280:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379574400:12345-0@lo:38:kworker.0 Request processed in 219us (3870us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318715.359286:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16381
00000100:00080000:0.0:1767318715.359450:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318715.359456:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318715.359460:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379573888:0@lo:38:kworker.0
00000100:00080000:0.0:1767318715.359469:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318715.359472:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318715.359475:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379574400:0@lo:38:kworker.0
00000100:00080000:0.0:1767318715.359483:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318715.359486:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318715.359489:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379573760:0@lo:38:kworker.0
00000100:00100000:1.0:1767318715.359586:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574656
00000100:00100000:1.0:1767318715.359591:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574656
00000100:00100000:1.0:1767318715.359616:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16382
00000100:00100000:1.0:1767318715.359621:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379574656:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318715.359631:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318715.359675:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379574656:12345-0@lo:38:kworker.0 Request processed in 52us (1165us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318715.359699:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16382
00000100:00100000:1.0:1767318715.359731:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318715.359762:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574528
00000100:00100000:1.0:1767318715.359765:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574528
00000100:00100000:1.0:1767318715.359800:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809
00000100:00100000:1.0:1767318715.359807:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379574528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318715.359846:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379574528:12345-0@lo:400:kworker.0 Request processed in 40us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318715.359852:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809
00000100:00080000:1.0:1767318715.359884:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318715.359905:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379574528:0@lo:400:kworker.0
00000100:00080000:0.0:1767318715.360294:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318715.360299:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318715.360303:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379574656:0@lo:38:kworker.0
00000100:00100000:3.0:1767318715.360385:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318715.360646:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574272
00000100:00100000:0.0:1767318715.360651:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574272
00000100:00080000:3.0:1767318715.360845:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318715.360928:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810
00000100:00100000:0.0:1767318715.360936:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379574272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318715.360988:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379574272:12345-0@lo:400:kworker.0 Request processed in 53us (602us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318715.361008:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810
00000100:00100000:0.0:1767318715.361042:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379574272:0@lo:400:kworker.0
00010000:00010000:1.0:1767318715.863864:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318716.887094:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318717.327292:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318717.327391:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291876736
00000100:00100000:2.0:1767318717.327402:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291876736
00000100:00100000:2.0:1767318717.327465:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3811
00000100:00100000:2.0:1767318717.327472:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291876736:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318717.327542:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291876736:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (260us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318717.327554:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3811
00000100:00080000:3.0:1767318717.327657:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318717.331096:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318717.331228:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291876608
00000100:00100000:1.0:1767318717.331240:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291876608
00000100:00100000:1.0:1767318717.331285:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16383
00000100:00100000:1.0:1767318717.331291:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291876608:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318717.331310:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318717.331362:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291876608:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 70us (276us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318717.331366:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16383
00000100:00100000:1.0:1767318717.399317:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318717.399336:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379574784:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318717.399401:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318717.399840:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574784
00000100:00100000:3.0:1767318717.399848:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574784
00000100:00100000:3.0:1767318717.399948:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004
00000100:00100000:3.0:1767318717.399958:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379574784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318717.400000:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318717.400051:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379574784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (649us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318717.400058:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004
00000100:00100000:3.0:1767318717.400110:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379574784:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318717.400796:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318717.911071:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318718.935114:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318718.935270:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318718.935607:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379574912:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318718.935677:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318718.940439:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379574912
00000100:00100000:2.0:1767318718.940457:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379574912
00000100:00080000:1.0:1767318718.941038:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318718.941177:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005
00000100:00100000:2.0:1767318718.941189:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379574912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318718.941223:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318718.941317:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379574912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (5638us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318718.941332:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005
00000100:00100000:0.0:1767318718.941434:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379574912:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318719.959515:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318720.471056:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318720.471067:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318720.471071:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318720.471076:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318720.471081:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318720.471089:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3617
00000100:00080000:3.0:1767318720.471095:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318720.471112:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318720.471189:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f134000 x1853164379575040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318720.471219:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318720.471223:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318720.471225:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318720.471238:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3617
00000100:00080000:3.0:1767318720.471241:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318720.471245:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318720.471258:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f135180 x1853164379575168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318720.471312:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318720.471329:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318720.471331:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318720.471334:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3617
00000100:00080000:3.0:1767318720.471337:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318720.471343:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318720.471344:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379575552:0@lo:400:kworker.0
00000100:00100000:3.0:1767318720.471358:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f137480 x1853164379575680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318720.471377:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318720.471381:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318720.471383:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318720.471387:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3617
00000100:00080000:3.0:1767318720.471390:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767318720.471395:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318720.471406:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f07a16300 x1853164379575936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318720.471417:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318720.471468:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379575808:0@lo:400:kworker.0
00000100:00100000:0.0:1767318720.471496:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379575040:0@lo:38:kworker.0
00000100:00100000:3.0:1767318720.471504:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318720.471544:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318720.471573:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379575168:0@lo:38:kworker.0
00000100:00100000:0.0:1767318720.471598:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318720.471625:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379575680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318720.471646:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318720.471706:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379575424:0@lo:400:kworker.0
00000100:00100000:2.0:1767318720.471739:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318720.471753:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575552
00000100:00100000:3.0:1767318720.471763:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575552
00000100:00100000:2.0:1767318720.471765:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318720.471773:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379575296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318720.471799:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318720.471823:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575808
00000100:00100000:3.0:1767318720.471827:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575808
00000100:00100000:2.0:1767318720.471846:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575040
00000100:00100000:3.0:1767318720.471854:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575680
00000100:00100000:3.0:1767318720.471859:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575680
00000100:00100000:2.0:1767318720.471860:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575040
00000100:00100000:3.0:1767318720.471901:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812
00000100:00100000:3.0:1767318720.471917:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379575552:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318720.471957:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318720.471978:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379575552:12345-0@lo:400:kworker.0 Request processed in 67us (562us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318720.471988:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575168
00000100:00100000:1.0:1767318720.471993:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575168
00000100:00100000:0.0:1767318720.472037:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f07a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379575936:0@lo:38:kworker.0
00000100:00100000:1.0:1767318720.472087:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858
00000100:00100000:1.0:1767318720.472093:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379575168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318720.472110:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318720.474753:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379575168:12345-0@lo:38:kworker.0 Request processed in 2648us (3143us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318720.474766:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858
00000100:00100000:1.0:1767318720.474821:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813
00000100:00100000:1.0:1767318720.474847:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379575808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318720.474930:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379575808:12345-0@lo:400:kworker.0 Request processed in 102us (3428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318720.474936:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813
00000100:00100000:1.0:1767318720.474954:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16384
00000100:00100000:1.0:1767318720.474958:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379575680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318720.474979:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318720.475006:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379575680:12345-0@lo:38:kworker.0 Request processed in 46us (3360us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318720.475012:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16384
00000100:00100000:1.0:1767318720.475023:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385
00000100:00100000:1.0:1767318720.475026:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379575040:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318720.475035:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318720.475074:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379575040:12345-0@lo:38:kworker.0 Request processed in 46us (3531us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318720.475080:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16385
00000100:00100000:1.0:1767318720.475135:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379575808:0@lo:400:kworker.0
00000100:00100000:1.0:1767318720.475215:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379575552:0@lo:400:kworker.0
00000100:00100000:1.0:1767318720.475254:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575424
00000100:00100000:1.0:1767318720.475260:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575424
00000100:00100000:1.0:1767318720.475300:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575296
00000100:00100000:1.0:1767318720.475304:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575296
00000100:00100000:1.0:1767318720.475326:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257
00000100:00100000:1.0:1767318720.475332:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379575424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318720.475372:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379575424:12345-0@lo:400:kworker.0 Request processed in 39us (3631us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318720.475378:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257
00000100:00100000:1.0:1767318720.475391:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258
00000100:00100000:1.0:1767318720.475396:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379575296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318720.475423:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379575296:12345-0@lo:400:kworker.0 Request processed in 27us (3624us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318720.475428:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258
00000100:00080000:1.0:1767318720.475456:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318720.475460:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318720.476715:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379575296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318720.476730:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379575424:0@lo:400:kworker.0
00000100:00100000:0.0:1767318720.478572:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318720.478667:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318720.478675:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318720.478680:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379575040:0@lo:38:kworker.0
00000100:00080000:0.0:1767318720.478696:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318720.478699:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318720.478703:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379575168:0@lo:38:kworker.0
00000100:00080000:0.0:1767318720.478732:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318720.478735:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318720.478738:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379575680:0@lo:38:kworker.0
00000100:00100000:3.0:1767318720.478766:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812
00000100:00100000:3.0:1767318720.478830:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379575936
00000100:00100000:3.0:1767318720.478836:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379575936
00000100:00100000:3.0:1767318720.478883:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386
00000100:00100000:3.0:1767318720.478890:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379575936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318720.478910:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318720.478969:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379575936:12345-0@lo:38:kworker.0 Request processed in 78us (403us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318720.478977:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386
00000100:00080000:0.0:1767318720.480199:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318720.480209:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318720.480214:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f07a16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379575936:0@lo:38:kworker.0
00010000:00010000:1.0:1767318720.983444:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318722.010708:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318722.447654:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318722.448101:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291876864
00000100:00100000:2.0:1767318722.448111:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291876864
00000100:00100000:2.0:1767318722.448214:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16387
00000100:00100000:2.0:1767318722.448223:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291876864:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318722.448247:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318722.448316:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291876864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (675us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318722.448321:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16387
00000100:00100000:0.0:1767318722.467734:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318722.468245:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291876992
00000100:00100000:2.0:1767318722.468255:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291876992
00000100:00100000:2.0:1767318722.468341:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3814
00000100:00080000:1.0:1767318722.468349:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318722.468355:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f07a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291876992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318722.468444:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f07a16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291876992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (719us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318722.468452:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3814
00000100:00100000:2.0:1767318722.519146:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318722.519390:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379576064:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318722.519569:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318722.520232:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576064
00000100:00100000:0.0:1767318722.520246:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576064
00000100:00100000:0.0:1767318722.520381:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006
00000100:00100000:0.0:1767318722.520403:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379576064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318722.520440:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318722.520518:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379576064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (949us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318722.520526:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006
00000100:00100000:2.0:1767318722.520613:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379576064:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318722.520668:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318723.031673:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318724.055316:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379576192:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318724.055398:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318724.055533:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576192
00000100:00100000:0.0:1767318724.055540:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576192
00000100:00100000:0.0:1767318724.055596:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007
00000100:00100000:0.0:1767318724.055606:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379576192:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318724.055614:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:0.0:1767318724.055634:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318724.055687:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379576192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (289us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318724.055695:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007
00000100:00100000:2.0:1767318724.055783:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379576192:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318724.055819:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318725.082850:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318725.591519:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318725.591554:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318725.591557:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318725.591562:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318725.591566:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318725.591576:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3622
00000100:00080000:0.0:1767318725.591581:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318725.591588:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318725.591636:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379576320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318725.591672:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318725.591676:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318725.591678:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318725.591683:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3622
00000100:00080000:0.0:1767318725.591686:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318725.591690:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318725.591703:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379576448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318725.591770:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318725.591773:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318725.591775:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318725.591778:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3622
00000100:00080000:0.0:1767318725.591781:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318725.591784:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318725.591795:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe300 x1853164379576960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318725.591820:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318725.591823:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318725.591825:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318725.591829:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3622
00000100:00080000:0.0:1767318725.591832:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767318725.591836:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318725.591847:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe680 x1853164379577216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318725.591899:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379577088:0@lo:400:kworker.0
00000100:00100000:0.0:1767318725.591968:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318725.592032:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318725.592038:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379576832:0@lo:400:kworker.0
00000100:00100000:0.0:1767318725.592071:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318725.592174:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577088
00000100:00100000:2.0:1767318725.592183:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577088
00000100:00100000:2.0:1767318725.592253:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576832
00000100:00100000:2.0:1767318725.592256:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576832
00000100:00100000:2.0:1767318725.592282:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815
00000100:00100000:2.0:1767318725.592290:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379577088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318725.592341:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379577088:12345-0@lo:400:kworker.0 Request processed in 52us (372us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318725.592348:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815
00000100:00100000:2.0:1767318725.592365:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816
00000100:00100000:2.0:1767318725.592371:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379576832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318725.592394:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379576832:12345-0@lo:400:kworker.0 Request processed in 24us (334us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318725.592399:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816
00000100:00100000:2.0:1767318725.592423:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379576320:0@lo:38:kworker.0
00000100:00100000:2.0:1767318725.592445:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318725.592465:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379576448:0@lo:38:kworker.0
00000100:00100000:2.0:1767318725.592491:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318725.592510:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379576960:0@lo:38:kworker.0
00000100:00100000:2.0:1767318725.592529:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318725.592542:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379577216:0@lo:38:kworker.0
00000100:00100000:2.0:1767318725.592559:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318725.592581:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576320
00000100:00100000:2.0:1767318725.592584:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576320
00000100:00100000:2.0:1767318725.592599:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576960
00000100:00100000:2.0:1767318725.592601:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576960
00000100:00100000:2.0:1767318725.592608:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577216
00000100:00100000:2.0:1767318725.592610:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577216
00000100:00100000:2.0:1767318725.592618:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16388
00000100:00100000:2.0:1767318725.592623:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379576320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318725.592644:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318725.592677:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379576320:12345-0@lo:38:kworker.0 Request processed in 52us (230us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318725.592683:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16388
00000100:00100000:2.0:1767318725.592700:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16389
00000100:00100000:2.0:1767318725.592704:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379576960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318725.592712:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318725.592734:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379576960:12345-0@lo:38:kworker.0 Request processed in 29us (203us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318725.592739:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16389
00000100:00100000:2.0:1767318725.592749:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16390
00000100:00100000:2.0:1767318725.592753:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379577216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318725.592761:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318725.592781:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379577216:12345-0@lo:38:kworker.0 Request processed in 28us (221us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318725.592786:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16390
00000100:00080000:2.0:1767318725.592818:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318725.592823:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318725.592826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379576320:0@lo:38:kworker.0
00000100:00080000:2.0:1767318725.592835:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318725.592837:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318725.592839:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379576960:0@lo:38:kworker.0
00000100:00080000:2.0:1767318725.592845:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318725.592848:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318725.592850:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379577216:0@lo:38:kworker.0
00000100:00100000:3.0:1767318725.592967:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379576704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318725.593000:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318725.593036:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318725.593042:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379576576:0@lo:400:kworker.0
00000100:00100000:3.0:1767318725.593062:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318725.593093:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576704
00000100:00100000:3.0:1767318725.593097:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576704
00000100:00100000:3.0:1767318725.593134:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576576
00000100:00100000:3.0:1767318725.593137:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576576
00000100:00100000:3.0:1767318725.593156:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259
00000100:00100000:3.0:1767318725.593162:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379576704:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318725.593199:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379576704:12345-0@lo:400:kworker.0 Request processed in 37us (198us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318725.593205:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259
00000100:00100000:3.0:1767318725.593216:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260
00000100:00100000:3.0:1767318725.593232:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379576576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318725.593258:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379576576:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318725.593263:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260
00000100:00100000:3.0:1767318725.593290:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379576576:0@lo:400:kworker.0
00000100:00100000:3.0:1767318725.593300:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379576704:0@lo:400:kworker.0
00000100:00080000:0.0:1767318725.594216:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318725.594225:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318725.594262:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379576832:0@lo:400:kworker.0
00000100:00100000:0.0:1767318725.594275:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379577088:0@lo:400:kworker.0
00000100:00100000:1.0:1767318725.596159:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379576448
00000100:00100000:1.0:1767318725.596172:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379576448
00000100:00100000:1.0:1767318725.596229:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859
00000100:00100000:1.0:1767318725.596237:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379576448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318725.596260:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318725.596349:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379576448:12345-0@lo:38:kworker.0 Request processed in 112us (3856us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318725.596356:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859
00000100:00080000:3.0:1767318725.597912:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318725.597925:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318725.597931:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379576448:0@lo:38:kworker.0
00010000:00010000:1.0:1767318726.103198:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318727.127242:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318727.570529:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318727.570579:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318727.571011:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291877120
00000100:00100000:2.0:1767318727.571011:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291877248
00000100:00100000:1.0:1767318727.571023:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291877120
00000100:00100000:2.0:1767318727.571032:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291877248
00000100:00080000:0.0:1767318727.571112:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318727.571134:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3817
00000100:00100000:1.0:1767318727.571147:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291877248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318727.571234:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291877248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (715us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318727.571242:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3817
00000100:00100000:1.0:1767318727.571263:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16391
00000100:00100000:1.0:1767318727.571268:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291877120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318727.571287:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318727.571314:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291877120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (734us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318727.571320:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16391
00000100:00100000:3.0:1767318727.639480:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318727.639508:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379577344:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318727.639585:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318727.639650:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577344
00000100:00100000:2.0:1767318727.639661:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577344
00000100:00100000:2.0:1767318727.639727:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008
00000100:00100000:2.0:1767318727.639738:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379577344:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318727.639774:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318727.639901:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379577344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (316us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318727.639909:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008
00000100:00080000:3.0:1767318727.640393:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318727.649077:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379577344:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318728.151891:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318729.175385:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318729.177149:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379577472:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318729.177218:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318729.177676:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577472
00000100:00100000:2.0:1767318729.177686:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577472
00000100:00100000:2.0:1767318729.177761:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009
00000100:00100000:2.0:1767318729.177771:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379577472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318729.177804:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318729.177835:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318729.177865:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379577472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (645us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318729.177894:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009
00000100:00100000:1.0:1767318729.177931:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f346a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379577472:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318730.199727:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318730.713207:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318730.713219:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318730.713222:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318730.713243:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318730.713247:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318730.713254:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3627
00000100:00080000:0.0:1767318730.713260:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318730.713267:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318730.713301:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe300 x1853164379577600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318730.713317:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318730.713320:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318730.713321:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318730.713325:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3627
00000100:00080000:0.0:1767318730.713327:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318730.713331:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318730.713345:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7bb80 x1853164379577728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318730.713412:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318730.713415:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318730.713417:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318730.713420:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3627
00000100:00080000:0.0:1767318730.713423:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318730.713426:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318730.713434:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78700 x1853164379578240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318730.713447:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318730.713455:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318730.713456:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318730.713459:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3627
00000100:00080000:0.0:1767318730.713463:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767318730.713467:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318730.713478:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78000 x1853164379578496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318730.713509:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379578112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318730.713520:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379578368:0@lo:400:kworker.0
00000100:00100000:0.0:1767318730.713571:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318730.713580:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379577984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318730.713595:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379577856:0@lo:400:kworker.0
00000100:00100000:1.0:1767318730.713619:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318730.713646:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318730.713662:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379578112
00000100:00100000:0.0:1767318730.713669:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379578112
00000100:00100000:1.0:1767318730.713699:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318730.713704:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577984
00000100:00100000:3.0:1767318730.713710:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577984
00000100:00100000:0.0:1767318730.713724:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379578368
00000100:00100000:0.0:1767318730.713728:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379578368
00000100:00080000:1.0:1767318730.713746:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318730.713757:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818
00000100:00100000:3.0:1767318730.713765:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577856
00000100:00100000:0.0:1767318730.713767:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379578112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318730.713770:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577856
00000100:00100000:1.0:1767318730.713773:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819
00000100:00100000:1.0:1767318730.713785:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379578368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318730.713808:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261
00000100:00100000:3.0:1767318730.713818:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379577984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318730.713831:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379578112:12345-0@lo:400:kworker.0 Request processed in 66us (259us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318730.713839:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379578368:12345-0@lo:400:kworker.0 Request processed in 56us (140us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318730.713843:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818
00000100:00100000:1.0:1767318730.713851:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819
00000100:00100000:3.0:1767318730.713897:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379577984:12345-0@lo:400:kworker.0 Request processed in 53us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318730.713906:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261
00000100:00100000:0.0:1767318730.713914:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379578112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318730.713917:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379578368:0@lo:400:kworker.0
00000100:00100000:3.0:1767318730.713927:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262
00000100:00100000:3.0:1767318730.713937:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379577856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318730.713986:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379577856:12345-0@lo:400:kworker.0 Request processed in 51us (343us total) trans 0 rc 0/0
00000100:00080000:1.0:1767318730.713993:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318730.713994:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262
00000100:00100000:1.0:1767318730.714024:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379577984:0@lo:400:kworker.0
00000100:00100000:3.0:1767318730.714043:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379577856:0@lo:400:kworker.0
00000100:00100000:3.0:1767318730.714090:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379577600:0@lo:38:kworker.0
00000100:00100000:3.0:1767318730.714116:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318730.714189:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379577728:0@lo:38:kworker.0
00000100:00100000:3.0:1767318730.714213:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318730.714242:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379578240:0@lo:38:kworker.0
00000100:00100000:3.0:1767318730.714262:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318730.714300:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577728
00000100:00100000:0.0:1767318730.714305:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577728
00000100:00100000:0.0:1767318730.714333:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860
00000100:00100000:0.0:1767318730.714338:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379577728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318730.714357:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318730.714390:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379577728:12345-0@lo:38:kworker.0 Request processed in 50us (176us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318730.714402:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860
00000100:00100000:3.0:1767318730.719420:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379578496:0@lo:38:kworker.0
00000100:00100000:3.0:1767318730.719508:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318730.722587:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379577600
00000100:00100000:2.0:1767318730.722607:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379577600
00000100:00100000:2.0:1767318730.722677:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379578240
00000100:00100000:2.0:1767318730.722682:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379578240
00000100:00100000:1.0:1767318730.722697:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16392
00000100:00100000:2.0:1767318730.722707:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16393
00000100:00100000:1.0:1767318730.722709:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379577600:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318730.722718:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379578240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318730.722738:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318730.722830:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379577600:12345-0@lo:38:kworker.0 Request processed in 123us (8711us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318730.722838:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16392
00000100:00080000:3.0:1767318730.723922:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318730.723933:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318730.723938:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379577600:0@lo:38:kworker.0
00000100:00080000:3.0:1767318730.723955:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318730.723958:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318730.723962:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379577728:0@lo:38:kworker.0
00000100:00100000:1.0:1767318730.724095:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379578496
00000100:00100000:1.0:1767318730.724101:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379578496
00000100:00100000:1.0:1767318730.724142:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16394
00000100:00100000:1.0:1767318730.724148:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379578496:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318730.728930:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318730.729153:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379578240:12345-0@lo:38:kworker.0 Request processed in 6432us (14885us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318730.729166:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16393
00000100:00080000:3.0:1767318730.729271:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318730.729277:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318730.729282:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379578240:0@lo:38:kworker.0
00010000:00020000:1.0:1767318730.730065:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318730.730136:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379578496:12345-0@lo:38:kworker.0 Request processed in 5985us (10626us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318730.730146:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16394
00000100:00080000:3.0:1767318730.730395:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318730.730400:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318730.730422:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379578496:0@lo:38:kworker.0
00010000:00010000:1.0:1767318731.223549:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318732.247147:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318732.692658:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318732.692702:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318732.692742:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291877504
00000100:00100000:1.0:1767318732.692752:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291877504
00000100:00100000:2.0:1767318732.692801:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291877376
00000100:00100000:2.0:1767318732.692807:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291877376
00000100:00100000:1.0:1767318732.692898:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3820
00000100:00100000:1.0:1767318732.692910:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291877504:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318732.693000:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291877504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 77us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318732.693008:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3820
00000100:00100000:1.0:1767318732.693033:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16395
00000100:00100000:1.0:1767318732.693048:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291877376:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318732.693069:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318732.693096:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291877376:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 56us (393us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318732.693102:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16395
00000100:00080000:3.0:1767318732.697298:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318732.759584:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318732.759601:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379578624:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318732.759669:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318732.759953:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379578624
00000100:00100000:2.0:1767318732.759961:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379578624
00000100:00100000:2.0:1767318732.760091:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010
00000100:00100000:2.0:1767318732.760101:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379578624:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318732.760129:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318732.760182:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379578624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (511us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318732.760189:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010
00000100:00100000:0.0:1767318732.760284:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379578624:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318732.764839:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318733.271144:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318734.295214:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318734.295237:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379578752:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318734.295340:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318734.295583:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379578752
00000100:00100000:2.0:1767318734.295601:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379578752
00000100:00080000:3.0:1767318734.295665:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318734.295666:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011
00000100:00100000:2.0:1767318734.295678:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379578752:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318734.295717:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318734.295772:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379578752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (432us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318734.295780:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011
00000100:00100000:3.0:1767318734.295825:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379578752:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318734.299497:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318735.319262:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318735.831428:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318735.831439:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318735.831442:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318735.831446:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318735.831451:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318735.831458:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3633
00000100:00080000:3.0:1767318735.831463:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318735.831470:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318735.831508:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe300 x1853164379578880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318735.831536:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318735.831540:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318735.831541:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318735.831545:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3633
00000100:00080000:3.0:1767318735.831547:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318735.831551:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318735.831565:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379579008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318735.831633:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318735.831651:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318735.831653:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318735.831657:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3633
00000100:00080000:3.0:1767318735.831659:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318735.831663:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318735.831674:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20000 x1853164379579520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318735.831689:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318735.831691:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318735.831693:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318735.831696:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3633
00000100:00080000:3.0:1767318735.831698:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318735.831702:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318735.831711:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2a00 x1853164379579776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318735.831739:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379579648:0@lo:400:kworker.0
00000100:00100000:1.0:1767318735.831921:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379579136:0@lo:400:kworker.0
00000100:00100000:0.0:1767318735.832002:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379578880:0@lo:38:kworker.0
00000100:00100000:2.0:1767318735.832002:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379579264:0@lo:400:kworker.0
00000100:00100000:1.0:1767318735.836701:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318735.839698:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579136
00000100:00100000:1.0:1767318735.839716:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579136
00000100:00080000:3.0:1767318735.839931:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318735.840002:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263
00000100:00100000:1.0:1767318735.840022:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379579136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318735.840100:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379579136:12345-0@lo:400:kworker.0 Request processed in 89us (3407us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318735.840107:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263
00000100:00100000:1.0:1767318735.840158:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379579136:0@lo:400:kworker.0
00000100:00100000:3.0:1767318735.849880:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379579392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318735.849970:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318735.850075:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318735.850135:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579392
00000100:00100000:3.0:1767318735.850143:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579392
00000100:00100000:3.0:1767318735.850195:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579648
00000100:00100000:3.0:1767318735.850199:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579648
00000100:00100000:3.0:1767318735.850231:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821
00000100:00100000:3.0:1767318735.850241:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379579392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318735.850310:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379579392:12345-0@lo:400:kworker.0 Request processed in 70us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318735.850317:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821
00000100:00100000:3.0:1767318735.850333:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822
00000100:00100000:3.0:1767318735.850339:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379579648:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318735.850371:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379579648:12345-0@lo:400:kworker.0 Request processed in 33us (296us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318735.850377:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822
00000100:00080000:3.0:1767318735.850408:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318735.850437:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379579392:0@lo:400:kworker.0
00000100:00100000:3.0:1767318735.850465:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379579648:0@lo:400:kworker.0
00000100:00100000:2.0:1767318735.852453:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318735.852593:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579264
00000100:00100000:1.0:1767318735.852601:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579264
00000100:00100000:1.0:1767318735.852687:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264
00000100:00100000:1.0:1767318735.852697:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379579264:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318735.852765:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379579264:12345-0@lo:400:kworker.0 Request processed in 70us (319us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318735.852773:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264
00000100:00100000:3.0:1767318735.852853:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379579264:0@lo:400:kworker.0
00000100:00100000:0.0:1767318735.857370:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318735.857581:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379579008:0@lo:38:kworker.0
00000100:00100000:0.0:1767318735.857617:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318735.857662:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379579520:0@lo:38:kworker.0
00000100:00100000:0.0:1767318735.857687:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318735.857747:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579008
00000100:00100000:2.0:1767318735.857757:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579008
00000100:00100000:2.0:1767318735.857866:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861
00000100:00100000:2.0:1767318735.857895:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379579008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318735.857920:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318735.857963:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379579008:12345-0@lo:38:kworker.0 Request processed in 68us (344us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318735.857970:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861
00000100:00100000:0.0:1767318735.861852:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379579776:0@lo:38:kworker.0
00000100:00100000:0.0:1767318735.861927:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318735.865271:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379578880
00000100:00100000:1.0:1767318735.865288:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379578880
00000100:00100000:1.0:1767318735.865412:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579520
00000100:00100000:1.0:1767318735.865416:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579520
00000100:00100000:2.0:1767318735.865446:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16396
00000100:00100000:2.0:1767318735.865453:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379578880:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318735.865473:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318735.865550:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379578880:12345-0@lo:38:kworker.0 Request processed in 96us (8186us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318735.865558:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16396
00000100:00100000:2.0:1767318735.865581:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16397
00000100:00100000:2.0:1767318735.865585:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379579520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318735.865594:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318735.865621:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379579520:12345-0@lo:38:kworker.0 Request processed in 35us (7933us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318735.865627:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16397
00000100:00080000:0.0:1767318735.873102:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318735.873116:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318735.873121:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379578880:0@lo:38:kworker.0
00000100:00080000:0.0:1767318735.873134:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318735.873137:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318735.873140:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379579008:0@lo:38:kworker.0
00000100:00080000:0.0:1767318735.873149:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318735.873152:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318735.873173:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379579520:0@lo:38:kworker.0
00000100:00100000:1.0:1767318735.873959:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579776
00000100:00100000:1.0:1767318735.873968:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579776
00000100:00100000:1.0:1767318735.874027:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16398
00000100:00100000:1.0:1767318735.874035:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379579776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318735.874066:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318735.874144:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379579776:12345-0@lo:38:kworker.0 Request processed in 109us (12216us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318735.874151:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16398
00000100:00080000:2.0:1767318735.874243:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318735.874247:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318735.874250:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379579776:0@lo:38:kworker.0
00010000:00010000:1.0:1767318736.344996:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767318736.782996:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291877632 offset 0 length 520: 4
00000100:00100000:0.0:1767318736.783057:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318736.783098:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318736.783273:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291877760
00000100:00100000:3.0:1767318736.783284:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291877760
00000100:00100000:3.0:1767318736.783335:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291877888
00000100:00100000:3.0:1767318736.783339:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291877888
00000100:00100000:3.0:1767318736.783388:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3823
00000100:00100000:3.0:1767318736.783400:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291877888:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318736.783471:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291877888:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (370us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318736.783479:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3823
00000100:00100000:1.0:1767318736.783509:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16399
00000100:00100000:1.0:1767318736.783516:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291877760:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318736.783537:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318736.783567:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291877760:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 50us (510us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767318736.784194:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318736.788777:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16399
00010000:00010000:1.0:1767318737.367175:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318737.879305:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379579904:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318737.879385:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318737.880931:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379579904
00000100:00100000:3.0:1767318737.880945:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379579904
00000100:00100000:3.0:1767318737.881054:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012
00000100:00100000:3.0:1767318737.881065:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379579904:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318737.881112:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318737.881188:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379579904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (1813us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318737.881195:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012
00000100:00080000:0.0:1767318737.881385:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318737.881553:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379579904:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318738.391165:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318739.416387:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318739.416412:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379580032:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318739.416477:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318739.416756:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580032
00000100:00100000:2.0:1767318739.416765:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580032
00000100:00100000:2.0:1767318739.416842:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013
00000100:00100000:2.0:1767318739.416852:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379580032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318739.416912:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318739.416959:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379580032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (480us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318739.416967:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013
00000100:00100000:2.0:1767318739.417030:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f345500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379580032:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318739.417281:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318739.417597:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318740.443734:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318740.951192:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318740.951205:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318740.951208:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318740.951212:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318740.951217:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318740.951226:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3638
00000100:00080000:3.0:1767318740.951232:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318740.951240:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318740.951285:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc000 x1853164379580160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318740.951314:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318740.951317:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318740.951319:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318740.951324:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3638
00000100:00080000:3.0:1767318740.951326:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318740.951330:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318740.951347:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce680 x1853164379580288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318740.951418:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379580416:0@lo:400:kworker.0
00000100:00100000:0.0:1767318740.951487:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318740.951607:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580416
00000100:00100000:1.0:1767318740.951615:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580416
00000100:00100000:1.0:1767318740.951683:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265
00000100:00100000:1.0:1767318740.951693:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379580416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318740.952794:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379580160:0@lo:38:kworker.0
00000100:00100000:2.0:1767318740.952850:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318740.952903:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379580288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318740.952926:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318740.952991:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580160
00000100:00100000:2.0:1767318740.952998:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580160
00000100:00100000:2.0:1767318740.953037:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16400
00000100:00100000:2.0:1767318740.953044:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379580160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318740.953076:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318740.953116:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379580160:12345-0@lo:38:kworker.0 Request processed in 71us (265us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318740.953133:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16400
00000100:00100000:2.0:1767318740.953156:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580288
00000100:00100000:2.0:1767318740.953160:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580288
00000100:00100000:2.0:1767318740.953177:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862
00000100:00100000:2.0:1767318740.953181:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379580288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318740.953191:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318740.953216:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379580288:12345-0@lo:38:kworker.0 Request processed in 33us (289us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318740.953222:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862
00000100:00080000:2.0:1767318740.953265:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318740.953275:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318740.953279:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379580160:0@lo:38:kworker.0
00000100:00080000:2.0:1767318740.953290:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318740.953294:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318740.953296:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379580288:0@lo:38:kworker.0
00000100:00100000:2.0:1767318740.953358:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379580544:0@lo:400:kworker.0
00000100:00100000:2.0:1767318740.953389:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318740.953413:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580544
00000100:00100000:2.0:1767318740.953416:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580544
00000100:00100000:2.0:1767318740.953445:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266
00000100:00100000:2.0:1767318740.953451:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379580544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318740.953486:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379580544:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318740.953492:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266
00000100:00100000:2.0:1767318740.953519:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379580544:0@lo:400:kworker.0
00000100:00080000:2.0:1767318740.953557:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318740.958584:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318740.958605:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318740.958609:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318740.958617:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3638
00000100:00080000:3.0:1767318740.958622:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318740.958641:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318740.958666:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164379580800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318740.958691:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318740.958695:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318740.958696:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318740.958700:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3638
00000100:00080000:3.0:1767318740.958702:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318740.958706:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318740.958717:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdf80 x1853164379581056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318740.958767:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379580928:0@lo:400:kworker.0
00000100:00100000:3.0:1767318740.958835:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318740.958897:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318740.958903:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379580672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318740.958925:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318740.959366:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580928
00000100:00100000:2.0:1767318740.959376:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580928
00000100:00100000:2.0:1767318740.959447:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580672
00000100:00100000:2.0:1767318740.959451:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580672
00000100:00100000:2.0:1767318740.959476:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824
00000100:00100000:2.0:1767318740.959485:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379580928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318740.959547:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379580928:12345-0@lo:400:kworker.0 Request processed in 62us (711us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318740.959554:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824
00000100:00100000:2.0:1767318740.959571:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825
00000100:00100000:2.0:1767318740.959577:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379580672:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318740.959603:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379580672:12345-0@lo:400:kworker.0 Request processed in 26us (677us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318740.959609:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825
00000100:00100000:2.0:1767318740.959644:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379580800:0@lo:38:kworker.0
00000100:00100000:2.0:1767318740.959672:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318740.959690:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379581056:0@lo:38:kworker.0
00000100:00100000:2.0:1767318740.959710:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318740.959734:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379580800
00000100:00100000:2.0:1767318740.959738:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379580800
00000100:00100000:2.0:1767318740.959766:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379581056
00000100:00100000:2.0:1767318740.959769:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379581056
00000100:00100000:2.0:1767318740.959784:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16401
00000100:00100000:2.0:1767318740.959788:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379580800:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318740.959806:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318740.959840:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379580800:12345-0@lo:38:kworker.0 Request processed in 50us (166us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318740.959846:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16401
00000100:00100000:2.0:1767318740.959857:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16402
00000100:00100000:2.0:1767318740.959860:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379581056:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318740.959893:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318740.959916:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379581056:12345-0@lo:38:kworker.0 Request processed in 54us (205us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318740.959921:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16402
00000100:00080000:2.0:1767318740.959958:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318740.959972:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318740.959975:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379580800:0@lo:38:kworker.0
00000100:00080000:2.0:1767318740.959985:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318740.959988:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318740.959991:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379581056:0@lo:38:kworker.0
00000100:00100000:2.0:1767318740.960025:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379580672:0@lo:400:kworker.0
00000100:00100000:2.0:1767318740.960035:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379580928:0@lo:400:kworker.0
00000100:00080000:3.0:1767318740.960432:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318740.960516:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379580416:12345-0@lo:400:kworker.0 Request processed in 8823us (9027us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318740.960527:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265
00000100:00100000:0.0:1767318740.960695:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379580416:0@lo:400:kworker.0
00010000:00010000:1.0:1767318741.463187:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318741.905730:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318741.905854:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318741.906717:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878144
00000100:00100000:0.0:1767318741.906728:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878144
00000100:00100000:0.0:1767318741.906805:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878016
00000100:00100000:0.0:1767318741.906808:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878016
00000100:00100000:0.0:1767318741.906855:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3826
00000100:00100000:0.0:1767318741.906865:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291878144:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318741.907001:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291878144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 137us (1281us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318741.907009:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3826
00000100:00100000:0.0:1767318741.907030:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16403
00000100:00100000:0.0:1767318741.907035:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291878016:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318741.907056:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318741.907084:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291878016:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 48us (1238us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318741.907106:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16403
00000100:00080000:3.0:1767318741.908907:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318741.979570:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318715/real 1767318715]  req@ffff8b0e0e0ded80 x1853164379573632/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318741.979602:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0e0ded80 x1853164379573632/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318740 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318741.979630:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.979656:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318741.979660:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379573632:0@lo:250:kworker.0
00000100:00080000:1.0:1767318741.979681:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318741.979687:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318741.979690:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318741.979694:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3617
00000100:00080000:1.0:1767318741.979698:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318741.979705:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318741.979734:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f136d80 x1853164379581184/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318741.979764:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318741.979768:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318741.979769:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318741.979772:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3643
00000100:00080000:1.0:1767318741.979775:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318741.979778:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318741.979792:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f136300 x1853164379581312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318741.979800:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318741.979803:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318741.979805:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318741.979809:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3643
00000100:00080000:1.0:1767318741.979811:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318741.979814:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318741.979836:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379581440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318741.979939:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318741.979942:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318741.979944:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318741.979948:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3643
00000100:00080000:1.0:1767318741.979951:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318741.979963:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318741.979983:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859880 x1853164379581952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318741.979998:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318741.980001:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318741.980003:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318741.980006:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3643
00000100:00080000:1.0:1767318741.980008:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318741.980011:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318741.980021:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858700 x1853164379582208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318741.980046:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379581824:0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.980110:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318741.980685:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318741.980694:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379582080:0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.980723:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318741.980821:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379581824
00000100:00100000:0.0:1767318741.980838:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379581824
00000100:00100000:0.0:1767318741.980932:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582080
00000100:00100000:0.0:1767318741.980936:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582080
00000100:00100000:0.0:1767318741.980967:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827
00000100:00100000:0.0:1767318741.980982:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379581824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318741.981036:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379581824:12345-0@lo:400:kworker.0 Request processed in 62us (926us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318741.981044:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827
00000100:00100000:0.0:1767318741.981062:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828
00000100:00100000:0.0:1767318741.981068:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379582080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318741.981092:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379582080:12345-0@lo:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318741.981097:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828
00000100:00100000:0.0:1767318741.981121:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379581696:0@lo:400:kworker.0
00000100:00100000:0.0:1767318741.981157:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318741.981180:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318741.981185:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379581568:0@lo:400:kworker.0
00000100:00100000:0.0:1767318741.981202:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318741.981727:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379581696
00000100:00100000:2.0:1767318741.981732:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379581696
00000100:00100000:2.0:1767318741.981784:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379581568
00000100:00100000:2.0:1767318741.981787:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379581568
00000100:00100000:2.0:1767318741.981808:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267
00000100:00100000:2.0:1767318741.981814:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379581696:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.981890:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379581696:12345-0@lo:400:kworker.0 Request processed in 56us (711us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318741.981906:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267
00000100:00100000:2.0:1767318741.981927:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268
00000100:00100000:2.0:1767318741.981933:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379581568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.981968:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379581568:12345-0@lo:400:kworker.0 Request processed in 36us (765us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318741.981983:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268
00000100:00100000:2.0:1767318741.982051:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379581568:0@lo:400:kworker.0
00000100:00100000:2.0:1767318741.982061:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379581696:0@lo:400:kworker.0
00000100:00100000:3.0:1767318741.982485:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379581184:0@lo:250:kworker.0
00000400:00000100:3.0:1767318741.982514:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379581184 offset 0 length 520: 4
00000100:00100000:3.0:1767318741.982551:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379581312:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.982577:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.982595:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379581440:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.982617:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.982635:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379581952:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.982655:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.982672:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379582208:0@lo:38:kworker.0
00000100:00100000:3.0:1767318741.982690:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318741.982721:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379581440
00000100:00100000:3.0:1767318741.982726:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379581440
00000100:00100000:3.0:1767318741.982749:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863
00000100:00100000:3.0:1767318741.982753:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379581440:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.982770:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.982803:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379581440:12345-0@lo:38:kworker.0 Request processed in 48us (185us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.982809:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863
00000100:00100000:3.0:1767318741.982840:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379581312
00000100:00100000:3.0:1767318741.982844:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379581312
00000100:00100000:3.0:1767318741.982892:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379581952
00000100:00100000:3.0:1767318741.982907:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379581952
00000100:00100000:3.0:1767318741.982929:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582208
00000100:00100000:3.0:1767318741.982932:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582208
00000100:00100000:3.0:1767318741.982944:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16404
00000100:00100000:3.0:1767318741.982948:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379581312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.982968:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.983003:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379581312:12345-0@lo:38:kworker.0 Request processed in 53us (426us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.983009:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16404
00000100:00100000:3.0:1767318741.983020:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16405
00000100:00100000:3.0:1767318741.983024:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379581952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.983032:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.983054:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379581952:12345-0@lo:38:kworker.0 Request processed in 28us (397us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.983059:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16405
00000100:00100000:3.0:1767318741.983068:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16406
00000100:00100000:3.0:1767318741.983072:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379582208:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318741.983080:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318741.983099:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379582208:12345-0@lo:38:kworker.0 Request processed in 26us (408us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318741.983104:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16406
00000100:00080000:3.0:1767318741.983149:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.983154:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.983157:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379581312:0@lo:38:kworker.0
00000100:00080000:3.0:1767318741.983167:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.983176:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.983180:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379581440:0@lo:38:kworker.0
00000100:00080000:3.0:1767318741.983190:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.983194:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.983196:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379581952:0@lo:38:kworker.0
00000100:00080000:3.0:1767318741.983204:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318741.983207:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318741.983209:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379582208:0@lo:38:kworker.0
00000100:00100000:1.0:1767318741.984353:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379582080:0@lo:400:kworker.0
00000100:00100000:1.0:1767318741.984370:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379581824:0@lo:400:kworker.0
00000100:00080000:0.0:1767318741.985707:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767318742.489085:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318742.999117:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379582336:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318742.999451:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318742.999556:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582336
00000100:00100000:3.0:1767318742.999564:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582336
00000100:00100000:3.0:1767318742.999637:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014
00000100:00100000:3.0:1767318742.999648:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379582336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318742.999677:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318742.999742:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379582336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (291us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318742.999750:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014
00000100:00100000:1.0:1767318742.999804:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379582336:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318742.999809:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318743.519100:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318744.536305:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318744.536305:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379582464:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318744.536384:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318744.536623:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582464
00000100:00100000:2.0:1767318744.536633:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582464
00000100:00100000:2.0:1767318744.536697:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015
00000100:00100000:2.0:1767318744.536706:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379582464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318744.536736:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318744.536781:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379582464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (397us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318744.536789:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015
00000100:00080000:0.0:1767318744.536851:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318744.537068:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379582464:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318745.560190:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767318746.585527:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318747.024234:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318747.024391:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878400
00000100:00100000:2.0:1767318747.024401:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878400
00000100:00100000:2.0:1767318747.024490:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3829
00000100:00100000:2.0:1767318747.024502:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291878400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318747.024589:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291878400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (366us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318747.024598:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3829
00000100:00080000:0.0:1767318747.024973:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318747.029363:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318747.029520:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878272
00000100:00100000:3.0:1767318747.029530:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878272
00000100:00100000:3.0:1767318747.029580:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16407
00000100:00100000:3.0:1767318747.029589:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291878272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318747.029627:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318747.029697:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291878272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 108us (343us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318747.029705:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16407
00000100:00080000:1.0:1767318747.095073:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318747.095085:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318747.095088:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318747.095092:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318747.095097:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318747.095104:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3644
00000100:00080000:1.0:1767318747.095109:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318747.095116:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318747.095157:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858e00 x1853164379582592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318747.095182:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318747.095186:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318747.095188:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318747.095191:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3644
00000100:00080000:1.0:1767318747.095193:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318747.095197:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318747.095209:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85aa00 x1853164379582720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318747.095268:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318747.095271:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318747.095288:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318747.095291:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3644
00000100:00080000:1.0:1767318747.095293:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318747.095297:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318747.095309:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b800 x1853164379583232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318747.095326:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318747.095329:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318747.095342:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318747.095346:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3644
00000100:00080000:1.0:1767318747.095348:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318747.095352:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318747.095364:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858700 x1853164379583488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318747.095408:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379582976:0@lo:400:kworker.0
00000100:00100000:1.0:1767318747.095478:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318747.095543:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318747.095550:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379582848:0@lo:400:kworker.0
00000100:00100000:1.0:1767318747.095573:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318747.095605:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582976
00000100:00100000:1.0:1767318747.095611:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582976
00000100:00100000:1.0:1767318747.095663:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582848
00000100:00100000:1.0:1767318747.095666:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582848
00000100:00100000:1.0:1767318747.095689:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269
00000100:00100000:1.0:1767318747.095698:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379582976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318747.095747:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379582976:12345-0@lo:400:kworker.0 Request processed in 50us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318747.095761:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269
00000100:00100000:1.0:1767318747.095782:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270
00000100:00100000:1.0:1767318747.095788:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379582848:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318747.095834:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379582848:12345-0@lo:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318747.095840:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270
00000100:00080000:1.0:1767318747.095861:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318747.095865:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318747.095939:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379582848:0@lo:400:kworker.0
00000100:00100000:1.0:1767318747.095950:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379582976:0@lo:400:kworker.0
00000100:00100000:3.0:1767318747.096686:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379582592:0@lo:38:kworker.0
00000100:00100000:3.0:1767318747.096727:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318747.096768:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379582720:0@lo:38:kworker.0
00000100:00100000:3.0:1767318747.096793:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318747.097159:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379583232:0@lo:38:kworker.0
00000100:00100000:3.0:1767318747.097186:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318747.097204:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379583488:0@lo:38:kworker.0
00000100:00100000:3.0:1767318747.097224:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318747.097260:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379583360:0@lo:400:kworker.0
00000100:00100000:3.0:1767318747.097282:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318747.097301:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318747.097306:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379583104:0@lo:400:kworker.0
00000100:00100000:3.0:1767318747.097326:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318747.097353:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582720
00000100:00100000:3.0:1767318747.097360:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582720
00000100:00100000:3.0:1767318747.097388:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864
00000100:00100000:3.0:1767318747.097394:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379582720:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318747.097506:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379582592
00000100:00100000:1.0:1767318747.097511:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379582592
00000100:00100000:1.0:1767318747.097530:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379583232
00000100:00100000:1.0:1767318747.097533:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379583232
00000100:00100000:1.0:1767318747.097539:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379583488
00000100:00100000:1.0:1767318747.097541:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379583488
00000100:00100000:1.0:1767318747.097547:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379583360
00000100:00100000:1.0:1767318747.097549:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379583360
00010000:00020000:3.0:1767318747.097599:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318747.097638:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379582720:12345-0@lo:38:kworker.0 Request processed in 243us (844us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318747.097661:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864
00000100:00100000:2.0:1767318747.097817:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379583104
00000100:00100000:2.0:1767318747.097822:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379583104
00000100:00100000:2.0:1767318747.097847:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830
00000100:00100000:2.0:1767318747.097854:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379583104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318747.097926:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379583104:12345-0@lo:400:kworker.0 Request processed in 72us (598us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318747.097932:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830
00000100:00100000:2.0:1767318747.097947:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16408
00000100:00100000:2.0:1767318747.097950:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379582592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318747.097960:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318747.097985:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379582592:12345-0@lo:38:kworker.0 Request processed in 33us (1258us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318747.097991:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16408
00000100:00100000:2.0:1767318747.098006:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16409
00000100:00100000:2.0:1767318747.098010:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379583232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318747.098020:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318747.098041:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379583232:12345-0@lo:38:kworker.0 Request processed in 29us (854us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318747.098046:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16409
00000100:00100000:2.0:1767318747.098058:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16410
00000100:00100000:2.0:1767318747.098062:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379583488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318747.098071:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318747.098091:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379583488:12345-0@lo:38:kworker.0 Request processed in 27us (866us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318747.098096:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16410
00000100:00080000:2.0:1767318747.098155:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318747.098160:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318747.098164:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379582592:0@lo:38:kworker.0
00000100:00080000:2.0:1767318747.098177:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318747.098180:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318747.098183:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379582720:0@lo:38:kworker.0
00000100:00080000:2.0:1767318747.098191:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318747.098194:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318747.098196:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379583232:0@lo:38:kworker.0
00000100:00080000:2.0:1767318747.098203:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318747.098205:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318747.098208:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379583488:0@lo:38:kworker.0
00000100:00100000:2.0:1767318747.098249:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379583104:0@lo:400:kworker.0
00000100:00100000:1.0:1767318747.098482:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831
00000100:00100000:1.0:1767318747.098491:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379583360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318747.098531:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379583360:12345-0@lo:400:kworker.0 Request processed in 43us (1248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318747.098537:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831
00000100:00080000:1.0:1767318747.098556:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318747.098998:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379583360:0@lo:400:kworker.0
00010000:00010000:1.0:1767318747.607507:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318748.119203:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379583616:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318748.119300:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318748.119408:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379583616
00000100:00100000:2.0:1767318748.119419:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379583616
00000100:00100000:2.0:1767318748.119494:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016
00000100:00100000:2.0:1767318748.119504:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379583616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318748.119535:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318748.123179:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379583616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3666us (3868us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318748.123196:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016
00000100:00100000:0.0:1767318748.123294:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379583616:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318748.631170:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318749.655140:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318749.655295:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379583744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318749.655386:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318749.655509:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379583744
00000100:00100000:3.0:1767318749.655519:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379583744
00000100:00100000:3.0:1767318749.655588:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017
00000100:00100000:3.0:1767318749.655598:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379583744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318749.655628:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318749.655693:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318749.657591:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379583744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1986us (2196us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318749.657608:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017
00000100:00100000:1.0:1767318749.662954:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379583744:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767318750.680553:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318751.703549:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318752.143607:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318752.143739:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878656
00000100:00100000:3.0:1767318752.143747:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878656
00000100:00100000:3.0:1767318752.143811:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3832
00000100:00100000:3.0:1767318752.143819:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291878656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318752.143949:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291878656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 130us (355us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318752.143957:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3832
00000100:00100000:3.0:1767318752.145157:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318752.145245:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878528
00000100:00100000:1.0:1767318752.145254:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878528
00000100:00080000:0.0:1767318752.145363:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318752.145409:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16411
00000100:00100000:1.0:1767318752.145417:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291878528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318752.145438:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318752.158763:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291878528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 13335us (13601us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318752.158778:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16411
00000100:00080000:1.0:1767318752.215051:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318752.215064:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318752.215067:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318752.215071:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318752.215077:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318752.215087:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3649
00000100:00080000:1.0:1767318752.215094:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318752.215102:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318752.215158:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859f80 x1853164379583872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318752.215188:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318752.215192:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318752.215213:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318752.215217:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3649
00000100:00080000:1.0:1767318752.215220:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318752.215226:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318752.215241:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b480 x1853164379584000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318752.215309:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318752.215312:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318752.215314:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318752.215318:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3649
00000100:00080000:1.0:1767318752.215320:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318752.215324:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318752.215335:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858e00 x1853164379584512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318752.215365:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318752.215368:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318752.215370:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318752.215374:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3649
00000100:00080000:1.0:1767318752.215376:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318752.215380:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318752.215386:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379583872:0@lo:38:kworker.0
00000100:00100000:1.0:1767318752.215389:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330000 x1853164379584768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318752.215412:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379584640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318752.215479:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379584256:0@lo:400:kworker.0
00000100:00100000:2.0:1767318752.215498:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379584128:0@lo:400:kworker.0
00000100:00100000:3.0:1767318752.220093:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318752.220169:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379584000:0@lo:38:kworker.0
00000100:00100000:3.0:1767318752.220213:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318752.220240:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379584512:0@lo:38:kworker.0
00000100:00100000:3.0:1767318752.220342:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318752.220383:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379584768:0@lo:38:kworker.0
00000100:00100000:3.0:1767318752.220424:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318752.220476:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379583872
00000100:00100000:3.0:1767318752.220484:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379583872
00000100:00100000:3.0:1767318752.221172:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584512
00000100:00100000:3.0:1767318752.221179:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584512
00000100:00100000:3.0:1767318752.221212:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584768
00000100:00100000:3.0:1767318752.221216:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584768
00000100:00100000:3.0:1767318752.221235:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16412
00000100:00100000:3.0:1767318752.221242:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379583872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318752.222642:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318752.222750:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379583872:12345-0@lo:38:kworker.0 Request processed in 1505us (2663us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318752.222761:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16412
00000100:00100000:3.0:1767318752.222803:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16413
00000100:00100000:3.0:1767318752.222809:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379584512:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318752.222827:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318752.222855:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379584512:12345-0@lo:38:kworker.0 Request processed in 46us (2591us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318752.222885:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16413
00000100:00100000:3.0:1767318752.222898:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16414
00000100:00100000:3.0:1767318752.222902:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379584768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318752.222912:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318752.222939:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379584768:12345-0@lo:38:kworker.0 Request processed in 35us (2514us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318752.222945:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16414
00000100:00080000:3.0:1767318752.223006:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318752.223026:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318752.223030:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379584768:0@lo:38:kworker.0
00000100:00080000:3.0:1767318752.223047:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318752.223050:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318752.223054:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379583872:0@lo:38:kworker.0
00000100:00080000:3.0:1767318752.223063:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318752.223065:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318752.223068:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379584512:0@lo:38:kworker.0
00000100:00100000:3.0:1767318752.223340:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584000
00000100:00100000:3.0:1767318752.223348:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584000
00000100:00100000:3.0:1767318752.223377:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865
00000100:00100000:3.0:1767318752.223382:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379584000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318752.223393:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318752.223430:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379584000:12345-0@lo:38:kworker.0 Request processed in 47us (3216us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318752.223436:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865
00000100:00080000:3.0:1767318752.223464:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318752.223468:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318752.223471:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379584000:0@lo:38:kworker.0
00000100:00100000:3.0:1767318752.223507:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379584384:0@lo:400:kworker.0
00000100:00100000:3.0:1767318752.223988:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318752.224031:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584384
00000100:00100000:3.0:1767318752.224035:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584384
00000100:00100000:3.0:1767318752.224085:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833
00000100:00100000:3.0:1767318752.224091:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379584384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318752.224147:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379584384:12345-0@lo:400:kworker.0 Request processed in 56us (159us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318752.224154:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833
00000100:00100000:3.0:1767318752.224186:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379584384:0@lo:400:kworker.0
00000100:00080000:3.0:1767318752.224212:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318752.225067:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318752.225304:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318752.225487:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584256
00000100:00100000:1.0:1767318752.225494:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584256
00000100:00100000:3.0:1767318752.225583:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584640
00000100:00100000:3.0:1767318752.225589:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584640
00000100:00100000:1.0:1767318752.225593:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271
00000100:00100000:1.0:1767318752.225605:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379584256:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767318752.225670:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318752.225674:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318752.226153:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379584256:12345-0@lo:400:kworker.0 Request processed in 547us (845us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318752.226164:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271
00000100:00100000:0.0:1767318752.226247:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379584256:0@lo:400:kworker.0
00000100:00100000:2.0:1767318752.227934:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318752.228170:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584128
00000100:00100000:1.0:1767318752.228180:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584128
00000100:00100000:1.0:1767318752.228271:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272
00000100:00100000:1.0:1767318752.228282:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379584128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318752.228358:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379584128:12345-0@lo:400:kworker.0 Request processed in 79us (440us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318752.228365:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272
00000100:00100000:2.0:1767318752.228669:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379584128:0@lo:400:kworker.0
00000100:00080000:0.0:1767318752.230284:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318752.232054:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834
00000100:00100000:3.0:1767318752.232070:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379584640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318752.232175:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379584640:12345-0@lo:400:kworker.0 Request processed in 110us (7110us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318752.232182:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834
00000100:00100000:1.0:1767318752.232522:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379584640:0@lo:400:kworker.0
00010000:00010000:2.0:1767318752.727569:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318753.240092:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318753.240112:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379584896:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318753.240180:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318753.241004:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379584896
00000100:00100000:3.0:1767318753.241014:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379584896
00000100:00100000:3.0:1767318753.241075:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018
00000100:00100000:3.0:1767318753.241085:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379584896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318753.241118:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318753.241193:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379584896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (1013us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318753.241201:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018
00000100:00100000:1.0:1767318753.241303:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379584896:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318753.751216:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318754.775585:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318754.775621:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379585024:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318754.775687:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318754.775896:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585024
00000100:00100000:0.0:1767318754.775904:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585024
00000100:00100000:0.0:1767318754.775971:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019
00000100:00100000:0.0:1767318754.776200:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379585024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318754.776228:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318754.776292:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379585024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 314us (604us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318754.776357:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019
00000100:00080000:3.0:1767318754.776432:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318754.776518:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379585024:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318754.776574:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318755.799886:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318756.823550:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318757.267153:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318757.267242:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878912
00000100:00100000:3.0:1767318757.267255:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878912
00000100:00100000:3.0:1767318757.267362:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3835
00000100:00100000:3.0:1767318757.267374:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291878912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318757.267463:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291878912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (319us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318757.267472:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3835
00000100:00080000:0.0:1767318757.268186:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318757.268453:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318757.268576:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291878784
00000100:00100000:1.0:1767318757.268582:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291878784
00000100:00100000:1.0:1767318757.268617:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16415
00000100:00100000:1.0:1767318757.268623:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291878784:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318757.268678:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318757.268736:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291878784:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 111us (286us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318757.268754:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16415
00000100:00080000:3.0:1767318757.335766:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318757.335777:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318757.335780:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318757.335784:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318757.335789:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318757.335797:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3654
00000100:00080000:3.0:1767318757.335802:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767318757.335809:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318757.335862:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164379585152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318757.335902:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318757.335904:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318757.335905:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318757.335908:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3654
00000100:00080000:3.0:1767318757.335910:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767318757.335913:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318757.335924:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff480 x1853164379585280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318757.336067:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318757.336082:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318757.336084:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318757.336087:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3654
00000100:00080000:3.0:1767318757.336089:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767318757.336092:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318757.336100:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd180 x1853164379585792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318757.336111:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318757.336113:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318757.336115:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318757.336117:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3654
00000100:00080000:3.0:1767318757.336119:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318757.336121:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318757.336127:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baffb80 x1853164379586048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318757.336146:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379585536:0@lo:400:kworker.0
00000100:00100000:3.0:1767318757.336167:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379585664:0@lo:400:kworker.0
00000100:00100000:2.0:1767318757.336230:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318757.336238:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318757.336299:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379585408:0@lo:400:kworker.0
00000100:00100000:2.0:1767318757.336590:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585536
00000100:00100000:2.0:1767318757.336597:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585536
00000100:00100000:2.0:1767318757.336674:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273
00000100:00100000:2.0:1767318757.336683:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379585536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318757.336849:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379585152:0@lo:38:kworker.0
00000100:00100000:3.0:1767318757.347788:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585664
00000100:00100000:3.0:1767318757.347804:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585664
00000100:00100000:3.0:1767318757.347909:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836
00000100:00100000:3.0:1767318757.347918:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379585664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318757.348206:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379585920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318757.348274:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318757.348319:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585920
00000100:00100000:1.0:1767318757.348322:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585920
00000100:00100000:1.0:1767318757.348345:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837
00000100:00100000:1.0:1767318757.348349:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379585920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318757.348375:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379585920:12345-0@lo:400:kworker.0 Request processed in 25us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318757.348379:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837
00000100:00100000:1.0:1767318757.348413:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379585920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318757.348444:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318757.348462:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585408
00000100:00100000:1.0:1767318757.348465:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585408
00000100:00100000:1.0:1767318757.348541:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274
00000100:00100000:1.0:1767318757.348545:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379585408:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318757.348566:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379585408:12345-0@lo:400:kworker.0 Request processed in 21us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318757.348570:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274
00000100:00100000:1.0:1767318757.348595:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379585408:0@lo:400:kworker.0
00000100:00080000:1.0:1767318757.348708:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318757.348712:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318757.348715:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318757.351172:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379585536:12345-0@lo:400:kworker.0 Request processed in 14479us (14930us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318757.351190:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273
00000100:00100000:1.0:1767318757.351415:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379585536:0@lo:400:kworker.0
00000100:00100000:0.0:1767318757.362132:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318757.362189:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379585280:0@lo:38:kworker.0
00000100:00100000:0.0:1767318757.362253:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318757.362290:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379585792:0@lo:38:kworker.0
00000100:00100000:0.0:1767318757.362314:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318757.362326:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379586048:0@lo:38:kworker.0
00000100:00100000:0.0:1767318757.362347:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318757.362372:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585152
00000100:00100000:0.0:1767318757.362380:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585152
00000100:00100000:2.0:1767318757.362382:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585792
00000100:00100000:2.0:1767318757.362389:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585792
00000100:00100000:0.0:1767318757.362417:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586048
00000100:00100000:0.0:1767318757.362422:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586048
00000100:00100000:2.0:1767318757.370168:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16416
00000100:00100000:2.0:1767318757.370182:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379585152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318757.370206:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318757.370311:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379585152:12345-0@lo:38:kworker.0 Request processed in 130us (8188us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318757.370319:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16416
00000100:00100000:2.0:1767318757.370342:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16417
00000100:00100000:2.0:1767318757.370346:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379585792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318757.370357:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318757.370378:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16418
00000100:00100000:2.0:1767318757.370383:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379585792:12345-0@lo:38:kworker.0 Request processed in 33us (8067us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318757.370391:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379586048:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318757.370400:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16417
00010000:00020000:3.0:1767318757.370409:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318757.370458:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318757.370464:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318757.370469:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379585152:0@lo:38:kworker.0
00000100:00100000:3.0:1767318757.370478:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379586048:12345-0@lo:38:kworker.0 Request processed in 87us (8128us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767318757.370482:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318757.370488:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16418
00000100:00080000:2.0:1767318757.370489:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318757.370495:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379585792:0@lo:38:kworker.0
00000100:00080000:2.0:1767318757.370504:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318757.370508:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318757.370512:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379586048:0@lo:38:kworker.0
00000100:00100000:3.0:1767318757.370559:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379585664:12345-0@lo:400:kworker.0 Request processed in 22640us (34319us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318757.370563:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379585280
00000100:00100000:3.0:1767318757.370569:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836
00000100:00100000:2.0:1767318757.370571:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379585280
00000100:00100000:2.0:1767318757.370608:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866
00000100:00100000:2.0:1767318757.370614:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379585280:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318757.370615:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379585664:0@lo:400:kworker.0
00010000:00020000:2.0:1767318757.370630:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318757.370663:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379585280:12345-0@lo:38:kworker.0 Request processed in 49us (8410us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318757.370671:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866
00000100:00080000:2.0:1767318757.370693:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318757.370696:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318757.370700:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379585280:0@lo:38:kworker.0
00010000:00010000:1.0:1767318757.855249:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318758.288131:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318758.288238:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291879040
00000100:00100000:0.0:1767318758.288248:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291879040
00000100:00100000:0.0:1767318758.288309:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16419
00000100:00100000:0.0:1767318758.288319:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291879040:12345-192.168.202.33@tcp:17:kworker.0
00000100:00100000:0.0:1767318758.288415:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291879040:12345-192.168.202.33@tcp:17:kworker.0 Request processed in 97us (294us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318758.288423:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16419
00000100:00100000:0.0:1767318758.360343:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318758.360370:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379586176:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318758.360452:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318758.360563:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586176
00000100:00100000:3.0:1767318758.360572:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586176
00000100:00100000:3.0:1767318758.360663:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020
00000100:00100000:3.0:1767318758.360673:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379586176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318758.360701:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318758.360754:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379586176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (302us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318758.360762:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020
00000100:00100000:1.0:1767318758.360850:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379586176:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318758.873671:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318759.896645:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379586304:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318759.896831:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767318759.897123:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318759.897384:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586304
00000100:00100000:2.0:1767318759.897403:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586304
00000100:00100000:2.0:1767318759.897478:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021
00000100:00100000:2.0:1767318759.897488:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379586304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318759.897518:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318759.897566:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379586304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (735us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318759.897573:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021
00000100:00080000:1.0:1767318759.897909:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318759.897932:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379586304:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318760.919420:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318761.946705:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318762.383740:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767318762.383797:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291879424 offset 0 length 520: 4
00000100:00100000:1.0:1767318762.383915:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291879168
00000100:00100000:1.0:1767318762.383926:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291879168
00000100:00100000:1.0:1767318762.383993:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16420
00000100:00100000:1.0:1767318762.384002:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291879168:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318762.384042:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318762.384115:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291879168:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 112us (387us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318762.384123:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16420
00000100:00100000:3.0:1767318762.384824:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318762.384924:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291879296
00000100:00100000:0.0:1767318762.384932:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291879296
00000100:00100000:0.0:1767318762.385019:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3838
00000100:00100000:0.0:1767318762.385030:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291879296:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318762.385109:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291879296:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (288us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318762.385117:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3838
00000100:00080000:1.0:1767318762.386279:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318762.455588:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318762.455600:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318762.455604:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318762.455608:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318762.455612:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318762.455621:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3659
00000100:00080000:3.0:1767318762.455627:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767318762.455634:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318762.455722:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd180 x1853164379586432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318762.455755:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318762.455759:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318762.455761:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318762.455765:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3659
00000100:00080000:3.0:1767318762.455777:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767318762.455780:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318762.455793:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164379586560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318762.455859:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318762.455862:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318762.455864:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318762.455884:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3659
00000100:00080000:3.0:1767318762.455887:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767318762.455890:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318762.455899:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd500 x1853164379587072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318762.455914:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318762.455917:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318762.455919:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318762.455922:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3659
00000100:00080000:3.0:1767318762.455923:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318762.455927:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318762.455941:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858700 x1853164379587328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318762.455966:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379586944:0@lo:400:kworker.0
00000100:00100000:3.0:1767318762.456022:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318762.456083:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318762.456088:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379587200:0@lo:400:kworker.0
00000100:00100000:3.0:1767318762.456106:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318762.456138:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586944
00000100:00100000:3.0:1767318762.456144:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586944
00000100:00100000:3.0:1767318762.456213:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379587200
00000100:00100000:3.0:1767318762.456216:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379587200
00000100:00100000:3.0:1767318762.456245:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839
00000100:00100000:3.0:1767318762.456253:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379586944:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318762.456297:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379586944:12345-0@lo:400:kworker.0 Request processed in 44us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318762.456304:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839
00000100:00100000:3.0:1767318762.456317:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840
00000100:00100000:3.0:1767318762.456322:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379587200:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318762.456343:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379587200:12345-0@lo:400:kworker.0 Request processed in 21us (235us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318762.456349:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840
00000100:00100000:2.0:1767318762.456361:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379586816:0@lo:400:kworker.0
00000100:00080000:3.0:1767318762.456366:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318762.456400:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379587200:0@lo:400:kworker.0
00000100:00100000:0.0:1767318762.456546:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379586432:0@lo:38:kworker.0
00000100:00100000:3.0:1767318762.456837:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379586944:0@lo:400:kworker.0
00000100:00100000:1.0:1767318762.457015:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379586688:0@lo:400:kworker.0
00000100:00100000:1.0:1767318762.457045:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318762.457245:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586688
00000100:00100000:3.0:1767318762.457257:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586688
00000100:00100000:3.0:1767318762.457298:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275
00000100:00100000:3.0:1767318762.457312:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379586688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318762.457344:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379586688:12345-0@lo:400:kworker.0 Request processed in 41us (298us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318762.457350:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275
00000100:00080000:1.0:1767318762.459776:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318762.459838:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379586688:0@lo:400:kworker.0
00000100:00100000:2.0:1767318762.464022:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318762.464221:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586816
00000100:00100000:1.0:1767318762.464233:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586816
00000100:00100000:1.0:1767318762.464316:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276
00000100:00100000:1.0:1767318762.464326:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379586816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318762.464406:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379586816:12345-0@lo:400:kworker.0 Request processed in 83us (1278us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318762.464414:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276
00000100:00080000:3.0:1767318762.464580:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318762.464657:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379586816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318762.470335:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318762.470393:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379586560:0@lo:38:kworker.0
00000100:00100000:1.0:1767318762.470427:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318762.470463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379587072:0@lo:38:kworker.0
00000100:00100000:1.0:1767318762.470496:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318762.470516:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379587328:0@lo:38:kworker.0
00000100:00100000:1.0:1767318762.470534:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318762.470581:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586432
00000100:00100000:1.0:1767318762.470588:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586432
00000100:00100000:1.0:1767318762.470619:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379587072
00000100:00100000:1.0:1767318762.470621:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379587072
00000100:00100000:1.0:1767318762.470631:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379587328
00000100:00100000:1.0:1767318762.470633:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379587328
00000100:00100000:1.0:1767318762.470649:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16421
00000100:00100000:1.0:1767318762.470656:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379586432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318762.470677:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318762.470718:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379586432:12345-0@lo:38:kworker.0 Request processed in 61us (389us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318762.470725:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16421
00000100:00100000:1.0:1767318762.470758:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16422
00000100:00100000:1.0:1767318762.470763:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379587072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318762.470783:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318762.470805:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379587072:12345-0@lo:38:kworker.0 Request processed in 42us (309us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318762.470812:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16422
00000100:00100000:1.0:1767318762.470824:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16423
00000100:00100000:1.0:1767318762.470827:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379587328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318762.470850:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318762.470895:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379587328:12345-0@lo:38:kworker.0 Request processed in 66us (360us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318762.470900:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16423
00000100:00080000:1.0:1767318762.470934:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318762.470938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318762.470942:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379586432:0@lo:38:kworker.0
00000100:00080000:1.0:1767318762.470949:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318762.470952:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318762.470954:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379587072:0@lo:38:kworker.0
00000100:00080000:1.0:1767318762.470960:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318762.470962:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318762.470964:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379587328:0@lo:38:kworker.0
00000100:00100000:2.0:1767318762.471265:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379586560
00000100:00100000:2.0:1767318762.471270:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379586560
00000100:00100000:2.0:1767318762.471305:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867
00000100:00100000:2.0:1767318762.471310:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379586560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318762.471320:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318762.471364:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379586560:12345-0@lo:38:kworker.0 Request processed in 53us (937us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318762.471371:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867
00000100:00080000:1.0:1767318762.472039:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318762.472045:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318762.472048:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379586560:0@lo:38:kworker.0
00010000:00010000:1.0:1767318762.967189:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318763.479300:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318763.479339:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379587456:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318763.479424:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318763.479529:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379587456
00000100:00100000:3.0:1767318763.479536:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379587456
00000100:00100000:3.0:1767318763.479616:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022
00000100:00100000:3.0:1767318763.479627:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379587456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318763.479676:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318763.479726:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379587456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318763.479736:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022
00000100:00100000:3.0:1767318763.479802:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379587456:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318763.991591:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318765.015202:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318765.015988:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318765.019532:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379587584:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318765.019684:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318765.020089:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379587584
00000100:00100000:3.0:1767318765.020098:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379587584
00000100:00100000:3.0:1767318765.020198:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023
00000100:00100000:3.0:1767318765.020213:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379587584:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318765.020225:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:3.0:1767318765.020268:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318765.020354:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379587584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (669us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318765.020361:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023
00000100:00100000:1.0:1767318765.020490:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379587584:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318766.039461:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318766.551105:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318741/real 1767318741]  req@ffff8b0f2f136d80 x1853164379581184/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318766 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318766.551186:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f136d80 x1853164379581184/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318766 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318766.551212:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318766.551261:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318766.551265:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379581184:0@lo:250:kworker.0
00000100:00080000:2.0:1767318766.551501:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318766.551507:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318766.551510:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318766.551514:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3644
00000100:00080000:2.0:1767318766.551519:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318766.551524:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318766.551554:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e85180 x1853164379587712/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318766.551580:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318766.551584:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318766.551586:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318766.551601:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3664
00000100:00080000:2.0:1767318766.551605:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767318766.551609:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318766.551803:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379587712:0@lo:250:kworker.0
00000400:00000100:1.0:1767318766.551867:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379587712 offset 0 length 520: 4
00000100:00100000:2.0:1767318766.551981:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e84e00 x1853164379587840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318766.552003:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318766.552007:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318766.552009:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318766.552013:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3664
00000100:00080000:2.0:1767318766.552016:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767318766.552032:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318766.552047:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e85500 x1853164379587968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318766.552110:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318766.552114:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318766.552116:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318766.552119:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3664
00000100:00080000:2.0:1767318766.552122:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767318766.552125:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318766.552136:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e85c00 x1853164379588480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318766.552151:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318766.552154:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318766.552156:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318766.552159:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3664
00000100:00080000:2.0:1767318766.552161:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318766.552177:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318766.552187:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f27e84380 x1853164379588736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318766.552210:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379588352:0@lo:400:kworker.0
00000100:00100000:2.0:1767318766.552256:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318766.552290:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318766.552295:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379588608:0@lo:400:kworker.0
00000100:00100000:1.0:1767318766.552437:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379587840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318766.552550:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379588224:0@lo:400:kworker.0
00000100:00100000:3.0:1767318766.552584:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379588096:0@lo:400:kworker.0
00000100:00100000:2.0:1767318766.556841:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318766.556964:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318766.557126:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588352
00000100:00100000:2.0:1767318766.557136:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588352
00000100:00100000:2.0:1767318766.557262:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588608
00000100:00100000:2.0:1767318766.557265:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588608
00000100:00100000:2.0:1767318766.557285:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379587840
00000100:00100000:2.0:1767318766.557288:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379587840
00000100:00100000:2.0:1767318766.557305:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841
00000100:00100000:0.0:1767318766.557902:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318766.557970:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588224
00000100:00100000:0.0:1767318766.557974:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588224
00000100:00100000:3.0:1767318766.558123:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318766.558166:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588096
00000100:00100000:3.0:1767318766.558171:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588096
00000100:00100000:3.0:1767318766.558354:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277
00000100:00100000:3.0:1767318766.558364:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379588096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318766.558427:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379588096:12345-0@lo:400:kworker.0 Request processed in 65us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318766.558434:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277
00000100:00100000:3.0:1767318766.558484:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379588096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318766.558527:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842
00000100:00100000:3.0:1767318766.558536:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379588608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318766.558590:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10901880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379588608:12345-0@lo:400:kworker.0 Request processed in 56us (1758us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318766.558597:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842
00000100:00100000:3.0:1767318766.558614:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16424
00000100:00100000:3.0:1767318766.558619:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379587840:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318766.558638:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318766.558670:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379587840:12345-0@lo:38:kworker.0 Request processed in 49us (1706us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318766.558676:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16424
00000100:00100000:3.0:1767318766.558710:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379588608:0@lo:400:kworker.0
00000100:00100000:2.0:1767318766.558983:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379588352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318766.559027:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379588352:12345-0@lo:400:kworker.0 Request processed in 1698us (6769us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318766.559034:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841
00000100:00080000:2.0:1767318766.559072:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318766.559077:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318766.560589:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278
00000100:00100000:0.0:1767318766.560608:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379588224:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318766.560689:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379588224:12345-0@lo:400:kworker.0 Request processed in 89us (2786us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318766.560696:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278
00000100:00100000:0.0:1767318766.560938:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379588224:0@lo:400:kworker.0
00000100:00100000:1.0:1767318766.564173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379587968:0@lo:38:kworker.0
00000100:00100000:1.0:1767318766.564789:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318766.564837:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379588480:0@lo:38:kworker.0
00000100:00100000:1.0:1767318766.564887:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318766.564917:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379588736:0@lo:38:kworker.0
00000100:00100000:1.0:1767318766.564938:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318766.564966:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588480
00000100:00100000:1.0:1767318766.564974:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588480
00000100:00100000:1.0:1767318766.565008:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588736
00000100:00100000:1.0:1767318766.565011:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588736
00000100:00100000:2.0:1767318766.565177:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379587968
00000100:00100000:2.0:1767318766.565191:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379587968
00000100:00100000:2.0:1767318766.565255:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868
00000100:00100000:2.0:1767318766.565262:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379587968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318766.565283:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318766.565324:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379587968:12345-0@lo:38:kworker.0 Request processed in 61us (535us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318766.565332:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868
00000100:00100000:2.0:1767318766.565377:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16425
00000100:00100000:2.0:1767318766.565382:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379588480:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318766.565392:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318766.565417:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379588480:12345-0@lo:38:kworker.0 Request processed in 34us (549us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318766.565423:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16425
00000100:00100000:2.0:1767318766.565456:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16426
00000100:00100000:2.0:1767318766.565460:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379588736:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318766.565468:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318766.565490:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379588736:12345-0@lo:38:kworker.0 Request processed in 29us (552us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318766.565496:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16426
00000100:00080000:1.0:1767318766.565727:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318766.565741:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318766.565745:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379588736:0@lo:38:kworker.0
00000100:00080000:1.0:1767318766.565772:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318766.565788:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318766.565792:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379587840:0@lo:38:kworker.0
00000100:00080000:1.0:1767318766.565804:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318766.565808:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318766.565810:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379587968:0@lo:38:kworker.0
00000100:00080000:1.0:1767318766.565817:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318766.565821:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318766.565823:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379588480:0@lo:38:kworker.0
00000100:00100000:3.0:1767318766.566713:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379588352:0@lo:400:kworker.0
00010000:00010000:1.0:1767318767.063110:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318767.503243:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318767.503855:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291879680
00000100:00100000:1.0:1767318767.503913:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291879680
00000100:00100000:3.0:1767318767.507027:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318767.507159:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291879552
00000100:00100000:0.0:1767318767.507169:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291879552
00000100:00100000:0.0:1767318767.507227:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16427
00000100:00100000:0.0:1767318767.507238:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291879552:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318767.507266:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318767.507341:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291879552:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 104us (326us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318767.507367:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16427
00000100:00100000:1.0:1767318767.508389:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3843
00000100:00100000:1.0:1767318767.508399:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291879680:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318767.508450:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291879680:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 54us (5219us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318767.508457:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3843
00000100:00080000:2.0:1767318767.514507:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318768.089107:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318768.599756:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379588864:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318768.599856:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318768.599988:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588864
00000100:00100000:0.0:1767318768.599997:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588864
00000100:00100000:0.0:1767318768.600081:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024
00000100:00100000:0.0:1767318768.600105:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379588864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318768.600145:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318768.600190:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379588864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (333us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318768.600198:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024
00000100:00100000:1.0:1767318768.600406:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379588864:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318768.600442:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318769.111328:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318770.135287:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318770.136417:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318770.136441:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379588992:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318770.136588:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318770.136765:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379588992
00000100:00100000:3.0:1767318770.136776:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379588992
00000100:00100000:3.0:1767318770.136902:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025
00000100:00100000:3.0:1767318770.136911:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379588992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318770.136954:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318770.137012:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379588992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (424us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318770.137021:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025
00000100:00100000:1.0:1767318770.137713:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379588992:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318770.137745:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318771.160590:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318771.675061:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318771.675072:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318771.675076:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318771.675079:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318771.675083:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318771.675091:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3668
00000100:00080000:0.0:1767318771.675095:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318771.675102:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318771.675142:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7ca80 x1853164379589120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318771.675173:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318771.675177:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318771.675187:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318771.675191:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3668
00000100:00080000:0.0:1767318771.675194:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318771.675215:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379589120:0@lo:38:kworker.0
00000100:00080000:0.0:1767318771.675256:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318771.675274:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7d500 x1853164379589248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318771.675308:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318771.675331:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379589376:0@lo:400:kworker.0
00000100:00100000:2.0:1767318771.675365:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318771.675381:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379589248:0@lo:38:kworker.0
00000100:00100000:3.0:1767318771.675449:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379589120
00000100:00100000:3.0:1767318771.675458:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379589120
00000100:00100000:3.0:1767318771.675500:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16428
00000100:00100000:3.0:1767318771.675508:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379589120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318771.675532:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318771.675592:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379589120:12345-0@lo:38:kworker.0 Request processed in 70us (270us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318771.675598:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16428
00000100:00100000:3.0:1767318771.675657:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379589376
00000100:00100000:1.0:1767318771.675690:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318771.675719:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379589248
00000100:00100000:1.0:1767318771.675724:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379589248
00000100:00100000:1.0:1767318771.675748:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869
00000100:00100000:1.0:1767318771.675752:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379589248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318771.675763:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318771.675787:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379589248:12345-0@lo:38:kworker.0 Request processed in 34us (106us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318771.675793:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869
00000100:00080000:1.0:1767318771.675859:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318771.675864:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318771.675891:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379589248:0@lo:38:kworker.0
00000100:00080000:1.0:1767318771.675908:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318771.675911:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318771.675914:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379589120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318771.675950:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379589504:0@lo:400:kworker.0
00000100:00100000:1.0:1767318771.675990:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318771.676034:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379589504
00000100:00100000:1.0:1767318771.676038:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379589504
00000100:00100000:1.0:1767318771.676072:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279
00000100:00100000:1.0:1767318771.676079:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379589504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318771.676121:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379589504:12345-0@lo:400:kworker.0 Request processed in 43us (130us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318771.676137:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279
00000100:00100000:1.0:1767318771.676167:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379589504:0@lo:400:kworker.0
00000100:00100000:3.0:1767318771.676443:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379589376
00000100:00100000:3.0:1767318771.676488:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280
00000100:00100000:3.0:1767318771.676495:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379589376:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318771.676724:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318771.685144:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10900000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379589376:12345-0@lo:400:kworker.0 Request processed in 8628us (9755us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318771.685161:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280
00000100:00100000:2.0:1767318771.694659:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379589376:0@lo:400:kworker.0
00000100:00080000:0.0:1767318771.695014:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318771.695021:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318771.695025:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318771.695031:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3668
00000100:00080000:0.0:1767318771.695036:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318771.695042:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318771.695063:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7df80 x1853164379589760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318771.695098:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318771.695102:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318771.695104:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318771.695107:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3668
00000100:00080000:0.0:1767318771.695110:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318771.695113:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318771.695124:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7ca80 x1853164379590016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318771.695200:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379589888:0@lo:400:kworker.0
00000100:00100000:2.0:1767318771.695259:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318771.695305:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318771.695311:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379589632:0@lo:400:kworker.0
00000100:00100000:2.0:1767318771.695334:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318771.695367:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379589888
00000100:00100000:2.0:1767318771.695375:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379589888
00000100:00100000:2.0:1767318771.695488:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379589632
00000100:00100000:2.0:1767318771.695492:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379589632
00000100:00100000:2.0:1767318771.695522:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844
00000100:00100000:2.0:1767318771.695531:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379589888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318771.695581:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379589888:12345-0@lo:400:kworker.0 Request processed in 51us (321us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318771.695589:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844
00000100:00100000:2.0:1767318771.695606:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845
00000100:00100000:3.0:1767318771.695610:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379589760:0@lo:38:kworker.0
00000100:00100000:2.0:1767318771.695613:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379589632:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318771.695638:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379589632:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318771.695638:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318771.695643:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845
00000100:00080000:1.0:1767318771.695915:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318771.702272:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379590016:0@lo:38:kworker.0
00000100:00100000:3.0:1767318771.702338:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318771.717272:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379589760
00000100:00100000:2.0:1767318771.717292:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379589760
00000100:00100000:2.0:1767318771.717337:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590016
00000100:00100000:2.0:1767318771.717341:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590016
00000100:00100000:2.0:1767318771.717356:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16429
00000100:00100000:2.0:1767318771.717364:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379589760:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318771.717392:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318771.717472:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379589760:12345-0@lo:38:kworker.0 Request processed in 108us (21832us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318771.717480:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16429
00000100:00100000:2.0:1767318771.717500:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16430
00000100:00100000:2.0:1767318771.717504:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379590016:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318771.717513:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318771.717537:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379590016:12345-0@lo:38:kworker.0 Request processed in 31us (15199us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318771.717542:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16430
00000100:00100000:2.0:1767318771.717714:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379589632:0@lo:400:kworker.0
00000100:00100000:2.0:1767318771.717731:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379589888:0@lo:400:kworker.0
00000100:00080000:2.0:1767318771.717787:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318771.717793:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318771.717797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379589760:0@lo:38:kworker.0
00000100:00080000:2.0:1767318771.717806:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318771.717809:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318771.717811:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379590016:0@lo:38:kworker.0
00010000:00010000:1.0:1767318772.186384:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318772.622961:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318772.623126:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291879936
00000100:00100000:0.0:1767318772.623136:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291879936
00000100:00100000:0.0:1767318772.623221:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3846
00000100:00100000:0.0:1767318772.623234:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291879936:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318772.623316:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291879936:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (363us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318772.623338:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3846
00000100:00080000:1.0:1767318772.623535:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318772.624985:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318772.625082:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291879808
00000100:00100000:1.0:1767318772.625091:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291879808
00000100:00100000:1.0:1767318772.625135:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16431
00000100:00100000:1.0:1767318772.625143:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291879808:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318772.625166:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318772.625222:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291879808:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 79us (323us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318772.625229:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16431
00010000:00010000:1.0:1767318773.211464:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318773.719954:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379590144:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318773.720055:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318773.720380:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590144
00000100:00100000:0.0:1767318773.720394:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590144
00000100:00100000:0.0:1767318773.720499:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026
00000100:00100000:0.0:1767318773.720512:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379590144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318773.720554:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767318773.720652:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318773.727724:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10902300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379590144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7196us (7649us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318773.727746:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026
00000100:00100000:2.0:1767318773.728255:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379590144:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318774.231475:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318775.255333:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318775.255634:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379590272:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318775.255747:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318775.255904:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590272
00000100:00100000:0.0:1767318775.255916:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590272
00000100:00100000:0.0:1767318775.256004:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027
00000100:00100000:0.0:1767318775.256018:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379590272:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318775.256060:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318775.256119:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379590272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (371us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318775.256128:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027
00000100:00080000:1.0:1767318775.256610:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318775.256674:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379590272:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318776.279952:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318776.791614:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318776.791625:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318776.791629:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318776.791632:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318776.791646:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318776.791654:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3674
00000100:00080000:0.0:1767318776.791660:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318776.791667:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318776.791728:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7d500 x1853164379590400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318776.791760:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318776.791765:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318776.791767:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318776.791771:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3674
00000100:00080000:0.0:1767318776.791773:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318776.791778:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318776.791793:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7ca80 x1853164379590528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318776.791815:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379590400:0@lo:38:kworker.0
00000100:00080000:0.0:1767318776.791866:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318776.791885:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318776.791887:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318776.791890:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3674
00000100:00080000:0.0:1767318776.791892:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318776.791896:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318776.791905:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318776.791906:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5500 x1853164379591040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318776.791924:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318776.791927:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318776.791928:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318776.791931:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3674
00000100:00080000:0.0:1767318776.791933:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318776.791936:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318776.791952:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6a00 x1853164379591296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318776.791965:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379590528:0@lo:38:kworker.0
00000100:00100000:0.0:1767318776.791988:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379591168:0@lo:400:kworker.0
00000100:00100000:2.0:1767318776.791990:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318776.792013:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318776.792019:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379591040:0@lo:38:kworker.0
00000100:00100000:0.0:1767318776.792031:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318776.792036:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379590912:0@lo:400:kworker.0
00000100:00100000:2.0:1767318776.792036:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318776.792051:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379591296:0@lo:38:kworker.0
00000100:00100000:0.0:1767318776.792053:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318776.792068:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318776.792082:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590400
00000100:00100000:0.0:1767318776.792090:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590400
00000100:00100000:2.0:1767318776.792092:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590528
00000100:00100000:2.0:1767318776.792095:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590528
00000100:00100000:0.0:1767318776.792118:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591168
00000100:00100000:0.0:1767318776.792120:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591168
00000100:00100000:2.0:1767318776.792124:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870
00000100:00100000:2.0:1767318776.792144:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379590528:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318776.792148:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591040
00000100:00100000:0.0:1767318776.792150:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591040
00000100:00100000:0.0:1767318776.792157:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590912
00000100:00100000:0.0:1767318776.792158:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590912
00010000:00020000:2.0:1767318776.792161:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318776.792170:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591296
00000100:00100000:0.0:1767318776.792172:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591296
00000100:00100000:0.0:1767318776.792180:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847
00000100:00100000:0.0:1767318776.792186:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379591168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318776.792208:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379590528:12345-0@lo:38:kworker.0 Request processed in 64us (216us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318776.792215:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870
00000100:00100000:0.0:1767318776.792221:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379591168:12345-0@lo:400:kworker.0 Request processed in 36us (207us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318776.792226:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847
00000100:00100000:0.0:1767318776.792237:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848
00000100:00100000:0.0:1767318776.792243:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379590912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318776.792267:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379590912:12345-0@lo:400:kworker.0 Request processed in 24us (212us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318776.792281:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379590784:0@lo:400:kworker.0
00000100:00100000:3.0:1767318776.792323:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318776.792334:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379590656:0@lo:400:kworker.0
00000100:00100000:3.0:1767318776.792388:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590784
00000100:00100000:3.0:1767318776.792394:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590784
00000100:00100000:1.0:1767318776.792419:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318776.792440:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379590656
00000100:00100000:3.0:1767318776.792446:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379590656
00000100:00100000:3.0:1767318776.792491:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281
00000100:00100000:3.0:1767318776.792500:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379590784:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318776.792567:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379590784:12345-0@lo:400:kworker.0 Request processed in 58us (234us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318776.792574:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281
00000100:00100000:3.0:1767318776.792589:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282
00000100:00100000:3.0:1767318776.792595:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379590656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318776.792629:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379590656:12345-0@lo:400:kworker.0 Request processed in 34us (213us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318776.792634:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282
00000100:00100000:3.0:1767318776.792694:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379590784:0@lo:400:kworker.0
00000100:00100000:3.0:1767318776.792724:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379590656:0@lo:400:kworker.0
00000100:00100000:2.0:1767318776.792920:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16432
00000100:00100000:2.0:1767318776.792927:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379590400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318776.792939:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318776.792969:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379590400:12345-0@lo:38:kworker.0 Request processed in 41us (1063us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318776.792976:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16432
00000100:00100000:2.0:1767318776.792991:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16433
00000100:00100000:2.0:1767318776.792995:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379591040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318776.793005:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318776.793030:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379591040:12345-0@lo:38:kworker.0 Request processed in 34us (993us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318776.793039:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16433
00000100:00100000:2.0:1767318776.793051:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16434
00000100:00100000:2.0:1767318776.793054:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379591296:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318776.793063:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318776.793085:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10902d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379591296:12345-0@lo:38:kworker.0 Request processed in 29us (1016us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318776.793091:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16434
00000100:00080000:2.0:1767318776.793117:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318776.793122:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318776.793125:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379591040:0@lo:38:kworker.0
00000100:00080000:2.0:1767318776.793132:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318776.793135:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318776.793138:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379591296:0@lo:38:kworker.0
00000100:00080000:2.0:1767318776.793144:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318776.793147:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318776.793150:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379590400:0@lo:38:kworker.0
00000100:00080000:2.0:1767318776.793157:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318776.793160:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318776.793162:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379590528:0@lo:38:kworker.0
00000100:00080000:2.0:1767318776.793204:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318776.793209:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318776.793255:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379590912:0@lo:400:kworker.0
00000100:00100000:2.0:1767318776.793265:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379591168:0@lo:400:kworker.0
00000100:00100000:0.0:1767318776.793938:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848
00010000:00010000:1.0:1767318777.303565:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318777.745016:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318777.745316:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291880064
00000100:00100000:3.0:1767318777.745328:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291880064
00000100:00100000:3.0:1767318777.745719:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16435
00000100:00100000:3.0:1767318777.745729:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291880064:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318777.745770:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318777.745851:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291880064:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 120us (846us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318777.745860:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16435
00000100:00100000:0.0:1767318777.745979:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318777.766862:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291880192
00000100:00100000:1.0:1767318777.766890:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291880192
00000100:00100000:1.0:1767318777.767009:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3849
00000100:00100000:1.0:1767318777.767020:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291880192:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318777.767106:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291880192:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (21127us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318777.767114:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3849
00000100:00080000:0.0:1767318777.767367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318778.327962:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318778.839842:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f27e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379591424:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318778.840132:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318778.841189:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591424
00000100:00100000:2.0:1767318778.841203:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591424
00000100:00100000:2.0:1767318778.841357:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028
00000100:00100000:2.0:1767318778.841378:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379591424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318778.841419:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318778.841512:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379591424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (1380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318778.841520:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028
00000100:00100000:3.0:1767318778.841950:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379591424:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318778.842285:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318779.351225:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318780.375510:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318780.379739:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379591552:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318780.379816:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318780.380006:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591552
00000100:00100000:1.0:1767318780.380015:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591552
00000100:00100000:1.0:1767318780.380084:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029
00000100:00100000:1.0:1767318780.380095:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379591552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318780.380132:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318780.380188:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379591552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (371us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318780.380196:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029
00000100:00100000:1.0:1767318780.380250:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379591552:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318780.380889:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318781.401081:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318781.915509:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318781.915520:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318781.915523:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318781.915527:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318781.915531:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318781.915539:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3679
00000100:00080000:2.0:1767318781.915544:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318781.915552:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318781.915606:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10901500 x1853164379591680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318781.915641:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318781.915645:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318781.915647:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318781.915651:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3679
00000100:00080000:2.0:1767318781.915653:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318781.915658:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318781.915684:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10901c00 x1853164379591808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318781.915754:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318781.915758:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318781.915760:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318781.915763:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3679
00000100:00080000:2.0:1767318781.915766:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318781.915769:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318781.915783:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10900a80 x1853164379592320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318781.915800:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318781.915803:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318781.915805:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318781.915809:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3679
00000100:00080000:2.0:1767318781.915811:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318781.915815:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318781.915825:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10901f80 x1853164379592576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318781.915976:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379592192:0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.916045:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318781.916149:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318781.916155:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379592448:0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.916178:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318781.916258:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592192
00000100:00100000:3.0:1767318781.916266:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592192
00000100:00100000:3.0:1767318781.916322:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592448
00000100:00100000:3.0:1767318781.916326:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592448
00000100:00100000:3.0:1767318781.916351:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850
00000100:00100000:3.0:1767318781.916359:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379592192:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.916420:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379592192:12345-0@lo:400:kworker.0 Request processed in 62us (375us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318781.916428:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850
00000100:00100000:3.0:1767318781.916444:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851
00000100:00100000:3.0:1767318781.916451:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379592448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.916479:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379592448:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318781.916485:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851
00000100:00080000:3.0:1767318781.916502:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318781.916532:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379591936:0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.916561:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318781.916600:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318781.916606:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379592064:0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.916628:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318781.916686:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379592448:0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.916699:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10900700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379592192:0@lo:400:kworker.0
00000100:00100000:0.0:1767318781.917112:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379591680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318781.917154:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318781.917182:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379591808:0@lo:38:kworker.0
00000100:00100000:0.0:1767318781.917204:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318781.917225:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379592320:0@lo:38:kworker.0
00000100:00100000:0.0:1767318781.917244:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318781.917260:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379592576:0@lo:38:kworker.0
00000100:00100000:0.0:1767318781.917279:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318781.917306:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591680
00000100:00100000:0.0:1767318781.917311:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591680
00000100:00100000:0.0:1767318781.917329:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592320
00000100:00100000:0.0:1767318781.917332:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592320
00000100:00100000:0.0:1767318781.917340:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592576
00000100:00100000:0.0:1767318781.917342:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592576
00000100:00100000:0.0:1767318781.917352:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16436
00000100:00100000:0.0:1767318781.917356:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379591680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318781.917373:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318781.917416:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379591680:12345-0@lo:38:kworker.0 Request processed in 58us (261us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318781.917423:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16436
00000100:00100000:0.0:1767318781.917437:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16437
00000100:00100000:0.0:1767318781.917441:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379592320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318781.917460:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318781.917486:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379592320:12345-0@lo:38:kworker.0 Request processed in 43us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318781.917492:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16437
00000100:00100000:0.0:1767318781.917504:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16438
00000100:00100000:0.0:1767318781.917508:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379592576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318781.917517:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318781.917538:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379592576:12345-0@lo:38:kworker.0 Request processed in 29us (259us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318781.917543:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16438
00000100:00080000:0.0:1767318781.917567:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318781.917573:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318781.917576:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379591680:0@lo:38:kworker.0
00000100:00080000:0.0:1767318781.917584:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318781.917587:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318781.917602:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379592320:0@lo:38:kworker.0
00000100:00080000:0.0:1767318781.917612:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318781.917615:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318781.917618:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379592576:0@lo:38:kworker.0
00000100:00100000:2.0:1767318781.918308:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591936
00000100:00100000:2.0:1767318781.918314:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591936
00000100:00100000:2.0:1767318781.918370:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592064
00000100:00100000:2.0:1767318781.918373:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592064
00000100:00100000:2.0:1767318781.918406:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283
00000100:00100000:2.0:1767318781.918413:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379591936:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318781.918472:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379591936:12345-0@lo:400:kworker.0 Request processed in 60us (1910us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318781.918478:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283
00000100:00100000:2.0:1767318781.918493:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284
00000100:00100000:2.0:1767318781.918500:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379592064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318781.918526:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379592064:12345-0@lo:400:kworker.0 Request processed in 27us (1898us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318781.918532:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284
00000100:00100000:2.0:1767318781.918581:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379592064:0@lo:400:kworker.0
00000100:00100000:2.0:1767318781.918604:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10902a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379591936:0@lo:400:kworker.0
00000100:00100000:3.0:1767318781.919301:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379591808
00000100:00100000:3.0:1767318781.919309:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379591808
00000100:00100000:3.0:1767318781.919343:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871
00000100:00100000:3.0:1767318781.919349:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379591808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318781.919365:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318781.919438:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379591808:12345-0@lo:38:kworker.0 Request processed in 87us (2231us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318781.919445:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871
00000100:00080000:1.0:1767318781.919639:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318781.919645:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318781.919652:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379591808:0@lo:38:kworker.0
00000100:00080000:0.0:1767318781.927992:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318782.426297:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318782.864199:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318782.867562:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318782.870889:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291880448
00000100:00100000:0.0:1767318782.870912:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291880448
00000100:00100000:0.0:1767318782.871006:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291880320
00000100:00100000:0.0:1767318782.871010:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291880320
00000100:00080000:3.0:1767318782.871108:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318782.871155:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3852
00000100:00100000:3.0:1767318782.871172:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291880448:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318782.871289:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291880448:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 124us (7106us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318782.871298:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3852
00000100:00100000:3.0:1767318782.871322:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16439
00000100:00100000:3.0:1767318782.871326:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291880320:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318782.871364:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318782.871397:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291880320:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 69us (3848us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318782.871403:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16439
00010000:00010000:1.0:1767318783.447213:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318783.959243:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379592704:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318783.959336:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318783.960128:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592704
00000100:00100000:3.0:1767318783.960138:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592704
00000100:00100000:3.0:1767318783.960205:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030
00000100:00100000:3.0:1767318783.960214:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379592704:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318783.960243:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318783.960302:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10902a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379592704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (966us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318783.960310:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030
00000100:00080000:0.0:1767318783.960375:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318783.960694:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379592704:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318784.471520:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318785.498861:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318785.499123:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318785.499145:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379592832:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318785.499214:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318785.499326:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592832
00000100:00100000:0.0:1767318785.499335:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592832
00000100:00100000:0.0:1767318785.499398:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031
00000100:00100000:0.0:1767318785.499408:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379592832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318785.499437:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318785.499480:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379592832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (265us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318785.499487:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031
00000100:00080000:3.0:1767318785.499547:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318785.499593:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10903800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379592832:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318786.519100:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318787.031858:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318787.031903:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318787.031907:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318787.031911:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318787.031916:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318787.031923:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3684
00000100:00080000:3.0:1767318787.031927:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318787.031935:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318787.031991:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06e7df80 x1853164379592960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318787.032021:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318787.032025:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318787.032027:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318787.032031:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3684
00000100:00080000:3.0:1767318787.032033:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318787.032038:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318787.032053:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164379593088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318787.032116:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318787.032120:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318787.032122:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318787.032125:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3684
00000100:00080000:3.0:1767318787.032127:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318787.032131:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318787.032142:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafe300 x1853164379593600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318787.032145:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379593216:0@lo:400:kworker.0
00000100:00080000:3.0:1767318787.032156:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318787.032159:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318787.032161:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318787.032164:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3684
00000100:00080000:3.0:1767318787.032166:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318787.032169:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318787.032186:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff480 x1853164379593856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318787.032218:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379593472:0@lo:400:kworker.0
00000100:00100000:2.0:1767318787.032224:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318787.032287:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379593344:0@lo:400:kworker.0
00000100:00100000:0.0:1767318787.032367:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379593728:0@lo:400:kworker.0
00000100:00100000:3.0:1767318787.036522:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318787.036717:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593472
00000100:00100000:2.0:1767318787.036730:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593472
00000100:00100000:2.0:1767318787.037203:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853
00000100:00100000:2.0:1767318787.037216:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379593472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318787.037283:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379593472:12345-0@lo:400:kworker.0 Request processed in 71us (769us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318787.037290:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853
00000100:00080000:2.0:1767318787.037316:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318787.037359:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379592960:0@lo:38:kworker.0
00000100:00100000:2.0:1767318787.037394:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318787.037414:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379593088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318787.037450:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318787.037474:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379593600:0@lo:38:kworker.0
00000100:00100000:2.0:1767318787.037503:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318787.037517:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379593856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318787.037536:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318787.037582:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593088
00000100:00100000:2.0:1767318787.037586:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593088
00000100:00100000:2.0:1767318787.037611:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872
00000100:00100000:2.0:1767318787.037616:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379593088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318787.037646:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318787.037681:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379593088:12345-0@lo:38:kworker.0 Request processed in 63us (230us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318787.037688:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872
00000100:00100000:2.0:1767318787.037704:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379592960
00000100:00100000:2.0:1767318787.037708:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379592960
00000100:00100000:2.0:1767318787.037722:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593600
00000100:00100000:2.0:1767318787.037725:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593600
00000100:00100000:2.0:1767318787.037736:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593856
00000100:00100000:2.0:1767318787.037751:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593856
00000100:00100000:2.0:1767318787.037767:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16440
00000100:00100000:2.0:1767318787.037772:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379592960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318787.037781:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318787.037807:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379592960:12345-0@lo:38:kworker.0 Request processed in 33us (412us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318787.037813:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16440
00000100:00100000:2.0:1767318787.037824:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16441
00000100:00100000:2.0:1767318787.037828:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379593600:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318787.037837:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318787.037856:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379593600:12345-0@lo:38:kworker.0 Request processed in 27us (352us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318787.037971:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16441
00000100:00100000:2.0:1767318787.038171:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16442
00000100:00100000:2.0:1767318787.038177:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379593856:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318787.038188:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318787.038217:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379593856:12345-0@lo:38:kworker.0 Request processed in 39us (680us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318787.038223:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16442
00000100:00080000:2.0:1767318787.038263:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318787.038267:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318787.038271:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379592960:0@lo:38:kworker.0
00000100:00080000:2.0:1767318787.038281:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318787.038284:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318787.038287:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379593088:0@lo:38:kworker.0
00000100:00080000:2.0:1767318787.038294:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318787.038297:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318787.038299:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379593600:0@lo:38:kworker.0
00000100:00080000:2.0:1767318787.038305:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318787.038308:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318787.038311:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379593856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318787.038377:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593216
00000100:00100000:2.0:1767318787.038382:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593216
00000100:00100000:2.0:1767318787.038418:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285
00000100:00100000:2.0:1767318787.038424:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10903800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379593216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318787.038464:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10903800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379593216:12345-0@lo:400:kworker.0 Request processed in 40us (6239us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318787.038470:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285
00000100:00080000:2.0:1767318787.038488:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318787.038510:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379593216:0@lo:400:kworker.0
00000100:00100000:1.0:1767318787.041672:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318787.041934:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379593472:0@lo:400:kworker.0
00000100:00100000:2.0:1767318787.044932:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593344
00000100:00100000:2.0:1767318787.044949:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593344
00000100:00100000:2.0:1767318787.045043:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286
00000100:00100000:2.0:1767318787.045054:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379593344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318787.045166:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379593344:12345-0@lo:400:kworker.0 Request processed in 114us (3502us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318787.045173:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286
00000100:00100000:1.0:1767318787.045424:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379593344:0@lo:400:kworker.0
00000100:00080000:3.0:1767318787.045517:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318787.047096:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318787.047232:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593728
00000100:00100000:2.0:1767318787.047242:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593728
00000100:00100000:2.0:1767318787.047350:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854
00000100:00100000:2.0:1767318787.047359:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379593728:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318787.047426:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379593728:12345-0@lo:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318787.047441:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854
00000100:00100000:0.0:1767318787.047644:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379593728:0@lo:400:kworker.0
00000100:00080000:3.0:1767318787.050035:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318787.543383:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318787.985581:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767318787.985625:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291880576 offset 0 length 520: 4
00000100:00100000:2.0:1767318787.985653:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291880832
00000100:00100000:1.0:1767318787.985654:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318787.985666:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291880832
00000100:00100000:0.0:1767318787.985745:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291880704
00000100:00100000:2.0:1767318787.985752:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3855
00000100:00100000:0.0:1767318787.985753:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291880704
00000100:00100000:2.0:1767318787.985765:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291880832:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318787.985789:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16443
00000100:00100000:0.0:1767318787.985797:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291880704:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318787.985820:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318787.985837:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291880832:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 75us (268us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318787.985846:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3855
00000100:00100000:0.0:1767318787.985907:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291880704:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 72us (216us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318787.985915:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16443
00000100:00080000:3.0:1767318787.987658:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318788.567148:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318789.079359:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379593984:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318789.079435:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318789.080222:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379593984
00000100:00100000:3.0:1767318789.080238:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379593984
00000100:00080000:2.0:1767318789.080372:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318789.080420:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032
00000100:00100000:3.0:1767318789.080431:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10900700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379593984:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318789.080470:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318789.080557:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10900700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379593984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (1122us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318789.080565:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032
00000100:00100000:2.0:1767318789.080647:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1876f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379593984:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318789.594736:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318790.616957:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318790.617621:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379594112:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318790.617709:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318790.618621:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379594112
00000100:00100000:2.0:1767318790.618635:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379594112
00000100:00100000:2.0:1767318790.618725:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033
00000100:00100000:2.0:1767318790.618736:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379594112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318790.618780:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318790.618845:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379594112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1135us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318790.618854:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033
00000100:00100000:1.0:1767318790.619391:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10903480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379594112:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318790.620098:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318791.127073:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318766/real 1767318766]  req@ffff8b0f27e85180 x1853164379587712/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318791 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318791.127110:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f27e85180 x1853164379587712/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318791 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318791.127132:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318791.127166:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318791.127170:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f27e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379587712:0@lo:250:kworker.0
00000100:00080000:1.0:1767318791.127845:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318791.127853:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767318791.127857:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318791.127863:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3668
00000100:00080000:1.0:1767318791.127925:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318791.127952:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318791.128003:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905c00 x1853164379594240/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318791.128032:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318791.128037:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318791.128039:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318791.128043:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3689
00000100:00080000:1.0:1767318791.128045:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318791.128049:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318791.128066:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379594368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318791.128074:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318791.128076:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318791.128078:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318791.128082:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3689
00000100:00080000:1.0:1767318791.128084:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318791.128088:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318791.128100:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164379594496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318791.128144:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318791.128147:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318791.128150:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318791.128154:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3689
00000100:00080000:1.0:1767318791.128157:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318791.128160:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318791.128179:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905f80 x1853164379594880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318791.128210:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318791.128213:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318791.128215:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318791.128218:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3689
00000100:00080000:1.0:1767318791.128220:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318791.128225:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318791.128236:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905180 x1853164379595136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318791.128255:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318791.128269:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379595008:0@lo:400:kworker.0
00000100:00100000:1.0:1767318791.128337:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318791.128380:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595008
00000100:00100000:1.0:1767318791.128389:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595008
00000100:00100000:1.0:1767318791.128675:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856
00000100:00100000:1.0:1767318791.128687:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379595008:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318791.128726:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379594240:0@lo:250:kworker.0
00000100:00100000:1.0:1767318791.128740:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379595008:12345-0@lo:400:kworker.0 Request processed in 57us (403us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318791.128748:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856
00000400:00000100:2.0:1767318791.128750:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379594240 offset 0 length 520: 4
00000100:00100000:2.0:1767318791.128783:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379594368:0@lo:38:kworker.0
00000100:00100000:2.0:1767318791.128807:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.128828:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379594496:0@lo:38:kworker.0
00000100:00080000:0.0:1767318791.128847:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318791.128851:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.128866:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379594880:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.128867:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379594624:0@lo:400:kworker.0
00000100:00100000:2.0:1767318791.128900:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318791.128906:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.128914:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379595136:0@lo:38:kworker.0
00000100:00100000:2.0:1767318791.128935:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318791.128940:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318791.128946:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379594752:0@lo:400:kworker.0
00000100:00100000:2.0:1767318791.128962:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379594496
00000100:00100000:0.0:1767318791.128964:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318791.128965:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379594496
00000100:00100000:2.0:1767318791.128986:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873
00000100:00100000:2.0:1767318791.128991:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f27e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379594496:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.128998:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379594368
00000100:00100000:0.0:1767318791.129001:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379594368
00010000:00020000:2.0:1767318791.129009:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318791.129018:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379594880
00000100:00100000:0.0:1767318791.129020:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379594880
00000100:00100000:0.0:1767318791.129027:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595136
00000100:00100000:0.0:1767318791.129030:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595136
00000100:00100000:0.0:1767318791.129037:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379594752
00000100:00100000:0.0:1767318791.129039:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379594752
00000100:00100000:2.0:1767318791.129040:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f27e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379594496:12345-0@lo:38:kworker.0 Request processed in 48us (188us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318791.129046:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873
00000100:00100000:0.0:1767318791.129057:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857
00000100:00100000:0.0:1767318791.129062:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379594752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318791.129065:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16444
00000100:00100000:2.0:1767318791.129068:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379594368:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318791.129092:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318791.129094:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379594752:12345-0@lo:400:kworker.0 Request processed in 32us (129us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318791.129100:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857
00000100:00100000:2.0:1767318791.129113:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379594368:12345-0@lo:38:kworker.0 Request processed in 43us (305us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318791.129114:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16445
00000100:00100000:0.0:1767318791.129120:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379594880:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318791.129120:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16444
00010000:00020000:0.0:1767318791.129130:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318791.129132:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16446
00000100:00100000:2.0:1767318791.129136:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379595136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318791.129145:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318791.129149:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379594880:12345-0@lo:38:kworker.0 Request processed in 29us (249us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318791.129155:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16445
00000100:00100000:2.0:1767318791.129164:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379595136:12345-0@lo:38:kworker.0 Request processed in 26us (228us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767318791.129169:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318791.129169:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16446
00000100:00100000:0.0:1767318791.129199:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379594752:0@lo:400:kworker.0
00000100:00080000:3.0:1767318791.129217:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318791.129227:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318791.129233:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379594368:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.129238:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379594624
00000100:00100000:0.0:1767318791.129243:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379594624
00000100:00080000:3.0:1767318791.129248:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318791.129254:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318791.129258:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379594496:0@lo:38:kworker.0
00000100:00080000:3.0:1767318791.129267:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318791.129270:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318791.129275:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379594880:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.129289:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287
00000100:00100000:0.0:1767318791.129297:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379594624:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318791.129299:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318791.129306:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318791.129311:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379595136:0@lo:38:kworker.0
00000100:00100000:0.0:1767318791.129340:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379594624:12345-0@lo:400:kworker.0 Request processed in 43us (431us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318791.129346:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287
00000100:00100000:0.0:1767318791.129385:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379594624:0@lo:400:kworker.0
00000100:00080000:2.0:1767318791.132196:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318791.132314:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379595008:0@lo:400:kworker.0
00010000:00010000:1.0:1767318791.639130:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318792.664348:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318793.104401:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318793.104451:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318793.104481:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291881088
00000100:00100000:0.0:1767318793.104501:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291881088
00000100:00100000:0.0:1767318793.104599:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291880960
00000100:00100000:0.0:1767318793.104603:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291880960
00000100:00100000:0.0:1767318793.104625:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3858
00000100:00100000:0.0:1767318793.104636:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291881088:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318793.104718:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291881088:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (328us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318793.104725:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3858
00000100:00100000:0.0:1767318793.104744:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16447
00000100:00100000:0.0:1767318793.104749:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291880960:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318793.104779:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318793.104805:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291880960:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (354us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318793.104812:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16447
00000100:00080000:3.0:1767318793.107977:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318793.688925:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318794.200617:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318794.200637:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379595264:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318794.200718:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318794.201356:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595264
00000100:00100000:0.0:1767318794.201368:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595264
00000100:00100000:0.0:1767318794.201458:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034
00000100:00100000:0.0:1767318794.201471:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379595264:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318794.201519:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318794.201602:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379595264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (882us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318794.201610:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034
00000100:00080000:3.0:1767318794.201675:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318794.201761:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1876df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379595264:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318794.711246:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318795.736436:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318795.738905:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318795.738931:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379595392:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318795.739022:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318795.739721:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595392
00000100:00100000:2.0:1767318795.739732:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595392
00000100:00100000:2.0:1767318795.739812:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035
00000100:00100000:2.0:1767318795.739823:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379595392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318795.739860:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318795.740111:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379595392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 289us (1087us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318795.740119:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035
00000100:00080000:3.0:1767318795.742951:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318795.743058:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379595392:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318796.247273:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318796.247287:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318796.247290:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318796.247294:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318796.247298:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318796.247307:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3693
00000100:00080000:1.0:1767318796.247312:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318796.247320:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318796.247367:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904000 x1853164379595520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318796.247402:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318796.247407:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318796.247409:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318796.247414:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3693
00000100:00080000:1.0:1767318796.247417:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318796.247421:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318796.247437:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906300 x1853164379595648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318796.247591:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379595776:0@lo:400:kworker.0
00000100:00080000:1.0:1767318796.247639:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318796.247643:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318796.247646:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318796.247650:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3693
00000100:00080000:1.0:1767318796.247660:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318796.247664:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318796.247678:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905f80 x1853164379596032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318796.247687:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318796.247704:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318796.247708:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318796.247710:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318796.247714:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3693
00000100:00080000:1.0:1767318796.247717:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318796.247721:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318796.247734:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379596288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318796.247760:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379596160:0@lo:400:kworker.0
00000100:00100000:0.0:1767318796.247862:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379595904:0@lo:400:kworker.0
00000100:00100000:2.0:1767318796.247975:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595776
00000100:00100000:2.0:1767318796.248040:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595776
00000100:00100000:2.0:1767318796.248099:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288
00000100:00100000:2.0:1767318796.248108:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379595776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318796.248160:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379595776:12345-0@lo:400:kworker.0 Request processed in 53us (478us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318796.248168:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288
00000100:00080000:2.0:1767318796.248189:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318796.248218:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379595776:0@lo:400:kworker.0
00000100:00100000:3.0:1767318796.248313:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379595520:0@lo:38:kworker.0
00000100:00100000:3.0:1767318796.248347:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318796.248376:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379595648:0@lo:38:kworker.0
00000100:00100000:3.0:1767318796.248400:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318796.248422:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379596032:0@lo:38:kworker.0
00000100:00100000:3.0:1767318796.248441:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318796.248456:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379596288:0@lo:38:kworker.0
00000100:00100000:3.0:1767318796.248487:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318796.248518:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595648
00000100:00100000:1.0:1767318796.248643:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318796.248669:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595520
00000100:00100000:1.0:1767318796.248672:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595520
00000100:00100000:1.0:1767318796.248689:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596032
00000100:00100000:1.0:1767318796.248691:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596032
00000100:00100000:1.0:1767318796.248699:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596288
00000100:00100000:1.0:1767318796.248701:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596288
00000100:00100000:1.0:1767318796.248707:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596160
00000100:00100000:1.0:1767318796.248708:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596160
00000100:00100000:1.0:1767318796.248727:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859
00000100:00100000:1.0:1767318796.248732:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379596160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318796.248761:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379596160:12345-0@lo:400:kworker.0 Request processed in 29us (118us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318796.248766:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859
00000100:00100000:3.0:1767318796.249069:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595648
00000100:00100000:3.0:1767318796.249092:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874
00000100:00100000:3.0:1767318796.249096:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379595648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318796.249114:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318796.249221:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318796.249251:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379595904
00000100:00100000:0.0:1767318796.249255:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379595904
00000100:00100000:3.0:1767318796.249791:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379595648:12345-0@lo:38:kworker.0 Request processed in 690us (1388us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318796.249798:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874
00000100:00100000:2.0:1767318796.250290:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16448
00000100:00100000:2.0:1767318796.250297:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379595520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318796.250315:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318796.250350:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379595520:12345-0@lo:38:kworker.0 Request processed in 52us (2003us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318796.250356:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16448
00000100:00100000:2.0:1767318796.250374:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16449
00000100:00100000:2.0:1767318796.250379:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379596032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318796.250387:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318796.250408:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379596032:12345-0@lo:38:kworker.0 Request processed in 29us (1967us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318796.250413:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16449
00000100:00100000:2.0:1767318796.250424:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16450
00000100:00100000:2.0:1767318796.250428:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379596288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318796.250436:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318796.250473:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379596288:12345-0@lo:38:kworker.0 Request processed in 30us (1972us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318796.250479:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16450
00000100:00080000:2.0:1767318796.250508:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318796.250569:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.250575:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.250579:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379595520:0@lo:38:kworker.0
00000100:00080000:2.0:1767318796.250591:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.250594:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.250597:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379595648:0@lo:38:kworker.0
00000100:00080000:2.0:1767318796.250605:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.250608:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.250611:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379596032:0@lo:38:kworker.0
00000100:00080000:2.0:1767318796.250619:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318796.250622:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318796.250625:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379596288:0@lo:38:kworker.0
00000100:00100000:0.0:1767318796.252241:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860
00000100:00100000:0.0:1767318796.252266:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379595904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318796.252358:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379595904:12345-0@lo:400:kworker.0 Request processed in 104us (3136us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318796.252365:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860
00000100:00100000:0.0:1767318796.252446:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379596160:0@lo:400:kworker.0
00000100:00100000:2.0:1767318796.252447:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379595904:0@lo:400:kworker.0
00010000:00010000:1.0:1767318796.760256:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318797.784223:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318798.226237:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318798.226284:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318798.226397:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291881344
00000100:00100000:3.0:1767318798.226409:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291881344
00000100:00100000:3.0:1767318798.226512:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291881216
00000100:00100000:3.0:1767318798.226516:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291881216
00000100:00100000:3.0:1767318798.226541:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3861
00000100:00100000:3.0:1767318798.226554:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291881344:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318798.226637:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291881344:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (411us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318798.226647:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3861
00000100:00100000:3.0:1767318798.226665:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16451
00000100:00100000:3.0:1767318798.226669:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291881216:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318798.226690:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318798.226712:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291881216:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 42us (428us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318798.226718:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16451
00000100:00080000:0.0:1767318798.226996:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318798.807150:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318799.321831:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318799.321901:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379596416:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318799.321976:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318799.322270:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596416
00000100:00100000:1.0:1767318799.322280:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596416
00000100:00100000:1.0:1767318799.322385:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036
00000100:00100000:1.0:1767318799.322410:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379596416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318799.322447:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318799.322504:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379596416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (527us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318799.322512:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036
00000100:00100000:3.0:1767318799.322566:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1876fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379596416:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318799.325506:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318799.831498:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318800.855198:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379596544:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318800.855465:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318800.856602:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318800.856860:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596544
00000100:00100000:1.0:1767318800.856895:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596544
00000100:00100000:1.0:1767318800.856979:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037
00000100:00100000:1.0:1767318800.856990:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379596544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318800.857036:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318800.857090:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379596544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (491us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318800.857097:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037
00000100:00100000:3.0:1767318800.857233:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379596544:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318800.857896:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767318801.367047:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318801.367060:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318801.367064:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318801.367080:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318801.367105:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318801.367115:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3698
00000100:00080000:1.0:1767318801.367120:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318801.367127:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318801.367164:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379596672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318801.367193:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318801.367197:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318801.367199:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318801.367203:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3698
00000100:00080000:1.0:1767318801.367205:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318801.367209:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318801.367221:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905f80 x1853164379596800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318801.367275:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318801.367279:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318801.367280:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318801.367285:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3698
00000100:00080000:1.0:1767318801.367288:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318801.367294:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318801.367295:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379596672:0@lo:38:kworker.0
00000100:00100000:1.0:1767318801.367307:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904700 x1853164379597184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318801.367365:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318801.367370:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318801.367377:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318801.367381:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3698
00000100:00080000:1.0:1767318801.367385:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318801.367391:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318801.367394:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318801.367407:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a431f80 x1853164379597440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318801.367445:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318801.367456:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379597312:0@lo:400:kworker.0
00000100:00100000:3.0:1767318801.367490:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379596800:0@lo:38:kworker.0
00000100:00100000:1.0:1767318801.367493:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318801.367530:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318801.367535:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596672
00000100:00100000:1.0:1767318801.367544:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596672
00000100:00100000:3.0:1767318801.367561:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379597184:0@lo:38:kworker.0
00000100:00100000:1.0:1767318801.367581:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597312
00000100:00100000:1.0:1767318801.367586:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597312
00000100:00100000:3.0:1767318801.367588:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318801.367611:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379597440:0@lo:38:kworker.0
00000100:00100000:1.0:1767318801.367626:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597184
00000100:00100000:1.0:1767318801.367631:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597184
00000100:00100000:3.0:1767318801.367636:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318801.367696:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379596928:0@lo:400:kworker.0
00000100:00100000:2.0:1767318801.367730:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318801.367754:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318801.367759:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379597056:0@lo:400:kworker.0
00000100:00080000:0.0:1767318801.367914:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318801.367927:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596800
00000100:00100000:0.0:1767318801.367931:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596800
00000100:00100000:0.0:1767318801.367957:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875
00000100:00100000:0.0:1767318801.367964:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379596800:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318801.367984:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318801.368027:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379596800:12345-0@lo:38:kworker.0 Request processed in 62us (498us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318801.368034:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875
00000100:00080000:3.0:1767318801.372345:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318801.372358:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318801.372363:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379596800:0@lo:38:kworker.0
00000100:00100000:1.0:1767318801.372711:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597440
00000100:00100000:1.0:1767318801.372721:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597440
00000100:00100000:1.0:1767318801.372766:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862
00000100:00100000:1.0:1767318801.372779:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379597312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318801.372970:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379597312:12345-0@lo:400:kworker.0 Request processed in 195us (5477us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318801.372979:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862
00000100:00100000:1.0:1767318801.373004:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16452
00000100:00100000:1.0:1767318801.373009:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379596672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318801.373029:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318801.373098:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379596672:12345-0@lo:38:kworker.0 Request processed in 86us (5707us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318801.373121:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16452
00000100:00100000:1.0:1767318801.373136:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16453
00000100:00100000:1.0:1767318801.373140:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379597184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318801.373150:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318801.373175:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379597184:12345-0@lo:38:kworker.0 Request processed in 33us (5588us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318801.373180:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16453
00000100:00100000:1.0:1767318801.373193:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16454
00000100:00100000:1.0:1767318801.373197:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379597440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318801.373205:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318801.373341:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379597440:12345-0@lo:38:kworker.0 Request processed in 142us (5704us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318801.373347:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16454
00000100:00100000:1.0:1767318801.373403:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379597312:0@lo:400:kworker.0
00000100:00080000:1.0:1767318801.373445:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318801.373450:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318801.373453:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379597184:0@lo:38:kworker.0
00000100:00080000:1.0:1767318801.373461:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318801.373464:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318801.373466:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379597440:0@lo:38:kworker.0
00000100:00080000:1.0:1767318801.373475:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318801.373478:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318801.373480:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379596672:0@lo:38:kworker.0
00000100:00100000:1.0:1767318801.373540:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379596928
00000100:00100000:1.0:1767318801.373545:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379596928
00000100:00100000:1.0:1767318801.373585:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289
00000100:00100000:1.0:1767318801.373591:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379596928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318801.373627:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379596928:12345-0@lo:400:kworker.0 Request processed in 36us (5897us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318801.373633:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289
00000100:00100000:1.0:1767318801.373654:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318801.373684:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379596928:0@lo:400:kworker.0
00000100:00100000:1.0:1767318801.373702:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597056
00000100:00100000:1.0:1767318801.373705:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597056
00000100:00100000:1.0:1767318801.373731:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863
00000100:00100000:1.0:1767318801.373737:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379597056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318801.373771:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379597056:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318801.373777:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863
00000100:00100000:1.0:1767318801.373802:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379597056:0@lo:400:kworker.0
00000100:00080000:1.0:1767318801.373970:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318801.373976:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318801.879621:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318802.903795:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318803.344897:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318803.344987:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318803.345177:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291881600
00000100:00100000:2.0:1767318803.345190:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291881600
00000100:00100000:2.0:1767318803.345273:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291881472
00000100:00100000:2.0:1767318803.345277:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291881472
00000100:00100000:2.0:1767318803.345301:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3864
00000100:00100000:2.0:1767318803.345311:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291881600:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318803.345415:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291881600:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 105us (559us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318803.345424:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3864
00000100:00100000:2.0:1767318803.345448:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16455
00000100:00100000:2.0:1767318803.345452:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291881472:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318803.345478:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318803.345506:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291881472:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (519us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318803.345512:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16455
00000100:00080000:1.0:1767318803.346389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318803.927142:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318804.439251:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318804.439274:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379597568:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318804.439362:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318804.439519:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597568
00000100:00100000:3.0:1767318804.439527:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597568
00000100:00100000:3.0:1767318804.439602:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038
00000100:00100000:3.0:1767318804.439613:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379597568:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318804.439648:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318804.439810:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379597568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 198us (446us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318804.439818:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038
00000100:00100000:3.0:1767318804.439891:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1876d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379597568:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318804.440314:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318804.953189:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318805.975238:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379597696:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318805.975343:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318805.975504:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597696
00000100:00100000:2.0:1767318805.975512:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597696
00000100:00100000:2.0:1767318805.975594:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039
00000100:00100000:2.0:1767318805.975605:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379597696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318805.975638:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318805.975689:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379597696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318805.975697:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039
00000100:00100000:2.0:1767318805.975745:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379597696:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318805.975810:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767318805.976281:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318806.487036:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318806.487048:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318806.487051:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318806.487056:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318806.487061:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318806.487070:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3703
00000100:00080000:1.0:1767318806.487076:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318806.487083:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318806.487130:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a432300 x1853164379597824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318806.487148:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318806.487152:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318806.487154:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318806.487159:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3703
00000100:00080000:1.0:1767318806.487161:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318806.487165:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318806.487179:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433480 x1853164379597952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318806.487187:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379597824:0@lo:38:kworker.0
00000100:00080000:1.0:1767318806.487264:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767318806.487269:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318806.487271:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318806.487275:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318806.487295:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3703
00000100:00080000:1.0:1767318806.487298:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318806.487302:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318806.487318:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a430380 x1853164379598336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318806.487337:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318806.487342:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1767318806.487342:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379597952:0@lo:38:kworker.0
00000100:00080000:1.0:1767318806.487347:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318806.487352:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3703
00000100:00080000:1.0:1767318806.487354:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318806.487358:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318806.487387:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318806.487399:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a430e00 x1853164379598592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318806.487427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379598336:0@lo:38:kworker.0
00000100:00100000:1.0:1767318806.487440:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379598464:0@lo:400:kworker.0
00000100:00100000:3.0:1767318806.487454:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318806.487480:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318806.487482:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379598592:0@lo:38:kworker.0
00000100:00100000:0.0:1767318806.487574:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379598080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318806.487623:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318806.487664:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379598208:0@lo:400:kworker.0
00000100:00100000:0.0:1767318806.487699:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597952
00000100:00100000:0.0:1767318806.487706:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597952
00000100:00100000:0.0:1767318806.487829:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876
00000100:00100000:0.0:1767318806.487837:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379597952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318806.487858:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318806.487917:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379597952:12345-0@lo:38:kworker.0 Request processed in 79us (530us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318806.487924:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876
00000100:00100000:0.0:1767318806.487958:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598080
00000100:00100000:0.0:1767318806.487962:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598080
00000100:00100000:0.0:1767318806.488008:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290
00000100:00100000:0.0:1767318806.488015:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379598080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318806.488062:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379598080:12345-0@lo:400:kworker.0 Request processed in 47us (438us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318806.488067:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290
00000100:00080000:0.0:1767318806.488083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318806.488112:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379598080:0@lo:400:kworker.0
00000100:00100000:1.0:1767318806.488415:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318806.495985:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318806.495998:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318806.496004:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379597952:0@lo:38:kworker.0
00000100:00100000:1.0:1767318806.496090:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318806.499142:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379597824
00000100:00100000:3.0:1767318806.499161:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379597824
00000100:00100000:3.0:1767318806.499960:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598336
00000100:00100000:3.0:1767318806.499967:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598336
00000100:00100000:3.0:1767318806.499996:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598464
00000100:00100000:3.0:1767318806.499998:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598464
00000100:00100000:3.0:1767318806.500032:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598592
00000100:00100000:3.0:1767318806.500035:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598592
00000100:00100000:3.0:1767318806.500136:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865
00000100:00100000:3.0:1767318806.500151:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379598464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318806.502451:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379598464:12345-0@lo:400:kworker.0 Request processed in 2296us (14961us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318806.502469:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865
00000100:00100000:3.0:1767318806.502512:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16456
00000100:00100000:3.0:1767318806.502519:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379597824:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318806.502526:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16457
00000100:00100000:2.0:1767318806.502534:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379598336:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318806.502543:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767318806.502548:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318806.504272:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379597824:12345-0@lo:38:kworker.0 Request processed in 1745us (16999us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318806.504284:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16456
00000100:00100000:3.0:1767318806.504313:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16458
00000100:00100000:3.0:1767318806.504319:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379598592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318806.504335:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318806.504383:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379598592:12345-0@lo:38:kworker.0 Request processed in 63us (15968us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318806.504404:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16458
00000100:00080000:3.0:1767318806.504432:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318806.504688:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318806.504694:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318806.504698:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379598592:0@lo:38:kworker.0
00000100:00080000:3.0:1767318806.506444:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318806.506455:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318806.506460:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379597824:0@lo:38:kworker.0
00000100:00100000:3.0:1767318806.508411:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379598464:0@lo:400:kworker.0
00000100:00100000:2.0:1767318806.510497:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379598336:12345-0@lo:38:kworker.0 Request processed in 7943us (23024us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318806.510511:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16457
00000100:00100000:2.0:1767318806.510540:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598208
00000100:00100000:2.0:1767318806.510548:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598208
00000100:00080000:2.0:1767318806.510589:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318806.510623:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866
00000100:00100000:2.0:1767318806.510631:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379598208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318806.510691:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379598208:12345-0@lo:400:kworker.0 Request processed in 61us (14601us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318806.510697:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866
00000100:00080000:1.0:1767318806.510896:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318806.510902:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318806.510906:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379598336:0@lo:38:kworker.0
00000100:00100000:1.0:1767318806.510941:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379598208:0@lo:400:kworker.0
00010000:00010000:1.0:1767318806.999173:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318808.023651:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318808.464519:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318808.464633:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318808.465771:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291881728
00000100:00100000:0.0:1767318808.465781:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291881728
00000100:00100000:0.0:1767318808.465846:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291881856
00000100:00100000:0.0:1767318808.465849:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291881856
00000100:00080000:1.0:1767318808.466193:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318808.466252:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3867
00000100:00100000:3.0:1767318808.466266:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291881856:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318808.466364:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291881856:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (1730us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318808.466372:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3867
00000100:00100000:3.0:1767318808.466395:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16459
00000100:00100000:3.0:1767318808.466399:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291881728:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318808.466417:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318808.466440:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291881728:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 39us (1932us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318808.466446:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16459
00010000:00010000:2.0:1767318809.047117:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318809.559234:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318809.559272:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379598720:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318809.559356:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318809.559442:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598720
00000100:00100000:3.0:1767318809.559452:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598720
00000100:00100000:3.0:1767318809.559514:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040
00000100:00100000:3.0:1767318809.559525:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379598720:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318809.559564:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:3.0:1767318809.560423:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318809.560496:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379598720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 972us (1138us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318809.560505:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040
00000100:00100000:0.0:1767318809.561299:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379598720:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318810.071375:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318811.095378:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318811.095403:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379598848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318811.095467:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318811.095601:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598848
00000100:00100000:3.0:1767318811.095609:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598848
00000100:00100000:3.0:1767318811.095682:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041
00000100:00100000:3.0:1767318811.095693:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379598848:12345-0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318811.095726:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00000024:3.0:1767318811.095727:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318811.095792:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379598848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (324us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318811.095798:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041
00000100:00080000:1.0:1767318811.095854:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318811.096005:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379598848:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318811.607412:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318811.607440:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318811.607442:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318811.607446:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318811.607450:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318811.607457:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3708
00000100:00080000:0.0:1767318811.607462:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318811.607468:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318811.607504:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a436680 x1853164379598976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318811.607531:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318811.607535:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318811.607537:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318811.607541:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3708
00000100:00080000:0.0:1767318811.607543:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318811.607547:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318811.607559:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a434380 x1853164379599104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318811.607622:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318811.607626:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318811.607627:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318811.607630:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3708
00000100:00080000:0.0:1767318811.607633:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318811.607636:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318811.607646:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a435500 x1853164379599616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318811.607669:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318811.607672:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318811.607674:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318811.607677:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3708
00000100:00080000:0.0:1767318811.607679:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318811.607682:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318811.607692:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a436a00 x1853164379599872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318811.607714:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379599744:0@lo:400:kworker.0
00000100:00100000:2.0:1767318811.607780:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379599360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318811.607807:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318811.607827:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318811.607896:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318811.607904:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318811.607905:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379599232:0@lo:400:kworker.0
00000100:00100000:0.0:1767318811.607913:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379599488:0@lo:400:kworker.0
00000100:00100000:2.0:1767318811.607940:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318811.607949:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318811.607981:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379599360
00000100:00100000:0.0:1767318811.607987:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379599744
00000100:00100000:0.0:1767318811.607994:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379599744
00000100:00100000:2.0:1767318811.607995:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379599360
00000100:00100000:2.0:1767318811.608041:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379599232
00000100:00100000:0.0:1767318811.608044:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379599488
00000100:00100000:2.0:1767318811.608045:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379599232
00000100:00100000:0.0:1767318811.608048:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379599488
00000100:00100000:0.0:1767318811.608083:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868
00000100:00100000:2.0:1767318811.608087:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291
00000100:00100000:0.0:1767318811.608096:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379599744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318811.608101:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379599360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318811.608156:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379599744:12345-0@lo:400:kworker.0 Request processed in 63us (349us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318811.608164:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379599360:12345-0@lo:400:kworker.0 Request processed in 66us (335us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318811.608167:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868
00000100:00100000:2.0:1767318811.608176:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291
00000100:00100000:0.0:1767318811.608190:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869
00000100:00100000:2.0:1767318811.608198:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292
00000100:00100000:0.0:1767318811.608202:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379599488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318811.608211:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379599232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318811.608236:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379599488:12345-0@lo:400:kworker.0 Request processed in 37us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318811.608251:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379599232:12345-0@lo:400:kworker.0 Request processed in 42us (309us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318811.608256:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869
00000100:00100000:2.0:1767318811.608264:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292
00000100:00100000:2.0:1767318811.608334:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379599232:0@lo:400:kworker.0
00000100:00100000:2.0:1767318811.608347:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379599360:0@lo:400:kworker.0
00000100:00100000:3.0:1767318811.608490:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379598976:0@lo:38:kworker.0
00000100:00100000:3.0:1767318811.608522:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318811.608552:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379599104:0@lo:38:kworker.0
00000100:00100000:3.0:1767318811.608575:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318811.608612:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379599616:0@lo:38:kworker.0
00000100:00100000:3.0:1767318811.608634:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318811.608649:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379599872:0@lo:38:kworker.0
00000100:00080000:1.0:1767318811.608651:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318811.608657:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318811.608678:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379598976
00000100:00100000:1.0:1767318811.608681:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379598976
00000100:00100000:3.0:1767318811.608687:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318811.608723:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379599104
00000100:00100000:3.0:1767318811.608727:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379599104
00000100:00100000:3.0:1767318811.608750:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877
00000100:00100000:3.0:1767318811.608755:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379599104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318811.608776:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318811.608815:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379599104:12345-0@lo:38:kworker.0 Request processed in 59us (239us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318811.608822:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877
00000100:00100000:0.0:1767318811.608824:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379599488:0@lo:400:kworker.0
00000100:00100000:0.0:1767318811.608837:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379599744:0@lo:400:kworker.0
00000100:00100000:1.0:1767318811.614266:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379599616
00000100:00100000:1.0:1767318811.614283:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379599616
00000100:00100000:1.0:1767318811.614481:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379599872
00000100:00100000:1.0:1767318811.614486:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379599872
00000100:00100000:1.0:1767318811.614503:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16460
00000100:00100000:1.0:1767318811.614514:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379598976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318811.614542:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318811.614637:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379598976:12345-0@lo:38:kworker.0 Request processed in 124us (6113us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318811.614644:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16460
00000100:00100000:1.0:1767318811.614666:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16461
00000100:00100000:1.0:1767318811.614671:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379599616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318811.614681:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318811.614706:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379599616:12345-0@lo:38:kworker.0 Request processed in 33us (6071us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318811.614741:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16461
00000100:00100000:1.0:1767318811.614754:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16462
00000100:00100000:1.0:1767318811.614758:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379599872:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767318811.615399:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318811.615406:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318811.615411:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379598976:0@lo:38:kworker.0
00000100:00080000:3.0:1767318811.615424:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318811.615427:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318811.615429:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379599104:0@lo:38:kworker.0
00000100:00080000:3.0:1767318811.615438:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318811.615441:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318811.615444:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379599616:0@lo:38:kworker.0
00010000:00020000:1.0:1767318811.615484:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318811.615525:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379599872:12345-0@lo:38:kworker.0 Request processed in 764us (6836us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318811.615533:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16462
00000100:00080000:3.0:1767318811.615556:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318811.615560:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318811.615563:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379599872:0@lo:38:kworker.0
00010000:00010000:1.0:1767318812.119204:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767318812.560270:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291881984 offset 0 length 520: 4
00000100:00100000:2.0:1767318812.560350:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318812.560440:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318812.564545:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291882112
00000100:00100000:3.0:1767318812.564563:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291882112
00000100:00100000:3.0:1767318812.564620:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291882240
00000100:00100000:3.0:1767318812.564624:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291882240
00000100:00100000:3.0:1767318812.564688:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3870
00000100:00100000:3.0:1767318812.564699:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291882240:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318812.564824:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16463
00000100:00100000:1.0:1767318812.564831:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291882112:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318812.564855:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318812.564946:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291882112:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 113us (4596us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318812.564955:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16463
00000100:00080000:2.0:1767318812.567653:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318812.568321:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291882240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 3607us (7863us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318812.568335:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3870
00010000:00010000:2.0:1767318813.144076:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318814.167984:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318814.679902:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318814.679923:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379600000:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318814.680023:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318814.680990:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379600000
00000100:00100000:3.0:1767318814.681010:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379600000
00000100:00100000:3.0:1767318814.682000:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042
00000100:00100000:3.0:1767318814.682019:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379600000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318814.682058:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318814.682149:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379600000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (2126us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318814.682229:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379600000:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318814.683032:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318814.685188:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042
00010000:00010000:2.0:1767318815.191187:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318816.215327:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318816.215353:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379600128:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318816.215954:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318816.216107:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379600128
00000100:00100000:3.0:1767318816.216115:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379600128
00000100:00100000:3.0:1767318816.216187:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043
00000100:00100000:3.0:1767318816.216208:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379600128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318816.216238:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318816.216303:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379600128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (349us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318816.216310:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043
00000100:00080000:1.0:1767318816.216565:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318816.216704:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379600128:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318816.229863:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318816.729328:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318791/real 1767318791]  req@ffff8b0f10905c00 x1853164379594240/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318816 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318816.729366:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f10905c00 x1853164379594240/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318816 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318816.729387:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318816.729396:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318816.729400:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379594240:0@lo:250:kworker.0
00000100:00080000:3.0:1767318816.729546:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318816.729552:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318816.729554:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318816.729559:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3693
00000100:00080000:3.0:1767318816.729563:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318816.729570:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318816.729605:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fea00 x1853164379600256/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318816.729642:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318816.729646:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318816.729648:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318816.729652:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3714
00000100:00080000:3.0:1767318816.729654:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318816.729658:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318816.729672:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ff800 x1853164379600384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318816.729680:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318816.729682:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318816.729684:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318816.729687:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3714
00000100:00080000:3.0:1767318816.729689:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318816.729693:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318816.729703:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc700 x1853164379600512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318816.729766:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318816.729769:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318816.729770:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318816.729773:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3714
00000100:00080000:3.0:1767318816.729776:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318816.729779:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318816.729790:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd180 x1853164379601024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318816.729818:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318816.729821:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318816.729823:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318816.729826:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3714
00000100:00080000:3.0:1767318816.729829:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318816.729833:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318816.729843:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe300 x1853164379601280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318816.729953:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379600640:0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730056:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318816.730143:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318816.730149:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379600768:0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730172:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318816.730222:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379600640
00000100:00100000:2.0:1767318816.730231:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379600640
00000100:00100000:2.0:1767318816.730304:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379600768
00000100:00100000:2.0:1767318816.730307:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379600768
00000100:00100000:2.0:1767318816.730331:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293
00000100:00100000:2.0:1767318816.730341:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379600640:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730397:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379600640:12345-0@lo:400:kworker.0 Request processed in 57us (341us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318816.730404:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293
00000100:00100000:2.0:1767318816.730421:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294
00000100:00100000:2.0:1767318816.730427:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379600768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730450:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379600768:12345-0@lo:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318816.730456:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294
00000100:00100000:2.0:1767318816.730496:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379600768:0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730505:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379600640:0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730528:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379600896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730556:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318816.730576:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318816.730581:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379601152:0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.730601:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318816.730849:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379600896
00000100:00080000:1.0:1767318816.730854:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318816.730854:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379600896
00000100:00100000:3.0:1767318816.730931:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601152
00000100:00100000:3.0:1767318816.730934:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601152
00000100:00100000:3.0:1767318816.730953:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871
00000100:00100000:3.0:1767318816.730958:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379600896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318816.731012:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379600896:12345-0@lo:400:kworker.0 Request processed in 53us (454us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318816.731018:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871
00000100:00100000:3.0:1767318816.731030:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872
00000100:00100000:3.0:1767318816.731037:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379601152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318816.731067:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379601152:12345-0@lo:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318816.731072:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872
00000100:00080000:2.0:1767318816.731675:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318816.731714:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379601152:0@lo:400:kworker.0
00000100:00100000:2.0:1767318816.731724:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379600896:0@lo:400:kworker.0
00000100:00100000:0.0:1767318816.731974:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379600256:0@lo:250:kworker.0
00000400:00000100:0.0:1767318816.732018:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379600256 offset 0 length 520: 4
00000100:00100000:0.0:1767318816.732042:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379600384:0@lo:38:kworker.0
00000100:00100000:0.0:1767318816.732065:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318816.732088:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379600512:0@lo:38:kworker.0
00000100:00100000:0.0:1767318816.732108:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318816.732200:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379600384
00000100:00100000:2.0:1767318816.732205:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379600384
00000100:00100000:2.0:1767318816.732236:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16464
00000100:00100000:2.0:1767318816.732241:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379600384:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318816.732260:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318816.732304:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379600384:12345-0@lo:38:kworker.0 Request processed in 62us (238us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318816.732311:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16464
00000100:00100000:0.0:1767318816.732525:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379601024:0@lo:38:kworker.0
00000100:00100000:0.0:1767318816.732549:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318816.732573:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379601280:0@lo:38:kworker.0
00000100:00100000:0.0:1767318816.732593:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318816.732625:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318816.732630:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318816.732645:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379600384:0@lo:38:kworker.0
00000100:00100000:0.0:1767318816.732669:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601024
00000100:00100000:0.0:1767318816.732672:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601024
00000100:00100000:0.0:1767318816.732690:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601280
00000100:00100000:0.0:1767318816.732692:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601280
00000100:00100000:0.0:1767318816.732705:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16465
00000100:00100000:0.0:1767318816.732709:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379601024:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318816.732719:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318816.732747:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379601024:12345-0@lo:38:kworker.0 Request processed in 36us (197us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318816.732752:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16465
00000100:00100000:0.0:1767318816.732764:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16466
00000100:00100000:0.0:1767318816.732767:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379601280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318816.732775:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318816.732794:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379601280:12345-0@lo:38:kworker.0 Request processed in 25us (201us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318816.732799:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16466
00000100:00080000:0.0:1767318816.732826:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318816.732830:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318816.732833:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379601024:0@lo:38:kworker.0
00000100:00080000:0.0:1767318816.732840:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318816.732843:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318816.732846:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379601280:0@lo:38:kworker.0
00000100:00100000:1.0:1767318816.737948:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379600512
00000100:00100000:1.0:1767318816.737965:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379600512
00000100:00100000:1.0:1767318816.738037:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878
00000100:00100000:1.0:1767318816.738046:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379600512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318816.738070:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318816.738160:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379600512:12345-0@lo:38:kworker.0 Request processed in 113us (6049us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318816.738749:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878
00000100:00080000:0.0:1767318816.738864:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318816.738890:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318816.738904:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379600512:0@lo:38:kworker.0
00010000:00010000:2.0:1767318817.244348:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318817.683570:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318817.683687:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291882496
00000100:00100000:0.0:1767318817.683698:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291882496
00000100:00100000:0.0:1767318817.683809:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3873
00000100:00100000:0.0:1767318817.683821:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291882496:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318817.683955:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291882496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 136us (394us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318817.683963:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3873
00000100:00100000:1.0:1767318817.684416:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318817.684542:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291882368
00000100:00100000:3.0:1767318817.684549:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291882368
00000100:00100000:3.0:1767318817.684584:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16467
00000100:00100000:3.0:1767318817.684601:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291882368:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318817.684625:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318817.684669:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291882368:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 68us (255us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318817.684677:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16467
00000100:00080000:2.0:1767318817.686370:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318818.264330:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318819.287324:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318819.799522:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379601408:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318819.799595:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318819.799733:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601408
00000100:00100000:3.0:1767318819.799742:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601408
00000100:00100000:3.0:1767318819.799806:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044
00000100:00100000:3.0:1767318819.799815:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379601408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318819.799848:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318819.799923:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379601408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (326us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318819.799930:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044
00000100:00100000:2.0:1767318819.800071:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379601408:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318819.800176:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318820.311176:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318821.340273:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318821.343240:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318821.343270:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379601536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318821.343345:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318821.343575:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601536
00000100:00100000:0.0:1767318821.343584:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601536
00000100:00100000:0.0:1767318821.343663:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045
00000100:00100000:0.0:1767318821.343673:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379601536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318821.343705:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318821.343764:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379601536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (418us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318821.343773:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045
00000100:00100000:2.0:1767318821.343917:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379601536:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318821.344194:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318821.846996:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318821.847008:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318821.847011:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318821.847014:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318821.847019:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318821.847027:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3719
00000100:00080000:3.0:1767318821.847033:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318821.847040:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318821.847082:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe680 x1853164379601664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318821.847108:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318821.847135:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318821.847137:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318821.847141:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3719
00000100:00080000:3.0:1767318821.847143:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318821.847147:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318821.847162:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc380 x1853164379601792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318821.847248:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318821.847252:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318821.847254:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318821.847258:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3719
00000100:00080000:3.0:1767318821.847260:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318821.847264:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318821.847277:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ffb80 x1853164379602304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318821.847293:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318821.847296:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318821.847299:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318821.847301:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3719
00000100:00080000:3.0:1767318821.847303:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318821.847307:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318821.847316:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc700 x1853164379602560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318821.847496:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379601920:0@lo:400:kworker.0
00000100:00100000:2.0:1767318821.847582:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318821.847648:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318821.847654:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379602048:0@lo:400:kworker.0
00000100:00100000:2.0:1767318821.847676:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318821.847907:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601920
00000100:00100000:2.0:1767318821.847916:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601920
00000100:00100000:2.0:1767318821.847973:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602048
00000100:00100000:2.0:1767318821.847976:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602048
00000100:00100000:2.0:1767318821.847999:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295
00000100:00100000:2.0:1767318821.848007:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379601920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318821.848061:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379601920:12345-0@lo:400:kworker.0 Request processed in 54us (479us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318821.848068:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295
00000100:00100000:2.0:1767318821.848091:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296
00000100:00100000:2.0:1767318821.848098:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379602048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318821.848126:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379602048:12345-0@lo:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318821.848131:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296
00000100:00100000:2.0:1767318821.848173:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379602048:0@lo:400:kworker.0
00000100:00100000:2.0:1767318821.848183:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379601920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318821.848372:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379602432:0@lo:400:kworker.0
00000100:00100000:1.0:1767318821.848408:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318821.848432:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318821.848437:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379602176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318821.848457:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318821.848483:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318821.848495:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602432
00000100:00100000:1.0:1767318821.848499:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602432
00000100:00100000:1.0:1767318821.848545:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602176
00000100:00100000:1.0:1767318821.848549:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602176
00000100:00100000:1.0:1767318821.848570:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874
00000100:00100000:1.0:1767318821.848575:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379602432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318821.848611:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379602432:12345-0@lo:400:kworker.0 Request processed in 35us (202us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318821.848617:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874
00000100:00100000:1.0:1767318821.848633:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875
00000100:00100000:1.0:1767318821.848639:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379602176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318821.848663:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379602176:12345-0@lo:400:kworker.0 Request processed in 25us (205us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318821.848669:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875
00000100:00080000:1.0:1767318821.848687:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318821.848913:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379602176:0@lo:400:kworker.0
00000100:00100000:1.0:1767318821.848923:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379602432:0@lo:400:kworker.0
00000100:00100000:0.0:1767318821.849475:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379601664:0@lo:38:kworker.0
00000100:00100000:0.0:1767318821.849533:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318821.849553:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379601792:0@lo:38:kworker.0
00000100:00100000:0.0:1767318821.849574:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318821.849609:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379602304:0@lo:38:kworker.0
00000100:00100000:0.0:1767318821.849632:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318821.849655:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379602560:0@lo:38:kworker.0
00000100:00100000:0.0:1767318821.849674:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318821.849865:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601664
00000100:00100000:3.0:1767318821.849896:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601664
00000100:00100000:3.0:1767318821.849935:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602304
00000100:00100000:3.0:1767318821.849938:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602304
00000100:00100000:3.0:1767318821.849946:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602560
00000100:00100000:3.0:1767318821.849948:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602560
00000100:00100000:3.0:1767318821.849958:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16468
00000100:00100000:3.0:1767318821.849964:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379601664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318821.849983:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318821.850056:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16469
00000100:00100000:1.0:1767318821.850062:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379602304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318821.850072:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318821.850141:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379601792
00000100:00100000:2.0:1767318821.850145:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379601792
00000100:00100000:2.0:1767318821.850167:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879
00000100:00100000:2.0:1767318821.850171:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379601792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318821.850181:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318821.850252:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16470
00000100:00100000:0.0:1767318821.850263:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379602560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318821.850272:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318821.852739:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379601664:12345-0@lo:38:kworker.0 Request processed in 2762us (3194us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318821.852754:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16468
00000100:00100000:1.0:1767318821.853060:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379602304:12345-0@lo:38:kworker.0 Request processed in 2995us (3426us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318821.853069:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16469
00000100:00100000:2.0:1767318821.858445:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379601792:12345-0@lo:38:kworker.0 Request processed in 8260us (8857us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318821.858461:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879
00000100:00100000:0.0:1767318821.860896:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379602560:12345-0@lo:38:kworker.0 Request processed in 10605us (11193us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318821.860912:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16470
00000100:00080000:3.0:1767318821.864685:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318821.864849:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318821.864857:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379601664:0@lo:38:kworker.0
00000100:00080000:3.0:1767318821.864904:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318821.864909:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318821.864912:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379601792:0@lo:38:kworker.0
00000100:00080000:3.0:1767318821.864924:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318821.864927:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318821.864931:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379602304:0@lo:38:kworker.0
00000100:00080000:3.0:1767318821.864940:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318821.864944:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318821.864947:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379602560:0@lo:38:kworker.0
00010000:00010000:1.0:1767318822.359150:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318822.799414:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318822.801336:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318822.801532:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291882624
00000100:00100000:2.0:1767318822.801557:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291882624
00000100:00100000:2.0:1767318822.801615:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291882752
00000100:00100000:2.0:1767318822.801618:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291882752
00000100:00080000:0.0:1767318822.801838:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318822.802291:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3876
00000100:00100000:2.0:1767318822.802309:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291882752:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318822.802351:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16471
00000100:00100000:0.0:1767318822.802366:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291882624:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318822.802393:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318822.802428:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291882752:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 121us (1105us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318822.802438:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3876
00000100:00100000:0.0:1767318822.802472:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291882624:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 105us (3067us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318822.802483:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16471
00010000:00010000:2.0:1767318823.383200:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318824.412238:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318824.919818:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379602688:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318824.919958:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318824.920089:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602688
00000100:00100000:1.0:1767318824.920098:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602688
00000100:00100000:1.0:1767318824.920162:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046
00000100:00100000:1.0:1767318824.920172:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379602688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318824.920213:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318824.920334:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318824.931587:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379602688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11406us (11618us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318824.931602:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046
00000100:00100000:2.0:1767318824.938677:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379602688:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318825.434572:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318826.455236:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318826.456371:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318826.456399:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379602816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318826.456484:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318826.456899:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602816
00000100:00100000:3.0:1767318826.456908:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602816
00000100:00100000:3.0:1767318826.456994:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047
00000100:00100000:3.0:1767318826.457004:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379602816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318826.457037:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318826.457092:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379602816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (608us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318826.457100:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047
00000100:00100000:3.0:1767318826.457147:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379602816:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318826.458035:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318826.967405:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318826.967417:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318826.967421:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318826.967424:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318826.967429:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318826.967438:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3724
00000100:00080000:3.0:1767318826.967444:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318826.967452:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318826.967499:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc380 x1853164379602944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318826.967532:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318826.967536:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318826.967537:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318826.967541:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3724
00000100:00080000:3.0:1767318826.967543:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318826.967547:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318826.967560:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe680 x1853164379603072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318826.967645:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318826.967649:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318826.967651:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318826.967655:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3724
00000100:00080000:3.0:1767318826.967658:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318826.967661:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318826.967685:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc000 x1853164379603584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318826.967701:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318826.967704:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318826.967706:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318826.967709:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3724
00000100:00080000:3.0:1767318826.967712:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318826.967715:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318826.967725:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd880 x1853164379603840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318826.967757:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379603456:0@lo:400:kworker.0
00000100:00100000:3.0:1767318826.967827:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318826.967916:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318826.967923:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379603712:0@lo:400:kworker.0
00000100:00100000:3.0:1767318826.967946:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318826.967979:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603456
00000100:00100000:3.0:1767318826.967997:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603456
00000100:00100000:3.0:1767318826.968047:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603712
00000100:00100000:3.0:1767318826.968058:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603712
00000100:00100000:0.0:1767318826.968211:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379602944:0@lo:38:kworker.0
00000100:00100000:0.0:1767318826.968246:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318826.968267:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379603072:0@lo:38:kworker.0
00000100:00100000:0.0:1767318826.968289:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318826.968313:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379603584:0@lo:38:kworker.0
00000100:00100000:0.0:1767318826.968332:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318826.968348:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379603840:0@lo:38:kworker.0
00000100:00100000:0.0:1767318826.968366:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318826.968395:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603072
00000100:00100000:0.0:1767318826.968399:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603072
00000100:00100000:0.0:1767318826.968427:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880
00000100:00100000:0.0:1767318826.968443:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379603072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318826.968465:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318826.968508:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379603072:12345-0@lo:38:kworker.0 Request processed in 65us (218us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318826.968515:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880
00000100:00100000:0.0:1767318826.968537:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379602944
00000100:00100000:0.0:1767318826.968540:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379602944
00000100:00100000:0.0:1767318826.968550:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603584
00000100:00100000:0.0:1767318826.968552:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603584
00000100:00100000:0.0:1767318826.968557:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603840
00000100:00100000:0.0:1767318826.968559:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603840
00000100:00100000:0.0:1767318826.968568:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877
00000100:00100000:1.0:1767318826.968630:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379603200:0@lo:400:kworker.0
00000100:00100000:1.0:1767318826.968658:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318826.968677:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318826.968682:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379603328:0@lo:400:kworker.0
00000100:00100000:1.0:1767318826.968700:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318826.968722:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16472
00000100:00100000:1.0:1767318826.968733:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379602944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318826.968742:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318826.968766:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379602944:12345-0@lo:38:kworker.0 Request processed in 32us (519us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318826.968771:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16472
00000100:00100000:1.0:1767318826.968783:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16473
00000100:00100000:1.0:1767318826.968786:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379603584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318826.968793:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318826.968810:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379603584:12345-0@lo:38:kworker.0 Request processed in 22us (477us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318826.968814:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16473
00000100:00100000:1.0:1767318826.968823:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16474
00000100:00100000:1.0:1767318826.968826:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379603840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318826.968834:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318826.968856:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379603840:12345-0@lo:38:kworker.0 Request processed in 28us (490us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318826.968862:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16474
00000100:00100000:1.0:1767318826.968895:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603200
00000100:00100000:1.0:1767318826.968899:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603200
00000100:00100000:1.0:1767318826.968926:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603328
00000100:00100000:1.0:1767318826.968929:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603328
00000100:00100000:1.0:1767318826.968947:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297
00000100:00100000:1.0:1767318826.968953:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379603200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318826.968993:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379603200:12345-0@lo:400:kworker.0 Request processed in 40us (333us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318826.968999:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297
00000100:00100000:1.0:1767318826.969021:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298
00000100:00100000:1.0:1767318826.969027:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379603328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318826.969053:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379603328:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318826.969058:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298
00000100:00080000:1.0:1767318826.969102:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318826.969107:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318826.969233:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318826.969240:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318826.969243:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379602944:0@lo:38:kworker.0
00000100:00080000:2.0:1767318826.969253:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318826.969256:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318826.969258:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379603072:0@lo:38:kworker.0
00000100:00080000:2.0:1767318826.969265:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318826.969267:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318826.969270:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379603584:0@lo:38:kworker.0
00000100:00080000:2.0:1767318826.969276:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318826.969278:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318826.969281:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379603840:0@lo:38:kworker.0
00000100:00100000:2.0:1767318826.969324:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379603328:0@lo:400:kworker.0
00000100:00100000:2.0:1767318826.969332:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379603200:0@lo:400:kworker.0
00000100:00100000:3.0:1767318826.969717:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878
00000100:00100000:0.0:1767318826.978220:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379603456:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318826.978342:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379603456:12345-0@lo:400:kworker.0 Request processed in 9767us (10515us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318826.978354:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877
00000100:00100000:2.0:1767318826.978507:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379603456:0@lo:400:kworker.0
00000100:00100000:3.0:1767318826.981918:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379603712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318826.982137:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379603712:12345-0@lo:400:kworker.0 Request processed in 12411us (14188us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318826.982148:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878
00000100:00100000:2.0:1767318826.988246:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379603712:0@lo:400:kworker.0
00010000:00010000:2.0:1767318827.485166:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318827.919409:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318827.919561:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291883008
00000100:00100000:3.0:1767318827.919572:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291883008
00000100:00100000:3.0:1767318827.919672:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3879
00000100:00100000:3.0:1767318827.919685:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291883008:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318827.919785:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291883008:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 103us (386us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318827.919793:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3879
00000100:00080000:1.0:1767318827.920560:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318827.923005:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318827.923389:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291882880
00000100:00100000:0.0:1767318827.923404:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291882880
00000100:00100000:0.0:1767318827.923475:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16475
00000100:00100000:0.0:1767318827.923486:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291882880:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318827.923517:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318827.924045:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291882880:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 555us (1050us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318827.924056:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16475
00010000:00010000:1.0:1767318828.503218:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318829.528188:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318830.039740:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318830.039765:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379603968:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318830.039865:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318830.040044:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379603968
00000100:00100000:2.0:1767318830.040054:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379603968
00000100:00100000:2.0:1767318830.040134:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048
00000100:00100000:2.0:1767318830.040145:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379603968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318830.040193:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318830.040263:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379603968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (397us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318830.040271:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048
00000100:00080000:1.0:1767318830.040338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318830.040375:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379603968:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318830.551432:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318831.575535:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318831.584590:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379604096:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318831.584722:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318831.584959:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604096
00000100:00100000:2.0:1767318831.584971:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604096
00000100:00100000:2.0:1767318831.585075:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049
00000100:00100000:2.0:1767318831.585091:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379604096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318831.585150:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318831.585240:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379604096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (518us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318831.585250:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049
00000100:00100000:0.0:1767318831.585359:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379604096:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318831.585387:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318832.087795:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318832.087812:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318832.087815:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318832.087820:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318832.087825:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318832.087836:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3729
00000100:00080000:2.0:1767318832.087845:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318832.087856:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318832.087941:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379a680 x1853164379604224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318832.087978:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318832.087983:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318832.087985:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318832.087990:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3729
00000100:00080000:2.0:1767318832.087993:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318832.087998:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318832.088041:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379604224:0@lo:38:kworker.0
00000100:00100000:0.0:1767318832.088147:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318832.088260:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604224
00000100:00100000:0.0:1767318832.088270:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604224
00000100:00100000:0.0:1767318832.088318:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16476
00000100:00100000:0.0:1767318832.088327:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379604224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318832.088354:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318832.088420:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379604224:12345-0@lo:38:kworker.0 Request processed in 92us (271us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318832.088428:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16476
00000100:00080000:1.0:1767318832.088556:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318832.088563:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318832.088566:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379604224:0@lo:38:kworker.0
00000100:00100000:2.0:1767318832.089814:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798380 x1853164379604352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318832.089918:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318832.089921:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318832.089924:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318832.089929:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3729
00000100:00080000:2.0:1767318832.089932:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318832.089939:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318832.089954:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b800 x1853164379604864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318832.089969:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318832.089972:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318832.089974:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318832.089977:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3729
00000100:00080000:2.0:1767318832.089980:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318832.089983:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318832.089993:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799880 x1853164379605120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318832.090021:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379604736:0@lo:400:kworker.0
00000100:00100000:2.0:1767318832.090084:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318832.090125:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318832.090130:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379604992:0@lo:400:kworker.0
00000100:00100000:2.0:1767318832.090303:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318832.090333:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604736
00000100:00100000:2.0:1767318832.090340:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604736
00000100:00100000:2.0:1767318832.090394:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604992
00000100:00100000:2.0:1767318832.090396:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604992
00000100:00080000:1.0:1767318832.090519:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318832.090536:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379604352:0@lo:38:kworker.0
00000100:00100000:1.0:1767318832.090572:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318832.090611:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379604864:0@lo:38:kworker.0
00000100:00100000:1.0:1767318832.090629:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318832.090643:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379605120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318832.090680:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318832.090708:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604864
00000100:00100000:1.0:1767318832.090711:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604864
00000100:00100000:1.0:1767318832.090730:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379605120
00000100:00100000:1.0:1767318832.090732:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379605120
00000100:00100000:1.0:1767318832.090743:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880
00000100:00100000:1.0:1767318832.090754:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379604736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318832.090809:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379604736:12345-0@lo:400:kworker.0 Request processed in 57us (724us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318832.090816:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880
00000100:00100000:1.0:1767318832.090836:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16477
00000100:00100000:1.0:1767318832.090839:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379604864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318832.090859:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318832.090904:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379604864:12345-0@lo:38:kworker.0 Request processed in 63us (273us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318832.090910:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16477
00000100:00100000:1.0:1767318832.090926:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16478
00000100:00100000:1.0:1767318832.090930:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379605120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318832.090938:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318832.090956:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379605120:12345-0@lo:38:kworker.0 Request processed in 25us (275us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318832.090961:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16478
00000100:00100000:1.0:1767318832.090999:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379604736:0@lo:400:kworker.0
00000100:00080000:1.0:1767318832.091028:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318832.091032:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318832.091041:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379604864:0@lo:38:kworker.0
00000100:00080000:1.0:1767318832.091050:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318832.091053:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318832.091056:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379605120:0@lo:38:kworker.0
00000100:00100000:1.0:1767318832.091097:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604352
00000100:00100000:1.0:1767318832.091100:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604352
00000100:00100000:1.0:1767318832.091119:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881
00000100:00100000:1.0:1767318832.091124:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379604352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318832.091143:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318832.091171:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379604352:12345-0@lo:38:kworker.0 Request processed in 46us (598us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318832.091176:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881
00000100:00080000:1.0:1767318832.091198:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318832.091202:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318832.091205:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379604352:0@lo:38:kworker.0
00000100:00100000:0.0:1767318832.091628:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379604608:0@lo:400:kworker.0
00000100:00100000:0.0:1767318832.091670:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318832.091699:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318832.091704:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379604480:0@lo:400:kworker.0
00000100:00100000:0.0:1767318832.091722:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318832.091754:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604608
00000100:00100000:0.0:1767318832.091757:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604608
00000100:00100000:0.0:1767318832.091789:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379604480
00000100:00100000:0.0:1767318832.091791:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379604480
00000100:00100000:3.0:1767318832.091932:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299
00000100:00100000:3.0:1767318832.091942:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379604608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318832.091994:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379604608:12345-0@lo:400:kworker.0 Request processed in 54us (323us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318832.092000:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299
00000100:00100000:2.0:1767318832.092128:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881
00000100:00100000:2.0:1767318832.092145:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379604992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318832.092189:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379604992:12345-0@lo:400:kworker.0 Request processed in 54us (1885us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318832.092195:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881
00000100:00100000:2.0:1767318832.092230:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379604992:0@lo:400:kworker.0
00000100:00100000:2.0:1767318832.092266:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379604608:0@lo:400:kworker.0
00000100:00100000:0.0:1767318832.092430:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300
00000100:00100000:0.0:1767318832.092438:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379604480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318832.092479:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379604480:12345-0@lo:400:kworker.0 Request processed in 42us (755us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318832.092485:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300
00000100:00080000:1.0:1767318832.092745:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318832.092751:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318832.094125:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379604480:0@lo:400:kworker.0
00010000:00010000:1.0:1767318832.599487:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318833.043599:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318833.043673:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318833.043726:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291883264
00000100:00100000:0.0:1767318833.043740:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291883264
00000100:00100000:2.0:1767318833.043900:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291883136
00000100:00100000:2.0:1767318833.043905:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291883136
00000100:00100000:0.0:1767318833.043910:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3882
00000100:00100000:0.0:1767318833.043924:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291883264:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318833.043953:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16479
00000100:00100000:2.0:1767318833.043960:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291883136:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:3.0:1767318833.043967:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:2.0:1767318833.043991:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318833.044055:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291883264:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 134us (473us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318833.044064:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3882
00000100:00100000:2.0:1767318833.050176:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291883136:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 6195us (6483us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318833.050197:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16479
00010000:00010000:2.0:1767318833.623305:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318834.648939:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318835.160042:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379605248:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318835.160153:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318835.160461:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379605248
00000100:00100000:1.0:1767318835.160472:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379605248
00000100:00100000:1.0:1767318835.160551:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050
00000100:00100000:1.0:1767318835.160562:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379605248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318835.160599:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318835.160658:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379605248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (505us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318835.160688:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050
00000100:00100000:1.0:1767318835.160754:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379605248:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318835.160815:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318835.671823:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318836.695121:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318836.696254:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318836.699295:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379605376:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318836.699430:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318836.699795:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379605376
00000100:00100000:2.0:1767318836.699807:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379605376
00000100:00100000:2.0:1767318836.699929:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051
00000100:00100000:2.0:1767318836.699941:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379605376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318836.699987:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318836.700071:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379605376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (640us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318836.700080:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051
00000100:00080000:3.0:1767318836.700287:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318836.706501:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379605376:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318837.208613:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318837.208628:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318837.208633:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318837.208899:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318837.208904:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318837.208915:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3734
00000100:00080000:1.0:1767318837.208921:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318837.208931:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318837.208995:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433480 x1853164379605504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318837.209111:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379605504:0@lo:38:kworker.0
00000100:00100000:2.0:1767318837.209250:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318837.209411:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379605504
00000100:00100000:3.0:1767318837.209422:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379605504
00000100:00100000:3.0:1767318837.209486:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16480
00000100:00100000:3.0:1767318837.209495:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379605504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318837.209522:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767318837.210364:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318837.210371:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318837.210374:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318837.210379:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3734
00000100:00080000:1.0:1767318837.210382:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318837.210388:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318837.210433:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a430380 x1853164379605632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318837.210828:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379605632:0@lo:38:kworker.0
00000100:00100000:2.0:1767318837.210902:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.211006:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379605632
00000100:00100000:0.0:1767318837.211014:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379605632
00000100:00100000:0.0:1767318837.211058:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882
00000100:00100000:0.0:1767318837.211065:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379605632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318837.211085:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318837.211137:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379605632:12345-0@lo:38:kworker.0 Request processed in 71us (234us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318837.211144:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882
00000100:00100000:3.0:1767318837.212215:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379605504:12345-0@lo:38:kworker.0 Request processed in 2713us (2958us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318837.212227:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16480
00000100:00080000:2.0:1767318837.212257:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318837.212263:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318837.212267:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379605504:0@lo:38:kworker.0
00000100:00080000:2.0:1767318837.212300:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318837.212304:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318837.212307:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379605632:0@lo:38:kworker.0
00000100:00100000:3.0:1767318837.212455:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379605760:0@lo:400:kworker.0
00000100:00100000:3.0:1767318837.212514:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.212571:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379605760
00000100:00100000:0.0:1767318837.212578:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379605760
00000100:00100000:0.0:1767318837.212653:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301
00000100:00100000:0.0:1767318837.212663:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379605760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318837.212749:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318837.212757:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379605888:0@lo:400:kworker.0
00000100:00100000:3.0:1767318837.212787:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318837.212820:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318837.212831:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379605888
00000100:00100000:3.0:1767318837.212835:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379605888
00000100:00100000:0.0:1767318837.212839:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379605760:12345-0@lo:400:kworker.0 Request processed in 179us (326us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318837.212847:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301
00000100:00080000:1.0:1767318837.212896:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318837.212902:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318837.212905:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318837.212910:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3734
00000100:00080000:1.0:1767318837.212914:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318837.212914:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318837.212919:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318837.212948:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a432d80 x1853164379606016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318837.213016:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883
00000100:00100000:3.0:1767318837.213025:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379605888:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318837.213047:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379605760:0@lo:400:kworker.0
00000100:00100000:3.0:1767318837.213054:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379605888:12345-0@lo:400:kworker.0 Request processed in 33us (267us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318837.213061:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883
00000100:00100000:0.0:1767318837.213062:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379605888:0@lo:400:kworker.0
00000100:00100000:2.0:1767318837.213125:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379606016:0@lo:38:kworker.0
00000100:00100000:3.0:1767318837.213151:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318837.213155:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318837.213169:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318837.213173:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318837.213175:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318837.213179:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3734
00000100:00080000:1.0:1767318837.213182:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318837.213186:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318837.213200:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a430e00 x1853164379606272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318837.213254:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379606144:0@lo:400:kworker.0
00000100:00100000:2.0:1767318837.213260:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379606272:0@lo:38:kworker.0
00000100:00100000:2.0:1767318837.213279:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318837.214192:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318837.214225:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379606016
00000100:00100000:1.0:1767318837.214225:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379606272
00000100:00100000:0.0:1767318837.214232:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379606016
00000100:00100000:1.0:1767318837.214232:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379606272
00000100:00100000:1.0:1767318837.214274:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16481
00000100:00100000:1.0:1767318837.214352:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379606272:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318837.214357:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379606144
00000100:00100000:3.0:1767318837.214360:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379606144
00010000:00020000:1.0:1767318837.214377:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318837.214419:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16482
00000100:00100000:0.0:1767318837.214424:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379606016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318837.214435:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318837.214502:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379606016:12345-0@lo:38:kworker.0 Request processed in 76us (1346us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318837.214509:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16482
00000100:00080000:0.0:1767318837.214547:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318837.214553:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318837.214557:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379606016:0@lo:38:kworker.0
00000100:00100000:1.0:1767318837.214569:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379606272:12345-0@lo:38:kworker.0 Request processed in 217us (1289us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318837.214575:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16481
00000100:00080000:0.0:1767318837.214576:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318837.214579:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318837.214582:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379606272:0@lo:38:kworker.0
00000100:00080000:1.0:1767318837.214619:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318837.215923:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884
00000100:00100000:3.0:1767318837.215954:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379606144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318837.216024:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379606144:12345-0@lo:400:kworker.0 Request processed in 77us (1838us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318837.216030:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884
00000100:00100000:0.0:1767318837.216110:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379606144:0@lo:400:kworker.0
00010000:00010000:2.0:1767318837.728737:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318838.160507:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318838.161048:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291883392
00000100:00100000:3.0:1767318838.161062:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291883392
00000100:00100000:3.0:1767318838.161138:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16483
00000100:00100000:3.0:1767318838.161148:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291883392:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318838.161179:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318838.161284:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291883392:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 135us (792us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318838.161292:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16483
00000100:00100000:3.0:1767318838.163220:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318838.163329:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291883520
00000100:00100000:2.0:1767318838.163341:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291883520
00000100:00100000:2.0:1767318838.163418:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3885
00000100:00100000:2.0:1767318838.163429:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291883520:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318838.163531:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291883520:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (319us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318838.163539:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3885
00000100:00080000:1.0:1767318838.164187:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767318838.164950:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291883648 offset 0 length 520: 4
00010000:00010000:2.0:1767318838.746745:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318839.767496:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318840.279108:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379606400:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318840.279792:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318840.280140:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379606400
00000100:00100000:1.0:1767318840.280153:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379606400
00000100:00100000:1.0:1767318840.280236:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052
00000100:00100000:1.0:1767318840.280246:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379606400:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318840.280286:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318840.280338:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379606400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (548us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318840.280346:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052
00000100:00080000:2.0:1767318840.280422:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318840.281168:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379606400:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318840.793065:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318841.303550:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318816/real 1767318816]  req@ffff8b0f2f3fea00 x1853164379600256/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318841 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767318841.303598:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f3fea00 x1853164379600256/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318841 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767318841.303625:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318841.303657:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767318841.303687:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379600256:0@lo:250:kworker.0
00000100:00080000:3.0:1767318841.304013:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318841.304021:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767318841.304132:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318841.304139:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3719
00000100:00080000:3.0:1767318841.304144:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318841.304152:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318841.304206:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd880 x1853164379606528/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318841.304237:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318841.304242:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318841.304244:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318841.304248:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3739
00000100:00080000:3.0:1767318841.304260:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318841.304265:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318841.304287:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc000 x1853164379606656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318841.304298:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318841.304302:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318841.304304:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318841.304309:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3739
00000100:00080000:3.0:1767318841.304311:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318841.304315:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318841.304330:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe680 x1853164379606784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318841.304436:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379606912:0@lo:400:kworker.0
00000100:00100000:1.0:1767318841.304532:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318841.304702:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379606912
00000100:00100000:2.0:1767318841.304714:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379606912
00000100:00100000:2.0:1767318841.304795:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302
00000100:00100000:2.0:1767318841.304807:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379606912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318841.304986:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379606528:0@lo:250:kworker.0
00000400:00000100:0.0:1767318841.305018:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379606528 offset 0 length 520: 4
00000100:00100000:0.0:1767318841.305060:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379606656:0@lo:38:kworker.0
00000100:00100000:0.0:1767318841.305092:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318841.305115:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379606784:0@lo:38:kworker.0
00000100:00100000:0.0:1767318841.305148:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318841.305190:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379606784
00000100:00100000:0.0:1767318841.305194:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379606784
00000100:00100000:0.0:1767318841.305223:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883
00000100:00100000:0.0:1767318841.305229:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0912e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379606784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318841.305255:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318841.305294:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0912e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379606784:12345-0@lo:38:kworker.0 Request processed in 62us (143us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318841.305301:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883
00000100:00080000:0.0:1767318841.305593:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318841.305599:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318841.305604:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379606784:0@lo:38:kworker.0
00000100:00100000:0.0:1767318841.305652:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379606656
00000100:00100000:0.0:1767318841.305656:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379606656
00000100:00100000:0.0:1767318841.305685:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16484
00000100:00100000:0.0:1767318841.305690:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379606656:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318841.305702:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318841.305737:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379606656:12345-0@lo:38:kworker.0 Request processed in 46us (644us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318841.305755:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16484
00000100:00100000:0.0:1767318841.305778:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379607040:0@lo:400:kworker.0
00000100:00100000:0.0:1767318841.305811:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318841.305847:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318841.305851:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318841.305855:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379606656:0@lo:38:kworker.0
00000100:00100000:0.0:1767318841.305912:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607040
00000100:00100000:0.0:1767318841.305916:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607040
00000100:00100000:0.0:1767318841.305956:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303
00000100:00100000:0.0:1767318841.305963:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379607040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318841.306003:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379607040:12345-0@lo:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318841.306010:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303
00000100:00100000:0.0:1767318841.306037:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379607040:0@lo:400:kworker.0
00000100:00080000:0.0:1767318841.306086:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318841.310187:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379606912:12345-0@lo:400:kworker.0 Request processed in 5366us (5639us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318841.310207:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302
00000100:00080000:3.0:1767318841.310519:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318841.310525:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318841.310529:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318841.310536:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3739
00000100:00080000:3.0:1767318841.310551:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318841.310559:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318841.310586:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ff480 x1853164379607296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318841.310615:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318841.310619:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318841.310621:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318841.310624:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3739
00000100:00080000:3.0:1767318841.310648:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318841.310652:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318841.310671:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fce00 x1853164379607552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318841.310715:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379607424:0@lo:400:kworker.0
00000100:00100000:3.0:1767318841.310985:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318841.311118:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318841.311126:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379607168:0@lo:400:kworker.0
00000100:00100000:3.0:1767318841.311156:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318841.311194:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607424
00000100:00100000:3.0:1767318841.311202:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607424
00000100:00100000:3.0:1767318841.311526:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607168
00000100:00100000:3.0:1767318841.311531:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607168
00000100:00100000:3.0:1767318841.312310:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886
00000100:00100000:3.0:1767318841.312323:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379607424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318841.312417:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379607424:12345-0@lo:400:kworker.0 Request processed in 97us (1432us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318841.312426:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886
00000100:00100000:3.0:1767318841.312445:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887
00000100:00100000:3.0:1767318841.312453:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379607168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318841.312485:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379607168:12345-0@lo:400:kworker.0 Request processed in 34us (1329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318841.312491:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887
00000100:00100000:2.0:1767318841.312855:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379607296:0@lo:38:kworker.0
00000100:00100000:2.0:1767318841.312933:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318841.312960:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379607552:0@lo:38:kworker.0
00000100:00100000:2.0:1767318841.312985:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318841.313337:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607296
00000100:00100000:2.0:1767318841.313346:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607296
00000100:00100000:2.0:1767318841.313377:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607552
00000100:00100000:2.0:1767318841.313381:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607552
00000100:00100000:2.0:1767318841.313400:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16485
00000100:00100000:2.0:1767318841.313406:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379607296:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318841.313436:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318841.313485:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379607296:12345-0@lo:38:kworker.0 Request processed in 78us (551us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318841.313493:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16485
00000100:00100000:2.0:1767318841.313511:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16486
00000100:00100000:2.0:1767318841.313515:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379607552:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318841.313524:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318841.314375:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379607552:12345-0@lo:38:kworker.0 Request processed in 851us (1381us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318841.314387:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16486
00000100:00080000:2.0:1767318841.314455:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318841.314462:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318841.314467:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379607296:0@lo:38:kworker.0
00000100:00080000:2.0:1767318841.314479:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318841.314483:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318841.314485:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379607552:0@lo:38:kworker.0
00000100:00100000:3.0:1767318841.315258:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379607168:0@lo:400:kworker.0
00000100:00100000:3.0:1767318841.315293:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379607424:0@lo:400:kworker.0
00000100:00080000:2.0:1767318841.319198:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318841.319968:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379606912:0@lo:400:kworker.0
00010000:00010000:2.0:1767318841.815261:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318841.815465:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379607680:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318841.815564:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318841.815684:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607680
00000100:00100000:3.0:1767318841.815695:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607680
00000100:00100000:3.0:1767318841.815769:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053
00000100:00100000:3.0:1767318841.815781:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379607680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318841.815822:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318841.815920:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379607680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (356us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318841.815928:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053
00000100:00100000:2.0:1767318841.816075:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379607680:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318842.844525:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318843.287445:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318843.287598:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318843.287769:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291883904
00000100:00100000:3.0:1767318843.287783:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291883904
00000100:00080000:2.0:1767318843.288066:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318843.288082:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291883776
00000100:00100000:3.0:1767318843.288086:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291883776
00000100:00100000:1.0:1767318843.288167:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3888
00000100:00100000:1.0:1767318843.288197:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291883904:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318843.288236:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16487
00000100:00100000:0.0:1767318843.288243:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291883776:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318843.288269:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318843.288311:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291883776:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 65us (713us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318843.288311:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291883904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 120us (886us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318843.288319:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16487
00000100:00100000:1.0:1767318843.290282:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3888
00010000:00010000:2.0:1767318843.865990:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318844.893212:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318845.399554:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379607808:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318845.399665:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318845.399832:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607808
00000100:00100000:1.0:1767318845.399843:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607808
00000100:00080000:2.0:1767318845.399985:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318845.399989:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054
00000100:00100000:1.0:1767318845.400007:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379607808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318845.400056:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318845.400129:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379607808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (473us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318845.400138:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054
00000100:00100000:0.0:1767318845.400336:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379607808:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318845.911575:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318846.424557:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318846.424568:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318846.424572:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318846.424576:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318846.424596:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318846.424604:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3743
00000100:00080000:2.0:1767318846.424609:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318846.424616:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318846.424655:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc000 x1853164379607936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318846.424673:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318846.424675:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318846.424677:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318846.424680:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3743
00000100:00080000:2.0:1767318846.424683:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318846.424686:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318846.424699:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcce00 x1853164379608064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318846.424769:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318846.424774:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318846.424776:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318846.424780:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3743
00000100:00080000:2.0:1767318846.424783:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318846.424788:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318846.424805:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164379608576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318846.424820:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379608192:0@lo:400:kworker.0
00000100:00080000:2.0:1767318846.424828:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318846.424832:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318846.424837:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767318846.424840:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379608320:0@lo:400:kworker.0
00000100:00080000:2.0:1767318846.424842:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3743
00000100:00080000:2.0:1767318846.424854:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318846.424862:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318846.424916:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164379608832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318846.424938:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318846.424952:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379608448:0@lo:400:kworker.0
00000100:00100000:2.0:1767318846.424994:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318846.425046:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318846.425057:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379608704:0@lo:400:kworker.0
00000100:00100000:3.0:1767318846.425086:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608192
00000100:00100000:3.0:1767318846.425096:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608192
00000100:00100000:1.0:1767318846.425107:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318846.425116:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318846.425162:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608320
00000100:00100000:3.0:1767318846.425167:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608320
00000100:00100000:0.0:1767318846.425209:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379607936:0@lo:38:kworker.0
00000100:00100000:3.0:1767318846.425212:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304
00000100:00100000:3.0:1767318846.425228:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379608192:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767318846.426280:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318846.426321:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305
00000100:00100000:2.0:1767318846.426337:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379608320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318846.426398:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379608320:12345-0@lo:400:kworker.0 Request processed in 68us (1303us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318846.426407:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305
00000100:00100000:2.0:1767318846.426440:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608448
00000100:00100000:2.0:1767318846.426446:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608448
00000100:00100000:2.0:1767318846.426486:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608704
00000100:00100000:2.0:1767318846.426490:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608704
00000100:00100000:2.0:1767318846.426511:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889
00000100:00100000:2.0:1767318846.426518:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379608448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318846.426555:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379608448:12345-0@lo:400:kworker.0 Request processed in 37us (1560us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318846.426561:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889
00000100:00100000:2.0:1767318846.426576:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890
00000100:00100000:2.0:1767318846.426601:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379608704:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318846.426627:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379608704:12345-0@lo:400:kworker.0 Request processed in 27us (1525us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318846.426632:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890
00000100:00080000:2.0:1767318846.426649:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318846.426677:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379608704:0@lo:400:kworker.0
00000100:00100000:2.0:1767318846.426688:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379608448:0@lo:400:kworker.0
00000100:00100000:1.0:1767318846.427378:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379608320:0@lo:400:kworker.0
00000100:00100000:3.0:1767318846.429228:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379608192:12345-0@lo:400:kworker.0 Request processed in 3994us (4281us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318846.429243:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304
00000100:00100000:2.0:1767318846.429477:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379608192:0@lo:400:kworker.0
00000100:00100000:0.0:1767318846.432056:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318846.432107:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379608064:0@lo:38:kworker.0
00000100:00100000:1.0:1767318846.432140:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379607936
00000100:00100000:1.0:1767318846.432150:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379607936
00000100:00100000:1.0:1767318846.432249:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16488
00000100:00100000:1.0:1767318846.432257:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379607936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318846.432280:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318846.432340:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379607936:12345-0@lo:38:kworker.0 Request processed in 82us (294us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318846.432347:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16488
00000100:00100000:0.0:1767318846.432573:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318846.432629:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379608576:0@lo:38:kworker.0
00000100:00100000:0.0:1767318846.432654:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318846.432682:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379608832:0@lo:38:kworker.0
00000100:00100000:2.0:1767318846.432693:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608064
00000100:00100000:2.0:1767318846.432700:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608064
00000100:00100000:0.0:1767318846.432708:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318846.432733:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884
00000100:00100000:2.0:1767318846.432740:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379608064:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767318846.432753:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00010000:00020000:2.0:1767318846.432753:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767318846.432762:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318846.432766:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379607936:0@lo:38:kworker.0
00000100:00080000:0.0:1767318846.432831:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318846.432835:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318846.432838:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379608064:0@lo:38:kworker.0
00000100:00100000:2.0:1767318846.433081:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379608064:12345-0@lo:38:kworker.0 Request processed in 340us (506us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318846.433088:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884
00000100:00100000:2.0:1767318846.433113:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608576
00000100:00100000:2.0:1767318846.433117:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608576
00000100:00100000:2.0:1767318846.433143:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608832
00000100:00100000:2.0:1767318846.433146:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608832
00000100:00100000:2.0:1767318846.433169:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16489
00000100:00100000:2.0:1767318846.433174:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379608576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318846.433185:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318846.433216:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16490
00000100:00100000:2.0:1767318846.433222:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379608576:12345-0@lo:38:kworker.0 Request processed in 45us (566us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318846.433224:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379608832:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318846.433236:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16489
00010000:00020000:0.0:1767318846.433241:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318846.433285:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379608832:12345-0@lo:38:kworker.0 Request processed in 61us (576us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318846.433292:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16490
00000100:00080000:0.0:1767318846.433320:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318846.433324:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318846.433327:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379608576:0@lo:38:kworker.0
00000100:00080000:0.0:1767318846.433356:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318846.433360:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318846.433362:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379608832:0@lo:38:kworker.0
00010000:00010000:1.0:1767318846.935087:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318846.937170:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318846.937197:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379608960:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318846.937267:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318846.937503:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379608960
00000100:00100000:3.0:1767318846.937511:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379608960
00000100:00100000:3.0:1767318846.937565:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055
00000100:00100000:3.0:1767318846.937573:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379608960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318846.937600:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318846.937736:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379608960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (467us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318846.937744:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055
00000100:00100000:1.0:1767318846.942113:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379608960:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318847.959073:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318848.402171:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318848.402197:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318848.406117:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291884032
00000100:00100000:3.0:1767318848.406133:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291884032
00000100:00100000:3.0:1767318848.406225:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291884160
00000100:00100000:3.0:1767318848.406229:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291884160
00000100:00100000:3.0:1767318848.406286:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3891
00000100:00100000:3.0:1767318848.406296:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291884160:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318848.406378:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291884160:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (4177us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318848.406385:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3891
00000100:00100000:3.0:1767318848.406401:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16491
00000100:00100000:3.0:1767318848.406405:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291884032:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318848.406424:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318848.406447:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291884032:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (4283us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318848.406452:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16491
00000100:00080000:2.0:1767318848.406535:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318848.985219:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318850.007346:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318850.519303:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379609088:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318850.519386:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318850.519520:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609088
00000100:00100000:1.0:1767318850.519529:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609088
00000100:00100000:1.0:1767318850.519593:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056
00000100:00100000:1.0:1767318850.519618:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379609088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318850.519648:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318850.519699:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379609088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (313us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318850.519707:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056
00000100:00100000:1.0:1767318850.519761:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379609088:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318850.519830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318851.034894:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318851.544433:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318851.544444:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318851.544448:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318851.544452:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318851.544456:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318851.544464:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3748
00000100:00080000:1.0:1767318851.544469:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318851.544477:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318851.544513:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433480 x1853164379609216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318851.544535:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318851.544539:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318851.544540:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318851.544544:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3748
00000100:00080000:1.0:1767318851.544547:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318851.544551:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318851.544563:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a432a00 x1853164379609344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318851.544641:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318851.544644:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318851.544646:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318851.544650:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3748
00000100:00080000:1.0:1767318851.544653:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318851.544657:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318851.544668:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798e00 x1853164379609856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318851.544682:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318851.544686:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318851.544688:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318851.544692:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3748
00000100:00080000:1.0:1767318851.544694:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318851.544698:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318851.544707:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798380 x1853164379610112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318851.544735:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379609728:0@lo:400:kworker.0
00000100:00100000:1.0:1767318851.544794:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318851.544847:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318851.544853:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379609984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318851.544910:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318851.544983:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609728
00000100:00100000:1.0:1767318851.544990:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609728
00000100:00100000:1.0:1767318851.545037:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609984
00000100:00100000:1.0:1767318851.545045:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609984
00000100:00100000:1.0:1767318851.545070:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892
00000100:00100000:1.0:1767318851.545077:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379609728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318851.545125:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379609728:12345-0@lo:400:kworker.0 Request processed in 47us (329us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318851.545132:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892
00000100:00100000:1.0:1767318851.545149:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893
00000100:00100000:1.0:1767318851.545155:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379609984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318851.545178:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379609984:12345-0@lo:400:kworker.0 Request processed in 23us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318851.545184:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893
00000100:00080000:1.0:1767318851.545212:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318851.545260:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379609984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318851.545269:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379609728:0@lo:400:kworker.0
00000100:00100000:0.0:1767318851.545358:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379609600:0@lo:400:kworker.0
00000100:00100000:0.0:1767318851.545390:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318851.545423:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318851.545429:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379609472:0@lo:400:kworker.0
00000100:00100000:0.0:1767318851.545448:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318851.545654:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609600
00000100:00100000:1.0:1767318851.545659:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609600
00000100:00100000:2.0:1767318851.545743:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609472
00000100:00100000:2.0:1767318851.545748:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609472
00000100:00100000:2.0:1767318851.545778:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306
00000100:00100000:2.0:1767318851.545785:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379609472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318851.545824:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379609472:12345-0@lo:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318851.545830:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306
00000100:00100000:2.0:1767318851.545860:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379609472:0@lo:400:kworker.0
00000100:00100000:1.0:1767318851.545974:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307
00000100:00100000:1.0:1767318851.545981:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379609600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318851.546015:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379609600:12345-0@lo:400:kworker.0 Request processed in 35us (624us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318851.546022:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307
00000100:00100000:3.0:1767318851.547270:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379609216:0@lo:38:kworker.0
00000100:00100000:3.0:1767318851.547332:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318851.547370:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379609344:0@lo:38:kworker.0
00000100:00100000:3.0:1767318851.547394:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318851.547440:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379609856:0@lo:38:kworker.0
00000100:00100000:3.0:1767318851.547461:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318851.547478:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379610112:0@lo:38:kworker.0
00000100:00100000:3.0:1767318851.547496:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318851.547524:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609344
00000100:00100000:3.0:1767318851.547530:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609344
00000100:00100000:3.0:1767318851.547556:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885
00000100:00100000:3.0:1767318851.547561:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379609344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318851.547581:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318851.547618:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379609344:12345-0@lo:38:kworker.0 Request processed in 55us (222us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318851.547625:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885
00000100:00100000:3.0:1767318851.547643:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609216
00000100:00100000:3.0:1767318851.547646:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609216
00000100:00100000:3.0:1767318851.547661:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379609856
00000100:00100000:3.0:1767318851.547664:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379609856
00000100:00100000:3.0:1767318851.547672:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379610112
00000100:00100000:3.0:1767318851.547675:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379610112
00000100:00100000:3.0:1767318851.547688:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16492
00000100:00100000:3.0:1767318851.547693:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379609216:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318851.547702:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318851.547725:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379609216:12345-0@lo:38:kworker.0 Request processed in 31us (394us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318851.547730:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16492
00000100:00100000:3.0:1767318851.547740:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16493
00000100:00100000:3.0:1767318851.547743:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379609856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318851.547751:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318851.547777:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379609856:12345-0@lo:38:kworker.0 Request processed in 32us (315us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318851.547782:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16493
00000100:00100000:3.0:1767318851.547792:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16494
00000100:00100000:3.0:1767318851.547796:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379610112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318851.547804:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318851.547822:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379610112:12345-0@lo:38:kworker.0 Request processed in 25us (326us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318851.547827:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16494
00000100:00080000:3.0:1767318851.547860:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318851.547864:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318851.547885:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379609216:0@lo:38:kworker.0
00000100:00080000:3.0:1767318851.547895:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318851.547898:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318851.547901:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379609344:0@lo:38:kworker.0
00000100:00080000:3.0:1767318851.547908:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318851.547910:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318851.547913:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379609856:0@lo:38:kworker.0
00000100:00080000:3.0:1767318851.547919:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318851.547922:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318851.548204:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379609600:0@lo:400:kworker.0
00000100:00100000:3.0:1767318851.548389:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379610112:0@lo:38:kworker.0
00000100:00080000:0.0:1767318851.550540:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318852.055121:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318852.055146:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379610240:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318852.055202:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318852.055710:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318852.055771:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379610240
00000100:00100000:0.0:1767318852.055780:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379610240
00000100:00100000:0.0:1767318852.056125:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057
00000100:00100000:0.0:1767318852.056136:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379610240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318852.056171:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318852.056231:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379610240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (521us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318852.056238:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057
00000100:00100000:3.0:1767318852.056323:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379610240:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318853.082834:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318853.521338:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318853.521486:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318853.522726:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291884416
00000100:00100000:1.0:1767318853.522740:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291884416
00000100:00100000:1.0:1767318853.522820:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291884288
00000100:00100000:1.0:1767318853.522824:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291884288
00000100:00080000:0.0:1767318853.523025:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318853.523105:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3894
00000100:00100000:1.0:1767318853.523118:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291884416:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318853.523198:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291884416:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (1866us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318853.523206:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3894
00000100:00100000:1.0:1767318853.523228:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16495
00000100:00100000:1.0:1767318853.523233:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291884288:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318853.523253:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318853.523280:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291884288:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (1817us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318853.523291:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16495
00010000:00010000:2.0:1767318854.103462:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318855.128194:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318855.639446:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379610368:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318855.639529:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318855.639956:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379610368
00000100:00100000:0.0:1767318855.639964:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379610368
00000100:00080000:1.0:1767318855.640034:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318855.640045:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058
00000100:00100000:0.0:1767318855.640057:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379610368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318855.640090:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318855.657539:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379610368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 17472us (17998us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318855.657573:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058
00000100:00100000:3.0:1767318855.658174:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379610368:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318856.151105:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318856.663021:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318856.663035:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318856.663039:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318856.663044:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318856.663049:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318856.663059:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3753
00000100:00080000:3.0:1767318856.663065:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318856.663073:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318856.663116:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5f100 x1853164379610496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318856.663132:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318856.663136:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318856.663138:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318856.663141:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3753
00000100:00080000:3.0:1767318856.663144:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318856.663148:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318856.663161:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5d180 x1853164379610624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318856.663222:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318856.663241:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767318856.663243:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:3.0:1767318856.663244:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318856.663251:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3753
00000100:00080000:3.0:1767318856.663254:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318856.663260:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318856.663261:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379611008:0@lo:400:kworker.0
00000100:00100000:3.0:1767318856.663274:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5df80 x1853164379611136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318856.663291:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318856.663295:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318856.663296:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318856.663300:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3753
00000100:00080000:3.0:1767318856.663302:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318856.663305:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318856.663315:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f26f5e300 x1853164379611392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318856.663335:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318856.663338:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379610880:0@lo:400:kworker.0
00000100:00100000:1.0:1767318856.663388:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318856.663403:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379611264:0@lo:400:kworker.0
00000100:00100000:3.0:1767318856.663435:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611008
00000100:00100000:1.0:1767318856.663437:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318856.663437:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318856.663445:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611008
00000100:00100000:1.0:1767318856.663449:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379610752:0@lo:400:kworker.0
00000100:00100000:2.0:1767318856.663480:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611264
00000100:00100000:1.0:1767318856.663481:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318856.663487:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611264
00000100:00100000:1.0:1767318856.663526:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379610880
00000100:00100000:1.0:1767318856.663532:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379610880
00000100:00100000:0.0:1767318856.663580:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379610496:0@lo:38:kworker.0
00000100:00100000:1.0:1767318856.663603:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379610752
00000100:00100000:1.0:1767318856.663609:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379610752
00000100:00100000:0.0:1767318856.663615:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318856.663639:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379610624:0@lo:38:kworker.0
00000100:00100000:1.0:1767318856.663646:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308
00000100:00100000:3.0:1767318856.663646:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379610496
00000100:00100000:3.0:1767318856.663652:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379610496
00000100:00100000:1.0:1767318856.663658:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379610880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318856.663669:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318856.663697:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379611136:0@lo:38:kworker.0
00000100:00100000:3.0:1767318856.663718:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895
00000100:00100000:0.0:1767318856.663720:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318856.663733:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379611008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318856.663740:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379611392:0@lo:38:kworker.0
00000100:00100000:0.0:1767318856.663762:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318856.663790:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379610624
00000100:00100000:0.0:1767318856.663794:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379610624
00000100:00100000:3.0:1767318856.663809:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379611008:12345-0@lo:400:kworker.0 Request processed in 78us (473us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318856.663817:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895
00000100:00100000:0.0:1767318856.663822:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886
00000100:00100000:0.0:1767318856.663831:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379610624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318856.663860:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318856.663903:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379610880:12345-0@lo:400:kworker.0 Request processed in 247us (516us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318856.663938:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379610624:12345-0@lo:38:kworker.0 Request processed in 103us (265us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318856.663938:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308
00000100:00100000:0.0:1767318856.663949:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886
00000100:00100000:1.0:1767318856.663971:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309
00000100:00100000:1.0:1767318856.663982:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379610752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318856.663983:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611136
00000100:00100000:0.0:1767318856.663989:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611136
00000100:00100000:0.0:1767318856.664003:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16496
00000100:00100000:0.0:1767318856.664010:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379610496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318856.664021:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318856.664029:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379610752:12345-0@lo:400:kworker.0 Request processed in 48us (547us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318856.664036:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309
00000100:00080000:1.0:1767318856.664060:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318856.664065:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379610496:12345-0@lo:38:kworker.0 Request processed in 53us (449us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318856.664066:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318856.664086:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16496
00000100:00100000:1.0:1767318856.664086:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611392
00000100:00100000:1.0:1767318856.664092:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611392
00000100:00100000:0.0:1767318856.664105:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16497
00000100:00100000:1.0:1767318856.664113:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16498
00000100:00100000:0.0:1767318856.664117:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379611136:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318856.664124:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379611392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318856.664131:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767318856.664139:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318856.664164:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379611136:12345-0@lo:38:kworker.0 Request processed in 49us (444us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318856.664171:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16497
00000100:00100000:1.0:1767318856.664181:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379611392:12345-0@lo:38:kworker.0 Request processed in 57us (415us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318856.664188:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16498
00000100:00100000:1.0:1767318856.664240:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379610752:0@lo:400:kworker.0
00000100:00100000:1.0:1767318856.664252:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379610880:0@lo:400:kworker.0
00000100:00080000:1.0:1767318856.664322:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318856.664328:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318856.664332:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379610496:0@lo:38:kworker.0
00000100:00080000:1.0:1767318856.664343:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318856.664347:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318856.664351:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379610624:0@lo:38:kworker.0
00000100:00080000:1.0:1767318856.664372:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318856.664377:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318856.664381:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379611136:0@lo:38:kworker.0
00000100:00080000:1.0:1767318856.664392:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318856.664396:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318856.664399:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379611392:0@lo:38:kworker.0
00000100:00100000:2.0:1767318856.670561:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896
00000100:00100000:2.0:1767318856.670588:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379611264:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318856.670637:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379611008:0@lo:400:kworker.0
00000100:00100000:2.0:1767318856.670681:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379611264:12345-0@lo:400:kworker.0 Request processed in 108us (7244us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318856.670692:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896
00000100:00100000:3.0:1767318856.670692:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379611264:0@lo:400:kworker.0
00000100:00100000:2.0:1767318857.175447:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379611520:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767318857.175474:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318857.175529:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318857.175746:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611520
00000100:00100000:3.0:1767318857.175756:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611520
00000100:00100000:3.0:1767318857.175821:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059
00000100:00100000:3.0:1767318857.175831:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379611520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318857.175893:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318857.175963:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379611520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (435us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318857.175970:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059
00000100:00100000:0.0:1767318857.176819:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379611520:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318858.199242:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318858.639349:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318858.639420:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318858.639525:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291884544
00000100:00100000:0.0:1767318858.639537:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291884544
00000100:00100000:0.0:1767318858.639583:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291884672
00000100:00100000:0.0:1767318858.639586:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291884672
00000100:00100000:0.0:1767318858.639633:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3897
00000100:00100000:0.0:1767318858.639649:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291884672:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318858.639727:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291884672:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (307us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318858.639735:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3897
00000100:00100000:0.0:1767318858.639754:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16499
00000100:00100000:0.0:1767318858.639758:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291884544:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318858.639780:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318858.639804:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291884544:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (467us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318858.639811:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16499
00000100:00080000:0.0:1767318858.639827:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318859.224585:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318860.247386:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318860.759155:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379611648:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318860.759231:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318860.759400:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611648
00000100:00100000:2.0:1767318860.759409:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611648
00000100:00100000:2.0:1767318860.759475:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060
00000100:00100000:2.0:1767318860.759496:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379611648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318860.759524:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318860.759980:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318860.760154:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379611648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 659us (922us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318860.760163:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060
00000100:00100000:1.0:1767318860.760270:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379611648:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318861.271866:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318861.783495:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318861.783507:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318861.783510:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318861.783514:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318861.783518:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318861.783526:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3759
00000100:00080000:2.0:1767318861.783531:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318861.783548:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318861.783592:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379611776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318861.783619:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318861.783622:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318861.783624:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318861.783627:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3759
00000100:00080000:2.0:1767318861.783629:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318861.783633:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318861.783645:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164379611904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318861.783715:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318861.783719:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318861.783720:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318861.783723:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3759
00000100:00080000:2.0:1767318861.783725:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318861.783729:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318861.783739:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a431880 x1853164379612416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318861.783754:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318861.783756:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318861.783758:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318861.783761:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3759
00000100:00080000:2.0:1767318861.783763:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318861.783767:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318861.783774:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcce00 x1853164379612672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318861.783800:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379612288:0@lo:400:kworker.0
00000100:00100000:2.0:1767318861.783915:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318861.783977:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318861.783984:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379612544:0@lo:400:kworker.0
00000100:00100000:2.0:1767318861.784007:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318861.784037:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612288
00000100:00100000:2.0:1767318861.784044:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612288
00000100:00100000:2.0:1767318861.784093:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612544
00000100:00100000:2.0:1767318861.784096:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612544
00000100:00100000:1.0:1767318861.784272:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379611776:0@lo:38:kworker.0
00000100:00100000:1.0:1767318861.784302:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318861.784326:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379611904:0@lo:38:kworker.0
00000100:00100000:1.0:1767318861.784350:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318861.784383:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379612416:0@lo:38:kworker.0
00000100:00100000:1.0:1767318861.784406:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318861.784423:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379612672:0@lo:38:kworker.0
00000100:00100000:1.0:1767318861.784442:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318861.784469:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611776
00000100:00100000:1.0:1767318861.784473:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611776
00000100:00100000:2.0:1767318861.784505:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612416
00000100:00100000:2.0:1767318861.784509:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612416
00000100:00100000:3.0:1767318861.784553:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612032:0@lo:400:kworker.0
00000100:00100000:3.0:1767318861.784587:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318861.784611:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318861.784616:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612160:0@lo:400:kworker.0
00000100:00100000:3.0:1767318861.784637:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318861.784676:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318861.784688:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612672
00000100:00100000:3.0:1767318861.784691:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612672
00000100:00100000:2.0:1767318861.791032:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898
00000100:00100000:2.0:1767318861.791060:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379612288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318861.791256:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379612288:12345-0@lo:400:kworker.0 Request processed in 209us (7340us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318861.791265:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898
00000100:00100000:2.0:1767318861.791286:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899
00000100:00100000:2.0:1767318861.791293:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379612544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318861.791323:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379612544:12345-0@lo:400:kworker.0 Request processed in 31us (7315us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318861.791329:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899
00000100:00100000:2.0:1767318861.791342:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16500
00000100:00100000:2.0:1767318861.791347:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379611776:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318861.791810:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16501
00000100:00100000:1.0:1767318861.791830:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379612416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318861.791851:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318861.792005:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379612416:12345-0@lo:38:kworker.0 Request processed in 173us (7596us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318861.792012:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16501
00000100:00100000:1.0:1767318861.792043:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612032
00000100:00100000:1.0:1767318861.792051:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612032
00000100:00100000:1.0:1767318861.792086:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612160
00000100:00100000:1.0:1767318861.792089:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612160
00010000:00020000:2.0:1767318861.792510:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318861.792679:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310
00000100:00100000:1.0:1767318861.792686:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318861.792733:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612032:12345-0@lo:400:kworker.0 Request processed in 47us (8144us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318861.792739:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310
00000100:00100000:1.0:1767318861.792985:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311
00000100:00100000:1.0:1767318861.792992:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318861.793022:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612160:12345-0@lo:400:kworker.0 Request processed in 30us (8384us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318861.793028:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311
00000100:00100000:1.0:1767318861.793093:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318861.793106:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612032:0@lo:400:kworker.0
00000100:00100000:1.0:1767318861.793182:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379611904
00000100:00100000:1.0:1767318861.793187:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379611904
00000100:00100000:1.0:1767318861.793215:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887
00000100:00100000:1.0:1767318861.793219:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379611904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318861.793231:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318861.793272:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379611904:12345-0@lo:38:kworker.0 Request processed in 50us (8920us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318861.793277:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887
00000100:00100000:1.0:1767318861.793333:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379612544:0@lo:400:kworker.0
00000100:00100000:1.0:1767318861.793345:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379612288:0@lo:400:kworker.0
00000100:00100000:2.0:1767318861.795142:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379611776:12345-0@lo:38:kworker.0 Request processed in 3785us (10831us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318861.795155:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16500
00000100:00080000:2.0:1767318861.795218:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318861.795224:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318861.795228:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379611776:0@lo:38:kworker.0
00000100:00080000:2.0:1767318861.795241:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318861.795244:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318861.795246:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379611904:0@lo:38:kworker.0
00000100:00080000:2.0:1767318861.795256:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318861.795259:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318861.795262:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379612416:0@lo:38:kworker.0
00000100:00080000:3.0:1767318861.799122:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318861.799155:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16502
00000100:00100000:3.0:1767318861.799166:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379612672:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318861.799191:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318861.799282:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379612672:12345-0@lo:38:kworker.0 Request processed in 117us (14838us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318861.799290:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16502
00000100:00080000:2.0:1767318861.806274:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318861.806288:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318861.806294:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379612672:0@lo:38:kworker.0
00000100:00100000:1.0:1767318862.295352:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612800:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318862.295440:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1767318862.295596:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318862.295764:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612800
00000100:00100000:3.0:1767318862.295772:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612800
00000100:00100000:3.0:1767318862.295850:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061
00000100:00100000:3.0:1767318862.295913:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318862.295950:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318862.296006:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (576us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318862.296013:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061
00000100:00100000:1.0:1767318862.296815:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612800:0@lo:13:osp-pre-0-1.0
00000400:00000100:2.0:1767318862.738306:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291884800 offset 0 length 520: 4
00000100:00100000:2.0:1767318862.738445:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318862.739243:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291884928
00000100:00100000:1.0:1767318862.739253:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291884928
00000100:00100000:1.0:1767318862.739295:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16503
00000100:00100000:1.0:1767318862.739303:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291884928:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318862.739327:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318862.739524:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318862.742093:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291884928:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2780us (3639us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318862.742108:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16503
00000100:00100000:1.0:1767318862.742143:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885056
00000100:00100000:1.0:1767318862.742151:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885056
00000100:00080000:2.0:1767318862.742363:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318862.749156:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3900
00000100:00100000:3.0:1767318862.749273:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291885056:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318862.749366:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291885056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 196us (10595us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318862.749375:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3900
00010000:00010000:1.0:1767318863.319071:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318864.353424:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318865.367333:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318865.882065:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318865.882086:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612928:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318865.882167:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318865.882576:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379612928
00000100:00100000:0.0:1767318865.882586:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379612928
00000100:00100000:0.0:1767318865.882660:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062
00000100:00100000:0.0:1767318865.882671:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318865.882723:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318865.882776:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379612928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (608us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318865.882783:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062
00000100:00080000:2.0:1767318865.885650:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318865.885721:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379612928:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318866.391171:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318866.903024:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318841/real 1767318841]  req@ffff8b0f2f3fd880 x1853164379606528/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318866 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318866.903061:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f3fd880 x1853164379606528/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318866 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318866.903110:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318866.904921:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318866.904934:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379606528:0@lo:250:kworker.0
00000100:00080000:0.0:1767318866.910802:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318866.910814:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318866.910826:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318866.910834:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3743
00000100:00080000:0.0:1767318866.910839:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318866.910846:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318866.910900:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905180 x1853164379613056/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318866.910923:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318866.910927:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318866.910929:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318866.910931:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3764
00000100:00080000:0.0:1767318866.910934:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318866.910937:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318866.910950:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164379613184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318866.910958:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767318866.911152:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379613056:0@lo:250:kworker.0
00000400:00000100:1.0:1767318866.911221:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379613056 offset 0 length 520: 4
00000100:00100000:1.0:1767318866.911269:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379613184:0@lo:38:kworker.0
00000100:00100000:1.0:1767318866.911552:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318866.911754:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379613184
00000100:00100000:3.0:1767318866.911764:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379613184
00000100:00100000:3.0:1767318866.911825:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16504
00000100:00100000:3.0:1767318866.911834:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379613184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318866.911856:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318866.911938:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379613184:12345-0@lo:38:kworker.0 Request processed in 104us (385us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318866.911946:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16504
00000100:00080000:2.0:1767318866.912172:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318866.912178:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318866.912182:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379613184:0@lo:38:kworker.0
00000100:00080000:0.0:1767318866.912513:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318866.912516:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318866.912521:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3764
00000100:00080000:0.0:1767318866.912524:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318866.912536:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318866.912557:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904000 x1853164379613312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318866.912625:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318866.912628:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318866.912630:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318866.912634:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3764
00000100:00080000:0.0:1767318866.912637:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318866.912640:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318866.912651:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164379613824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318866.912666:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318866.912669:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318866.912670:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318866.912673:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3764
00000100:00080000:0.0:1767318866.912675:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318866.912679:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318866.912688:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906680 x1853164379614080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318866.912891:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379613568:0@lo:400:kworker.0
00000100:00100000:3.0:1767318866.912931:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318866.912968:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318866.912985:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379613440:0@lo:400:kworker.0
00000100:00100000:3.0:1767318866.913006:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318866.913132:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379613696:0@lo:400:kworker.0
00000100:00100000:2.0:1767318866.913170:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318866.913195:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318866.913200:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379613952:0@lo:400:kworker.0
00000100:00100000:2.0:1767318866.913219:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318866.913243:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379613312:0@lo:38:kworker.0
00000100:00100000:2.0:1767318866.913269:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318866.913297:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379613824:0@lo:38:kworker.0
00000100:00100000:2.0:1767318866.913553:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318866.913569:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379614080:0@lo:38:kworker.0
00000100:00100000:2.0:1767318866.913589:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318866.913994:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379613568
00000100:00100000:1.0:1767318866.914001:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379613568
00000100:00100000:1.0:1767318866.914056:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379613440
00000100:00100000:1.0:1767318866.914059:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379613440
00000100:00100000:1.0:1767318866.914078:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312
00000100:00100000:1.0:1767318866.914087:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379613568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318866.914139:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379613568:12345-0@lo:400:kworker.0 Request processed in 54us (1207us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318866.914146:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312
00000100:00100000:1.0:1767318866.914178:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313
00000100:00100000:1.0:1767318866.914185:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379613440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318866.914215:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379613440:12345-0@lo:400:kworker.0 Request processed in 31us (1208us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318866.914221:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313
00000100:00100000:1.0:1767318866.914240:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379613696
00000100:00100000:1.0:1767318866.914243:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379613696
00000100:00100000:1.0:1767318866.914268:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379613952
00000100:00100000:1.0:1767318866.914271:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379613952
00000100:00100000:1.0:1767318866.914928:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379613824
00000100:00100000:1.0:1767318866.914933:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379613824
00000100:00100000:1.0:1767318866.914943:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614080
00000100:00100000:1.0:1767318866.914945:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614080
00000100:00100000:1.0:1767318866.914955:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901
00000100:00100000:1.0:1767318866.914963:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379613696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318866.915682:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379613696:12345-0@lo:400:kworker.0 Request processed in 718us (2509us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318866.915690:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901
00000100:00100000:1.0:1767318866.915715:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902
00000100:00100000:1.0:1767318866.915723:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379613952:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318866.915918:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16505
00000100:00100000:3.0:1767318866.915934:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379613824:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318866.915957:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318866.916014:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379613824:12345-0@lo:38:kworker.0 Request processed in 79us (2460us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318866.916019:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16505
00000100:00100000:3.0:1767318866.916034:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16506
00000100:00100000:3.0:1767318866.916038:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379614080:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318866.916048:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318866.916072:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379614080:12345-0@lo:38:kworker.0 Request processed in 31us (2481us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318866.916076:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16506
00000100:00100000:3.0:1767318866.916128:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379613440:0@lo:400:kworker.0
00000100:00100000:3.0:1767318866.916143:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379613568:0@lo:400:kworker.0
00000100:00100000:3.0:1767318866.916226:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379613312
00000100:00100000:3.0:1767318866.916230:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379613312
00000100:00100000:3.0:1767318866.916253:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888
00000100:00100000:3.0:1767318866.916257:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379613312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318866.916267:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318866.916604:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379613312:12345-0@lo:38:kworker.0 Request processed in 344us (3332us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318866.916610:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888
00000100:00100000:1.0:1767318866.916903:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379613952:12345-0@lo:400:kworker.0 Request processed in 1181us (3682us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318866.916910:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902
00000100:00080000:2.0:1767318866.917100:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318866.917107:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318866.917136:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379613952:0@lo:400:kworker.0
00000100:00100000:2.0:1767318866.917149:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379613696:0@lo:400:kworker.0
00000100:00080000:2.0:1767318866.917194:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318866.917198:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318866.917203:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379613312:0@lo:38:kworker.0
00000100:00080000:2.0:1767318866.917211:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318866.917215:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318866.917217:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379613824:0@lo:38:kworker.0
00000100:00080000:2.0:1767318866.917225:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318866.917228:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318866.917231:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379614080:0@lo:38:kworker.0
00010000:00010000:1.0:1767318867.415352:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318867.415759:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318867.415783:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379614208:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318867.415905:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318867.416146:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614208
00000100:00100000:3.0:1767318867.416155:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614208
00000100:00100000:3.0:1767318867.416216:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063
00000100:00100000:3.0:1767318867.416225:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379614208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318867.416276:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318867.416323:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379614208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (418us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318867.416328:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063
00000100:00100000:2.0:1767318867.416449:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379614208:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318867.859803:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318867.859987:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318867.862035:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885312
00000100:00100000:3.0:1767318867.862050:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885312
00000100:00100000:3.0:1767318867.862147:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885184
00000100:00100000:3.0:1767318867.862152:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885184
00000100:00100000:3.0:1767318867.862180:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3903
00000100:00100000:3.0:1767318867.862194:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291885312:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318867.862290:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291885312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (2497us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318867.862297:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3903
00000100:00100000:3.0:1767318867.862315:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16507
00000100:00100000:3.0:1767318867.862320:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291885184:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318867.862343:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318867.862369:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291885184:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (2381us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318867.862375:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16507
00000100:00080000:2.0:1767318867.868237:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318868.439169:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318869.464094:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318870.488952:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318870.999114:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318870.999137:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379614336:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318870.999238:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318870.999347:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614336
00000100:00100000:2.0:1767318870.999364:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614336
00000100:00080000:3.0:1767318870.999432:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318870.999456:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064
00000100:00100000:2.0:1767318870.999473:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379614336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318870.999511:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318870.999597:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379614336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (358us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318870.999605:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064
00000100:00100000:1.0:1767318871.000676:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379614336:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318871.516965:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318872.023277:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318872.023312:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318872.023316:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318872.023321:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318872.023326:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318872.023335:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3769
00000100:00080000:0.0:1767318872.023342:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318872.023350:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318872.023408:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906d80 x1853164379614464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318872.023438:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318872.023442:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318872.023444:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318872.023448:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3769
00000100:00080000:0.0:1767318872.023450:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318872.023454:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318872.023468:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905f80 x1853164379614592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318872.023532:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318872.023535:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318872.023537:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318872.023541:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3769
00000100:00080000:0.0:1767318872.023543:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318872.023546:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318872.023555:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905c00 x1853164379615104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318872.023576:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318872.023580:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318872.023581:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318872.023585:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3769
00000100:00080000:0.0:1767318872.023587:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318872.023591:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318872.023598:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906300 x1853164379615360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318872.023670:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379615232:0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.023763:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.023891:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318872.023898:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379614976:0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.023924:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.023981:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379615232
00000100:00100000:2.0:1767318872.023990:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379615232
00000100:00100000:3.0:1767318872.023990:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379614720:0@lo:400:kworker.0
00000100:00100000:3.0:1767318872.024031:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.024055:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614976
00000100:00100000:2.0:1767318872.024058:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614976
00000100:00100000:3.0:1767318872.024064:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318872.024069:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379614848:0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.024085:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904
00000100:00100000:3.0:1767318872.024090:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.024094:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379615232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318872.024127:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614720
00000100:00100000:3.0:1767318872.024131:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614720
00000100:00100000:2.0:1767318872.024150:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379615232:12345-0@lo:400:kworker.0 Request processed in 57us (387us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318872.024159:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904
00000100:00100000:3.0:1767318872.024161:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614848
00000100:00100000:3.0:1767318872.024163:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614848
00000100:00100000:2.0:1767318872.024178:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905
00000100:00100000:3.0:1767318872.024181:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314
00000100:00100000:2.0:1767318872.024183:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379614976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318872.024187:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379614720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.024211:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379614976:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318872.024217:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905
00000100:00100000:3.0:1767318872.024231:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379614720:12345-0@lo:400:kworker.0 Request processed in 31us (187us total) trans 0 rc 0/0
00000100:00080000:2.0:1767318872.024237:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318872.024237:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314
00000100:00080000:2.0:1767318872.024242:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318872.024245:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318872.024248:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315
00000100:00100000:3.0:1767318872.024254:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379614848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.024266:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379614464:0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.024282:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379614848:12345-0@lo:400:kworker.0 Request processed in 28us (190us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318872.024288:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315
00000100:00100000:2.0:1767318872.024290:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.024305:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379614592:0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.024339:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379614848:0@lo:400:kworker.0
00000100:00100000:0.0:1767318872.024358:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614464
00000100:00100000:0.0:1767318872.024361:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614464
00000100:00100000:0.0:1767318872.024387:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16508
00000100:00100000:0.0:1767318872.024392:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379614464:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318872.024416:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318872.025345:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.025400:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379615104:0@lo:38:kworker.0
00000100:00100000:2.0:1767318872.025433:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.025455:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379615360:0@lo:38:kworker.0
00000100:00100000:2.0:1767318872.025478:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318872.025534:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379615104
00000100:00100000:2.0:1767318872.025541:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379615104
00000100:00100000:2.0:1767318872.025566:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379615360
00000100:00100000:2.0:1767318872.025569:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379615360
00000100:00100000:2.0:1767318872.025578:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16509
00000100:00100000:2.0:1767318872.025584:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379615104:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318872.025601:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318872.025637:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379615104:12345-0@lo:38:kworker.0 Request processed in 52us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318872.025645:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16509
00000100:00100000:2.0:1767318872.025659:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16510
00000100:00100000:2.0:1767318872.025663:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379615360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318872.025673:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318872.025694:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379615360:12345-0@lo:38:kworker.0 Request processed in 29us (215us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318872.025701:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16510
00000100:00100000:2.0:1767318872.026040:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379614976:0@lo:400:kworker.0
00000100:00100000:2.0:1767318872.026062:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379615232:0@lo:400:kworker.0
00000100:00080000:2.0:1767318872.026097:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318872.026103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318872.026106:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379615104:0@lo:38:kworker.0
00000100:00080000:2.0:1767318872.026114:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318872.026117:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318872.026120:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379615360:0@lo:38:kworker.0
00000100:00100000:1.0:1767318872.026258:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379614592
00000100:00100000:1.0:1767318872.026263:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379614592
00000100:00100000:1.0:1767318872.026301:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889
00000100:00100000:1.0:1767318872.026307:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379614592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318872.026320:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318872.026392:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379614592:12345-0@lo:38:kworker.0 Request processed in 83us (1051us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318872.026399:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889
00000100:00080000:1.0:1767318872.026432:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318872.026436:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318872.026440:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379614592:0@lo:38:kworker.0
00000100:00100000:3.0:1767318872.029472:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379614720:0@lo:400:kworker.0
00000100:00100000:0.0:1767318872.034665:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379614464:12345-0@lo:38:kworker.0 Request processed in 10107us (10209us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318872.034687:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16508
00000100:00080000:1.0:1767318872.035706:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318872.035717:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318872.035723:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379614464:0@lo:38:kworker.0
00010000:00010000:1.0:1767318872.535282:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318872.540398:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318872.540432:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379615488:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318872.540535:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318872.540806:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379615488
00000100:00100000:3.0:1767318872.540818:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379615488
00000100:00100000:3.0:1767318872.540916:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065
00000100:00100000:3.0:1767318872.540928:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379615488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318872.540971:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318872.541036:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379615488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (501us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318872.541045:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065
00000100:00100000:2.0:1767318872.541217:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379615488:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318872.979662:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318872.979731:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318872.979953:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885568
00000100:00100000:3.0:1767318872.979969:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885568
00000100:00080000:2.0:1767318872.980061:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318872.980084:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885440
00000100:00100000:3.0:1767318872.980102:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885440
00000100:00100000:3.0:1767318872.980137:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3906
00000100:00100000:3.0:1767318872.980156:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291885568:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318872.980168:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16511
00000100:00100000:0.0:1767318872.980182:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291885440:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318872.980216:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318872.980288:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291885568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 135us (638us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318872.980336:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3906
00000100:00100000:0.0:1767318872.987352:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291885440:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 7155us (7604us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318872.987372:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16511
00010000:00010000:1.0:1767318873.559266:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318874.584776:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318875.608922:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318876.122340:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379615616:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318876.122457:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318876.123100:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379615616
00000100:00100000:3.0:1767318876.123112:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379615616
00000100:00100000:3.0:1767318876.123212:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066
00000100:00100000:3.0:1767318876.123224:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379615616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318876.123264:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318876.123342:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379615616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (884us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318876.123350:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066
00000100:00100000:1.0:1767318876.123459:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379615616:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318876.123526:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318876.632034:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318877.144319:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318877.144333:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318877.144337:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318877.144342:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318877.144347:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318877.144359:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3774
00000100:00080000:1.0:1767318877.144364:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318877.144373:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318877.144431:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23480 x1853164379615744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318877.145609:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318877.145614:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318877.145616:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318877.145622:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3774
00000100:00080000:1.0:1767318877.145625:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318877.145631:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318877.145658:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20380 x1853164379615872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318877.145806:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318877.146117:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379615744:0@lo:38:kworker.0
00000100:00100000:2.0:1767318877.146291:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318877.146360:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379615872:0@lo:38:kworker.0
00000100:00100000:2.0:1767318877.146391:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318877.146730:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379615872
00000100:00100000:2.0:1767318877.146741:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379615872
00000100:00100000:2.0:1767318877.146801:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890
00000100:00100000:2.0:1767318877.146810:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379615872:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318877.146835:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318877.146909:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379615872:12345-0@lo:38:kworker.0 Request processed in 98us (516us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318877.146917:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890
00000100:00080000:2.0:1767318877.146973:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767318877.147195:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379615744
00000100:00100000:0.0:1767318877.147200:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379615744
00000100:00100000:0.0:1767318877.147249:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16512
00000100:00100000:0.0:1767318877.147254:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379615744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318877.147266:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318877.147302:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379615744:12345-0@lo:38:kworker.0 Request processed in 46us (1012us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318877.147309:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16512
00000100:00080000:2.0:1767318877.147528:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318877.147534:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379615872:0@lo:38:kworker.0
00000100:00080000:2.0:1767318877.147564:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318877.147568:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318877.147572:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379615744:0@lo:38:kworker.0
00000100:00100000:3.0:1767318877.148351:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616128:0@lo:400:kworker.0
00000100:00100000:3.0:1767318877.148416:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318877.148566:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616000:0@lo:400:kworker.0
00000100:00100000:3.0:1767318877.148593:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318877.148714:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616128
00000100:00100000:0.0:1767318877.148730:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616128
00000100:00100000:0.0:1767318877.149076:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616000
00000100:00100000:0.0:1767318877.149080:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616000
00000100:00100000:0.0:1767318877.149106:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316
00000100:00100000:0.0:1767318877.149115:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318877.149273:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616128:12345-0@lo:400:kworker.0 Request processed in 159us (856us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318877.149281:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316
00000100:00100000:0.0:1767318877.149299:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317
00000100:00100000:0.0:1767318877.149304:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318877.149334:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616000:12345-0@lo:400:kworker.0 Request processed in 30us (740us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318877.149339:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317
00000100:00080000:3.0:1767318877.149421:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318877.149560:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616128:0@lo:400:kworker.0
00000100:00100000:3.0:1767318877.149572:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616000:0@lo:400:kworker.0
00000100:00100000:2.0:1767318877.150939:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:1.0:1767318877.150982:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318877.150988:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318877.150994:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318877.151001:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3774
00000100:00080000:1.0:1767318877.151006:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318877.151014:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318877.151045:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22300 x1853164379616384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318877.151123:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318877.151156:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379616512:0@lo:400:kworker.0
00000100:00100000:3.0:1767318877.151234:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318877.151335:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379616384:0@lo:38:kworker.0
00000100:00100000:3.0:1767318877.151371:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318877.151848:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616512
00000100:00100000:0.0:1767318877.151859:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616512
00000100:00100000:0.0:1767318877.151965:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616384
00000100:00100000:0.0:1767318877.151969:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616384
00000100:00100000:0.0:1767318877.152001:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907
00000100:00100000:0.0:1767318877.152013:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379616512:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318877.152084:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379616512:12345-0@lo:400:kworker.0 Request processed in 74us (849us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318877.152103:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907
00000100:00100000:0.0:1767318877.152123:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16513
00000100:00100000:0.0:1767318877.152128:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379616384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318877.152164:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318877.152202:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379616384:12345-0@lo:38:kworker.0 Request processed in 73us (831us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318877.152209:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16513
00000100:00100000:0.0:1767318877.152262:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379616512:0@lo:400:kworker.0
00000100:00080000:3.0:1767318877.153112:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318877.153169:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318877.153176:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318877.153181:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379616384:0@lo:38:kworker.0
00000100:00100000:2.0:1767318877.153422:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379616256:0@lo:400:kworker.0
00000100:00100000:2.0:1767318877.153653:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318877.153707:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318877.153713:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318877.153716:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318877.153730:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3774
00000100:00080000:1.0:1767318877.153734:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318877.153742:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318877.153777:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164379616640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318877.154267:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379616640:0@lo:38:kworker.0
00000100:00100000:3.0:1767318877.154302:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318877.154589:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616256
00000100:00100000:0.0:1767318877.154599:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616256
00000100:00100000:0.0:1767318877.154680:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616640
00000100:00100000:0.0:1767318877.154683:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616640
00000100:00100000:0.0:1767318877.154705:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908
00000100:00100000:0.0:1767318877.154715:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379616256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318877.154800:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379616256:12345-0@lo:400:kworker.0 Request processed in 87us (1148us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318877.154809:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908
00000100:00100000:0.0:1767318877.154829:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16514
00000100:00100000:0.0:1767318877.154834:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379616640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318877.154857:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318877.155307:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318877.155594:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379616256:0@lo:400:kworker.0
00000100:00100000:0.0:1767318877.155742:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379616640:12345-0@lo:38:kworker.0 Request processed in 905us (1438us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318877.155751:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16514
00000100:00080000:3.0:1767318877.155837:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318877.155842:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318877.155846:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379616640:0@lo:38:kworker.0
00000100:00100000:2.0:1767318877.655516:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318877.655547:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318877.655680:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767318877.657436:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318877.659037:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616768
00000100:00100000:3.0:1767318877.659056:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616768
00000100:00100000:3.0:1767318877.659235:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067
00000100:00100000:3.0:1767318877.659248:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318877.659294:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318877.659413:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (3733us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318877.659422:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067
00000100:00100000:2.0:1767318877.659593:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318878.102164:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318878.102242:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318878.102244:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885824
00000100:00100000:1.0:1767318878.102257:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885824
00000100:00100000:0.0:1767318878.102336:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885696
00000100:00100000:0.0:1767318878.102342:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885696
00000100:00100000:1.0:1767318878.102368:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3909
00000100:00100000:1.0:1767318878.102380:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291885824:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767318878.102443:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318878.102500:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291885824:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (352us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318878.102509:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3909
00000100:00100000:1.0:1767318878.102546:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16515
00000100:00100000:1.0:1767318878.102552:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291885696:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318878.102577:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318878.102606:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291885696:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (364us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318878.102624:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16515
00010000:00010000:2.0:1767318878.679225:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318879.703183:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318880.728424:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318881.242320:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616896:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318881.242427:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318881.242860:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379616896
00000100:00100000:3.0:1767318881.242888:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379616896
00000100:00100000:3.0:1767318881.242975:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068
00000100:00100000:3.0:1767318881.242997:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318881.243041:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318881.243137:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379616896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (710us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318881.243146:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068
00000100:00080000:2.0:1767318881.244520:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318881.244610:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379616896:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318881.751246:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318882.264208:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.264223:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318882.264227:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.264233:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.264239:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.264251:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3779
00000100:00080000:0.0:1767318882.264256:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.264269:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318882.264330:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904700 x1853164379617024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318882.264354:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.264359:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.264362:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.264366:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3779
00000100:00080000:0.0:1767318882.264369:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.264373:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318882.264387:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906d80 x1853164379617152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318882.264431:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379617024:0@lo:38:kworker.0
00000100:00080000:0.0:1767318882.264476:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.264481:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.264484:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.264489:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3779
00000100:00080000:0.0:1767318882.264492:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.264497:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318882.264530:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318882.264545:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906300 x1853164379617664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318882.264577:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318882.264581:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318882.264583:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318882.264587:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3779
00000100:00080000:0.0:1767318882.264590:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318882.264597:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318882.264612:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907480 x1853164379617920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318882.264629:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379617152:0@lo:38:kworker.0
00000100:00100000:0.0:1767318882.264650:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379617792:0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.264718:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318882.264755:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318882.264762:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379617536:0@lo:400:kworker.0
00000100:00100000:3.0:1767318882.264775:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318882.264813:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318882.264846:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379617664:0@lo:38:kworker.0
00000100:00100000:0.0:1767318882.264865:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617024
00000100:00100000:0.0:1767318882.264906:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617024
00000100:00100000:3.0:1767318882.264940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318882.265001:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379617280:0@lo:400:kworker.0
00000100:00100000:1.0:1767318882.265046:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318882.265073:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318882.265078:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379617408:0@lo:400:kworker.0
00000100:00100000:1.0:1767318882.265100:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318882.265183:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617152
00000100:00100000:2.0:1767318882.265187:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617152
00000100:00100000:2.0:1767318882.265219:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891
00000100:00100000:2.0:1767318882.265227:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379617152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318882.265254:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318882.265301:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379617152:12345-0@lo:38:kworker.0 Request processed in 74us (538us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318882.265308:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891
00000100:00100000:3.0:1767318882.270611:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379617920:0@lo:38:kworker.0
00000100:00100000:3.0:1767318882.271412:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318882.273926:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617792
00000100:00100000:0.0:1767318882.273952:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617792
00000100:00100000:0.0:1767318882.274060:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617536
00000100:00100000:0.0:1767318882.274064:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617536
00000100:00100000:0.0:1767318882.274084:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617664
00000100:00100000:0.0:1767318882.274088:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617664
00000100:00100000:0.0:1767318882.274107:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910
00000100:00100000:0.0:1767318882.274119:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379617792:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.274244:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379617792:12345-0@lo:400:kworker.0 Request processed in 127us (9525us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318882.274462:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910
00000100:00100000:0.0:1767318882.274500:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911
00000100:00100000:0.0:1767318882.274508:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379617536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.274541:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379617536:12345-0@lo:400:kworker.0 Request processed in 34us (9730us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318882.274548:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911
00000100:00100000:0.0:1767318882.274562:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16516
00000100:00100000:0.0:1767318882.274567:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379617024:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318882.274595:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318882.274629:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379617024:12345-0@lo:38:kworker.0 Request processed in 60us (10106us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318882.274635:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16516
00000100:00100000:0.0:1767318882.274647:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16517
00000100:00100000:0.0:1767318882.274651:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379617664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318882.274660:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318882.274701:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379617664:12345-0@lo:38:kworker.0 Request processed in 49us (9765us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318882.274708:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16517
00000100:00080000:0.0:1767318882.274738:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318882.274810:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379617536:0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.274840:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379617792:0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.274943:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617280
00000100:00100000:0.0:1767318882.274949:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617280
00000100:00100000:0.0:1767318882.275000:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617408
00000100:00100000:0.0:1767318882.275012:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617408
00000100:00100000:0.0:1767318882.275044:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318
00000100:00100000:0.0:1767318882.275051:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379617280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.275101:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379617280:12345-0@lo:400:kworker.0 Request processed in 50us (10054us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318882.275107:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318
00000100:00100000:0.0:1767318882.275119:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319
00000100:00100000:0.0:1767318882.275125:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379617408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.275155:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379617408:12345-0@lo:400:kworker.0 Request processed in 30us (10053us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318882.275161:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319
00000100:00080000:0.0:1767318882.275184:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318882.277731:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379617408:0@lo:400:kworker.0
00000100:00100000:0.0:1767318882.277757:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379617280:0@lo:400:kworker.0
00000100:00080000:3.0:1767318882.279487:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318882.279506:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318882.279513:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379617024:0@lo:38:kworker.0
00000100:00080000:3.0:1767318882.279528:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318882.279532:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318882.279534:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379617152:0@lo:38:kworker.0
00000100:00080000:3.0:1767318882.279577:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318882.279581:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318882.279584:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379617664:0@lo:38:kworker.0
00000100:00100000:2.0:1767318882.281507:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379617920
00000100:00100000:2.0:1767318882.281527:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379617920
00000100:00100000:2.0:1767318882.281601:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16518
00000100:00100000:2.0:1767318882.281612:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379617920:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318882.281644:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318882.281769:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379617920:12345-0@lo:38:kworker.0 Request processed in 158us (10359us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318882.281778:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16518
00000100:00080000:3.0:1767318882.285104:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318882.285120:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318882.285126:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379617920:0@lo:38:kworker.0
00010000:00010000:2.0:1767318882.777423:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318882.777761:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379618048:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318882.777892:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318882.778043:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618048
00000100:00100000:3.0:1767318882.778064:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618048
00000100:00100000:3.0:1767318882.778122:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069
00000100:00100000:3.0:1767318882.778132:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379618048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318882.778173:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318882.778226:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379618048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (357us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318882.778234:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069
00000100:00100000:1.0:1767318882.784754:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379618048:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318883.218487:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318883.218764:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291885952
00000100:00100000:1.0:1767318883.218796:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291885952
00000100:00100000:1.0:1767318883.218926:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16519
00000100:00100000:1.0:1767318883.218938:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291885952:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318883.218973:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318883.219062:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291885952:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 125us (589us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318883.219069:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16519
00000100:00100000:3.0:1767318883.220384:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318883.220525:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291886080
00000100:00100000:1.0:1767318883.220539:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291886080
00000100:00100000:1.0:1767318883.220659:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3912
00000100:00100000:1.0:1767318883.220684:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291886080:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318883.220776:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291886080:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (402us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318883.220784:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3912
00000100:00080000:2.0:1767318883.221737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318883.803316:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318884.827183:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318885.854196:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318886.359652:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379618176:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318886.359745:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318886.359915:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618176
00000100:00100000:0.0:1767318886.359924:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618176
00000100:00100000:0.0:1767318886.359992:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070
00000100:00100000:0.0:1767318886.360001:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379618176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318886.360031:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318886.360197:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318886.361980:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379618176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1967us (2222us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318886.361996:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070
00000100:00100000:2.0:1767318886.362858:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379618176:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318886.871168:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318887.383812:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318887.383827:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318887.383830:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318887.383835:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318887.383840:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318887.383851:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3784
00000100:00080000:1.0:1767318887.383857:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318887.383866:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318887.383947:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21180 x1853164379618304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318887.383978:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318887.383982:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318887.383984:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318887.383988:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3784
00000100:00080000:1.0:1767318887.383990:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318887.383994:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318887.384188:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23b80 x1853164379618432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318887.384263:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318887.385773:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379618304:0@lo:38:kworker.0
00000100:00100000:0.0:1767318887.385895:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318887.385997:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379618432:0@lo:38:kworker.0
00000100:00100000:0.0:1767318887.386024:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318887.386074:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618432
00000100:00100000:0.0:1767318887.386082:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618432
00000100:00100000:0.0:1767318887.386122:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892
00000100:00100000:0.0:1767318887.386129:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379618432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318887.386156:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318887.386203:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379618432:12345-0@lo:38:kworker.0 Request processed in 72us (177us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318887.386211:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892
00000100:00080000:0.0:1767318887.386257:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318887.386263:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318887.386267:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379618432:0@lo:38:kworker.0
00000100:00100000:3.0:1767318887.387283:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379618688:0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.387334:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318887.387364:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379618560:0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.387385:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318887.387429:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618688
00000100:00100000:3.0:1767318887.387435:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618688
00000100:00100000:3.0:1767318887.387482:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618560
00000100:00100000:3.0:1767318887.387486:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618560
00000100:00100000:3.0:1767318887.387505:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320
00000100:00100000:3.0:1767318887.387513:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379618688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.387564:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379618688:12345-0@lo:400:kworker.0 Request processed in 52us (228us total) trans 0 rc 0/0
00000100:00080000:1.0:1767318887.387952:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318887.387957:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318887.387960:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318887.387966:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3784
00000100:00080000:1.0:1767318887.387970:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318887.387975:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318887.388706:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320
00000100:00100000:1.0:1767318887.388756:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22d80 x1853164379618944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318887.388811:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318887.388816:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318887.388818:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318887.388822:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3784
00000100:00080000:1.0:1767318887.388825:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318887.388830:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318887.388862:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20700 x1853164379619200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318887.388935:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379618816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318887.388985:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318887.389459:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318887.389467:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379619072:0@lo:400:kworker.0
00000100:00100000:2.0:1767318887.389469:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618304
00000100:00100000:2.0:1767318887.389479:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618304
00000100:00100000:1.0:1767318887.389502:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318887.389516:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618816
00000100:00100000:2.0:1767318887.389520:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618816
00000100:00100000:1.0:1767318887.389546:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379619072
00000100:00100000:1.0:1767318887.389551:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379619072
00000100:00100000:2.0:1767318887.389575:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913
00000100:00100000:2.0:1767318887.389587:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379618816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318887.389601:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914
00000100:00100000:1.0:1767318887.389610:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379619072:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318887.389700:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321
00000100:00100000:0.0:1767318887.389713:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379618560:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318887.389743:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318887.389749:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318887.389766:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16520
00000100:00100000:3.0:1767318887.389772:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379618304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318887.389866:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318887.389960:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379619072:12345-0@lo:400:kworker.0 Request processed in 352us (459us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318887.389968:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914
00000100:00100000:1.0:1767318887.390183:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379618944:0@lo:38:kworker.0
00000100:00100000:1.0:1767318887.390215:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318887.390234:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379619200:0@lo:38:kworker.0
00000100:00100000:1.0:1767318887.390255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318887.390283:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379618944
00000100:00100000:1.0:1767318887.390287:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379618944
00000100:00100000:1.0:1767318887.390300:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379619200
00000100:00100000:1.0:1767318887.390302:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379619200
00000100:00100000:1.0:1767318887.390311:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16521
00000100:00100000:1.0:1767318887.390315:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379618944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318887.390325:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318887.390353:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379618944:12345-0@lo:38:kworker.0 Request processed in 37us (138us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318887.390366:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16521
00000100:00100000:1.0:1767318887.390379:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16522
00000100:00100000:1.0:1767318887.390383:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379619200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318887.390393:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318887.390418:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379619200:12345-0@lo:38:kworker.0 Request processed in 33us (162us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318887.390424:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16522
00000100:00080000:1.0:1767318887.390456:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318887.390460:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318887.390463:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379618944:0@lo:38:kworker.0
00000100:00080000:1.0:1767318887.390471:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318887.390474:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318887.390477:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379619200:0@lo:38:kworker.0
00000100:00100000:1.0:1767318887.390531:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379619072:0@lo:400:kworker.0
00000100:00100000:1.0:1767318887.390542:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379618816:0@lo:400:kworker.0
00000100:00100000:1.0:1767318887.390591:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379618688:0@lo:400:kworker.0
00000100:00100000:2.0:1767318887.397084:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379618816:12345-0@lo:400:kworker.0 Request processed in 7488us (8086us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318887.397102:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913
00000100:00100000:0.0:1767318887.399902:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379618560:12345-0@lo:400:kworker.0 Request processed in 10180us (12502us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318887.399921:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321
00000100:00100000:1.0:1767318887.400050:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379618560:0@lo:400:kworker.0
00000100:00100000:3.0:1767318887.411687:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379618304:12345-0@lo:38:kworker.0 Request processed in 21902us (25780us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318887.411703:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16520
00000100:00080000:1.0:1767318887.413769:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318887.413782:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318887.413798:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379618304:0@lo:38:kworker.0
00010000:00010000:1.0:1767318887.895310:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318887.895620:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379619328:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318887.895732:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318887.895806:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379619328
00000100:00100000:0.0:1767318887.895815:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379619328
00000100:00100000:0.0:1767318887.895887:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071
00000100:00100000:0.0:1767318887.895897:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379619328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318887.895931:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318887.895994:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379619328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (261us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318887.896007:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071
00000100:00100000:1.0:1767318887.896731:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379619328:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318888.338964:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318888.339217:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291886336
00000100:00100000:3.0:1767318888.339239:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291886336
00000100:00100000:3.0:1767318888.339322:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3915
00000100:00080000:1.0:1767318888.339323:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318888.339464:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291886336:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318888.339548:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291886336:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 216us (592us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318888.339557:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3915
00000100:00100000:0.0:1767318888.339647:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318888.340330:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291886208
00000100:00100000:3.0:1767318888.340338:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291886208
00000100:00100000:3.0:1767318888.340378:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16523
00000100:00100000:3.0:1767318888.340384:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291886208:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318888.340405:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318888.340464:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291886208:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 79us (817us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318888.340471:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16523
00000400:00000100:2.0:1767318888.347281:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291886464 offset 0 length 520: 4
00010000:00010000:2.0:1767318888.919158:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318889.943551:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318890.967943:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318891.479378:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379619456:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318891.479469:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318891.479651:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379619456
00000100:00100000:0.0:1767318891.479668:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379619456
00000100:00100000:0.0:1767318891.479758:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072
00000100:00100000:0.0:1767318891.479767:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379619456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318891.479802:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318891.479855:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379619456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318891.479864:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072
00000100:00100000:2.0:1767318891.480028:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f26f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379619456:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318891.480092:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318891.482232:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318866/real 1767318866]  req@ffff8b0f10905180 x1853164379613056/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318891 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318891.482265:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f10905180 x1853164379613056/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318891 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318891.482284:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318891.482310:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318891.482314:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379613056:0@lo:250:kworker.0
00000100:00080000:0.0:1767318891.482392:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318891.482397:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318891.482400:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318891.482405:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3769
00000100:00080000:0.0:1767318891.482409:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318891.482415:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318891.482447:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d880 x1853164379619584/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318891.482472:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318891.482476:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318891.482478:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318891.482482:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3789
00000100:00080000:0.0:1767318891.482484:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318891.482487:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318891.482502:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c700 x1853164379619712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318891.482527:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318891.482530:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318891.482531:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318891.482535:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3789
00000100:00080000:0.0:1767318891.482538:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318891.482541:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318891.482554:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d180 x1853164379619840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318891.482637:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318891.482687:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379619584:0@lo:250:kworker.0
00000400:00000100:2.0:1767318891.482743:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379619584 offset 0 length 520: 4
00000100:00100000:2.0:1767318891.482777:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379619712:0@lo:38:kworker.0
00000100:00100000:2.0:1767318891.482819:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318891.482847:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379619840:0@lo:38:kworker.0
00000100:00100000:2.0:1767318891.482923:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318891.482982:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379619712
00000100:00100000:2.0:1767318891.482992:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379619712
00000100:00100000:2.0:1767318891.483045:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16524
00000100:00100000:2.0:1767318891.483055:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379619712:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318891.483084:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318891.483136:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379619712:12345-0@lo:38:kworker.0 Request processed in 80us (315us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318891.483145:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16524
00000100:00080000:2.0:1767318891.483198:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318891.483202:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318891.483206:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379619712:0@lo:38:kworker.0
00000100:00100000:1.0:1767318891.483987:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379619840
00000100:00100000:1.0:1767318891.483996:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379619840
00000100:00100000:1.0:1767318891.484055:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893
00000100:00100000:1.0:1767318891.484063:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379619840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318891.484078:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318891.484308:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379619840:12345-0@lo:38:kworker.0 Request processed in 244us (1384us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318891.484316:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893
00000100:00080000:2.0:1767318891.484604:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318891.484611:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318891.484615:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379619840:0@lo:38:kworker.0
00000100:00100000:3.0:1767318891.486827:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379620096:0@lo:400:kworker.0
00000100:00100000:3.0:1767318891.487328:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318891.487388:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379619968:0@lo:400:kworker.0
00000100:00100000:3.0:1767318891.487419:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318891.487554:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379619968
00000100:00100000:1.0:1767318891.487564:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379619968
00000100:00080000:3.0:1767318891.487754:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318891.487982:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322
00000100:00100000:1.0:1767318891.487998:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379619968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318891.488077:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379619968:12345-0@lo:400:kworker.0 Request processed in 83us (656us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318891.488151:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379619968:0@lo:400:kworker.0
00000100:00100000:1.0:1767318891.488761:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322
00000100:00080000:0.0:1767318891.489038:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318891.489045:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318891.489049:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318891.489054:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3789
00000100:00080000:0.0:1767318891.489059:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318891.489064:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318891.489102:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e680 x1853164379620224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318891.489141:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318891.489144:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318891.489146:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318891.489150:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3789
00000100:00080000:0.0:1767318891.489152:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318891.489157:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318891.489169:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e300 x1853164379620480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318891.489317:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379620352:0@lo:400:kworker.0
00000100:00100000:1.0:1767318891.489364:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318891.489469:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620096
00000100:00100000:3.0:1767318891.489476:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620096
00000100:00100000:3.0:1767318891.489538:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620352
00000100:00100000:3.0:1767318891.489542:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620352
00000100:00100000:3.0:1767318891.489571:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916
00000100:00100000:3.0:1767318891.489580:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379620096:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318891.490141:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318891.490180:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917
00000100:00100000:1.0:1767318891.490192:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379620352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318891.490266:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379620352:12345-0@lo:400:kworker.0 Request processed in 77us (900us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318891.490281:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917
00000100:00100000:1.0:1767318891.490342:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379620352:0@lo:400:kworker.0
00000100:00100000:2.0:1767318891.490543:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379620224:0@lo:38:kworker.0
00000100:00100000:2.0:1767318891.490579:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318891.490618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379620480:0@lo:38:kworker.0
00000100:00100000:2.0:1767318891.490639:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318891.490668:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620224
00000100:00100000:2.0:1767318891.490672:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620224
00000100:00100000:2.0:1767318891.490693:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620480
00000100:00100000:2.0:1767318891.490696:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620480
00000100:00100000:2.0:1767318891.490712:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16525
00000100:00100000:2.0:1767318891.490716:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379620224:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318891.490738:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318891.490789:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379620224:12345-0@lo:38:kworker.0 Request processed in 71us (209us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318891.490798:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16525
00000100:00100000:2.0:1767318891.490813:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16526
00000100:00100000:3.0:1767318891.490815:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379620096:12345-0@lo:400:kworker.0 Request processed in 1236us (3488us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318891.490818:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379620480:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318891.490822:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916
00010000:00020000:2.0:1767318891.490827:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318891.491033:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379620096:0@lo:400:kworker.0
00000100:00100000:2.0:1767318891.495821:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379620480:12345-0@lo:38:kworker.0 Request processed in 4991us (5169us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318891.495838:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16526
00000100:00080000:3.0:1767318891.498605:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318891.498619:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318891.498624:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379620224:0@lo:38:kworker.0
00000100:00080000:3.0:1767318891.498641:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318891.498644:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318891.498646:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379620480:0@lo:38:kworker.0
00010000:00010000:1.0:1767318891.991397:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318893.016642:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767318893.016666:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379620608:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318893.016748:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318893.017103:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620608
00000100:00100000:1.0:1767318893.017113:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620608
00000100:00100000:1.0:1767318893.017181:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073
00000100:00100000:1.0:1767318893.017191:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379620608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318893.017221:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318893.017269:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379620608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (521us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318893.017277:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073
00000100:00080000:3.0:1767318893.017342:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318893.017379:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379620608:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318893.020520:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318893.456566:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318893.456729:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318893.457084:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291886720
00000100:00100000:1.0:1767318893.457095:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291886720
00000100:00100000:1.0:1767318893.457178:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291886592
00000100:00100000:1.0:1767318893.457182:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291886592
00000100:00100000:1.0:1767318893.457203:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3918
00000100:00100000:1.0:1767318893.457213:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291886720:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318893.457249:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16527
00000100:00100000:0.0:1767318893.457257:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291886592:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318893.457279:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318893.457289:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291886720:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 75us (730us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318893.457298:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3918
00000100:00100000:0.0:1767318893.457314:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291886592:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (583us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318893.457322:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16527
00000100:00080000:3.0:1767318893.457439:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318894.039261:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318895.063129:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318896.087285:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318896.599242:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318896.599252:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318896.599255:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318896.599262:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318896.599267:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318896.599275:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3793
00000100:00080000:1.0:1767318896.599280:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318896.599287:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318896.599328:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21c00 x1853164379620736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318896.599354:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318896.599358:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318896.599359:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318896.599363:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3793
00000100:00080000:1.0:1767318896.599366:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318896.599369:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318896.599382:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164379620864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318896.599447:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318896.599450:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318896.599452:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318896.599456:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3793
00000100:00080000:1.0:1767318896.599458:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318896.599461:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318896.599473:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23b80 x1853164379621376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318896.599496:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318896.599500:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318896.599502:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318896.599507:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3793
00000100:00080000:1.0:1767318896.599509:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318896.599512:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318896.599523:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164379621632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318896.599585:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379621248:0@lo:400:kworker.0
00000100:00100000:1.0:1767318896.599643:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318896.599696:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318896.599701:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379621504:0@lo:400:kworker.0
00000100:00100000:1.0:1767318896.599719:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318896.599746:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379621248
00000100:00100000:1.0:1767318896.599752:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379621248
00000100:00100000:1.0:1767318896.599789:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379621504
00000100:00100000:1.0:1767318896.599792:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379621504
00000100:00100000:1.0:1767318896.599810:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919
00000100:00100000:1.0:1767318896.599817:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379621248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318896.599859:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379621248:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318896.599865:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919
00000100:00100000:1.0:1767318896.599904:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920
00000100:00100000:1.0:1767318896.599910:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379621504:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767318896.600022:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318896.600033:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379620736:0@lo:38:kworker.0
00000100:00100000:2.0:1767318896.600202:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379620992:0@lo:400:kworker.0
00000100:00100000:0.0:1767318896.600254:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379621120:0@lo:400:kworker.0
00000100:00100000:1.0:1767318896.600794:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379621504:12345-0@lo:400:kworker.0 Request processed in 882us (1070us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318896.600800:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318896.600801:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920
00000100:00100000:1.0:1767318896.600855:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379621504:0@lo:400:kworker.0
00000100:00100000:1.0:1767318896.600866:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379621248:0@lo:400:kworker.0
00000100:00100000:2.0:1767318896.600911:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620992
00000100:00100000:2.0:1767318896.600917:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620992
00000100:00100000:2.0:1767318896.600977:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323
00000100:00100000:2.0:1767318896.600984:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379620992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318896.601007:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318896.601015:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379620992:12345-0@lo:400:kworker.0 Request processed in 33us (215us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318896.601021:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323
00000100:00080000:2.0:1767318896.601038:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318896.601045:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379620864:0@lo:38:kworker.0
00000100:00100000:2.0:1767318896.601047:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379621760:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318896.601069:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318896.601069:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318896.601091:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379621376:0@lo:38:kworker.0
00000100:00100000:2.0:1767318896.601096:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379620992:0@lo:400:kworker.0
00000100:00100000:3.0:1767318896.601110:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318896.601126:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379621632:0@lo:38:kworker.0
00000100:00100000:3.0:1767318896.601146:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318896.601187:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620736
00000100:00100000:3.0:1767318896.601191:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620736
00000100:00100000:3.0:1767318896.601209:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379621376
00000100:00100000:3.0:1767318896.601212:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379621376
00000100:00100000:3.0:1767318896.601223:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379621632
00000100:00100000:3.0:1767318896.601226:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379621632
00000100:00100000:3.0:1767318896.601239:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16528
00000100:00100000:3.0:1767318896.601243:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379620736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318896.601262:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318896.601306:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379620736:12345-0@lo:38:kworker.0 Request processed in 61us (298us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318896.601313:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16528
00000100:00100000:3.0:1767318896.601325:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16529
00000100:00100000:3.0:1767318896.601329:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379621376:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318896.601344:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379620864
00010000:00020000:3.0:1767318896.601347:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318896.601348:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379620864
00000100:00100000:2.0:1767318896.601369:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894
00000100:00100000:3.0:1767318896.601370:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379621376:12345-0@lo:38:kworker.0 Request processed in 41us (259us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318896.601373:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379620864:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767318896.601376:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16529
00010000:00020000:2.0:1767318896.601383:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318896.601385:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16530
00000100:00100000:3.0:1767318896.601389:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379621632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318896.601405:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318896.601407:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379620864:12345-0@lo:38:kworker.0 Request processed in 33us (338us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318896.601413:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894
00000100:00100000:3.0:1767318896.601425:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379621632:12345-0@lo:38:kworker.0 Request processed in 35us (279us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318896.601431:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16530
00000100:00080000:2.0:1767318896.601456:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318896.601456:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379621760
00000100:00100000:3.0:1767318896.601459:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379621760
00000100:00080000:2.0:1767318896.601461:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318896.601464:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379620736:0@lo:38:kworker.0
00000100:00080000:2.0:1767318896.601472:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318896.601475:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318896.601478:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379620864:0@lo:38:kworker.0
00000100:00100000:3.0:1767318896.601480:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074
00000100:00080000:2.0:1767318896.601486:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767318896.601486:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379621760:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318896.601489:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318896.601491:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379621376:0@lo:38:kworker.0
00000100:00080000:2.0:1767318896.601497:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318896.601500:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318896.601502:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379621632:0@lo:38:kworker.0
00002000:00000024:3.0:1767318896.601504:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318896.601539:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379621760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (469us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318896.601567:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379621760:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318896.601642:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074
00000100:00100000:0.0:1767318896.601785:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318896.601859:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379621120
00000100:00100000:3.0:1767318896.601864:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379621120
00000100:00100000:3.0:1767318896.602068:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324
00000100:00100000:3.0:1767318896.602078:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379621120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318896.602114:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379621120:12345-0@lo:400:kworker.0 Request processed in 40us (329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318896.602130:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324
00000100:00100000:1.0:1767318896.602270:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379621120:0@lo:400:kworker.0
00000100:00080000:0.0:1767318896.602427:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318897.111237:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318898.135238:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318898.135260:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379621888:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318898.135317:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:0.0:1767318898.135393:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318898.136222:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379621888
00000100:00100000:3.0:1767318898.136231:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379621888
00000100:00100000:3.0:1767318898.136307:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075
00000100:00100000:3.0:1767318898.136317:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379621888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318898.136350:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318898.136411:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379621888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1091us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318898.136436:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075
00000100:00100000:0.0:1767318898.136672:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379621888:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318898.137128:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318898.575162:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318898.576092:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318898.576286:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291886976
00000100:00100000:3.0:1767318898.576301:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291886976
00000100:00100000:3.0:1767318898.576417:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291886848
00000100:00100000:3.0:1767318898.576421:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291886848
00000100:00100000:1.0:1767318898.576604:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3921
00000100:00100000:1.0:1767318898.576619:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291886976:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318898.576728:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291886976:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 112us (1581us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318898.576738:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3921
00000100:00080000:2.0:1767318898.576816:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318898.576917:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16531
00000100:00100000:3.0:1767318898.576924:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291886848:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318898.576954:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318898.576990:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291886848:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 65us (903us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318898.576997:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16531
00010000:00010000:2.0:1767318899.159438:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318900.184048:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318901.207538:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767318901.719304:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318901.719320:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318901.719323:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318901.719328:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318901.719334:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318901.719345:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3799
00000100:00080000:1.0:1767318901.719352:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318901.719362:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318901.719424:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379622016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318901.719460:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318901.719464:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318901.719466:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318901.719470:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3799
00000100:00080000:1.0:1767318901.719474:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318901.719478:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318901.719492:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379622144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318901.719583:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318901.719587:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318901.719589:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318901.719593:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3799
00000100:00080000:1.0:1767318901.719596:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318901.719600:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318901.719614:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164379622656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318901.719632:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318901.719635:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318901.719637:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318901.719641:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3799
00000100:00080000:1.0:1767318901.719644:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318901.719648:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318901.719660:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23b80 x1853164379622912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318901.719662:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379622400:0@lo:400:kworker.0
00000100:00100000:1.0:1767318901.719686:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379622784:0@lo:400:kworker.0
00000100:00100000:2.0:1767318901.719927:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379622272:0@lo:400:kworker.0
00000100:00100000:3.0:1767318901.719984:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379622016:0@lo:38:kworker.0
00000100:00100000:0.0:1767318901.728341:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318901.728482:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622400
00000100:00100000:0.0:1767318901.728494:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622400
00000100:00100000:0.0:1767318901.728591:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325
00000100:00100000:0.0:1767318901.728602:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379622400:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318901.728680:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379622400:12345-0@lo:400:kworker.0 Request processed in 79us (350us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318901.728714:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325
00000100:00100000:0.0:1767318901.728751:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379622528:0@lo:400:kworker.0
00000100:00100000:0.0:1767318901.728797:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318901.728861:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379622400:0@lo:400:kworker.0
00000100:00100000:0.0:1767318901.730091:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622528
00000100:00100000:0.0:1767318901.730103:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622528
00000100:00100000:0.0:1767318901.730172:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922
00000100:00100000:0.0:1767318901.730187:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379622528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318901.730280:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379622528:12345-0@lo:400:kworker.0 Request processed in 98us (1481us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318901.730287:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922
00000100:00100000:0.0:1767318901.730365:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379622528:0@lo:400:kworker.0
00000100:00100000:0.0:1767318901.730452:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318901.730465:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379623040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318901.730520:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318901.730671:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623040
00000100:00100000:0.0:1767318901.730676:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623040
00000100:00100000:0.0:1767318901.730713:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076
00000100:00100000:0.0:1767318901.730719:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379623040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318901.730748:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318901.730789:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379623040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (268us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318901.730796:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076
00000100:00100000:0.0:1767318901.730828:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379623040:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767318901.730940:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767318901.730947:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318901.730950:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318901.734427:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318901.735343:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622784
00000100:00100000:0.0:1767318901.735359:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622784
00000100:00100000:0.0:1767318901.735465:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923
00000100:00100000:0.0:1767318901.735479:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379622784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318901.735601:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379622784:12345-0@lo:400:kworker.0 Request processed in 124us (1184us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318901.735610:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923
00000100:00100000:2.0:1767318901.736829:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318901.737043:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622272
00000100:00100000:0.0:1767318901.737052:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622272
00000100:00100000:0.0:1767318901.737114:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326
00000100:00100000:0.0:1767318901.737125:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379622272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318901.737195:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379622272:12345-0@lo:400:kworker.0 Request processed in 72us (370us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318901.737204:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326
00000100:00100000:2.0:1767318901.737313:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379622272:0@lo:400:kworker.0
00000100:00080000:1.0:1767318901.738836:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318901.738967:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379622784:0@lo:400:kworker.0
00000100:00100000:3.0:1767318901.741379:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318901.741443:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379622144:0@lo:38:kworker.0
00000100:00100000:3.0:1767318901.741485:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318901.741628:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379622656:0@lo:38:kworker.0
00000100:00100000:3.0:1767318901.741659:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318901.741697:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379622912:0@lo:38:kworker.0
00000100:00100000:3.0:1767318901.741720:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318901.741754:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622016
00000100:00100000:2.0:1767318901.741898:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622656
00000100:00100000:2.0:1767318901.741920:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622656
00000100:00100000:2.0:1767318901.741984:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622912
00000100:00100000:2.0:1767318901.741988:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622912
00000100:00100000:2.0:1767318901.742012:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16532
00000100:00100000:2.0:1767318901.742022:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379622656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318901.742054:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318901.742107:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379622656:12345-0@lo:38:kworker.0 Request processed in 86us (447us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318901.742116:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16532
00000100:00100000:2.0:1767318901.742138:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16533
00000100:00100000:2.0:1767318901.742142:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379622912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318901.742152:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318901.742175:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379622912:12345-0@lo:38:kworker.0 Request processed in 31us (454us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318901.742182:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16533
00000100:00080000:2.0:1767318901.742267:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318901.742275:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318901.742280:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379622912:0@lo:38:kworker.0
00000100:00080000:2.0:1767318901.742316:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318901.742320:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318901.742324:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379622656:0@lo:38:kworker.0
00000100:00100000:3.0:1767318901.742694:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622016
00000100:00100000:3.0:1767318901.742728:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16534
00000100:00100000:3.0:1767318901.742734:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379622016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318901.742745:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318901.742811:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379622016:12345-0@lo:38:kworker.0 Request processed in 75us (1442us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318901.742818:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16534
00000100:00080000:2.0:1767318901.743416:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318901.743424:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318901.743429:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379622016:0@lo:38:kworker.0
00000100:00100000:1.0:1767318901.750407:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379622144
00000100:00100000:1.0:1767318901.750428:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379622144
00000100:00100000:1.0:1767318901.755025:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895
00000100:00100000:1.0:1767318901.755042:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379622144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318901.755078:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318901.755231:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379622144:12345-0@lo:38:kworker.0 Request processed in 189us (13743us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318901.755240:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895
00000100:00080000:3.0:1767318901.755388:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318901.755395:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318901.755401:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379622144:0@lo:38:kworker.0
00010000:00010000:0.0:1767318902.231078:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318903.257015:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318903.257026:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379623168:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318903.257133:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318903.257427:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623168
00000100:00100000:3.0:1767318903.257439:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623168
00000100:00100000:3.0:1767318903.257537:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077
00000100:00100000:3.0:1767318903.257549:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379623168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318903.257589:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318903.257704:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379623168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (571us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318903.257712:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077
00000100:00080000:1.0:1767318903.257784:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318903.265669:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379623168:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318903.695432:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318903.696025:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318903.696126:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291887232
00000100:00100000:1.0:1767318903.696140:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291887232
00000100:00100000:1.0:1767318903.696228:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291887104
00000100:00100000:1.0:1767318903.696231:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291887104
00000100:00100000:1.0:1767318903.696257:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3924
00000100:00100000:1.0:1767318903.696268:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291887232:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318903.696311:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16535
00000100:00100000:3.0:1767318903.696319:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291887104:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318903.696345:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318903.696368:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291887232:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 100us (950us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318903.696378:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3924
00000100:00100000:3.0:1767318903.696384:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291887104:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 63us (359us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318903.696391:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16535
00000100:00080000:2.0:1767318903.696473:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767318904.279356:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318905.303638:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318906.327087:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318906.839151:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379623296:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318906.839259:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318906.839691:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318906.839697:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318906.839701:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318906.839706:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318906.839711:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318906.839718:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3804
00000100:00080000:1.0:1767318906.839723:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318906.839733:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318906.839763:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20700 x1853164379623424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318906.839782:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318906.839786:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318906.839788:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318906.839792:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3804
00000100:00080000:1.0:1767318906.839795:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318906.839798:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318906.839814:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21c00 x1853164379623552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318906.839852:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318906.839856:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318906.839858:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318906.839861:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3804
00000100:00080000:1.0:1767318906.839864:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318906.839891:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318906.839904:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23b80 x1853164379623936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318906.839922:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318906.839926:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318906.839928:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318906.839932:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3804
00000100:00080000:1.0:1767318906.839934:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318906.839939:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318906.839949:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a432680 x1853164379624192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318906.839974:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379624064:0@lo:400:kworker.0
00000100:00100000:1.0:1767318906.840017:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318906.840042:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318906.840047:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379623808:0@lo:400:kworker.0
00000100:00100000:1.0:1767318906.840067:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318906.840111:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624064
00000100:00100000:2.0:1767318906.840117:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623296
00000100:00100000:1.0:1767318906.840122:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624064
00000100:00100000:2.0:1767318906.840132:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623296
00000100:00100000:1.0:1767318906.840223:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623808
00000100:00100000:1.0:1767318906.840228:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623808
00000100:00100000:2.0:1767318906.840235:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078
00000100:00100000:2.0:1767318906.840252:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379623296:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318906.840277:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925
00000100:00100000:1.0:1767318906.840290:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379624064:12345-0@lo:400:kworker.0
00002000:00000024:2.0:1767318906.840291:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318906.840357:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379624064:12345-0@lo:400:kworker.0 Request processed in 71us (338us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318906.840366:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925
00000100:00100000:1.0:1767318906.840390:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926
00000100:00100000:1.0:1767318906.840397:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379623808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318906.840425:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379623808:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318906.840431:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926
00000100:00080000:1.0:1767318906.840464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318906.840471:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318906.840487:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379623680:0@lo:400:kworker.0
00000100:00100000:1.0:1767318906.840520:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318906.840586:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379623808:0@lo:400:kworker.0
00000100:00100000:1.0:1767318906.840601:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379624064:0@lo:400:kworker.0
00000100:00100000:1.0:1767318906.840661:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623680
00000100:00100000:1.0:1767318906.840665:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623680
00000100:00100000:1.0:1767318906.840704:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327
00000100:00100000:1.0:1767318906.840710:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379623680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318906.840754:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379623680:12345-0@lo:400:kworker.0 Request processed in 43us (233us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318906.840761:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327
00000100:00080000:1.0:1767318906.840775:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318906.840789:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379623680:0@lo:400:kworker.0
00000100:00100000:0.0:1767318906.840986:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379623296:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318906.841801:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379623424:0@lo:38:kworker.0
00000100:00100000:0.0:1767318906.841851:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318906.841917:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379623552:0@lo:38:kworker.0
00000100:00100000:0.0:1767318906.841947:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318906.841981:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379623936:0@lo:38:kworker.0
00000100:00100000:0.0:1767318906.842003:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318906.842020:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379624192:0@lo:38:kworker.0
00000100:00100000:0.0:1767318906.842042:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318906.842076:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623552
00000100:00100000:0.0:1767318906.842082:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623552
00000100:00100000:0.0:1767318906.842117:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896
00000100:00100000:0.0:1767318906.842124:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379623552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318906.842146:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318906.842189:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379623552:12345-0@lo:38:kworker.0 Request processed in 64us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318906.842195:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896
00000100:00100000:0.0:1767318906.842217:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623424
00000100:00100000:0.0:1767318906.842221:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623424
00000100:00100000:0.0:1767318906.842240:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379623936
00000100:00100000:0.0:1767318906.842243:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379623936
00000100:00100000:0.0:1767318906.842257:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624192
00000100:00100000:0.0:1767318906.842259:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624192
00000100:00100000:0.0:1767318906.842275:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16536
00000100:00100000:0.0:1767318906.842279:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379623424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318906.842290:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318906.842317:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379623424:12345-0@lo:38:kworker.0 Request processed in 35us (466us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318906.842323:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16536
00000100:00100000:0.0:1767318906.842335:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16537
00000100:00100000:0.0:1767318906.842346:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379623936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318906.842356:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318906.842381:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379623936:12345-0@lo:38:kworker.0 Request processed in 34us (377us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318906.842386:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16537
00000100:00100000:0.0:1767318906.842415:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16538
00000100:00100000:0.0:1767318906.842419:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379624192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318906.842428:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318906.842460:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379624192:12345-0@lo:38:kworker.0 Request processed in 30us (408us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318906.842467:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16538
00000100:00080000:0.0:1767318906.842514:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318906.842519:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318906.842523:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379623424:0@lo:38:kworker.0
00000100:00080000:0.0:1767318906.842532:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318906.842534:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318906.842537:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379623552:0@lo:38:kworker.0
00000100:00080000:0.0:1767318906.842544:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318906.842546:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318906.842549:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379623936:0@lo:38:kworker.0
00000100:00080000:0.0:1767318906.842555:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318906.842558:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318906.842561:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379624192:0@lo:38:kworker.0
00000100:00100000:2.0:1767318906.842791:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379623296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 432us (1419us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318906.842814:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078
00010000:00010000:2.0:1767318907.354776:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318908.376573:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318908.376765:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318908.383561:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379624320:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318908.383677:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318908.383805:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624320
00000100:00100000:2.0:1767318908.383833:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624320
00000100:00080000:1.0:1767318908.384035:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318908.384803:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079
00000100:00100000:2.0:1767318908.384819:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379624320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318908.384853:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318908.384966:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379624320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (1290us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318908.384976:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079
00000100:00100000:1.0:1767318908.385077:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379624320:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318908.817368:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318908.817488:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318908.817741:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291887360
00000100:00100000:1.0:1767318908.817752:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291887360
00000100:00100000:1.0:1767318908.818058:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291887488
00000100:00100000:1.0:1767318908.818062:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291887488
00000100:00100000:0.0:1767318908.818169:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3927
00000100:00100000:0.0:1767318908.818194:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291887488:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318908.820337:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291887488:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 2131us (2833us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318908.820356:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3927
00000100:00100000:0.0:1767318908.820404:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16539
00000100:00100000:0.0:1767318908.820411:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291887360:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318908.820445:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318908.820482:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291887360:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 70us (3252us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318908.820489:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16539
00000100:00080000:2.0:1767318908.821118:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318909.399631:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318910.424404:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318911.447143:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318911.959219:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318911.959237:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379624448:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318911.959324:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318911.959370:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624448
00000100:00100000:3.0:1767318911.959388:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624448
00000100:00100000:3.0:1767318911.959535:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080
00000100:00100000:3.0:1767318911.959549:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379624448:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318911.959580:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00002000:00000024:3.0:1767318911.959597:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318911.959663:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767318911.959668:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318911.959673:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318911.959678:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318911.959688:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3809
00000100:00080000:1.0:1767318911.959695:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318911.959703:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318911.959720:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379624448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (393us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318911.959732:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080
00000100:00100000:1.0:1767318911.959738:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a432d80 x1853164379624576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767318911.959770:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318911.959775:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318911.959777:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318911.959781:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3809
00000100:00080000:1.0:1767318911.959784:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318911.959788:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767318911.959803:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a430380 x1853164379624704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318911.959931:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318911.959935:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318911.959939:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318911.959941:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318911.959945:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3809
00000100:00080000:1.0:1767318911.959948:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767318911.959951:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318911.959958:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379624576:0@lo:38:kworker.0
00000100:00100000:1.0:1767318911.959965:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a432a00 x1853164379625088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318911.959978:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379624448:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767318911.959992:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767318911.959997:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767318911.959999:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767318911.960003:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3809
00000100:00100000:2.0:1767318911.960004:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318911.960006:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767318911.960022:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379625216:0@lo:400:kworker.0
00000100:00080000:1.0:1767318911.960022:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318911.960034:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379624704:0@lo:38:kworker.0
00000100:00100000:1.0:1767318911.960052:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433800 x1853164379625344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318911.960078:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318911.960079:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379624960:0@lo:400:kworker.0
00000100:00100000:0.0:1767318911.960100:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318911.960121:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379625088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318911.960158:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318911.960205:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624704
00000100:00100000:0.0:1767318911.960212:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624704
00000100:00100000:0.0:1767318911.960244:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897
00000100:00100000:0.0:1767318911.960249:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379624704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318911.960276:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318911.961467:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624576
00000100:00100000:1.0:1767318911.961482:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624576
00000100:00100000:1.0:1767318911.961527:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379625216
00000100:00100000:1.0:1767318911.961531:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379625216
00000100:00100000:1.0:1767318911.961570:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379625088
00000100:00100000:1.0:1767318911.961573:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379625088
00000100:00100000:1.0:1767318911.961834:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928
00000100:00100000:1.0:1767318911.961848:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379625216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318911.964517:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379624832:0@lo:400:kworker.0
00000100:00100000:1.0:1767318911.976856:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379625216:12345-0@lo:400:kworker.0 Request processed in 15002us (16751us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318911.976891:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928
00000100:00100000:1.0:1767318911.979764:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16540
00000100:00100000:1.0:1767318911.979777:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379624576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318911.979804:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318911.979905:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379624576:12345-0@lo:38:kworker.0 Request processed in 127us (19900us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318911.979913:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16540
00000100:00100000:1.0:1767318911.979928:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16541
00000100:00100000:1.0:1767318911.979933:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379625088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318911.979942:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318911.979968:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379625088:12345-0@lo:38:kworker.0 Request processed in 34us (19810us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318911.979973:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16541
00000100:00100000:1.0:1767318911.982963:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379625216:0@lo:400:kworker.0
00000100:00100000:1.0:1767318911.984761:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379624704:12345-0@lo:38:kworker.0 Request processed in 24497us (24669us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318911.984780:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897
00000100:00080000:1.0:1767318911.984864:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318911.985415:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318911.988562:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624832
00000100:00100000:1.0:1767318911.988585:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624832
00000100:00100000:1.0:1767318911.988684:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328
00000100:00100000:1.0:1767318911.988696:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379624832:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318911.988821:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379624832:12345-0@lo:400:kworker.0 Request processed in 120us (3405us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318911.988829:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328
00000100:00080000:1.0:1767318911.988860:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318911.989080:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379624832:0@lo:400:kworker.0
00000100:00080000:2.0:1767318911.991614:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318911.991630:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318911.991636:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379625088:0@lo:38:kworker.0
00000100:00100000:2.0:1767318911.991650:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379625344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318911.991978:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318911.992026:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318911.992032:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318911.992037:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379624576:0@lo:38:kworker.0
00000100:00080000:2.0:1767318911.992054:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318911.992059:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318911.992062:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379624704:0@lo:38:kworker.0
00000100:00100000:1.0:1767318911.992105:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379625344
00000100:00100000:1.0:1767318911.992122:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379625344
00000100:00100000:2.0:1767318911.993462:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16542
00000100:00100000:2.0:1767318911.993473:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379625344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318911.993499:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318911.993588:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379625344:12345-0@lo:38:kworker.0 Request processed in 114us (1609us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318911.993595:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16542
00000100:00080000:3.0:1767318911.994371:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318911.994380:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318911.994385:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379625344:0@lo:38:kworker.0
00000100:00100000:0.0:1767318911.994759:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318911.994912:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379624960
00000100:00100000:1.0:1767318911.994924:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379624960
00000100:00100000:1.0:1767318911.995013:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929
00000100:00100000:1.0:1767318911.995023:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379624960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318911.995119:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379624960:12345-0@lo:400:kworker.0 Request processed in 97us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318911.995128:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929
00000100:00080000:2.0:1767318911.995253:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318911.999002:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379624960:0@lo:400:kworker.0
00010000:00010000:2.0:1767318912.476683:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318912.915459:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767318912.915527:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291887616 offset 0 length 520: 4
00000100:00100000:0.0:1767318912.915551:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318912.916231:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291887872
00000100:00100000:1.0:1767318912.916246:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291887872
00000100:00100000:1.0:1767318912.916344:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291887744
00000100:00100000:1.0:1767318912.916349:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291887744
00000100:00100000:1.0:1767318912.916377:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3930
00000100:00100000:1.0:1767318912.916389:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291887872:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318912.916523:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291887872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 135us (1079us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318912.916532:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3930
00000100:00100000:1.0:1767318912.916561:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16543
00000100:00100000:1.0:1767318912.916567:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291887744:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318912.916595:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318912.916628:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291887744:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (1075us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318912.916635:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16543
00000100:00080000:3.0:1767318912.921023:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318913.495423:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318913.495649:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379625472:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318913.495769:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318913.495959:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379625472
00000100:00100000:2.0:1767318913.495972:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379625472
00000100:00100000:2.0:1767318913.496069:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081
00000100:00100000:2.0:1767318913.496081:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379625472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318913.496124:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318913.496182:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379625472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (413us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318913.496191:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081
00000100:00080000:3.0:1767318913.496425:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318913.496533:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379625472:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318914.519159:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318915.543325:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318916.119140:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318891/real 1767318891]  req@ffff8b0f08e9d880 x1853164379619584/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767318916.119186:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f08e9d880 x1853164379619584/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767318916.119212:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318916.119249:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767318916.119255:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379619584:0@lo:250:kworker.0
00000100:00080000:0.0:1767318916.119471:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318916.119479:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318916.119483:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318916.119489:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3793
00000100:00080000:0.0:1767318916.119494:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318916.119502:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318916.119548:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905500 x1853164379625600/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318916.119580:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318916.119584:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318916.119586:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318916.119590:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3814
00000100:00080000:0.0:1767318916.119593:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318916.119597:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318916.119617:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379625728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318916.119626:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318916.119630:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318916.119632:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318916.119636:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3814
00000100:00080000:0.0:1767318916.119639:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318916.119643:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318916.119678:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907480 x1853164379625856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318916.119758:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318916.119762:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318916.119764:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318916.119768:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3814
00000100:00080000:0.0:1767318916.119772:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318916.119777:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318916.119789:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906680 x1853164379626368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318916.119805:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318916.119809:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318916.119810:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318916.119814:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3814
00000100:00080000:0.0:1767318916.119817:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318916.119821:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318916.119833:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905c00 x1853164379626624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318916.119893:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379626240:0@lo:400:kworker.0
00000100:00100000:0.0:1767318916.119984:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318916.120054:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767318916.120060:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379626496:0@lo:400:kworker.0
00000100:00100000:0.0:1767318916.120086:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318916.120123:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379626240
00000100:00100000:0.0:1767318916.120142:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379626240
00000100:00100000:0.0:1767318916.120201:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379626496
00000100:00100000:0.0:1767318916.120205:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379626496
00000100:00100000:0.0:1767318916.120232:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931
00000100:00100000:0.0:1767318916.120242:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379626240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318916.120305:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379626240:12345-0@lo:400:kworker.0 Request processed in 63us (319us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318916.120433:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932
00000100:00100000:1.0:1767318916.120445:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379626496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120497:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379626496:12345-0@lo:400:kworker.0 Request processed in 55us (409us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318916.120505:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932
00000100:00100000:1.0:1767318916.120547:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379625984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120582:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318916.120611:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318916.120616:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379626112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120639:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318916.120666:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379625984
00000100:00100000:1.0:1767318916.120669:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379625984
00000100:00100000:1.0:1767318916.120700:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379626112
00000100:00100000:1.0:1767318916.120703:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379626112
00000100:00100000:1.0:1767318916.120725:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329
00000100:00100000:1.0:1767318916.120732:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379625984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120768:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379625984:12345-0@lo:400:kworker.0 Request processed in 36us (185us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318916.120775:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329
00000100:00100000:1.0:1767318916.120792:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330
00000100:00100000:1.0:1767318916.120798:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379626112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120825:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379626112:12345-0@lo:400:kworker.0 Request processed in 26us (185us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318916.120831:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330
00000100:00100000:1.0:1767318916.120899:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379626112:0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120912:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379625984:0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120967:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379626496:0@lo:400:kworker.0
00000100:00100000:1.0:1767318916.120978:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379626240:0@lo:400:kworker.0
00000100:00080000:3.0:1767318916.121067:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318916.121073:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318916.121076:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318916.121183:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379625600:0@lo:250:kworker.0
00000400:00000100:2.0:1767318916.121217:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379625600 offset 0 length 520: 4
00000100:00100000:2.0:1767318916.121238:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379625728:0@lo:38:kworker.0
00000100:00100000:2.0:1767318916.121262:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318916.121287:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379625856:0@lo:38:kworker.0
00000100:00100000:2.0:1767318916.121323:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318916.121340:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379626368:0@lo:38:kworker.0
00000100:00100000:2.0:1767318916.121361:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318916.121392:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379626624:0@lo:38:kworker.0
00000100:00100000:2.0:1767318916.121416:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318916.121445:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379625728
00000100:00100000:2.0:1767318916.121449:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379625728
00000100:00100000:2.0:1767318916.121473:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379626368
00000100:00100000:2.0:1767318916.121476:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379626368
00000100:00100000:2.0:1767318916.121490:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379626624
00000100:00100000:2.0:1767318916.121493:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379626624
00000100:00100000:2.0:1767318916.121503:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16544
00000100:00100000:2.0:1767318916.121508:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379625728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318916.121531:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318916.121572:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379625728:12345-0@lo:38:kworker.0 Request processed in 61us (307us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318916.121579:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16544
00000100:00100000:2.0:1767318916.121594:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16545
00000100:00100000:2.0:1767318916.121598:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379626368:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318916.121608:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318916.121628:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379626368:12345-0@lo:38:kworker.0 Request processed in 30us (266us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318916.121634:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16545
00000100:00100000:2.0:1767318916.121644:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16546
00000100:00100000:2.0:1767318916.121648:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379626624:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318916.121655:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318916.121676:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379626624:12345-0@lo:38:kworker.0 Request processed in 26us (259us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318916.121682:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16546
00000100:00080000:2.0:1767318916.121719:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318916.121725:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318916.121728:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379625728:0@lo:38:kworker.0
00000100:00080000:2.0:1767318916.121738:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318916.121741:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318916.121744:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379626368:0@lo:38:kworker.0
00000100:00080000:2.0:1767318916.121751:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318916.121755:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318916.121757:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379626624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318916.121883:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931
00000100:00100000:1.0:1767318916.122571:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379625856
00000100:00100000:1.0:1767318916.122580:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379625856
00000100:00100000:1.0:1767318916.122626:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898
00000100:00100000:1.0:1767318916.122633:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379625856:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318916.122647:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318916.122705:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379625856:12345-0@lo:38:kworker.0 Request processed in 72us (1381us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318916.122711:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898
00000100:00080000:2.0:1767318916.122912:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318916.122918:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318916.122921:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379625856:0@lo:38:kworker.0
00010000:00010000:2.0:1767318916.568000:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318917.079693:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318917.079735:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379626752:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318917.079851:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318917.080648:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379626752
00000100:00100000:2.0:1767318917.080663:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379626752
00000100:00100000:2.0:1767318917.080755:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082
00000100:00100000:2.0:1767318917.080767:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379626752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318917.080819:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318917.080934:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379626752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (1082us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318917.080944:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082
00000100:00100000:3.0:1767318917.081067:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379626752:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318917.595262:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318918.037269:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318918.037323:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318918.038578:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888128
00000100:00100000:0.0:1767318918.038595:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888128
00000100:00100000:0.0:1767318918.038702:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888000
00000100:00100000:0.0:1767318918.038706:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888000
00000100:00100000:0.0:1767318918.038733:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3933
00000100:00100000:0.0:1767318918.038746:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291888128:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318918.038847:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16547
00000100:00100000:0.0:1767318918.038852:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291888128:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (1595us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318918.038860:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291888000:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:0.0:1767318918.038908:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3933
00010000:00020000:2.0:1767318918.038931:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318918.038981:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291888000:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 123us (1656us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318918.038989:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16547
00000100:00080000:1.0:1767318918.039442:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318918.615152:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318918.615194:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379626880:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318918.615302:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318918.615396:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318918.615467:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379626880
00000100:00100000:0.0:1767318918.615478:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379626880
00000100:00100000:0.0:1767318918.615561:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083
00000100:00100000:0.0:1767318918.615573:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379626880:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767318918.615599:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:0.0:1767318918.615612:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318918.615678:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379626880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (282us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318918.615686:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083
00000100:00100000:1.0:1767318918.617327:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379626880:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318919.639114:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318920.663268:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318921.175221:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318921.175232:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318921.175236:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318921.175241:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318921.175246:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318921.175257:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3818
00000100:00080000:2.0:1767318921.175262:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318921.175271:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318921.175337:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330380 x1853164379627008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318921.175376:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318921.175379:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318921.175381:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318921.175385:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3818
00000100:00080000:2.0:1767318921.175388:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318921.175391:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318921.175407:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379627136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318921.175455:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318921.175458:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318921.175459:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318921.175462:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3818
00000100:00080000:2.0:1767318921.175465:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318921.175467:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318921.175475:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330000 x1853164379627648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318921.175490:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318921.175493:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318921.175494:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318921.175497:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3818
00000100:00080000:2.0:1767318921.175498:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318921.175501:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318921.175507:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc000 x1853164379627904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318921.175679:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379627392:0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.175766:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318921.175839:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318921.175843:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379627264:0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.175861:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318921.175908:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379627520:0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.175927:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318921.175941:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767318921.175944:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379627776:0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.175957:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318921.175981:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627392
00000100:00100000:2.0:1767318921.175988:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627392
00000100:00100000:2.0:1767318921.176033:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627264
00000100:00100000:2.0:1767318921.176035:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627264
00000100:00100000:2.0:1767318921.176049:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331
00000100:00100000:2.0:1767318921.176056:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379627392:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.176101:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379627392:12345-0@lo:400:kworker.0 Request processed in 45us (335us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318921.176107:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331
00000100:00100000:2.0:1767318921.176121:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332
00000100:00100000:2.0:1767318921.176124:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379627264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.176140:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379627264:12345-0@lo:400:kworker.0 Request processed in 16us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318921.176144:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332
00000100:00100000:2.0:1767318921.176157:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627520
00000100:00100000:2.0:1767318921.176159:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627520
00000100:00100000:2.0:1767318921.176178:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627776
00000100:00100000:2.0:1767318921.176180:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627776
00000100:00100000:2.0:1767318921.176190:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934
00000100:00100000:2.0:1767318921.176194:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379627520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.176215:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379627520:12345-0@lo:400:kworker.0 Request processed in 21us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318921.176218:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934
00000100:00100000:2.0:1767318921.176228:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935
00000100:00100000:2.0:1767318921.176234:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379627776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.176256:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379627776:12345-0@lo:400:kworker.0 Request processed in 23us (297us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318921.176266:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935
00000100:00100000:2.0:1767318921.176311:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379627776:0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.176335:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379627520:0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.176369:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379627264:0@lo:400:kworker.0
00000100:00100000:2.0:1767318921.176378:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379627392:0@lo:400:kworker.0
00000100:00080000:1.0:1767318921.176512:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318921.176518:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318921.176520:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318921.176537:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379627008:0@lo:38:kworker.0
00000100:00100000:1.0:1767318921.176563:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318921.176584:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379627136:0@lo:38:kworker.0
00000100:00100000:1.0:1767318921.176603:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318921.176625:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379627648:0@lo:38:kworker.0
00000100:00100000:1.0:1767318921.176639:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318921.176649:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379627904:0@lo:38:kworker.0
00000100:00100000:1.0:1767318921.176662:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318921.176680:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627008
00000100:00100000:1.0:1767318921.176682:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627008
00000100:00100000:1.0:1767318921.176699:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627648
00000100:00100000:1.0:1767318921.176701:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627648
00000100:00100000:1.0:1767318921.176709:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627904
00000100:00100000:1.0:1767318921.176711:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627904
00000100:00100000:1.0:1767318921.176717:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16548
00000100:00100000:1.0:1767318921.176721:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379627008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318921.176740:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318921.176775:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379627008:12345-0@lo:38:kworker.0 Request processed in 52us (210us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318921.176781:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16548
00000100:00100000:1.0:1767318921.176799:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16549
00000100:00100000:1.0:1767318921.176803:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379627648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318921.176812:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318921.176830:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379627648:12345-0@lo:38:kworker.0 Request processed in 27us (190us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318921.176834:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16549
00000100:00100000:1.0:1767318921.176842:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16550
00000100:00100000:1.0:1767318921.176844:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379627904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318921.176850:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318921.176864:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379627904:12345-0@lo:38:kworker.0 Request processed in 18us (201us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318921.176891:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16550
00000100:00080000:1.0:1767318921.176916:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318921.176920:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318921.176923:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379627008:0@lo:38:kworker.0
00000100:00080000:1.0:1767318921.176927:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318921.176930:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318921.176932:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379627648:0@lo:38:kworker.0
00000100:00080000:1.0:1767318921.176936:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318921.176938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318921.176940:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379627904:0@lo:38:kworker.0
00000100:00100000:2.0:1767318921.177456:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379627136
00000100:00100000:2.0:1767318921.177463:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379627136
00000100:00100000:2.0:1767318921.177496:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899
00000100:00100000:2.0:1767318921.177501:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379627136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318921.177512:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318921.177567:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379627136:12345-0@lo:38:kworker.0 Request processed in 64us (961us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318921.177573:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899
00000100:00080000:3.0:1767318921.177593:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318921.177597:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318921.177601:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379627136:0@lo:38:kworker.0
00010000:00010000:2.0:1767318921.687397:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318922.199725:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318922.199753:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379628032:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318922.199854:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318922.202932:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628032
00000100:00100000:3.0:1767318922.202955:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628032
00000100:00100000:3.0:1767318922.203056:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084
00000100:00100000:3.0:1767318922.203069:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379628032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767318922.203116:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318922.203245:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379628032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 178us (3390us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318922.203254:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084
00000100:00100000:2.0:1767318922.203565:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379628032:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318922.711954:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318923.150838:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318923.150991:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888256
00000100:00100000:3.0:1767318923.151003:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888256
00000100:00100000:3.0:1767318923.151054:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16551
00000100:00100000:3.0:1767318923.151062:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291888256:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318923.151088:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318923.151178:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291888256:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 115us (352us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318923.151184:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16551
00000100:00100000:1.0:1767318923.151631:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318923.152666:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888384
00000100:00100000:0.0:1767318923.152702:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888384
00000100:00100000:0.0:1767318923.152809:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3936
00000100:00100000:0.0:1767318923.152821:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291888384:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318923.152944:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291888384:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 125us (1314us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318923.152953:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3936
00000100:00080000:2.0:1767318923.153293:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318923.735346:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318923.735381:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379628160:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318923.735493:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318923.736015:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628160
00000100:00100000:0.0:1767318923.736027:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628160
00000100:00080000:2.0:1767318923.736111:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318923.739355:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085
00000100:00100000:0.0:1767318923.739392:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379628160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318923.739447:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318923.740240:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379628160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 868us (4744us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318923.740250:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085
00000100:00100000:1.0:1767318923.740599:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379628160:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318923.742966:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318924.762805:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318925.783529:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318926.295203:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318926.295219:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318926.295223:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318926.295228:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318926.295235:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318926.295246:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3823
00000100:00080000:2.0:1767318926.295252:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318926.295260:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318926.295326:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff800 x1853164379628288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318926.295355:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318926.295359:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318926.295361:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318926.295366:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3823
00000100:00080000:2.0:1767318926.295368:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318926.295372:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318926.295383:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafed80 x1853164379628416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318926.295441:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318926.295444:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318926.295446:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318926.295449:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3823
00000100:00080000:2.0:1767318926.295452:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318926.295454:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318926.295463:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafea00 x1853164379628928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318926.295478:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318926.295481:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318926.295483:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318926.295486:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3823
00000100:00080000:2.0:1767318926.295488:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318926.295492:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318926.295499:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd880 x1853164379629184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318926.295534:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379629056:0@lo:400:kworker.0
00000100:00100000:2.0:1767318926.295617:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318926.295687:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318926.295692:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379628800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318926.295710:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318926.295787:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379628288:0@lo:38:kworker.0
00000100:00100000:1.0:1767318926.295822:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318926.295855:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379628416:0@lo:38:kworker.0
00000100:00100000:1.0:1767318926.295901:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318926.295922:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379628928:0@lo:38:kworker.0
00000100:00100000:1.0:1767318926.295939:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318926.295952:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379629184:0@lo:38:kworker.0
00000100:00100000:1.0:1767318926.295969:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318926.296002:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628416
00000100:00100000:1.0:1767318926.296011:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628416
00000100:00100000:1.0:1767318926.296055:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900
00000100:00100000:1.0:1767318926.296065:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379628416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318926.296091:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318926.296135:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379628416:12345-0@lo:38:kworker.0 Request processed in 70us (232us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318926.296142:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900
00000100:00100000:1.0:1767318926.296173:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629056
00000100:00100000:1.0:1767318926.296176:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629056
00000100:00100000:1.0:1767318926.296215:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628800
00000100:00100000:1.0:1767318926.296217:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628800
00000100:00100000:1.0:1767318926.296231:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628288
00000100:00100000:1.0:1767318926.296232:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628288
00000100:00100000:1.0:1767318926.296240:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628928
00000100:00100000:1.0:1767318926.296242:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628928
00000100:00100000:1.0:1767318926.296248:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629184
00000100:00100000:1.0:1767318926.296250:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629184
00000100:00100000:1.0:1767318926.296258:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937
00000100:00100000:1.0:1767318926.296263:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379629056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318926.296317:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379629056:12345-0@lo:400:kworker.0 Request processed in 53us (700us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318926.296323:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937
00000100:00100000:1.0:1767318926.296336:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938
00000100:00100000:1.0:1767318926.296341:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379628800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318926.296362:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379628800:12345-0@lo:400:kworker.0 Request processed in 21us (651us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318926.296367:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938
00000100:00100000:1.0:1767318926.296376:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16552
00000100:00100000:1.0:1767318926.296380:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379628288:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318926.296390:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318926.296406:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379628288:12345-0@lo:38:kworker.0 Request processed in 25us (584us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318926.296412:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16552
00000100:00100000:1.0:1767318926.296421:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16553
00000100:00100000:1.0:1767318926.296424:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379628928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318926.296434:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318926.296450:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379628928:12345-0@lo:38:kworker.0 Request processed in 25us (510us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318926.296455:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16553
00000100:00100000:1.0:1767318926.296463:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16554
00000100:00100000:1.0:1767318926.296466:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379629184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318926.296474:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318926.296489:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379629184:12345-0@lo:38:kworker.0 Request processed in 21us (519us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318926.296494:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16554
00000100:00080000:1.0:1767318926.296537:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318926.296542:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318926.296546:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379628288:0@lo:38:kworker.0
00000100:00080000:1.0:1767318926.296554:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318926.296557:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318926.296560:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379628416:0@lo:38:kworker.0
00000100:00080000:1.0:1767318926.296566:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318926.296569:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318926.296572:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379628928:0@lo:38:kworker.0
00000100:00080000:1.0:1767318926.296578:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318926.296581:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318926.296583:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379629184:0@lo:38:kworker.0
00000100:00100000:0.0:1767318926.297112:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379628672:0@lo:400:kworker.0
00000100:00100000:0.0:1767318926.297172:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318926.297217:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318926.297223:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379628544:0@lo:400:kworker.0
00000100:00100000:0.0:1767318926.297242:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318926.297290:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628672
00000100:00100000:0.0:1767318926.297296:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628672
00000100:00100000:0.0:1767318926.297334:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379628544
00000100:00100000:0.0:1767318926.297336:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379628544
00000100:00100000:0.0:1767318926.297357:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333
00000100:00100000:0.0:1767318926.297363:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379628672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318926.297401:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379628672:12345-0@lo:400:kworker.0 Request processed in 38us (229us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318926.297426:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333
00000100:00100000:0.0:1767318926.297440:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334
00000100:00100000:0.0:1767318926.297445:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379628544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318926.297467:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379628544:12345-0@lo:400:kworker.0 Request processed in 22us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318926.297472:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334
00000100:00100000:0.0:1767318926.297507:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379628544:0@lo:400:kworker.0
00000100:00100000:0.0:1767318926.297515:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379628672:0@lo:400:kworker.0
00000100:00080000:2.0:1767318926.297957:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318926.297963:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767318926.297966:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318926.297994:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379628800:0@lo:400:kworker.0
00000100:00100000:2.0:1767318926.298007:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379629056:0@lo:400:kworker.0
00010000:00010000:0.0:1767318926.807158:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318927.322909:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379629312:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318927.323021:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318927.323301:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629312
00000100:00100000:2.0:1767318927.323313:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629312
00000100:00100000:2.0:1767318927.323387:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086
00000100:00100000:2.0:1767318927.323398:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379629312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318927.323438:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318927.323940:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379629312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 542us (917us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318927.323950:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086
00000100:00100000:3.0:1767318927.324130:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379629312:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318927.836211:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318928.282056:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318928.282168:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318928.282421:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888640
00000100:00100000:2.0:1767318928.282436:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888640
00000100:00100000:2.0:1767318928.282545:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888512
00000100:00100000:2.0:1767318928.282549:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888512
00000100:00100000:2.0:1767318928.282574:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3939
00000100:00100000:2.0:1767318928.282587:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291888640:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318928.282688:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291888640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (649us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318928.282697:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3939
00000100:00100000:2.0:1767318928.282719:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16555
00000100:00100000:2.0:1767318928.282724:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291888512:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318928.282764:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318928.282799:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291888512:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 72us (630us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318928.282806:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16555
00000100:00080000:0.0:1767318928.282957:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318928.855998:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318928.856213:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379629440:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318928.856492:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318928.858182:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629440
00000100:00100000:2.0:1767318928.858200:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629440
00000100:00100000:2.0:1767318928.858326:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087
00000100:00100000:2.0:1767318928.858338:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379629440:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318928.858369:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:2.0:1767318928.858386:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318928.858489:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379629440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (1998us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318928.858501:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087
00000100:00100000:0.0:1767318928.858763:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379629440:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318929.881418:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318930.903129:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318931.415066:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318931.415082:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318931.415086:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318931.415091:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318931.415097:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318931.415108:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3828
00000100:00080000:2.0:1767318931.415115:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318931.415124:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318931.415185:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baffb80 x1853164379629568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318931.415389:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318931.415394:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318931.415396:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318931.415402:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3828
00000100:00080000:2.0:1767318931.415404:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318931.415409:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318931.415433:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc700 x1853164379629696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318931.415509:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318931.415513:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318931.415515:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318931.415518:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3828
00000100:00080000:2.0:1767318931.415522:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318931.415526:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318931.415538:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafea00 x1853164379630208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318931.415555:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318931.415559:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318931.415560:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318931.415564:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3828
00000100:00080000:2.0:1767318931.415566:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318931.415570:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318931.415580:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff800 x1853164379630464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318931.415696:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379629824:0@lo:400:kworker.0
00000100:00100000:3.0:1767318931.415812:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318931.415953:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318931.415960:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379629952:0@lo:400:kworker.0
00000100:00100000:3.0:1767318931.415987:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318931.416131:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629824
00000100:00100000:2.0:1767318931.416142:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629824
00000100:00100000:1.0:1767318931.416302:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379629568:0@lo:38:kworker.0
00000100:00100000:2.0:1767318931.416347:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629952
00000100:00100000:2.0:1767318931.416352:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629952
00000100:00100000:1.0:1767318931.416364:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318931.416476:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335
00000100:00100000:0.0:1767318931.416490:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379629824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318931.416575:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379629824:12345-0@lo:400:kworker.0 Request processed in 89us (763us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318931.416583:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335
00000100:00100000:0.0:1767318931.416628:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379630080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318931.416693:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379630336:0@lo:400:kworker.0
00000100:00100000:0.0:1767318931.416763:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379629824:0@lo:400:kworker.0
00000100:00100000:1.0:1767318931.417295:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379629696:0@lo:38:kworker.0
00000100:00100000:1.0:1767318931.417345:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318931.417374:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379630208:0@lo:38:kworker.0
00000100:00100000:1.0:1767318931.417403:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318931.417422:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379630464:0@lo:38:kworker.0
00000100:00100000:1.0:1767318931.417446:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318931.417486:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629696
00000100:00100000:1.0:1767318931.417492:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629696
00000100:00100000:1.0:1767318931.417524:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901
00000100:00100000:1.0:1767318931.417531:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379629696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318931.417558:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318931.417603:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379629696:12345-0@lo:38:kworker.0 Request processed in 70us (258us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318931.417611:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901
00000100:00100000:1.0:1767318931.417640:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379629568
00000100:00100000:1.0:1767318931.417645:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379629568
00000100:00100000:1.0:1767318931.417668:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630208
00000100:00100000:1.0:1767318931.417672:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630208
00000100:00100000:1.0:1767318931.417688:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630464
00000100:00100000:1.0:1767318931.417691:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630464
00000100:00100000:1.0:1767318931.417708:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16556
00000100:00100000:1.0:1767318931.417713:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379629568:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318931.417725:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318931.417755:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379629568:12345-0@lo:38:kworker.0 Request processed in 41us (1393us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318931.417761:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16556
00000100:00100000:1.0:1767318931.417773:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16557
00000100:00100000:1.0:1767318931.417777:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379630208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318931.417786:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318931.417810:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379630208:12345-0@lo:38:kworker.0 Request processed in 31us (406us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318931.417816:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16557
00000100:00100000:1.0:1767318931.417828:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16558
00000100:00100000:1.0:1767318931.417832:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379630464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318931.417841:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318931.417863:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379630464:12345-0@lo:38:kworker.0 Request processed in 29us (417us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318931.417895:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16558
00000100:00100000:1.0:1767318931.417934:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318931.417970:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630080
00000100:00100000:1.0:1767318931.417974:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630080
00000100:00080000:3.0:1767318931.424345:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318931.424365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318931.424369:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318931.424417:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318931.424524:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630336
00000100:00100000:0.0:1767318931.424556:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630336
00000100:00100000:0.0:1767318931.424645:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940
00000100:00100000:0.0:1767318931.424657:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379630336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318931.424763:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379630336:12345-0@lo:400:kworker.0 Request processed in 109us (353us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318931.424770:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940
00000100:00100000:0.0:1767318931.424834:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379630336:0@lo:400:kworker.0
00000100:00080000:0.0:1767318931.424909:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318931.424916:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318931.424920:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379629568:0@lo:38:kworker.0
00000100:00080000:0.0:1767318931.424934:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318931.424938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318931.424941:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379629696:0@lo:38:kworker.0
00000100:00080000:0.0:1767318931.424951:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318931.424955:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318931.424958:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379630208:0@lo:38:kworker.0
00000100:00080000:0.0:1767318931.424969:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318931.424973:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318931.424976:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379630464:0@lo:38:kworker.0
00000100:00080000:3.0:1767318931.425785:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318931.429347:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336
00000100:00100000:2.0:1767318931.429382:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379629952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318931.429586:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379629952:12345-0@lo:400:kworker.0 Request processed in 212us (13589us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318931.429684:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379629952:0@lo:400:kworker.0
00000100:00100000:2.0:1767318931.432093:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336
00000100:00100000:1.0:1767318931.435622:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941
00000100:00100000:1.0:1767318931.435646:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379630080:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318931.435783:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379630080:12345-0@lo:400:kworker.0 Request processed in 148us (17847us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318931.435791:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941
00000100:00100000:3.0:1767318931.435917:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379630080:0@lo:400:kworker.0
00010000:00010000:2.0:1767318931.927135:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318932.440955:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318932.440988:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379630592:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318932.441105:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318932.441328:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630592
00000100:00100000:1.0:1767318932.441340:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630592
00000100:00100000:1.0:1767318932.441418:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088
00000100:00100000:1.0:1767318932.441430:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379630592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318932.441472:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318932.441531:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379630592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (425us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318932.441540:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088
00000100:00100000:2.0:1767318932.441841:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379630592:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318932.951293:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318933.390990:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318933.391113:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888896
00000100:00100000:1.0:1767318933.391126:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888896
00000100:00100000:1.0:1767318933.391257:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3942
00000100:00100000:1.0:1767318933.391271:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291888896:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318933.391380:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291888896:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (405us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318933.391390:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3942
00000100:00080000:3.0:1767318933.391930:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318933.395299:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318933.395483:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291888768
00000100:00100000:2.0:1767318933.395494:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291888768
00000100:00100000:2.0:1767318933.395551:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16559
00000100:00100000:2.0:1767318933.395559:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291888768:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318933.395586:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318933.395674:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291888768:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 116us (390us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318933.395680:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16559
00010000:00010000:2.0:1767318933.975222:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318933.975655:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379630720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318933.975771:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318933.975908:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630720
00000100:00100000:0.0:1767318933.975919:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630720
00000100:00100000:0.0:1767318933.976011:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089
00000100:00100000:0.0:1767318933.976021:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379630720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318933.976097:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767318933.976164:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318933.976683:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379630720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 661us (909us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318933.976693:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089
00000100:00100000:2.0:1767318933.976856:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379630720:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318934.999096:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318936.023809:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318936.536123:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318936.536141:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318936.536145:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318936.536149:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318936.536156:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318936.536166:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3833
00000100:00080000:0.0:1767318936.536172:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318936.536190:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318936.536253:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7800 x1853164379630848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318936.536289:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318936.536293:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318936.536295:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318936.536300:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3833
00000100:00080000:0.0:1767318936.536303:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318936.536307:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318936.536322:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4380 x1853164379630976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318936.536398:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318936.536420:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318936.536423:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318936.536427:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3833
00000100:00080000:0.0:1767318936.536430:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318936.536434:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318936.536446:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4e00 x1853164379631488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318936.536462:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318936.536466:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318936.536468:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318936.536471:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3833
00000100:00080000:0.0:1767318936.536474:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318936.536478:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318936.536487:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5c00 x1853164379631744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318936.536533:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379631232:0@lo:400:kworker.0
00000100:00100000:0.0:1767318936.536631:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318936.536716:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318936.536723:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379631104:0@lo:400:kworker.0
00000100:00100000:0.0:1767318936.536747:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318936.536776:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379631616:0@lo:400:kworker.0
00000100:00100000:0.0:1767318936.536805:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318936.536824:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318936.536830:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379631360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318936.536852:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318936.537033:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379631232
00000100:00100000:2.0:1767318936.537043:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379631232
00000100:00100000:2.0:1767318936.537110:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379631104
00000100:00100000:2.0:1767318936.537113:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379631104
00000100:00100000:2.0:1767318936.537142:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337
00000100:00100000:2.0:1767318936.537152:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379631232:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318936.537228:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379631232:12345-0@lo:400:kworker.0 Request processed in 77us (597us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318936.537237:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337
00000100:00100000:2.0:1767318936.537256:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338
00000100:00100000:2.0:1767318936.537263:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379631104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318936.537293:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379631104:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318936.537299:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338
00000100:00100000:2.0:1767318936.537320:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379631616
00000100:00100000:2.0:1767318936.537324:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379631616
00000100:00100000:2.0:1767318936.537353:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379631360
00000100:00100000:2.0:1767318936.537356:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379631360
00000100:00100000:2.0:1767318936.537378:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943
00000100:00100000:2.0:1767318936.537385:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379631616:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318936.537415:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379631616:12345-0@lo:400:kworker.0 Request processed in 31us (609us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318936.537421:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943
00000100:00100000:2.0:1767318936.537432:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944
00000100:00100000:2.0:1767318936.537437:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379631360:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318936.537459:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379631360:12345-0@lo:400:kworker.0 Request processed in 22us (607us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318936.537464:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944
00000100:00100000:2.0:1767318936.537515:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379631104:0@lo:400:kworker.0
00000100:00100000:2.0:1767318936.537525:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379631232:0@lo:400:kworker.0
00000100:00080000:1.0:1767318936.538118:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318936.538126:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318936.538128:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318936.538146:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379630848:0@lo:38:kworker.0
00000100:00100000:1.0:1767318936.538199:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318936.538236:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379630976:0@lo:38:kworker.0
00000100:00100000:1.0:1767318936.538263:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318936.538301:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379631488:0@lo:38:kworker.0
00000100:00100000:1.0:1767318936.538323:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318936.538343:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379631744:0@lo:38:kworker.0
00000100:00100000:1.0:1767318936.538372:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318936.538402:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630848
00000100:00100000:1.0:1767318936.538407:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630848
00000100:00100000:1.0:1767318936.538433:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379631488
00000100:00100000:1.0:1767318936.538436:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379631488
00000100:00100000:1.0:1767318936.538449:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379631744
00000100:00100000:1.0:1767318936.538451:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379631744
00000100:00100000:1.0:1767318936.538466:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16560
00000100:00100000:1.0:1767318936.538472:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379630848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318936.538495:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318936.538530:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379630848:12345-0@lo:38:kworker.0 Request processed in 56us (331us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318936.538536:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16560
00000100:00100000:1.0:1767318936.538553:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16561
00000100:00100000:1.0:1767318936.538557:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379631488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318936.538565:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318936.538585:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379631488:12345-0@lo:38:kworker.0 Request processed in 26us (260us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318936.538590:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16561
00000100:00100000:1.0:1767318936.538599:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16562
00000100:00100000:1.0:1767318936.538603:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379631744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318936.538611:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318936.538628:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379631744:12345-0@lo:38:kworker.0 Request processed in 24us (256us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318936.538633:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16562
00000100:00080000:1.0:1767318936.538681:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318936.538687:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318936.538690:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379630848:0@lo:38:kworker.0
00000100:00080000:1.0:1767318936.538700:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318936.538704:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318936.538707:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379631488:0@lo:38:kworker.0
00000100:00080000:1.0:1767318936.538714:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318936.538717:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318936.538720:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379631744:0@lo:38:kworker.0
00000100:00100000:3.0:1767318936.538810:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379630976
00000100:00100000:3.0:1767318936.538815:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379630976
00000100:00100000:3.0:1767318936.538845:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902
00000100:00100000:3.0:1767318936.538850:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379630976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318936.538859:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318936.538928:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379630976:12345-0@lo:38:kworker.0 Request processed in 77us (663us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318936.538933:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902
00000100:00080000:3.0:1767318936.538955:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318936.538958:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318936.538961:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379630976:0@lo:38:kworker.0
00000100:00100000:0.0:1767318936.540136:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379631360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318936.540155:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379631616:0@lo:400:kworker.0
00010000:00010000:2.0:1767318937.047461:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318937.488154:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767318937.488369:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291889024 offset 0 length 520: 4
00000100:00100000:3.0:1767318937.488392:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318937.488486:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291889280
00000100:00100000:2.0:1767318937.488499:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291889280
00000100:00080000:3.0:1767318937.488554:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318937.488574:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291889152
00000100:00100000:2.0:1767318937.488577:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291889152
00000100:00100000:2.0:1767318937.488600:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3945
00000100:00100000:2.0:1767318937.488609:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291889280:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318937.488688:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291889280:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (551us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318937.488695:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3945
00000100:00100000:2.0:1767318937.488710:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16563
00000100:00100000:2.0:1767318937.488713:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291889152:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318937.488733:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318937.488751:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291889152:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 37us (358us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318937.488755:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16563
00000100:00100000:1.0:1767318937.559768:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379631872:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318937.559965:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318937.560587:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379631872
00000100:00100000:2.0:1767318937.560600:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379631872
00000100:00100000:2.0:1767318937.560794:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090
00000100:00100000:2.0:1767318937.560803:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379631872:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318937.560847:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318937.560939:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379631872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (974us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318937.560949:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090
00000100:00100000:3.0:1767318937.561037:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379631872:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318938.071254:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318939.095117:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318939.096278:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379632000:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318939.096388:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318939.096632:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632000
00000100:00100000:3.0:1767318939.096643:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632000
00000100:00100000:3.0:1767318939.096725:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091
00000100:00100000:3.0:1767318939.096736:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379632000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318939.096954:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767318939.097081:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379632000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 347us (692us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318939.097090:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091
00000100:00080000:2.0:1767318939.097442:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318939.097495:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379632000:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318940.119135:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318941.143126:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318941.656513:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318941.656529:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318941.656533:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318941.656538:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318941.656543:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318941.656553:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3838
00000100:00080000:2.0:1767318941.656559:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318941.656568:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318941.656620:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafea00 x1853164379632128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318941.656655:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318941.656659:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318941.656661:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318941.656665:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3838
00000100:00080000:2.0:1767318941.656668:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318941.656673:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318941.656687:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc700 x1853164379632256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318941.656729:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318916/real 1767318916]  req@ffff8b0f10905500 x1853164379625600/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318941 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318941.656763:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318941.656768:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1767318941.656770:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f10905500 x1853164379625600/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318941 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318941.656772:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318941.656784:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3838
00000100:00080000:2.0:1767318941.656798:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318941.656805:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318941.656816:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379632512:0@lo:400:kworker.0
00000100:00100000:2.0:1767318941.656825:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379632768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318941.656826:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379632128:0@lo:38:kworker.0
00000100:00080000:2.0:1767318941.656926:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318941.656932:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318941.656936:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318941.656943:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3838
00000100:00080000:2.0:1767318941.656946:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318941.656951:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318941.656968:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330380 x1853164379633024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318941.657003:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379632896:0@lo:400:kworker.0
00000100:00100000:1.0:1767318941.657044:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379632640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318941.664218:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318941.664591:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318941.664612:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379632384:0@lo:400:kworker.0
00000100:00100000:0.0:1767318941.664788:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318941.664852:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318941.665686:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379632256:0@lo:38:kworker.0
00000100:00100000:2.0:1767318941.667010:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318941.667148:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632512
00000100:00100000:2.0:1767318941.667160:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632512
00000100:00100000:2.0:1767318941.667233:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632384
00000100:00100000:2.0:1767318941.667235:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632384
00000100:00100000:2.0:1767318941.667259:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339
00000100:00100000:2.0:1767318941.667474:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379632512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318941.667616:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379632512:12345-0@lo:400:kworker.0 Request processed in 348us (3417us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318941.667626:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339
00000100:00100000:2.0:1767318941.667649:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340
00000100:00100000:2.0:1767318941.667655:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379632384:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318941.667686:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379632384:12345-0@lo:400:kworker.0 Request processed in 33us (2899us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318941.667691:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340
00000100:00100000:2.0:1767318941.667714:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632128
00000100:00100000:2.0:1767318941.667718:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632128
00000100:00100000:2.0:1767318941.667746:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632896
00000100:00100000:2.0:1767318941.667748:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632896
00000100:00100000:2.0:1767318941.667766:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946
00000100:00100000:2.0:1767318941.667770:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379632896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318941.667860:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318941.667894:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379632896:12345-0@lo:400:kworker.0 Request processed in 122us (892us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318941.667901:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946
00000100:00100000:2.0:1767318941.667914:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16564
00000100:00100000:2.0:1767318941.667918:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379632128:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318941.667946:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318941.667990:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379632128:12345-0@lo:38:kworker.0 Request processed in 70us (3147us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318941.667996:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16564
00000100:00080000:2.0:1767318941.668017:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318941.668023:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318941.668025:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318941.668086:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379632896:0@lo:400:kworker.0
00000100:00100000:2.0:1767318941.668566:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632256
00000100:00100000:2.0:1767318941.668572:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632256
00000100:00100000:2.0:1767318941.668600:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903
00000100:00100000:2.0:1767318941.668607:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379632256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318941.668624:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318941.668630:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318941.668665:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318941.668678:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379632256:12345-0@lo:38:kworker.0 Request processed in 64us (818us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318941.668678:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379625600:0@lo:250:kworker.0
00000100:00100000:2.0:1767318941.668699:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903
00000100:00080000:2.0:1767318941.668738:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318941.668743:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767318941.668747:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318941.668751:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3818
00000100:00080000:2.0:1767318941.668754:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318941.668758:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318941.668784:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330000 x1853164379633152/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318941.668820:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379632768:0@lo:38:kworker.0
00000100:00100000:3.0:1767318941.668910:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318941.668954:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632768
00000100:00100000:2.0:1767318941.668958:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632768
00000100:00100000:2.0:1767318941.668976:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16565
00000100:00100000:2.0:1767318941.668979:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379632768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318941.668989:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318941.669491:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379633024:0@lo:38:kworker.0
00000100:00100000:2.0:1767318941.669562:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379632768:12345-0@lo:38:kworker.0 Request processed in 524us (599us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318941.669568:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16565
00000100:00100000:3.0:1767318941.669664:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318941.669722:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379633024
00000100:00100000:2.0:1767318941.669726:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379633024
00000100:00100000:2.0:1767318941.669744:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16566
00000100:00100000:2.0:1767318941.669748:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379633024:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318941.669757:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767318941.669808:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318941.669830:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318941.669834:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379632128:0@lo:38:kworker.0
00000100:00080000:3.0:1767318941.669851:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318941.669856:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318941.669860:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379632256:0@lo:38:kworker.0
00000100:00100000:2.0:1767318941.669888:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379633024:12345-0@lo:38:kworker.0 Request processed in 117us (203us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318941.669894:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16566
00000100:00100000:3.0:1767318941.669936:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379633152:0@lo:250:kworker.0
00000400:00000100:3.0:1767318941.670622:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379633152 offset 0 length 520: 4
00000100:00080000:3.0:1767318941.670668:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318941.670673:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318941.670676:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379632768:0@lo:38:kworker.0
00000100:00080000:3.0:1767318941.670686:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318941.670689:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318941.670692:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379633024:0@lo:38:kworker.0
00000100:00100000:1.0:1767318941.672376:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318941.672560:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379632640
00000100:00100000:2.0:1767318941.672572:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379632640
00000100:00100000:2.0:1767318941.672990:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947
00000100:00100000:2.0:1767318941.673003:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379632640:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318941.673100:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379632640:12345-0@lo:400:kworker.0 Request processed in 100us (734us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318941.673109:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947
00000100:00080000:3.0:1767318941.673248:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318941.673263:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379632640:0@lo:400:kworker.0
00000100:00100000:0.0:1767318941.677689:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379632384:0@lo:400:kworker.0
00000100:00100000:0.0:1767318941.677716:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379632512:0@lo:400:kworker.0
00010000:00010000:2.0:1767318942.167487:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318942.609439:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318942.609630:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318942.615169:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291889408
00000100:00100000:2.0:1767318942.615204:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291889408
00000100:00100000:2.0:1767318942.615273:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291889536
00000100:00100000:2.0:1767318942.615277:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291889536
00000100:00100000:2.0:1767318942.615358:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3948
00000100:00100000:2.0:1767318942.615370:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291889536:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318942.615659:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291889536:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 290us (6027us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318942.615669:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3948
00000100:00100000:2.0:1767318942.615696:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16567
00000100:00100000:2.0:1767318942.615701:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291889408:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318942.615727:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318942.615758:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291889408:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (6336us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318942.615765:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16567
00000100:00080000:0.0:1767318942.615862:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318942.679410:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767318942.679436:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379633280:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318942.680031:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318942.680367:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379633280
00000100:00100000:0.0:1767318942.680386:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379633280
00000100:00100000:0.0:1767318942.680477:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092
00000100:00100000:0.0:1767318942.680489:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379633280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318942.680531:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318942.680613:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379633280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (584us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318942.680622:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092
00000100:00100000:1.0:1767318942.680800:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379633280:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318943.191062:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318944.215164:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318944.215506:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379633408:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318944.215656:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318944.215712:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379633408
00000100:00100000:3.0:1767318944.215724:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379633408
00000100:00100000:1.0:1767318944.215923:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093
00000100:00100000:1.0:1767318944.215940:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379633408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318944.215979:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318944.216043:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379633408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (386us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318944.216215:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379633408:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767318944.216905:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318944.220419:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093
00010000:00010000:2.0:1767318945.244911:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318946.263241:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318946.775243:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318946.775257:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318946.775261:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318946.775266:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318946.775272:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318946.775282:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3844
00000100:00080000:2.0:1767318946.775288:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318946.775296:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318946.775352:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333b80 x1853164379633536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318946.775426:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379633536:0@lo:38:kworker.0
00000100:00100000:3.0:1767318946.775527:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318946.775691:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379633536
00000100:00100000:0.0:1767318946.775701:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379633536
00000100:00100000:0.0:1767318946.775755:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16568
00000100:00100000:0.0:1767318946.775764:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379633536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318946.775790:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318946.778285:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318946.778298:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318946.778303:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318946.778311:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3844
00000100:00080000:2.0:1767318946.778316:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318946.778324:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318946.778373:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332300 x1853164379633664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318946.778896:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379633664:0@lo:38:kworker.0
00000100:00100000:3.0:1767318946.780162:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318946.780354:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379633664
00000100:00100000:1.0:1767318946.780365:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379633664
00000100:00100000:1.0:1767318946.780423:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904
00000100:00100000:1.0:1767318946.780433:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379633664:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318946.780461:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318946.780531:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379633664:12345-0@lo:38:kworker.0 Request processed in 98us (373us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318946.780539:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904
00000100:00100000:0.0:1767318946.780685:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379633536:12345-0@lo:38:kworker.0 Request processed in 4918us (5155us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318946.780696:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16568
00000100:00080000:2.0:1767318946.782127:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318946.782135:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318946.782139:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318946.782146:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3844
00000100:00080000:2.0:1767318946.782153:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318946.782160:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318946.782188:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729df80 x1853164379634176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318946.782215:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318946.782219:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318946.782220:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318946.782225:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3844
00000100:00080000:2.0:1767318946.782227:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318946.782232:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318946.782246:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ed80 x1853164379634432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318946.782296:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379634048:0@lo:400:kworker.0
00000100:00100000:2.0:1767318946.782368:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318946.782414:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318946.782420:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379634304:0@lo:400:kworker.0
00000100:00100000:2.0:1767318946.782444:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318946.782563:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634048
00000100:00100000:1.0:1767318946.782572:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634048
00000100:00100000:1.0:1767318946.782641:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634304
00000100:00100000:1.0:1767318946.782645:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634304
00000100:00100000:1.0:1767318946.782673:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949
00000100:00100000:1.0:1767318946.782682:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379634048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318946.782735:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379634048:12345-0@lo:400:kworker.0 Request processed in 55us (367us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318946.782741:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949
00000100:00100000:1.0:1767318946.782757:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950
00000100:00100000:1.0:1767318946.782761:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379634304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318946.782775:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379634304:12345-0@lo:400:kworker.0 Request processed in 15us (332us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318946.782779:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950
00000100:00100000:1.0:1767318946.782799:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379633792:0@lo:400:kworker.0
00000100:00100000:1.0:1767318946.782831:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318946.782855:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318946.782861:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379633920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318946.782913:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318946.783110:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318946.783137:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379633792
00000100:00100000:2.0:1767318946.783141:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379633792
00000100:00100000:2.0:1767318946.783226:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379633920
00000100:00100000:2.0:1767318946.783233:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379633920
00000100:00080000:0.0:1767318946.783276:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318946.783280:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318946.783329:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341
00000100:00100000:1.0:1767318946.783339:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379633792:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318946.783381:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379633792:12345-0@lo:400:kworker.0 Request processed in 45us (550us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318946.783388:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341
00000100:00100000:1.0:1767318946.783404:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342
00000100:00100000:1.0:1767318946.783410:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379633920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318946.783437:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379633920:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318946.783442:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342
00000100:00100000:1.0:1767318946.783482:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379633920:0@lo:400:kworker.0
00000100:00100000:1.0:1767318946.783494:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379633792:0@lo:400:kworker.0
00000100:00080000:3.0:1767318946.784039:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318946.784046:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318946.784071:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379633536:0@lo:38:kworker.0
00000100:00100000:3.0:1767318946.784101:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379634176:0@lo:38:kworker.0
00000100:00100000:3.0:1767318946.784139:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318946.784175:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379634432:0@lo:38:kworker.0
00000100:00100000:3.0:1767318946.784194:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318946.784218:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318946.784222:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318946.784225:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379633664:0@lo:38:kworker.0
00000100:00100000:3.0:1767318946.784940:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379634304:0@lo:400:kworker.0
00000100:00100000:3.0:1767318946.784956:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379634048:0@lo:400:kworker.0
00000100:00100000:3.0:1767318946.785039:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634176
00000100:00100000:3.0:1767318946.785045:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634176
00000100:00100000:3.0:1767318946.785075:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634432
00000100:00100000:3.0:1767318946.785077:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634432
00000100:00100000:3.0:1767318946.785103:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16569
00000100:00100000:3.0:1767318946.785109:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379634176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318946.785133:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318946.785187:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379634176:12345-0@lo:38:kworker.0 Request processed in 77us (1048us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318946.785194:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16569
00000100:00100000:3.0:1767318946.785208:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16570
00000100:00100000:3.0:1767318946.785212:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379634432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318946.785220:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318946.788253:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318946.788270:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318946.788276:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379634176:0@lo:38:kworker.0
00000100:00100000:3.0:1767318946.789889:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379634432:12345-0@lo:38:kworker.0 Request processed in 4580us (5598us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318946.789930:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16570
00000100:00080000:2.0:1767318946.790017:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318946.790025:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318946.790029:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379634432:0@lo:38:kworker.0
00010000:00010000:0.0:1767318947.287817:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318947.733679:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318947.733737:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318947.733792:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291889792
00000100:00100000:1.0:1767318947.733805:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291889792
00000100:00100000:1.0:1767318947.733922:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291889664
00000100:00100000:1.0:1767318947.733927:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291889664
00000100:00100000:1.0:1767318947.733949:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3951
00000100:00100000:1.0:1767318947.733960:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291889792:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318947.734059:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291889792:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (394us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318947.734068:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3951
00000100:00100000:1.0:1767318947.734135:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16571
00000100:00100000:1.0:1767318947.734139:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291889664:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318947.734166:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318947.734199:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291889664:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (461us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318947.734205:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16571
00000100:00080000:1.0:1767318947.734225:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318947.800347:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318947.800376:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379634560:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318947.800475:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318947.801753:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634560
00000100:00100000:0.0:1767318947.801768:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634560
00000100:00100000:0.0:1767318947.808821:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094
00000100:00100000:0.0:1767318947.808854:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379634560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318947.808916:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318947.810389:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379634560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1545us (9904us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318947.810405:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094
00000100:00100000:2.0:1767318947.815020:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379634560:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318948.311558:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318949.335459:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379634688:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318949.335585:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318949.339588:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634688
00000100:00100000:0.0:1767318949.339611:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634688
00000100:00100000:0.0:1767318949.339734:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095
00000100:00080000:1.0:1767318949.339743:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318949.339747:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379634688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318949.339789:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318949.339931:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379634688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 187us (4346us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318949.339939:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095
00000100:00100000:1.0:1767318949.340155:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379634688:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318949.340346:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318950.359281:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767318951.384967:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318951.898396:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318951.898410:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318951.898413:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318951.898444:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318951.898449:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318951.898459:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3849
00000100:00080000:0.0:1767318951.898465:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318951.898474:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318951.898528:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5c00 x1853164379634816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318951.898569:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318951.898573:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318951.898575:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318951.898580:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3849
00000100:00080000:0.0:1767318951.898582:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318951.898587:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318951.898601:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4e00 x1853164379634944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318951.898666:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318951.898669:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318951.898671:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318951.898675:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3849
00000100:00080000:0.0:1767318951.898677:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318951.898681:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318951.898692:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4380 x1853164379635456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318951.898709:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318951.898719:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318951.898721:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318951.898724:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3849
00000100:00080000:0.0:1767318951.898727:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318951.898732:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318951.898747:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85c000 x1853164379635712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318951.898891:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379635200:0@lo:400:kworker.0
00000100:00100000:2.0:1767318951.898985:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318951.899080:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767318951.899087:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379635072:0@lo:400:kworker.0
00000100:00100000:2.0:1767318951.899113:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318951.899208:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379635584:0@lo:400:kworker.0
00000100:00100000:1.0:1767318951.899245:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318951.899281:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318951.899287:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379635328:0@lo:400:kworker.0
00000100:00100000:1.0:1767318951.899309:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318951.899350:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635200
00000100:00100000:1.0:1767318951.899360:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635200
00000100:00100000:1.0:1767318951.899422:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635072
00000100:00100000:1.0:1767318951.899425:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635072
00000100:00100000:1.0:1767318951.899447:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343
00000100:00100000:1.0:1767318951.899455:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379635200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318951.899507:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379635200:12345-0@lo:400:kworker.0 Request processed in 53us (522us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318951.899514:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343
00000100:00100000:1.0:1767318951.899535:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344
00000100:00100000:1.0:1767318951.899541:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379635072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318951.899565:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379635072:12345-0@lo:400:kworker.0 Request processed in 24us (451us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318951.899571:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344
00000100:00100000:1.0:1767318951.899590:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635584
00000100:00100000:1.0:1767318951.899593:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635584
00000100:00100000:1.0:1767318951.899617:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635328
00000100:00100000:1.0:1767318951.899619:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635328
00000100:00100000:1.0:1767318951.899637:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952
00000100:00100000:1.0:1767318951.899642:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379635584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318951.899675:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379635584:12345-0@lo:400:kworker.0 Request processed in 32us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318951.899681:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952
00000100:00100000:1.0:1767318951.899692:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953
00000100:00100000:1.0:1767318951.899698:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379635328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318951.899723:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379635328:12345-0@lo:400:kworker.0 Request processed in 25us (413us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318951.899728:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953
00000100:00080000:1.0:1767318951.899746:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767318951.899752:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767318951.899753:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318951.899776:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379634816:0@lo:38:kworker.0
00000100:00100000:1.0:1767318951.899803:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318951.899819:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379634944:0@lo:38:kworker.0
00000100:00100000:1.0:1767318951.899845:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318951.899897:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379635456:0@lo:38:kworker.0
00000100:00100000:1.0:1767318951.899920:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318951.899937:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379635712:0@lo:38:kworker.0
00000100:00100000:1.0:1767318951.899960:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318951.899989:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634944
00000100:00100000:1.0:1767318951.899993:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634944
00000100:00100000:1.0:1767318951.900015:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905
00000100:00100000:1.0:1767318951.900019:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379634944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318951.900053:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318951.900089:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379634944:12345-0@lo:38:kworker.0 Request processed in 67us (242us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318951.900096:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905
00000100:00100000:1.0:1767318951.900116:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379634816
00000100:00100000:1.0:1767318951.900119:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379634816
00000100:00100000:1.0:1767318951.900136:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635456
00000100:00100000:1.0:1767318951.900139:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635456
00000100:00100000:1.0:1767318951.900149:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635712
00000100:00100000:1.0:1767318951.900152:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635712
00000100:00100000:1.0:1767318951.900161:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16572
00000100:00100000:1.0:1767318951.900165:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379634816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318951.900175:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318951.900197:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379634816:12345-0@lo:38:kworker.0 Request processed in 31us (394us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318951.900203:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16572
00000100:00100000:1.0:1767318951.900214:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16573
00000100:00100000:1.0:1767318951.900217:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379635456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318951.900226:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318951.900244:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379635456:12345-0@lo:38:kworker.0 Request processed in 25us (323us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318951.900250:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16573
00000100:00100000:1.0:1767318951.900260:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16574
00000100:00100000:1.0:1767318951.900264:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379635712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318951.900272:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318951.900291:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379635712:12345-0@lo:38:kworker.0 Request processed in 26us (330us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318951.900297:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16574
00000100:00100000:1.0:1767318951.900357:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379635328:0@lo:400:kworker.0
00000100:00100000:1.0:1767318951.900369:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379635584:0@lo:400:kworker.0
00000100:00080000:1.0:1767318951.900401:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318951.900406:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318951.900409:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379634816:0@lo:38:kworker.0
00000100:00080000:1.0:1767318951.900416:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318951.900420:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318951.900423:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379634944:0@lo:38:kworker.0
00000100:00080000:1.0:1767318951.900430:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318951.900433:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318951.900435:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379635456:0@lo:38:kworker.0
00000100:00080000:1.0:1767318951.900442:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318951.900445:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318951.900448:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379635712:0@lo:38:kworker.0
00000100:00100000:2.0:1767318951.900580:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379635072:0@lo:400:kworker.0
00000100:00100000:2.0:1767318951.900591:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379635200:0@lo:400:kworker.0
00010000:00010000:2.0:1767318952.407223:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318952.847495:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318952.847562:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318952.847730:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291889920
00000100:00100000:1.0:1767318952.847744:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291889920
00000100:00100000:1.0:1767318952.847808:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291890048
00000100:00100000:1.0:1767318952.847812:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291890048
00000100:00100000:1.0:1767318952.847891:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3954
00000100:00100000:1.0:1767318952.847904:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291890048:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318952.848014:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291890048:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 112us (451us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318952.848024:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3954
00000100:00100000:1.0:1767318952.848065:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16575
00000100:00100000:1.0:1767318952.848071:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291889920:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767318952.848111:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318952.848142:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291889920:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 69us (680us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318952.848149:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16575
00000100:00080000:1.0:1767318952.848170:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318952.919403:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379635840:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318952.919501:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318952.919715:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635840
00000100:00100000:0.0:1767318952.919726:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635840
00000100:00100000:0.0:1767318952.919792:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096
00000100:00100000:0.0:1767318952.919802:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379635840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318952.919841:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318952.919922:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379635840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (421us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318952.919930:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096
00000100:00100000:3.0:1767318952.920118:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379635840:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318953.432552:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318954.456054:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318954.456439:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379635968:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318954.456548:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318954.456751:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379635968
00000100:00100000:1.0:1767318954.456762:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379635968
00000100:00100000:1.0:1767318954.456894:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097
00000100:00100000:1.0:1767318954.456906:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379635968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318954.456952:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318954.457014:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379635968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (465us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318954.457036:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097
00000100:00080000:2.0:1767318954.457177:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767318954.457225:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379635968:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767318955.479483:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318956.505390:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318957.016448:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318957.016459:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318957.016462:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318957.016468:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318957.016473:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318957.016483:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3854
00000100:00080000:0.0:1767318957.016488:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318957.016497:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318957.016542:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f100 x1853164379636096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318957.016570:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318957.016574:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318957.016576:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318957.016580:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3854
00000100:00080000:0.0:1767318957.016583:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318957.016587:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318957.016602:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d880 x1853164379636224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318957.016659:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379636480:0@lo:400:kworker.0
00000100:00080000:0.0:1767318957.016661:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318957.016664:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318957.016666:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318957.016670:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3854
00000100:00080000:0.0:1767318957.016672:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318957.016677:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318957.016687:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f800 x1853164379636736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318957.016704:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318957.016708:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318957.016710:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318957.016713:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3854
00000100:00080000:0.0:1767318957.016716:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318957.016720:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318957.016731:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d500 x1853164379636992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318957.016763:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379636352:0@lo:400:kworker.0
00000100:00100000:1.0:1767318957.016925:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379636096:0@lo:38:kworker.0
00000100:00100000:2.0:1767318957.019641:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379636864:0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.029018:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318957.029394:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379636608:0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.029465:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318957.029541:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636608
00000100:00100000:3.0:1767318957.029552:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636608
00000100:00100000:3.0:1767318957.029629:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955
00000100:00100000:3.0:1767318957.029643:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379636608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.029709:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379636608:12345-0@lo:400:kworker.0 Request processed in 71us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318957.029717:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955
00000100:00100000:3.0:1767318957.029775:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379636608:0@lo:400:kworker.0
00000100:00080000:3.0:1767318957.029807:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318957.029975:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636480
00000100:00100000:3.0:1767318957.029980:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636480
00000100:00100000:3.0:1767318957.030032:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345
00000100:00100000:3.0:1767318957.030039:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379636480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.030082:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379636480:12345-0@lo:400:kworker.0 Request processed in 44us (1089us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318957.030108:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345
00000100:00080000:3.0:1767318957.030132:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318957.030158:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379636480:0@lo:400:kworker.0
00000100:00100000:1.0:1767318957.031209:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318957.031264:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379636224:0@lo:38:kworker.0
00000100:00100000:3.0:1767318957.031269:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636096
00000100:00100000:3.0:1767318957.031280:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636096
00000100:00100000:1.0:1767318957.031308:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318957.031324:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16576
00000100:00100000:3.0:1767318957.031333:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379636096:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767318957.031349:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379636736:0@lo:38:kworker.0
00010000:00020000:3.0:1767318957.031364:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318957.031378:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318957.031401:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379636992:0@lo:38:kworker.0
00000100:00100000:3.0:1767318957.031421:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379636096:12345-0@lo:38:kworker.0 Request processed in 87us (215us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318957.031429:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16576
00000100:00100000:1.0:1767318957.031434:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767318957.031477:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318957.031483:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318957.031487:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379636096:0@lo:38:kworker.0
00000100:00100000:1.0:1767318957.031519:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636224
00000100:00100000:1.0:1767318957.031523:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636224
00000100:00100000:1.0:1767318957.031549:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906
00000100:00100000:1.0:1767318957.031555:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379636224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318957.031566:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318957.031596:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379636224:12345-0@lo:38:kworker.0 Request processed in 40us (288us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318957.031603:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906
00000100:00100000:3.0:1767318957.031721:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636736
00000100:00100000:3.0:1767318957.031726:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636736
00000100:00100000:3.0:1767318957.031745:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636992
00000100:00100000:3.0:1767318957.031748:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636992
00000100:00100000:3.0:1767318957.031764:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16577
00000100:00100000:3.0:1767318957.031768:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379636736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318957.031777:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318957.031806:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379636736:12345-0@lo:38:kworker.0 Request processed in 36us (429us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318957.031811:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16577
00000100:00100000:3.0:1767318957.031821:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16578
00000100:00100000:3.0:1767318957.031825:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379636992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318957.031833:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318957.031856:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379636992:12345-0@lo:38:kworker.0 Request processed in 29us (424us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767318957.031935:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318957.031941:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318957.031944:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379636224:0@lo:38:kworker.0
00000100:00080000:1.0:1767318957.031952:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318957.031955:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318957.031958:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379636736:0@lo:38:kworker.0
00000100:00080000:1.0:1767318957.031965:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318957.031968:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318957.031970:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379636992:0@lo:38:kworker.0
00000100:00100000:3.0:1767318957.032303:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16578
00000100:00100000:2.0:1767318957.036579:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318957.036756:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636864
00000100:00100000:3.0:1767318957.036771:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636864
00000100:00100000:3.0:1767318957.036863:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956
00000100:00100000:3.0:1767318957.036913:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379636864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318957.037017:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379636864:12345-0@lo:400:kworker.0 Request processed in 109us (450us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318957.037027:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956
00000100:00100000:0.0:1767318957.037078:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318957.037235:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379636352
00000100:00100000:1.0:1767318957.037246:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379636352
00000100:00100000:1.0:1767318957.037360:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346
00000100:00100000:1.0:1767318957.037371:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379636352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318957.037455:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379636352:12345-0@lo:400:kworker.0 Request processed in 85us (601us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318957.037463:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346
00000100:00080000:2.0:1767318957.037502:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318957.037510:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318957.037569:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379636864:0@lo:400:kworker.0
00000100:00100000:0.0:1767318957.037571:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379636352:0@lo:400:kworker.0
00010000:00010000:2.0:1767318957.527167:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318957.967094:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318957.967636:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291890176
00000100:00100000:0.0:1767318957.967650:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291890176
00000100:00100000:0.0:1767318957.967707:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16579
00000100:00100000:0.0:1767318957.967716:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291890176:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318957.967747:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318957.967942:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291890176:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 226us (863us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318957.967948:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16579
00000100:00100000:3.0:1767318957.971088:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318957.971618:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291890304
00000100:00100000:0.0:1767318957.971631:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291890304
00000100:00100000:0.0:1767318957.971736:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3957
00000100:00100000:0.0:1767318957.971748:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291890304:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318957.971842:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291890304:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (769us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318957.971851:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3957
00000100:00080000:1.0:1767318957.971974:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318958.039397:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318958.039419:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379637120:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318958.039521:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318958.039719:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379637120
00000100:00100000:0.0:1767318958.039739:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379637120
00000100:00100000:0.0:1767318958.039814:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098
00000100:00100000:0.0:1767318958.039824:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379637120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318958.039865:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318958.039945:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379637120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (424us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318958.039971:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098
00000100:00100000:2.0:1767318958.040310:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379637120:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318958.551622:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318959.575631:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379637248:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318959.575742:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318959.576432:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379637248
00000100:00100000:1.0:1767318959.576445:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379637248
00000100:00100000:1.0:1767318959.576531:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099
00000100:00100000:1.0:1767318959.576544:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379637248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318959.576586:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318959.576650:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379637248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (907us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318959.576658:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099
00000100:00080000:0.0:1767318959.576794:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318959.576850:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318959.576926:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379637248:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318960.600673:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318961.626028:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318962.135238:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318962.135252:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318962.135255:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318962.135260:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318962.135265:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318962.135275:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3859
00000100:00080000:0.0:1767318962.135281:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318962.135289:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318962.135345:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e300 x1853164379637376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318962.135380:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318962.135385:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318962.135386:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318962.135391:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3859
00000100:00080000:0.0:1767318962.135393:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318962.135397:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318962.135413:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85fb80 x1853164379637504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318962.135479:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318962.135483:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318962.135485:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318962.135489:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3859
00000100:00080000:0.0:1767318962.135510:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318962.135514:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318962.135533:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85df80 x1853164379638016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318962.135552:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318962.135556:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318962.135558:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318962.135562:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3859
00000100:00080000:0.0:1767318962.135564:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318962.135569:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318962.135592:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d500 x1853164379638272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318962.135749:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379637376:0@lo:38:kworker.0
00000100:00100000:1.0:1767318962.135839:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318962.135957:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379637504:0@lo:38:kworker.0
00000100:00100000:1.0:1767318962.135988:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318962.136212:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379638016:0@lo:38:kworker.0
00000100:00100000:1.0:1767318962.136240:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318962.136256:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379638272:0@lo:38:kworker.0
00000100:00100000:1.0:1767318962.136276:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318962.136322:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379637504
00000100:00100000:1.0:1767318962.136331:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379637504
00000100:00100000:1.0:1767318962.136381:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907
00000100:00100000:1.0:1767318962.136390:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379637504:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318962.136419:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318962.136473:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379637504:12345-0@lo:38:kworker.0 Request processed in 82us (483us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318962.136481:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907
00000100:00100000:1.0:1767318962.136512:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379637376
00000100:00100000:1.0:1767318962.136516:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379637376
00000100:00100000:1.0:1767318962.136534:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379638016
00000100:00100000:1.0:1767318962.136537:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379638016
00000100:00100000:1.0:1767318962.136547:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379638272
00000100:00100000:1.0:1767318962.136549:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379638272
00000100:00100000:1.0:1767318962.136562:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16580
00000100:00100000:1.0:1767318962.136566:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379637376:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318962.136576:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318962.136698:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379637632:0@lo:400:kworker.0
00000100:00100000:2.0:1767318962.136737:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318962.136766:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767318962.136772:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379637760:0@lo:400:kworker.0
00000100:00100000:2.0:1767318962.136793:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318962.136819:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379637632
00000100:00100000:2.0:1767318962.136822:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379637632
00000100:00100000:2.0:1767318962.136902:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379637760
00000100:00100000:2.0:1767318962.136905:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379637760
00000100:00100000:2.0:1767318962.136927:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347
00000100:00100000:2.0:1767318962.136933:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379637632:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318962.136992:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379637632:12345-0@lo:400:kworker.0 Request processed in 59us (254us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318962.136999:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347
00000100:00100000:1.0:1767318962.137421:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379637376:12345-0@lo:38:kworker.0 Request processed in 852us (1581us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318962.137430:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16580
00000100:00100000:1.0:1767318962.137446:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16581
00000100:00100000:1.0:1767318962.137450:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379638016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318962.137461:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318962.137483:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379638016:12345-0@lo:38:kworker.0 Request processed in 31us (1242us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318962.137488:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16581
00000100:00100000:1.0:1767318962.137499:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16582
00000100:00100000:1.0:1767318962.137504:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379638272:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318962.137513:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318962.137534:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379638272:12345-0@lo:38:kworker.0 Request processed in 28us (1257us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318962.137539:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16582
00000100:00100000:2.0:1767318962.137641:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348
00000100:00100000:2.0:1767318962.137650:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379637760:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767318962.137707:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318962.137712:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318962.137716:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379637376:0@lo:38:kworker.0
00000100:00100000:3.0:1767318962.137791:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379637888:0@lo:400:kworker.0
00000100:00080000:0.0:1767318962.141551:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767318962.141566:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767318962.141607:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379638144:0@lo:400:kworker.0
00000100:00100000:2.0:1767318962.142450:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379637760:12345-0@lo:400:kworker.0 Request processed in 4797us (5651us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318962.142466:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348
00000100:00100000:2.0:1767318962.142565:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379637760:0@lo:400:kworker.0
00000100:00100000:2.0:1767318962.142581:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379637632:0@lo:400:kworker.0
00000100:00080000:1.0:1767318962.143351:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318962.143360:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318962.143364:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379637504:0@lo:38:kworker.0
00000100:00080000:1.0:1767318962.143381:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318962.143385:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318962.143388:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379638016:0@lo:38:kworker.0
00000100:00080000:1.0:1767318962.143400:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318962.143403:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318962.143406:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379638272:0@lo:38:kworker.0
00000100:00100000:3.0:1767318962.143549:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318962.143666:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379637888
00000100:00100000:1.0:1767318962.143675:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379637888
00000100:00100000:1.0:1767318962.143756:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958
00000100:00100000:1.0:1767318962.143766:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379637888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318962.143829:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379637888:12345-0@lo:400:kworker.0 Request processed in 65us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318962.143836:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958
00000100:00100000:3.0:1767318962.143999:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379637888:0@lo:400:kworker.0
00000100:00080000:2.0:1767318962.144250:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318962.144423:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318962.144509:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379638144
00000100:00100000:3.0:1767318962.144515:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379638144
00000100:00100000:3.0:1767318962.144558:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959
00000100:00100000:3.0:1767318962.144565:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379638144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318962.144616:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379638144:12345-0@lo:400:kworker.0 Request processed in 51us (192us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318962.144622:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959
00000100:00080000:2.0:1767318962.144677:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767318962.144765:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379638144:0@lo:400:kworker.0
00010000:00010000:2.0:1767318962.647524:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318963.092530:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767318963.093725:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291890432 offset 0 length 520: 4
00000100:00100000:2.0:1767318963.093767:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318963.101183:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291890688
00000100:00100000:0.0:1767318963.101211:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291890688
00000100:00100000:0.0:1767318963.101346:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291890560
00000100:00100000:0.0:1767318963.101351:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291890560
00000100:00100000:0.0:1767318963.101411:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3960
00000100:00100000:0.0:1767318963.101500:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291890688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318963.101613:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291890688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 117us (9098us total) trans 0 rc 0/0
00000100:00080000:2.0:1767318963.101704:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318963.105026:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16583
00000100:00100000:3.0:1767318963.105042:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291890560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318963.105070:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318963.105168:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291890560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 128us (11399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318963.105318:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16583
00000100:00100000:0.0:1767318963.107610:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3960
00000100:00100000:2.0:1767318963.161619:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379638400:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318963.161732:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318963.164283:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379638400
00000100:00100000:1.0:1767318963.164305:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379638400
00000100:00100000:1.0:1767318963.164397:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100
00000100:00100000:1.0:1767318963.164409:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379638400:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318963.164459:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318963.164569:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379638400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (2837us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318963.164577:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100
00000100:00100000:1.0:1767318963.164660:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379638400:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767318963.672800:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318964.696350:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318964.696542:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379638528:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767318964.696640:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318964.696777:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379638528
00000100:00100000:1.0:1767318964.696788:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379638528
00000100:00100000:1.0:1767318964.696906:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101
00000100:00100000:1.0:1767318964.696918:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379638528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318964.696966:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767318964.697044:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318964.707046:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379638528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10112us (10388us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318964.707068:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101
00000100:00100000:2.0:1767318964.707407:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379638528:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318965.719271:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318966.231209:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318941/real 1767318941]  req@ffff8b0e07330000 x1853164379633152/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318966 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767318966.231275:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e07330000 x1853164379633152/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318966 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767318966.231301:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318966.231348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767318966.231352:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379633152:0@lo:250:kworker.0
00000100:00080000:0.0:1767318966.231466:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318966.231472:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318966.231476:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318966.231483:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3844
00000100:00080000:0.0:1767318966.231488:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318966.231495:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318966.231539:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d880 x1853164379638656/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318966.231571:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318966.231575:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318966.231577:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318966.231581:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3864
00000100:00080000:0.0:1767318966.231583:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318966.231588:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318966.231605:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f100 x1853164379638784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318966.231615:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318966.231619:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318966.231621:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318966.231625:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3864
00000100:00080000:0.0:1767318966.231627:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318966.231631:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318966.231666:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ed80 x1853164379638912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318966.231738:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318966.231742:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318966.231744:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318966.231747:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3864
00000100:00080000:0.0:1767318966.231750:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318966.231754:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318966.231766:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e680 x1853164379639424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318966.231783:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318966.231786:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318966.231788:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767318966.231789:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379639168:0@lo:400:kworker.0
00000100:00080000:0.0:1767318966.231791:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3864
00000100:00080000:0.0:1767318966.231794:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318966.231798:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318966.231808:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d500 x1853164379639680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318966.231833:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379639296:0@lo:400:kworker.0
00000100:00100000:1.0:1767318966.231942:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379639040:0@lo:400:kworker.0
00000100:00100000:2.0:1767318966.232003:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379638656:0@lo:250:kworker.0
00000100:00100000:3.0:1767318966.237337:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318966.237864:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639168
00000100:00100000:3.0:1767318966.237898:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639168
00000100:00100000:3.0:1767318966.237996:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349
00000100:00100000:3.0:1767318966.238008:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379639168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318966.238104:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379639168:12345-0@lo:400:kworker.0 Request processed in 99us (780us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318966.238113:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349
00000100:00100000:3.0:1767318966.238179:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379639168:0@lo:400:kworker.0
00000100:00100000:3.0:1767318966.238238:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379639552:0@lo:400:kworker.0
00000100:00100000:3.0:1767318966.238283:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318966.238325:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639552
00000100:00100000:3.0:1767318966.238329:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639552
00000100:00100000:3.0:1767318966.238364:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961
00000100:00100000:3.0:1767318966.238371:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379639552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318966.238407:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379639552:12345-0@lo:400:kworker.0 Request processed in 36us (123us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318966.238413:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961
00000100:00100000:3.0:1767318966.238438:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379639552:0@lo:400:kworker.0
00000100:00080000:3.0:1767318966.238461:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767318966.238467:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318966.242332:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000400:00000100:2.0:1767318966.247060:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379638656 offset 0 length 520: 4
00000100:00100000:2.0:1767318966.247225:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379638784:0@lo:38:kworker.0
00000100:00100000:3.0:1767318966.248628:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639040
00000100:00100000:3.0:1767318966.248645:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639040
00000100:00100000:3.0:1767318966.248785:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350
00000100:00100000:3.0:1767318966.248799:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379639040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318966.248966:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379639040:12345-0@lo:400:kworker.0 Request processed in 170us (6651us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318966.248975:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350
00000100:00080000:1.0:1767318966.249757:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318966.249822:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379639040:0@lo:400:kworker.0
00000100:00100000:0.0:1767318966.250274:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318966.253601:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318966.254108:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379638912:0@lo:38:kworker.0
00000100:00100000:2.0:1767318966.254200:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318966.254232:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379639424:0@lo:38:kworker.0
00000100:00100000:2.0:1767318966.254262:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318966.254610:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379638912
00000100:00100000:1.0:1767318966.254622:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379638912
00000100:00100000:1.0:1767318966.254683:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908
00000100:00100000:1.0:1767318966.254693:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379638912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318966.254725:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318966.254790:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379638912:12345-0@lo:38:kworker.0 Request processed in 97us (587us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318966.254805:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908
00000100:00100000:3.0:1767318966.255956:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639296
00000100:00100000:3.0:1767318966.255971:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639296
00000100:00100000:3.0:1767318966.256056:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379638784
00000100:00100000:3.0:1767318966.256059:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379638784
00000100:00100000:3.0:1767318966.256081:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962
00000100:00100000:3.0:1767318966.256291:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379639296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318966.256813:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16584
00000100:00100000:1.0:1767318966.256823:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379638784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318966.256847:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318966.257032:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639424
00000100:00100000:0.0:1767318966.257042:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639424
00000100:00100000:0.0:1767318966.257147:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16585
00000100:00100000:0.0:1767318966.257153:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379639424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318966.257165:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318966.257270:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379638784:12345-0@lo:38:kworker.0 Request processed in 447us (3681us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318966.257278:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16584
00000100:00080000:1.0:1767318966.257316:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318966.257730:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379639296:12345-0@lo:400:kworker.0 Request processed in 1635us (7450us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318966.257738:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962
00000100:00100000:1.0:1767318966.257957:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379639296:0@lo:400:kworker.0
00000100:00100000:2.0:1767318966.258202:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379639680:0@lo:38:kworker.0
00000100:00100000:2.0:1767318966.258262:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318966.258348:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318966.258354:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318966.258357:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379638784:0@lo:38:kworker.0
00000100:00080000:2.0:1767318966.258368:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318966.258371:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318966.258373:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379638912:0@lo:38:kworker.0
00000100:00100000:3.0:1767318966.259102:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639680
00000100:00100000:3.0:1767318966.259112:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639680
00000100:00100000:3.0:1767318966.259199:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16586
00000100:00100000:3.0:1767318966.259206:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379639680:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318966.259229:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318966.259553:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379639680:12345-0@lo:38:kworker.0 Request processed in 345us (1290us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318966.259561:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16586
00000100:00080000:2.0:1767318966.259630:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318966.259635:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318966.259639:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379639680:0@lo:38:kworker.0
00000100:00100000:0.0:1767318966.260273:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379639424:12345-0@lo:38:kworker.0 Request processed in 3114us (6006us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318966.260282:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16585
00000100:00080000:2.0:1767318966.260517:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318966.260523:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318966.260528:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379639424:0@lo:38:kworker.0
00010000:00010000:2.0:1767318966.754161:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318967.772602:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318968.212724:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318968.212796:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318968.213168:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291890944
00000100:00100000:3.0:1767318968.213168:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291890816
00000100:00100000:0.0:1767318968.213183:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291890944
00000100:00100000:3.0:1767318968.213183:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291890816
00000100:00100000:3.0:1767318968.213242:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16587
00000100:00100000:3.0:1767318968.213253:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291890816:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:2.0:1767318968.213275:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:3.0:1767318968.213297:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318968.213586:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291890816:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 331us (786us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318968.214048:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3963
00000100:00100000:0.0:1767318968.214060:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291890944:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318968.214139:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291890944:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (1441us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318968.214148:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3963
00000100:00100000:3.0:1767318968.216233:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16587
00000100:00100000:3.0:1767318968.279433:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767318968.279460:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379639808:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318968.279554:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318968.279966:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639808
00000100:00100000:2.0:1767318968.279977:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639808
00000100:00100000:2.0:1767318968.280077:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102
00000100:00100000:2.0:1767318968.280090:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379639808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318968.280128:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318968.280193:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379639808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (640us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318968.280202:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102
00000100:00100000:2.0:1767318968.280263:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379639808:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318968.280625:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318968.793864:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318969.817839:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318969.819782:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318969.819815:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379639936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318969.819959:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318969.820722:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379639936
00000100:00100000:3.0:1767318969.820737:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379639936
00000100:00100000:3.0:1767318969.820833:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103
00000100:00100000:3.0:1767318969.820843:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379639936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767318969.820927:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767318969.820944:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318969.821033:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379639936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 191us (1075us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318969.821043:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103
00000100:00100000:2.0:1767318969.821206:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379639936:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318970.842523:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318971.352821:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318971.352847:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318971.352850:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318971.352855:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318971.352861:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318971.352919:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3868
00000100:00080000:0.0:1767318971.352925:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318971.352941:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318971.353001:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ce00 x1853164379640064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318971.353038:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318971.353042:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318971.353066:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318971.353071:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3868
00000100:00080000:0.0:1767318971.353074:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318971.353088:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318971.353105:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ea00 x1853164379640192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318971.353174:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318971.353177:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318971.353179:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318971.353183:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3868
00000100:00080000:0.0:1767318971.353186:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318971.353190:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318971.353202:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ed80 x1853164379640704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318971.353219:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318971.353223:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318971.353226:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318971.353229:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3868
00000100:00080000:0.0:1767318971.353232:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318971.353237:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318971.353260:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85c000 x1853164379640960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318971.353628:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379640576:0@lo:400:kworker.0
00000100:00100000:0.0:1767318971.353718:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318971.353803:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767318971.353810:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379640832:0@lo:400:kworker.0
00000100:00100000:0.0:1767318971.353836:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318971.353909:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640576
00000100:00100000:0.0:1767318971.353918:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640576
00000100:00100000:0.0:1767318971.353981:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640832
00000100:00100000:0.0:1767318971.353984:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640832
00000100:00100000:0.0:1767318971.354012:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964
00000100:00100000:0.0:1767318971.354022:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379640576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318971.354081:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379640576:12345-0@lo:400:kworker.0 Request processed in 59us (363us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318971.354090:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964
00000100:00100000:0.0:1767318971.354110:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965
00000100:00100000:0.0:1767318971.354116:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379640832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318971.354142:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379640832:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318971.354148:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965
00000100:00100000:0.0:1767318971.354188:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379640832:0@lo:400:kworker.0
00000100:00100000:0.0:1767318971.354199:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379640576:0@lo:400:kworker.0
00000100:00100000:1.0:1767318971.355617:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379640320:0@lo:400:kworker.0
00000100:00100000:1.0:1767318971.355706:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318971.355800:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318971.355809:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379640448:0@lo:400:kworker.0
00000100:00100000:1.0:1767318971.355835:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318971.355946:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640320
00000100:00100000:1.0:1767318971.355954:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640320
00000100:00100000:1.0:1767318971.356015:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640448
00000100:00100000:1.0:1767318971.356018:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640448
00000100:00100000:1.0:1767318971.356048:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351
00000100:00100000:1.0:1767318971.356058:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379640320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318971.356131:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379640320:12345-0@lo:400:kworker.0 Request processed in 75us (425us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318971.356144:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351
00000100:00100000:1.0:1767318971.356168:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352
00000100:00100000:1.0:1767318971.356175:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379640448:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318971.356211:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379640448:12345-0@lo:400:kworker.0 Request processed in 37us (374us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318971.356217:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352
00000100:00100000:1.0:1767318971.356559:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379640448:0@lo:400:kworker.0
00000100:00080000:2.0:1767318971.356571:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767318971.356577:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379640320:0@lo:400:kworker.0
00000100:00080000:2.0:1767318971.356579:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767318971.356585:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318971.356613:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379640064:0@lo:38:kworker.0
00000100:00100000:2.0:1767318971.356656:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318971.356682:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379640192:0@lo:38:kworker.0
00000100:00100000:2.0:1767318971.356712:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318971.356747:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379640704:0@lo:38:kworker.0
00000100:00100000:2.0:1767318971.356769:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318971.356789:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379640960:0@lo:38:kworker.0
00000100:00100000:2.0:1767318971.356810:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318971.356850:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640704
00000100:00100000:3.0:1767318971.356851:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640064
00000100:00100000:2.0:1767318971.356855:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640704
00000100:00100000:3.0:1767318971.356933:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640064
00000100:00100000:2.0:1767318971.356935:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640960
00000100:00100000:2.0:1767318971.356943:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640960
00000100:00100000:2.0:1767318971.356964:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16588
00000100:00100000:2.0:1767318971.356970:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379640704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318971.356996:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318971.357021:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16589
00000100:00100000:3.0:1767318971.357036:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379640960:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318971.357046:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16590
00000100:00100000:2.0:1767318971.357049:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379640704:12345-0@lo:38:kworker.0 Request processed in 76us (277us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318971.357065:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379640064:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767318971.357071:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16588
00010000:00020000:3.0:1767318971.357089:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767318971.357115:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318971.357124:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318971.357130:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379640704:0@lo:38:kworker.0
00000100:00100000:1.0:1767318971.357200:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379640192
00000100:00100000:1.0:1767318971.357206:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379640192
00000100:00100000:3.0:1767318971.357214:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379640960:12345-0@lo:38:kworker.0 Request processed in 174us (396us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318971.357224:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16589
00000100:00100000:1.0:1767318971.357269:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909
00000100:00100000:1.0:1767318971.357278:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379640192:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767318971.357298:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318971.357305:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318971.357310:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379640960:0@lo:38:kworker.0
00010000:00020000:0.0:1767318971.357384:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318971.357443:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379640064:12345-0@lo:38:kworker.0 Request processed in 384us (787us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318971.357452:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16590
00000100:00080000:3.0:1767318971.357925:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318971.357932:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318971.357936:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379640064:0@lo:38:kworker.0
00010000:00020000:1.0:1767318971.363583:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318971.363738:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379640192:12345-0@lo:38:kworker.0 Request processed in 6456us (7020us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318971.363754:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909
00000100:00080000:3.0:1767318971.363982:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318971.363990:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318971.363994:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379640192:0@lo:38:kworker.0
00010000:00010000:2.0:1767318971.863403:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318972.888745:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318973.328920:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318973.329057:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291891200
00000100:00100000:0.0:1767318973.329071:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291891200
00000100:00100000:0.0:1767318973.329174:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3966
00000100:00100000:0.0:1767318973.329197:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291891200:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318973.329316:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291891200:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 132us (453us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318973.329325:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3966
00000100:00080000:2.0:1767318973.329526:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318973.351968:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318973.352555:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291891072
00000100:00100000:3.0:1767318973.352571:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291891072
00000100:00100000:3.0:1767318973.352641:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16591
00000100:00100000:3.0:1767318973.352651:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291891072:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318973.352685:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318973.352791:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291891072:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 139us (839us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318973.352800:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16591
00000100:00100000:1.0:1767318973.407706:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379641088:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318973.407835:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318973.413841:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641088
00000100:00100000:0.0:1767318973.413915:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641088
00000100:00100000:0.0:1767318973.414031:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104
00000100:00100000:0.0:1767318973.414044:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379641088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318973.414093:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318973.414206:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379641088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (6370us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318973.414214:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104
00000100:00100000:1.0:1767318973.418194:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379641088:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767318973.418219:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318973.911769:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318974.935162:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318974.935338:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379641216:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318974.935443:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318974.940986:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641216
00000100:00100000:0.0:1767318974.941010:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641216
00000100:00100000:0.0:1767318974.941122:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105
00000100:00100000:0.0:1767318974.941136:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379641216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318974.941182:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767318974.945755:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767318974.947997:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379641216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6843us (12533us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318974.948020:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105
00000100:00100000:1.0:1767318974.948193:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379641216:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318975.961955:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318976.471185:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318976.471204:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318976.471208:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318976.471213:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318976.471219:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318976.471231:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3873
00000100:00080000:3.0:1767318976.471238:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318976.471246:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318976.471337:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80700 x1853164379641344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318976.471359:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318976.471363:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318976.471364:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318976.471369:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3873
00000100:00080000:3.0:1767318976.471371:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318976.471376:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318976.471388:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c83480 x1853164379641472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318976.471472:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318976.471476:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318976.471478:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318976.471482:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3873
00000100:00080000:3.0:1767318976.471485:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318976.471490:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318976.471503:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80e00 x1853164379641984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318976.471520:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318976.471523:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318976.471525:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318976.471528:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3873
00000100:00080000:3.0:1767318976.471531:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318976.471535:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318976.471557:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c83800 x1853164379642240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318976.471589:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379642112:0@lo:400:kworker.0
00000100:00100000:3.0:1767318976.471701:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318976.471795:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318976.471801:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379641856:0@lo:400:kworker.0
00000100:00100000:3.0:1767318976.471840:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318976.471908:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379642112
00000100:00100000:3.0:1767318976.471920:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379642112
00000100:00100000:0.0:1767318976.471933:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641856
00000100:00100000:0.0:1767318976.471940:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641856
00000100:00100000:2.0:1767318976.472037:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379641344:0@lo:38:kworker.0
00000100:00100000:2.0:1767318976.472073:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318976.472158:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379641728:0@lo:400:kworker.0
00000100:00100000:1.0:1767318976.472200:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318976.472236:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767318976.472242:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379641600:0@lo:400:kworker.0
00000100:00100000:1.0:1767318976.472266:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318976.472295:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641728
00000100:00100000:1.0:1767318976.472299:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641728
00000100:00100000:1.0:1767318976.472333:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641600
00000100:00100000:1.0:1767318976.472336:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641600
00000100:00100000:1.0:1767318976.472363:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353
00000100:00100000:1.0:1767318976.472374:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379641728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318976.472437:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379641728:12345-0@lo:400:kworker.0 Request processed in 64us (236us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318976.472446:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353
00000100:00100000:1.0:1767318976.472469:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354
00000100:00100000:1.0:1767318976.472475:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379641600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318976.472505:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379641600:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318976.472511:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354
00000100:00100000:1.0:1767318976.472572:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379641600:0@lo:400:kworker.0
00000100:00100000:1.0:1767318976.472583:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379641728:0@lo:400:kworker.0
00000100:00100000:2.0:1767318976.476619:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379641472:0@lo:38:kworker.0
00000100:00100000:2.0:1767318976.476712:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318976.476763:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379641984:0@lo:38:kworker.0
00000100:00100000:2.0:1767318976.476804:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318976.477004:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641344
00000100:00100000:3.0:1767318976.477017:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641344
00000100:00100000:3.0:1767318976.477086:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967
00000100:00100000:3.0:1767318976.477106:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379642112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318976.477196:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379642112:12345-0@lo:400:kworker.0 Request processed in 101us (5494us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318976.477204:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967
00000100:00100000:3.0:1767318976.477224:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968
00000100:00100000:3.0:1767318976.477232:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379641856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318976.477266:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379641856:12345-0@lo:400:kworker.0 Request processed in 35us (5425us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318976.477271:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968
00000100:00100000:3.0:1767318976.477286:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16592
00000100:00100000:3.0:1767318976.477291:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379641344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318976.477315:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318976.477351:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379641344:12345-0@lo:38:kworker.0 Request processed in 58us (5277us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318976.477379:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16592
00000100:00080000:3.0:1767318976.477411:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767318976.477418:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767318976.477423:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318976.477472:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379641856:0@lo:400:kworker.0
00000100:00100000:3.0:1767318976.477488:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379642112:0@lo:400:kworker.0
00000100:00100000:3.0:1767318976.477564:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641472
00000100:00100000:3.0:1767318976.477568:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641472
00000100:00100000:3.0:1767318976.477593:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910
00000100:00100000:3.0:1767318976.477598:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379641472:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318976.477609:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318976.477641:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379641472:12345-0@lo:38:kworker.0 Request processed in 42us (929us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318976.477648:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910
00000100:00100000:2.0:1767318976.483772:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379642240:0@lo:38:kworker.0
00000100:00100000:2.0:1767318976.483977:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767318976.484097:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318976.484102:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318976.484105:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379641344:0@lo:38:kworker.0
00000100:00080000:2.0:1767318976.484117:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318976.484119:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318976.484122:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379641472:0@lo:38:kworker.0
00000100:00100000:1.0:1767318976.484294:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379641984
00000100:00100000:1.0:1767318976.484305:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379641984
00000100:00100000:0.0:1767318976.484337:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379642240
00000100:00100000:0.0:1767318976.484344:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379642240
00000100:00100000:1.0:1767318976.484357:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16593
00000100:00100000:1.0:1767318976.484366:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379641984:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318976.484391:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318976.484397:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16594
00000100:00100000:0.0:1767318976.484403:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379642240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318976.484412:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318976.484447:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379641984:12345-0@lo:38:kworker.0 Request processed in 80us (7641us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318976.484458:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16593
00000100:00100000:0.0:1767318976.484461:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379642240:12345-0@lo:38:kworker.0 Request processed in 52us (478us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318976.484471:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16594
00000100:00080000:2.0:1767318976.484541:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318976.484546:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318976.484549:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379641984:0@lo:38:kworker.0
00000100:00080000:2.0:1767318976.484558:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767318976.484561:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767318976.484563:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379642240:0@lo:38:kworker.0
00010000:00010000:2.0:1767318976.983755:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318978.007515:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318978.448518:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318978.448621:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318978.453494:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291891456
00000100:00100000:3.0:1767318978.453513:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291891456
00000100:00100000:3.0:1767318978.453655:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291891328
00000100:00100000:3.0:1767318978.453660:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291891328
00000100:00100000:3.0:1767318978.453689:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3969
00000100:00100000:3.0:1767318978.453702:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291891456:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767318978.454173:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291891456:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 473us (5664us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318978.454183:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3969
00000100:00100000:3.0:1767318978.454205:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16595
00000100:00100000:3.0:1767318978.454210:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291891328:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767318978.456532:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318978.457610:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291891328:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 3380us (8980us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318978.457624:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16595
00000100:00080000:0.0:1767318978.461688:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767318978.521499:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318978.521532:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379642368:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767318978.521626:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318978.521715:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379642368
00000100:00100000:2.0:1767318978.521723:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379642368
00000100:00100000:2.0:1767318978.521779:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106
00000100:00100000:2.0:1767318978.521826:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379642368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767318978.521856:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318978.521920:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379642368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (293us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318978.521928:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106
00000100:00100000:2.0:1767318978.521976:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379642368:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318978.522005:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767318979.031156:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318980.055632:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00010000:00010000:0.0:1767318980.055634:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318980.055658:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379642496:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767318980.055739:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318980.056450:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379642496
00000100:00100000:0.0:1767318980.056460:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379642496
00000100:00100000:0.0:1767318980.056540:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107
00000100:00100000:0.0:1767318980.056552:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379642496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318980.056583:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318980.056721:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379642496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (981us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318980.056730:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107
00000100:00080000:2.0:1767318980.056823:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767318980.075915:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379642496:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767318981.079952:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767318981.591528:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318981.591540:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767318981.591543:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318981.591547:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318981.591552:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318981.591559:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3878
00000100:00080000:2.0:1767318981.591564:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318981.591572:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318981.591614:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45180 x1853164379642624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318981.591645:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318981.591649:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318981.591651:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318981.591655:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3878
00000100:00080000:2.0:1767318981.591658:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318981.591662:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318981.591675:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46a00 x1853164379642752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318981.591738:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318981.591752:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318981.591753:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318981.591756:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3878
00000100:00080000:2.0:1767318981.591759:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318981.591762:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318981.591784:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164379643264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767318981.591800:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767318981.591803:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767318981.591805:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767318981.591808:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3878
00000100:00080000:2.0:1767318981.591810:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767318981.591814:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767318981.591823:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45f80 x1853164379643520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767318981.591849:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379643392:0@lo:400:kworker.0
00000100:00100000:2.0:1767318981.591934:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318981.592007:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767318981.592014:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379643136:0@lo:400:kworker.0
00000100:00100000:2.0:1767318981.592036:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318981.592183:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379642624:0@lo:38:kworker.0
00000100:00100000:0.0:1767318981.592212:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318981.592237:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379642752:0@lo:38:kworker.0
00000100:00100000:0.0:1767318981.592271:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318981.592293:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379643264:0@lo:38:kworker.0
00000100:00100000:0.0:1767318981.592327:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318981.592349:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379643520:0@lo:38:kworker.0
00000100:00100000:0.0:1767318981.592368:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318981.592394:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643136
00000100:00100000:0.0:1767318981.592401:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643136
00000100:00100000:0.0:1767318981.592464:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379642624
00000100:00100000:0.0:1767318981.592468:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379642624
00000100:00100000:0.0:1767318981.592478:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643264
00000100:00100000:0.0:1767318981.592480:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643264
00000100:00100000:0.0:1767318981.592486:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643520
00000100:00100000:0.0:1767318981.592488:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643520
00000100:00100000:0.0:1767318981.592498:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970
00000100:00100000:0.0:1767318981.592507:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379643136:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318981.592559:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379643136:12345-0@lo:400:kworker.0 Request processed in 54us (521us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318981.592566:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970
00000100:00100000:0.0:1767318981.592583:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16596
00000100:00100000:0.0:1767318981.592587:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379642624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318981.592605:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318981.592635:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379642624:12345-0@lo:38:kworker.0 Request processed in 47us (422us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318981.592641:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16596
00000100:00100000:0.0:1767318981.592652:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16597
00000100:00100000:0.0:1767318981.592656:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379643264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318981.592665:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318981.592685:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379643264:12345-0@lo:38:kworker.0 Request processed in 27us (358us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318981.592690:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16597
00000100:00100000:0.0:1767318981.592701:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16598
00000100:00100000:0.0:1767318981.592704:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379643520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318981.592713:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318981.592746:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379643520:12345-0@lo:38:kworker.0 Request processed in 40us (376us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318981.592751:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16598
00000100:00080000:0.0:1767318981.592768:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767318981.592807:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318981.592813:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318981.592816:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379642624:0@lo:38:kworker.0
00000100:00080000:0.0:1767318981.592825:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318981.592827:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318981.592830:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379643264:0@lo:38:kworker.0
00000100:00080000:0.0:1767318981.592837:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318981.592840:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318981.592843:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379643520:0@lo:38:kworker.0
00000100:00100000:0.0:1767318981.592909:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379643136:0@lo:400:kworker.0
00000100:00100000:1.0:1767318981.593930:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379642880:0@lo:400:kworker.0
00000100:00100000:1.0:1767318981.593986:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318981.594037:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767318981.594044:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379643008:0@lo:400:kworker.0
00000100:00100000:1.0:1767318981.594078:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318981.594127:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379642880
00000100:00100000:1.0:1767318981.594134:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379642880
00000100:00100000:1.0:1767318981.594175:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643008
00000100:00100000:1.0:1767318981.594178:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643008
00000100:00100000:1.0:1767318981.594196:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355
00000100:00100000:1.0:1767318981.594202:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379642880:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318981.594246:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379642880:12345-0@lo:400:kworker.0 Request processed in 44us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318981.594251:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355
00000100:00100000:1.0:1767318981.594281:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356
00000100:00100000:1.0:1767318981.594287:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379643008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318981.594327:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379643008:12345-0@lo:400:kworker.0 Request processed in 39us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318981.594332:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356
00000100:00080000:1.0:1767318981.594356:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318981.594382:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379643008:0@lo:400:kworker.0
00000100:00100000:1.0:1767318981.594392:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379642880:0@lo:400:kworker.0
00000100:00100000:2.0:1767318981.595005:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643392
00000100:00100000:2.0:1767318981.595014:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643392
00000100:00100000:3.0:1767318981.595194:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379642752
00000100:00100000:3.0:1767318981.595199:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379642752
00000100:00100000:3.0:1767318981.595225:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911
00000100:00100000:3.0:1767318981.595230:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379642752:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318981.595249:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318981.595332:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379642752:12345-0@lo:38:kworker.0 Request processed in 100us (3070us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318981.595339:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911
00000100:00100000:3.0:1767318981.595361:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971
00000100:00100000:3.0:1767318981.595368:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379643392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318981.595411:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379643392:12345-0@lo:400:kworker.0 Request processed in 43us (3476us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318981.595417:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971
00000100:00100000:3.0:1767318981.595459:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379643392:0@lo:400:kworker.0
00000100:00080000:3.0:1767318981.595488:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318981.595493:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318981.595511:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379642752:0@lo:38:kworker.0
00000100:00080000:1.0:1767318981.596047:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767318982.103465:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318983.130950:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318983.570190:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318983.570248:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767318983.570561:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291891712
00000100:00100000:1.0:1767318983.570572:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291891712
00000100:00100000:1.0:1767318983.570657:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291891584
00000100:00100000:1.0:1767318983.570661:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291891584
00000100:00100000:1.0:1767318983.570685:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3972
00000100:00100000:1.0:1767318983.570707:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291891712:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767318983.570800:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291891712:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (620us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318983.570808:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3972
00000100:00100000:0.0:1767318983.570911:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16599
00000100:00100000:0.0:1767318983.570919:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291891584:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:2.0:1767318983.570925:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:0.0:1767318983.570939:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318983.570965:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291891584:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (717us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318983.570970:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16599
00000100:00100000:3.0:1767318983.639275:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767318983.639296:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379643648:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318983.639373:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318983.639561:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643648
00000100:00100000:0.0:1767318983.639569:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643648
00000100:00100000:0.0:1767318983.639631:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108
00000100:00100000:0.0:1767318983.639641:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379643648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318983.639672:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318983.639735:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379643648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (352us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318983.639743:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108
00000100:00080000:2.0:1767318983.640978:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318983.641224:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379643648:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767318984.153228:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767318985.175901:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318985.177600:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379643776:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767318985.177688:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318985.179282:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643776
00000100:00100000:0.0:1767318985.179295:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643776
00000100:00100000:0.0:1767318985.179384:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109
00000100:00100000:0.0:1767318985.179395:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379643776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767318985.179429:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318985.179519:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379643776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (1830us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318985.179527:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109
00000100:00100000:3.0:1767318985.180226:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379643776:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767318985.182273:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767318986.199127:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767318986.712503:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318986.712514:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767318986.712524:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318986.712528:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318986.712533:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318986.712541:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3883
00000100:00080000:3.0:1767318986.712546:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318986.712554:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318986.712614:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c81c00 x1853164379643904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318986.712646:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318986.712650:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318986.712651:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318986.712655:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3883
00000100:00080000:3.0:1767318986.712658:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318986.712661:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318986.712676:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c83800 x1853164379644032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318986.712772:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318986.712776:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318986.712779:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318986.712783:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3883
00000100:00080000:3.0:1767318986.712785:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318986.712790:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379644160:0@lo:400:kworker.0
00000100:00080000:3.0:1767318986.712791:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318986.712807:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80000 x1853164379644544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767318986.712825:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767318986.712828:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767318986.712830:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767318986.712833:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3883
00000100:00080000:3.0:1767318986.712835:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767318986.712839:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318986.712853:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eea00 x1853164379644800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318986.712894:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318986.712902:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379644416:0@lo:400:kworker.0
00000100:00100000:3.0:1767318986.712942:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318986.712968:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318986.712976:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379644288:0@lo:400:kworker.0
00000100:00100000:3.0:1767318986.712977:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767318986.712988:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379644672:0@lo:400:kworker.0
00000100:00100000:1.0:1767318986.713009:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318986.713021:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318986.713049:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644160
00000100:00100000:1.0:1767318986.713057:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644160
00000100:00100000:3.0:1767318986.713064:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644416
00000100:00100000:3.0:1767318986.713070:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644416
00000100:00100000:3.0:1767318986.713124:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644672
00000100:00100000:1.0:1767318986.713125:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644288
00000100:00100000:1.0:1767318986.713129:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644288
00000100:00100000:3.0:1767318986.713136:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644672
00000100:00100000:1.0:1767318986.713157:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357
00000100:00100000:1.0:1767318986.713168:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379644160:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318986.713174:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973
00000100:00100000:3.0:1767318986.713185:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379644416:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318986.713228:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379644416:12345-0@lo:400:kworker.0 Request processed in 46us (286us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318986.713236:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973
00000100:00100000:3.0:1767318986.713252:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974
00000100:00100000:3.0:1767318986.713259:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379644672:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318986.713287:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379644672:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318986.713292:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974
00000100:00100000:3.0:1767318986.713332:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379644672:0@lo:400:kworker.0
00000100:00100000:3.0:1767318986.713343:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379644416:0@lo:400:kworker.0
00000100:00080000:2.0:1767318986.713356:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767318986.713364:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318986.713390:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358
00000100:00100000:2.0:1767318986.713400:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379644288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767318986.713458:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379644288:12345-0@lo:400:kworker.0 Request processed in 61us (450us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318986.713465:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358
00000100:00100000:0.0:1767318986.713624:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379643904:0@lo:38:kworker.0
00000100:00100000:0.0:1767318986.713666:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318986.713671:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379644160:12345-0@lo:400:kworker.0 Request processed in 504us (804us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318986.713679:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357
00000100:00100000:0.0:1767318986.713700:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379644032:0@lo:38:kworker.0
00000100:00100000:1.0:1767318986.713710:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379643904
00000100:00100000:1.0:1767318986.713716:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379643904
00000100:00100000:0.0:1767318986.713740:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318986.713749:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16600
00000100:00100000:1.0:1767318986.713754:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379643904:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767318986.713772:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379644544:0@lo:38:kworker.0
00010000:00020000:1.0:1767318986.713773:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318986.713805:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318986.713818:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379643904:12345-0@lo:38:kworker.0 Request processed in 62us (151us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318986.713825:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16600
00000100:00100000:0.0:1767318986.713828:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379644800:0@lo:38:kworker.0
00000100:00100000:1.0:1767318986.713838:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644544
00000100:00100000:1.0:1767318986.713843:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644544
00000100:00100000:0.0:1767318986.713857:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318986.713935:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767318986.713940:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767318986.713944:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379643904:0@lo:38:kworker.0
00000100:00100000:0.0:1767318986.713966:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644032
00000100:00100000:0.0:1767318986.713971:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644032
00000100:00100000:0.0:1767318986.713997:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912
00000100:00100000:0.0:1767318986.714001:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379644032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318986.714011:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318986.714038:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379644032:12345-0@lo:38:kworker.0 Request processed in 36us (300us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318986.714043:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912
00000100:00100000:3.0:1767318986.714202:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379644288:0@lo:400:kworker.0
00000100:00100000:3.0:1767318986.714213:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379644160:0@lo:400:kworker.0
00000100:00100000:1.0:1767318986.714838:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644800
00000100:00100000:1.0:1767318986.714847:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644800
00000100:00100000:1.0:1767318986.714895:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16601
00000100:00100000:1.0:1767318986.714901:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379644544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318986.714915:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318986.714959:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379644544:12345-0@lo:38:kworker.0 Request processed in 57us (1154us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318986.714966:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16601
00000100:00100000:1.0:1767318986.714981:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16602
00000100:00100000:1.0:1767318986.714984:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379644800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318986.714993:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318986.715016:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379644800:12345-0@lo:38:kworker.0 Request processed in 30us (1160us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318986.715020:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16602
00000100:00080000:1.0:1767318986.715083:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318986.715088:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318986.715091:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379644032:0@lo:38:kworker.0
00000100:00080000:1.0:1767318986.715100:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318986.715103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318986.715105:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379644544:0@lo:38:kworker.0
00000100:00080000:1.0:1767318986.715112:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318986.715115:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318986.715118:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379644800:0@lo:38:kworker.0
00010000:00010000:1.0:1767318987.227832:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767318987.666020:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291891840 offset 0 length 520: 4
00000100:00100000:3.0:1767318987.666061:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318987.666103:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767318987.666207:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892096
00000100:00100000:0.0:1767318987.666218:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892096
00000100:00100000:0.0:1767318987.666301:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291891968
00000100:00100000:0.0:1767318987.666304:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291891968
00000100:00100000:0.0:1767318987.666323:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3975
00000100:00100000:0.0:1767318987.666334:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291892096:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318987.666416:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291892096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (354us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318987.666433:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3975
00000100:00100000:0.0:1767318987.666455:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16603
00000100:00100000:0.0:1767318987.666460:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291891968:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318987.666480:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767318987.666508:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291891968:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (405us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318987.666515:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16603
00000100:00080000:2.0:1767318987.666833:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767318988.247047:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318988.759965:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767318988.759984:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379644928:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767318988.760052:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318988.760296:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379644928
00000100:00100000:1.0:1767318988.760304:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379644928
00000100:00100000:1.0:1767318988.760412:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110
00000100:00100000:1.0:1767318988.760423:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379644928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318988.760456:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318988.760508:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379644928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (455us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318988.760517:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110
00000100:00100000:0.0:1767318988.760552:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379644928:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767318988.763175:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767318989.271522:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318990.295221:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379645056:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318990.295298:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318990.295754:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379645056
00000100:00100000:1.0:1767318990.295763:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379645056
00000100:00100000:1.0:1767318990.295831:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111
00000100:00100000:1.0:1767318990.295841:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379645056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767318990.295895:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318990.295950:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379645056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (650us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318990.295958:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111
00000100:00100000:1.0:1767318990.296021:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379645056:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318990.296109:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767318990.296137:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318991.319492:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318991.831026:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318966/real 1767318966]  req@ffff8b0e0c85d880 x1853164379638656/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318991 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767318991.831066:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c85d880 x1853164379638656/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767318991 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767318991.831081:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318991.831108:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767318991.831112:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379638656:0@lo:250:kworker.0
00000100:00080000:0.0:1767318991.832756:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318991.832766:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767318991.832770:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318991.832776:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3868
00000100:00080000:0.0:1767318991.832781:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318991.832788:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318991.832828:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164379645184/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318991.832864:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318991.832920:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318991.832922:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318991.832926:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3889
00000100:00080000:0.0:1767318991.832929:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318991.832932:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318991.832950:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06d80 x1853164379645312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767318991.832959:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379645184:0@lo:250:kworker.0
00000100:00080000:0.0:1767318991.832964:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318991.832969:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318991.832971:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318991.832976:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3889
00000100:00080000:0.0:1767318991.832978:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318991.832982:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318991.832998:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05880 x1853164379645440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000400:00000100:1.0:1767318991.833026:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379645184 offset 0 length 520: 4
00000100:00080000:0.0:1767318991.833064:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318991.833068:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318991.833070:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318991.833075:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3889
00000100:00100000:1.0:1767318991.833078:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379645312:0@lo:38:kworker.0
00000100:00080000:0.0:1767318991.833080:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318991.833088:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318991.833102:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379645952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767318991.833110:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379645568:0@lo:400:kworker.0
00000100:00100000:1.0:1767318991.833117:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767318991.833126:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318991.833130:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318991.833132:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318991.833137:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3889
00000100:00080000:0.0:1767318991.833140:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767318991.833144:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379645440:0@lo:38:kworker.0
00000100:00080000:0.0:1767318991.833146:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767318991.833158:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318991.833162:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04000 x1853164379646208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318991.833199:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379645824:0@lo:400:kworker.0
00000100:00100000:2.0:1767318991.833298:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379645696:0@lo:400:kworker.0
00000100:00100000:3.0:1767318991.839914:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379645312
00000100:00100000:3.0:1767318991.839930:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379645312
00000100:00100000:3.0:1767318991.839984:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16604
00000100:00100000:3.0:1767318991.840008:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379645312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318991.840031:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318991.840092:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379645312:12345-0@lo:38:kworker.0 Request processed in 85us (6978us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318991.840101:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16604
00000100:00100000:3.0:1767318991.840148:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379645568
00000100:00100000:3.0:1767318991.840152:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379645568
00000100:00100000:3.0:1767318991.840376:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359
00000100:00100000:3.0:1767318991.840387:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379645568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318991.840435:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379645568:12345-0@lo:400:kworker.0 Request processed in 51us (7278us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318991.840441:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359
00000100:00080000:3.0:1767318991.840458:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318991.840487:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379645568:0@lo:400:kworker.0
00000100:00100000:3.0:1767318991.840743:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379646080:0@lo:400:kworker.0
00000100:00100000:3.0:1767318991.840784:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318991.840815:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646080
00000100:00100000:3.0:1767318991.840820:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646080
00000100:00080000:3.0:1767318991.840836:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318991.840861:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976
00000100:00100000:3.0:1767318991.840887:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379646080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318991.840926:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379646080:12345-0@lo:400:kworker.0 Request processed in 59us (142us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318991.840932:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976
00000100:00100000:3.0:1767318991.840957:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379646080:0@lo:400:kworker.0
00000100:00100000:0.0:1767318991.842524:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767318991.843005:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379645824
00000100:00100000:3.0:1767318991.843029:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379645824
00000100:00100000:1.0:1767318991.843108:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767318991.843143:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318991.843164:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379645952:0@lo:38:kworker.0
00000100:00100000:1.0:1767318991.843206:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318991.843381:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379645440
00000100:00100000:0.0:1767318991.843386:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379645440
00000100:00100000:0.0:1767318991.843414:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913
00000100:00100000:0.0:1767318991.843421:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379645440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767318991.843441:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318991.844323:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379645952
00000100:00100000:3.0:1767318991.844330:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379645952
00000100:00100000:3.0:1767318991.844358:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977
00000100:00100000:1.0:1767318991.844375:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379646208:0@lo:38:kworker.0
00000100:00100000:2.0:1767318991.844432:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318991.844484:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379645696
00000100:00100000:2.0:1767318991.844488:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379645696
00000100:00100000:2.0:1767318991.844518:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360
00000100:00100000:2.0:1767318991.844525:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379645696:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318991.844718:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379645824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767318991.848331:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379645824:12345-0@lo:400:kworker.0 Request processed in 3470us (5663us total) trans 0 rc 0/0
00000100:00100000:3.0:1767318991.848347:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977
00000100:00100000:3.0:1767318991.848440:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16605
00000100:00100000:3.0:1767318991.848447:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379645952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767318991.848470:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318991.848939:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379645952:12345-0@lo:38:kworker.0 Request processed in 489us (5730us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318991.848947:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16605
00000100:00100000:1.0:1767318991.849304:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318991.849343:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646208
00000100:00100000:1.0:1767318991.849352:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646208
00000100:00100000:1.0:1767318991.849383:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16606
00000100:00100000:1.0:1767318991.849388:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379646208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318991.849405:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318991.849436:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379645696:12345-0@lo:400:kworker.0 Request processed in 4907us (5000us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318991.849445:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379646208:12345-0@lo:38:kworker.0 Request processed in 54us (140us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318991.849451:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360
00000100:00100000:1.0:1767318991.849462:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16606
00000100:00080000:1.0:1767318991.849508:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767318991.849512:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379645696:0@lo:400:kworker.0
00000100:00080000:1.0:1767318991.849516:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318991.849522:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379646208:0@lo:38:kworker.0
00000100:00080000:1.0:1767318991.849537:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318991.849542:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318991.849545:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379645312:0@lo:38:kworker.0
00000100:00080000:1.0:1767318991.849570:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318991.849573:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318991.849576:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379645952:0@lo:38:kworker.0
00000100:00100000:1.0:1767318991.849613:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379645824:0@lo:400:kworker.0
00000100:00100000:0.0:1767318991.849855:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379645440:12345-0@lo:38:kworker.0 Request processed in 6431us (6745us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767318991.849864:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913
00000100:00080000:1.0:1767318991.849944:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767318991.849949:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767318991.849953:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379645440:0@lo:38:kworker.0
00010000:00010000:0.0:1767318992.343078:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767318992.785718:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318992.785817:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767318992.786121:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892352
00000100:00100000:3.0:1767318992.786131:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892352
00000100:00100000:3.0:1767318992.786228:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892224
00000100:00100000:3.0:1767318992.786232:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892224
00000100:00080000:0.0:1767318992.786247:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318992.786258:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3978
00000100:00100000:3.0:1767318992.786272:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291892352:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767318992.786297:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16607
00000100:00100000:0.0:1767318992.786305:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291892224:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767318992.786330:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767318992.786359:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291892352:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (649us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318992.786368:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291892224:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 61us (548us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767318992.786369:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3978
00000100:00100000:0.0:1767318992.786391:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16607
00010000:00010000:2.0:1767318993.367104:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318993.881191:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379646336:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767318993.881270:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318993.881519:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646336
00000100:00100000:1.0:1767318993.881528:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646336
00000100:00100000:1.0:1767318993.881637:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112
00000100:00100000:1.0:1767318993.881684:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379646336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767318993.881717:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767318993.881764:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379646336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (494us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318993.881772:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112
00000100:00080000:3.0:1767318993.881823:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767318993.881893:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379646336:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767318994.391156:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767318995.415302:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767318995.422373:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379646464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767318995.422448:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318995.422614:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646464
00000100:00100000:2.0:1767318995.422624:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646464
00000100:00100000:2.0:1767318995.422700:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113
00000100:00100000:2.0:1767318995.422711:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379646464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767318995.422742:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767318995.422816:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379646464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (367us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318995.422825:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113
00000100:00100000:2.0:1767318995.422912:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379646464:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767318995.425029:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767318996.439075:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767318996.951969:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318996.951981:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767318996.951984:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318996.951989:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318996.951995:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318996.952005:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3894
00000100:00080000:0.0:1767318996.952010:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318996.952019:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318996.952068:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379646592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318996.952104:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318996.952108:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318996.952110:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318996.952115:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3894
00000100:00080000:0.0:1767318996.952117:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318996.952121:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318996.952135:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05c00 x1853164379646720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318996.952187:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318996.952190:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318996.952192:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318996.952196:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3894
00000100:00080000:0.0:1767318996.952198:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318996.952201:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318996.952210:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379647232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767318996.952226:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767318996.952229:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767318996.952231:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767318996.952234:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3894
00000100:00080000:0.0:1767318996.952237:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767318996.952240:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767318996.952248:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04000 x1853164379647488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767318996.952282:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379647360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318996.952352:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318996.952428:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767318996.952437:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379647104:0@lo:400:kworker.0
00000100:00100000:0.0:1767318996.952467:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318996.952600:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379646848:0@lo:400:kworker.0
00000100:00100000:1.0:1767318996.952670:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318996.952710:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767318996.952716:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379646976:0@lo:400:kworker.0
00000100:00100000:1.0:1767318996.952740:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767318996.952776:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379647360
00000100:00100000:1.0:1767318996.952783:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379647360
00000100:00100000:1.0:1767318996.952846:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379647104
00000100:00100000:1.0:1767318996.952850:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379647104
00000100:00100000:1.0:1767318996.952913:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979
00000100:00100000:1.0:1767318996.952921:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379647360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318996.952979:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379647360:12345-0@lo:400:kworker.0 Request processed in 58us (627us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318996.952987:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979
00000100:00100000:1.0:1767318996.953011:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980
00000100:00100000:1.0:1767318996.953017:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379647104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767318996.953045:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379647104:12345-0@lo:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0
00000100:00100000:1.0:1767318996.953050:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980
00000100:00080000:1.0:1767318996.953065:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767318996.953110:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379647104:0@lo:400:kworker.0
00000100:00100000:1.0:1767318996.953120:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379647360:0@lo:400:kworker.0
00000100:00100000:0.0:1767318996.953540:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646848
00000100:00100000:0.0:1767318996.953547:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646848
00000100:00100000:0.0:1767318996.953582:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646976
00000100:00100000:0.0:1767318996.953584:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646976
00000100:00100000:0.0:1767318996.953602:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361
00000100:00100000:0.0:1767318996.953608:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379646848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318996.953662:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379646848:12345-0@lo:400:kworker.0 Request processed in 54us (992us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318996.953668:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361
00000100:00100000:0.0:1767318996.953681:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362
00000100:00100000:0.0:1767318996.953687:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379646976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767318996.953714:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379646976:12345-0@lo:400:kworker.0 Request processed in 27us (973us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318996.953719:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362
00000100:00100000:2.0:1767318996.954099:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379646592:0@lo:38:kworker.0
00000100:00100000:2.0:1767318996.954136:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318996.954168:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379646720:0@lo:38:kworker.0
00000100:00100000:2.0:1767318996.954193:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318996.954222:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379647232:0@lo:38:kworker.0
00000100:00100000:2.0:1767318996.954244:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318996.954259:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379647488:0@lo:38:kworker.0
00000100:00100000:2.0:1767318996.954280:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767318996.954310:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646720
00000100:00100000:2.0:1767318996.954315:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646720
00000100:00100000:2.0:1767318996.954340:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914
00000100:00100000:2.0:1767318996.954345:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379646720:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767318996.955752:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318996.955859:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379646720:12345-0@lo:38:kworker.0 Request processed in 1509us (1662us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318996.955883:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914
00000100:00100000:1.0:1767318996.956080:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379646592
00000100:00100000:1.0:1767318996.956088:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379646592
00000100:00100000:1.0:1767318996.956121:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379647232
00000100:00100000:1.0:1767318996.956125:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379647232
00000100:00100000:1.0:1767318996.956141:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379647488
00000100:00100000:1.0:1767318996.956144:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379647488
00000100:00100000:1.0:1767318996.956161:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16608
00000100:00100000:1.0:1767318996.956167:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379646592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318996.956182:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318996.956215:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379646592:12345-0@lo:38:kworker.0 Request processed in 47us (2079us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318996.956222:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16608
00000100:00100000:1.0:1767318996.956237:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16609
00000100:00100000:1.0:1767318996.956241:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379647232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318996.956251:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318996.956274:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379647232:12345-0@lo:38:kworker.0 Request processed in 31us (2029us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318996.956279:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16609
00000100:00100000:1.0:1767318996.956292:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16610
00000100:00100000:1.0:1767318996.956295:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379647488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767318996.956304:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767318996.956327:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379647488:12345-0@lo:38:kworker.0 Request processed in 29us (2046us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767318996.956332:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16610
00000100:00080000:1.0:1767318996.956360:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767318996.956418:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379646976:0@lo:400:kworker.0
00000100:00100000:1.0:1767318996.956431:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379646848:0@lo:400:kworker.0
00000100:00080000:3.0:1767318996.959615:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318996.959639:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318996.959645:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379646592:0@lo:38:kworker.0
00000100:00080000:3.0:1767318996.959662:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318996.959667:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318996.959670:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379646720:0@lo:38:kworker.0
00000100:00080000:3.0:1767318996.959682:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318996.959685:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318996.959688:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379647232:0@lo:38:kworker.0
00000100:00080000:3.0:1767318996.959698:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767318996.959702:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767318996.959705:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379647488:0@lo:38:kworker.0
00010000:00010000:2.0:1767318997.463133:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767318997.904351:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318997.904467:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892608
00000100:00100000:2.0:1767318997.904479:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892608
00000100:00100000:2.0:1767318997.904566:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3981
00000100:00100000:2.0:1767318997.904577:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291892608:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767318997.904674:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291892608:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 98us (333us total) trans 0 rc 0/0
00000100:00100000:2.0:1767318997.904684:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3981
00000100:00080000:1.0:1767318997.904757:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767318997.907240:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767318997.915362:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892480
00000100:00100000:2.0:1767318997.915457:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892480
00000100:00100000:2.0:1767318997.915747:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16611
00000100:00100000:2.0:1767318997.915755:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291892480:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767318997.915781:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767318997.916330:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291892480:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 571us (9094us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767318997.916339:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16611
00010000:00010000:2.0:1767318998.491769:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767318998.999073:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379647616:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767318998.999145:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767318998.999353:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379647616
00000100:00100000:0.0:1767318998.999362:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379647616
00000100:00100000:0.0:1767318998.999433:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114
00000100:00100000:0.0:1767318998.999445:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379647616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767318998.999477:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767318998.999534:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379647616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1767318998.999542:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114
00000100:00080000:1.0:1767318998.999622:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767318998.999645:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379647616:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767318999.511694:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319000.535229:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319000.535863:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379647744:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319000.535968:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319000.536290:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379647744
00000100:00100000:3.0:1767319000.536300:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379647744
00000100:00100000:3.0:1767319000.536375:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115
00000100:00100000:3.0:1767319000.536385:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379647744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319000.536414:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319000.536477:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379647744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (508us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319000.536484:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115
00000100:00100000:0.0:1767319000.536582:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379647744:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319000.536699:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319001.559348:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319002.071221:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319002.071232:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319002.071235:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319002.071239:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319002.071242:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319002.071251:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3899
00000100:00080000:1.0:1767319002.071256:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319002.071264:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319002.071303:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18380 x1853164379647872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319002.071330:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319002.071333:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319002.071335:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319002.071338:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3899
00000100:00080000:1.0:1767319002.071341:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319002.071344:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319002.071357:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19f80 x1853164379648000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319002.071434:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319002.071437:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319002.071439:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319002.071443:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3899
00000100:00080000:1.0:1767319002.071446:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319002.071449:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319002.071453:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379648128:0@lo:400:kworker.0
00000100:00100000:1.0:1767319002.071460:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164379648512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319002.071474:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319002.071477:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319002.071478:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319002.071481:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3899
00000100:00080000:1.0:1767319002.071483:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319002.071486:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319002.071495:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19880 x1853164379648768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319002.071522:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319002.071565:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379648384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319002.071579:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319002.071594:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379648256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319002.071606:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319002.071615:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319002.071628:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319002.071633:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379648640:0@lo:400:kworker.0
00000100:00100000:2.0:1767319002.071642:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648128
00000100:00100000:2.0:1767319002.071649:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648128
00000100:00100000:1.0:1767319002.071654:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319002.071699:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648256
00000100:00100000:2.0:1767319002.071703:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648256
00000100:00100000:2.0:1767319002.071725:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363
00000100:00100000:2.0:1767319002.071734:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379648128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319002.071779:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364
00000100:00100000:2.0:1767319002.071780:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379648128:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319002.071786:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363
00000100:00100000:0.0:1767319002.071788:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379648256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319002.071809:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648384
00000100:00100000:2.0:1767319002.071813:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648384
00000100:00100000:0.0:1767319002.071819:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379648256:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319002.071824:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364
00000100:00100000:2.0:1767319002.071836:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648640
00000100:00100000:2.0:1767319002.071839:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648640
00000100:00100000:0.0:1767319002.071846:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379647872:0@lo:38:kworker.0
00000100:00100000:2.0:1767319002.071858:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982
00000100:00100000:2.0:1767319002.071864:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379648384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319002.071885:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319002.071903:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379648000:0@lo:38:kworker.0
00000100:00100000:2.0:1767319002.071908:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379648384:12345-0@lo:400:kworker.0 Request processed in 44us (300us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319002.071913:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982
00000100:00100000:0.0:1767319002.071924:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319002.071924:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379647872
00000100:00100000:2.0:1767319002.071927:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379647872
00000100:00100000:2.0:1767319002.071943:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983
00000100:00100000:0.0:1767319002.071946:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379648512:0@lo:38:kworker.0
00000100:00100000:2.0:1767319002.071948:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379648640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319002.071965:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319002.071969:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379648640:12345-0@lo:400:kworker.0 Request processed in 21us (313us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319002.071974:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379648768:0@lo:38:kworker.0
00000100:00100000:2.0:1767319002.071974:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983
00000100:00100000:2.0:1767319002.071983:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648512
00000100:00100000:2.0:1767319002.071986:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648512
00000100:00100000:0.0:1767319002.071991:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319002.071993:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648768
00000100:00100000:2.0:1767319002.071995:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648768
00000100:00100000:2.0:1767319002.072004:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16612
00000100:00100000:2.0:1767319002.072009:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379647872:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319002.072012:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16613
00000100:00100000:0.0:1767319002.072016:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379648512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319002.072025:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319002.072056:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379647872:12345-0@lo:38:kworker.0 Request processed in 46us (186us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319002.072062:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16612
00000100:00100000:2.0:1767319002.072072:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16614
00000100:00100000:2.0:1767319002.072076:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379648768:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319002.072129:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379648640:0@lo:400:kworker.0
00000100:00100000:1.0:1767319002.072140:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379648384:0@lo:400:kworker.0
00000100:00080000:1.0:1767319002.072176:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319002.072181:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319002.072184:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379647872:0@lo:38:kworker.0
00000100:00080000:1.0:1767319002.072220:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319002.072224:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319002.072226:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319002.072242:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379648256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319002.072251:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379648128:0@lo:400:kworker.0
00000100:00100000:1.0:1767319002.072279:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648000
00000100:00100000:1.0:1767319002.072282:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648000
00000100:00100000:1.0:1767319002.072303:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915
00000100:00100000:1.0:1767319002.072307:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379648000:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319002.077007:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319002.077129:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379648512:12345-0@lo:38:kworker.0 Request processed in 5107us (5158us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319002.077144:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16613
00000100:00080000:3.0:1767319002.077926:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319002.077933:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319002.077937:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379648512:0@lo:38:kworker.0
00010000:00020000:2.0:1767319002.078004:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319002.078065:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379648768:12345-0@lo:38:kworker.0 Request processed in 5986us (6072us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319002.078074:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16614
00010000:00020000:1.0:1767319002.080841:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319002.080971:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379648000:12345-0@lo:38:kworker.0 Request processed in 8659us (9042us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319002.080983:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915
00000100:00080000:3.0:1767319002.081197:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319002.081203:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319002.081207:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379648000:0@lo:38:kworker.0
00000100:00080000:3.0:1767319002.081220:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319002.081224:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319002.081227:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379648768:0@lo:38:kworker.0
00010000:00010000:2.0:1767319002.585023:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319003.027339:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319003.027405:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319003.027669:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892864
00000100:00100000:2.0:1767319003.027680:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892864
00000100:00100000:2.0:1767319003.027752:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892736
00000100:00100000:2.0:1767319003.027754:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892736
00000100:00100000:2.0:1767319003.027770:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3984
00000100:00100000:2.0:1767319003.027779:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291892864:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319003.027859:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291892864:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (532us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319003.027866:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3984
00000100:00100000:2.0:1767319003.027918:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16615
00000100:00100000:2.0:1767319003.027923:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291892736:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319003.027942:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319003.027964:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291892736:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (559us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319003.027970:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16615
00000100:00080000:0.0:1767319003.028275:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319003.608992:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319004.119995:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319004.120017:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379648896:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319004.120096:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319004.120236:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379648896
00000100:00100000:2.0:1767319004.120245:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379648896
00000100:00100000:2.0:1767319004.120306:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116
00000100:00100000:2.0:1767319004.120316:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379648896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319004.120346:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319004.120402:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379648896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (305us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319004.120411:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116
00000100:00100000:1.0:1767319004.120631:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379648896:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319004.120838:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319004.631037:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319005.655195:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319005.655986:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379649024:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319005.656070:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319005.656339:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649024
00000100:00100000:3.0:1767319005.656350:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649024
00000100:00100000:3.0:1767319005.656412:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117
00000100:00100000:3.0:1767319005.656423:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379649024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319005.656454:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767319005.656624:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319005.656686:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379649024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 266us (616us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319005.656693:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117
00000100:00100000:1.0:1767319005.656760:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379649024:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319006.680018:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319007.191754:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319007.191761:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319007.191764:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319007.191768:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319007.191772:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319007.191780:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3904
00000100:00080000:1.0:1767319007.191784:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319007.191792:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319007.191827:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79180 x1853164379649152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319007.191853:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319007.191856:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319007.191858:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319007.191861:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3904
00000100:00080000:1.0:1767319007.191863:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319007.191866:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319007.191900:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7b480 x1853164379649280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319007.191922:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379649152:0@lo:38:kworker.0
00000100:00080000:1.0:1767319007.191944:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319007.191947:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319007.191948:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319007.191951:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3904
00000100:00080000:1.0:1767319007.191953:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319007.191956:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319007.191967:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79f80 x1853164379649792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319007.191981:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319007.191983:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319007.191985:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319007.191988:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3904
00000100:00100000:0.0:1767319007.191991:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319007.191991:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319007.191995:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319007.192004:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7bb80 x1853164379650048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319007.192069:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379649408:0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.192105:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319007.192136:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379649280:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.192138:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319007.192143:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379649536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.192161:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319007.192162:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319007.192186:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379649792:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.192189:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379649664:0@lo:400:kworker.0
00000100:00100000:0.0:1767319007.192206:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319007.192231:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649408
00000100:00100000:0.0:1767319007.192233:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379650048:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.192238:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649408
00000100:00100000:0.0:1767319007.192256:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319007.192281:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649152
00000100:00100000:0.0:1767319007.192284:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649152
00000100:00100000:2.0:1767319007.192287:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649536
00000100:00100000:2.0:1767319007.192290:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649536
00000100:00100000:0.0:1767319007.192301:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649792
00000100:00100000:0.0:1767319007.192304:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649792
00000100:00100000:2.0:1767319007.192310:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365
00000100:00100000:2.0:1767319007.192317:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379649408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.192366:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379649408:12345-0@lo:400:kworker.0 Request processed in 50us (261us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319007.192374:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365
00000100:00100000:2.0:1767319007.192392:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366
00000100:00100000:2.0:1767319007.192399:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379649536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.192441:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379649536:12345-0@lo:400:kworker.0 Request processed in 43us (278us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319007.192447:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366
00000100:00100000:2.0:1767319007.192465:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650048
00000100:00100000:2.0:1767319007.192468:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650048
00000100:00100000:2.0:1767319007.192490:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16616
00000100:00100000:2.0:1767319007.192508:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379649152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319007.192525:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319007.192566:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379649152:12345-0@lo:38:kworker.0 Request processed in 56us (575us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319007.192572:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16616
00000100:00100000:2.0:1767319007.192586:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16617
00000100:00100000:2.0:1767319007.192590:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379650048:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319007.192601:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319007.192624:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379650048:12345-0@lo:38:kworker.0 Request processed in 32us (366us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319007.192629:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16617
00000100:00100000:2.0:1767319007.192679:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379649536:0@lo:400:kworker.0
00000100:00100000:0.0:1767319007.192688:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16618
00000100:00100000:2.0:1767319007.192689:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379649408:0@lo:400:kworker.0
00000100:00100000:0.0:1767319007.192692:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379649792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319007.192701:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319007.192727:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379649792:12345-0@lo:38:kworker.0 Request processed in 34us (520us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319007.192733:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16618
00000100:00080000:2.0:1767319007.192740:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319007.192743:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319007.192752:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319007.192753:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319007.192757:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319007.192760:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379649792:0@lo:38:kworker.0
00000100:00080000:0.0:1767319007.192767:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319007.192769:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:0.0:1767319007.192771:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319007.192773:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379650048:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.192775:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379649920:0@lo:400:kworker.0
00000100:00080000:0.0:1767319007.192780:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319007.192782:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319007.192785:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379649152:0@lo:38:kworker.0
00000100:00100000:2.0:1767319007.192795:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319007.192805:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649664
00000100:00100000:0.0:1767319007.192808:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649664
00000100:00100000:2.0:1767319007.192813:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649920
00000100:00100000:2.0:1767319007.192815:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649920
00000100:00100000:0.0:1767319007.192837:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985
00000100:00100000:0.0:1767319007.192843:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379649664:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319007.192896:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379649664:12345-0@lo:400:kworker.0 Request processed in 53us (142us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319007.192902:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985
00000100:00100000:2.0:1767319007.197251:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986
00000100:00100000:2.0:1767319007.197277:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379649920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.197373:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379649920:12345-0@lo:400:kworker.0 Request processed in 110us (4575us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319007.197382:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986
00000100:00080000:2.0:1767319007.197608:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319007.197652:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379649920:0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.197665:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379649664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319007.197721:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379649280
00000100:00100000:2.0:1767319007.197728:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379649280
00000100:00100000:2.0:1767319007.197761:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916
00000100:00100000:2.0:1767319007.197766:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379649280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319007.197784:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319007.197828:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379649280:12345-0@lo:38:kworker.0 Request processed in 61us (5664us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319007.197835:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916
00000100:00080000:2.0:1767319007.197892:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319007.197897:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319007.197901:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379649280:0@lo:38:kworker.0
00010000:00010000:1.0:1767319007.704258:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319008.144105:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319008.144160:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319008.144256:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291892992
00000100:00100000:3.0:1767319008.144266:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291892992
00000100:00100000:3.0:1767319008.144309:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291893120
00000100:00100000:3.0:1767319008.144313:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291893120
00000100:00100000:3.0:1767319008.144370:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3987
00000100:00100000:3.0:1767319008.144381:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291893120:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319008.144486:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291893120:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (325us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319008.144494:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3987
00000100:00100000:3.0:1767319008.144513:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16619
00000100:00100000:3.0:1767319008.144517:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291892992:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319008.144554:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319008.144583:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291892992:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 63us (488us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319008.144589:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16619
00000100:00080000:1.0:1767319008.145303:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319008.732342:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319009.239195:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319009.239216:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379650176:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319009.239352:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319009.239504:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650176
00000100:00100000:3.0:1767319009.239512:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650176
00000100:00100000:3.0:1767319009.239583:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118
00000100:00100000:3.0:1767319009.239594:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379650176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319009.239622:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319009.239682:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379650176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319009.239689:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118
00000100:00100000:0.0:1767319009.239775:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379650176:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319009.240291:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319009.751278:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319010.775198:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319010.775222:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379650304:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319010.775302:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319010.775466:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650304
00000100:00100000:2.0:1767319010.775475:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650304
00000100:00100000:2.0:1767319010.775546:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119
00000100:00100000:2.0:1767319010.775556:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379650304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319010.775589:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319010.775637:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379650304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (334us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319010.775644:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119
00000100:00080000:1.0:1767319010.776821:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319010.776907:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379650304:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319010.780005:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319011.799527:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319012.311231:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319012.311244:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319012.311247:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319012.311251:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319012.311257:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319012.311265:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3909
00000100:00080000:3.0:1767319012.311269:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319012.311297:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319012.311345:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eca80 x1853164379650432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319012.311481:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319012.311485:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319012.311487:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319012.311499:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3909
00000100:00080000:3.0:1767319012.311501:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319012.311505:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319012.311523:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec000 x1853164379650560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319012.311602:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319012.311606:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319012.311608:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319012.311612:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3909
00000100:00080000:3.0:1767319012.311615:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319012.311618:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319012.311629:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ece00 x1853164379651072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319012.311645:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319012.311648:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319012.311650:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319012.311653:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3909
00000100:00080000:3.0:1767319012.311656:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319012.311666:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319012.311679:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80000 x1853164379651328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319012.311710:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379651200:0@lo:400:kworker.0
00000100:00100000:3.0:1767319012.311779:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319012.311856:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319012.311862:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379650944:0@lo:400:kworker.0
00000100:00100000:3.0:1767319012.311915:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319012.311999:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379650688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319012.312033:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319012.312064:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319012.312068:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379650816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319012.312083:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319012.312105:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379651200
00000100:00100000:2.0:1767319012.312111:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379651200
00000100:00100000:2.0:1767319012.312151:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650944
00000100:00100000:2.0:1767319012.312153:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650944
00000100:00100000:2.0:1767319012.312170:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988
00000100:00100000:2.0:1767319012.312175:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379651200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319012.312213:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379651200:12345-0@lo:400:kworker.0 Request processed in 38us (435us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319012.312218:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988
00000100:00100000:2.0:1767319012.312231:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989
00000100:00100000:2.0:1767319012.312234:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379650944:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319012.312250:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379650944:12345-0@lo:400:kworker.0 Request processed in 16us (336us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319012.312254:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989
00000100:00100000:2.0:1767319012.312265:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650688
00000100:00100000:2.0:1767319012.312267:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650688
00000100:00100000:2.0:1767319012.312284:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650816
00000100:00100000:2.0:1767319012.312286:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650816
00000100:00100000:2.0:1767319012.312300:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367
00000100:00100000:2.0:1767319012.312306:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379650688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319012.312335:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379650688:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319012.312341:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367
00000100:00100000:2.0:1767319012.312351:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368
00000100:00100000:2.0:1767319012.312357:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379650816:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319012.312377:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379650816:12345-0@lo:400:kworker.0 Request processed in 21us (293us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319012.312381:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368
00000100:00080000:1.0:1767319012.312502:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319012.312507:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319012.312509:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319012.312577:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379650944:0@lo:400:kworker.0
00000100:00100000:1.0:1767319012.312588:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379651200:0@lo:400:kworker.0
00000100:00100000:1.0:1767319012.312636:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379650816:0@lo:400:kworker.0
00000100:00100000:1.0:1767319012.312641:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379650688:0@lo:400:kworker.0
00000100:00100000:0.0:1767319012.312836:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379650432:0@lo:38:kworker.0
00000100:00100000:0.0:1767319012.312891:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319012.312921:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379650560:0@lo:38:kworker.0
00000100:00100000:0.0:1767319012.312945:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319012.312967:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379651072:0@lo:38:kworker.0
00000100:00100000:0.0:1767319012.312986:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319012.313003:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379651328:0@lo:38:kworker.0
00000100:00100000:0.0:1767319012.313024:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319012.313052:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650432
00000100:00100000:0.0:1767319012.313056:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650432
00000100:00100000:0.0:1767319012.313076:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379651072
00000100:00100000:0.0:1767319012.313079:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379651072
00000100:00100000:0.0:1767319012.313089:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379651328
00000100:00100000:0.0:1767319012.313092:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379651328
00000100:00100000:0.0:1767319012.313106:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16620
00000100:00100000:0.0:1767319012.313110:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379650432:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319012.313721:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379650560
00000100:00100000:2.0:1767319012.313728:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379650560
00000100:00100000:2.0:1767319012.313749:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917
00000100:00100000:2.0:1767319012.313753:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379650560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319012.313769:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319012.313806:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379650560:12345-0@lo:38:kworker.0 Request processed in 53us (860us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319012.313810:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917
00000100:00100000:2.0:1767319012.313825:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16621
00000100:00100000:2.0:1767319012.313828:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379651072:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319012.313834:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319012.313849:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379651072:12345-0@lo:38:kworker.0 Request processed in 20us (863us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319012.313853:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16621
00000100:00100000:2.0:1767319012.313863:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16622
00000100:00100000:2.0:1767319012.313865:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379651328:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319012.313884:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319012.313898:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379651328:12345-0@lo:38:kworker.0 Request processed in 32us (874us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319012.313901:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16622
00000100:00080000:2.0:1767319012.313930:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319012.313933:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319012.313935:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379650560:0@lo:38:kworker.0
00000100:00080000:2.0:1767319012.313940:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319012.313943:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319012.313944:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379651072:0@lo:38:kworker.0
00000100:00080000:2.0:1767319012.313949:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319012.313951:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319012.313953:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379651328:0@lo:38:kworker.0
00010000:00020000:0.0:1767319012.314046:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319012.314076:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379650432:12345-0@lo:38:kworker.0 Request processed in 965us (1185us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319012.314080:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16620
00000100:00080000:2.0:1767319012.314681:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319012.314687:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319012.314691:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379650432:0@lo:38:kworker.0
00010000:00010000:3.0:1767319012.827207:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319013.273947:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319013.273996:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319013.274033:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291893504 offset 0 length 520: 4
00000100:00100000:1.0:1767319013.274129:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291893376
00000100:00100000:1.0:1767319013.274140:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291893376
00000100:00100000:2.0:1767319013.274174:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291893248
00000100:00100000:2.0:1767319013.274178:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291893248
00000100:00100000:2.0:1767319013.274234:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3990
00000100:00080000:0.0:1767319013.274238:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319013.274246:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291893376:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319013.274363:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291893376:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (425us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319013.274372:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3990
00000100:00100000:2.0:1767319013.274406:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16623
00000100:00100000:2.0:1767319013.274414:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291893248:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319013.274449:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319013.274498:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291893248:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 70us (486us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319013.274505:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16623
00010000:00010000:2.0:1767319013.847492:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319014.359506:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319014.359531:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379651456:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319014.359604:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319014.359838:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379651456
00000100:00100000:3.0:1767319014.359846:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379651456
00000100:00100000:3.0:1767319014.359942:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120
00000100:00100000:3.0:1767319014.359953:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379651456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319014.359987:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319014.360037:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379651456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (432us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319014.360043:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120
00000100:00080000:2.0:1767319014.360188:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319014.360227:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379651456:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319014.871314:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319015.895305:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319015.895562:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319015.895576:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379651584:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319015.895650:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319015.896060:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379651584
00000100:00100000:3.0:1767319015.896069:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379651584
00000100:00100000:3.0:1767319015.896128:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121
00000100:00100000:3.0:1767319015.896136:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379651584:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319015.896171:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319015.896223:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379651584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (573us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319015.896242:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121
00000100:00100000:1.0:1767319015.896392:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379651584:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319015.896448:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319016.407349:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767318991/real 1767318991]  req@ffff8b0e0be06300 x1853164379645184/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319016 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319016.407389:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0be06300 x1853164379645184/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319016 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319016.407417:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319016.407429:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319016.407434:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379645184:0@lo:250:kworker.0
00000100:00080000:3.0:1767319016.407590:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319016.407597:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319016.407601:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319016.407606:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3894
00000100:00080000:3.0:1767319016.407610:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319016.407618:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319016.407658:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c81880 x1853164379651712/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319016.407690:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319016.407695:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319016.407697:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319016.407700:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3914
00000100:00080000:3.0:1767319016.407702:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319016.407707:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319016.407726:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80700 x1853164379651840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319016.407735:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319016.407738:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319016.407740:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319016.407744:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3914
00000100:00080000:3.0:1767319016.407746:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319016.407749:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319016.407759:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80000 x1853164379651968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319016.407836:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319016.407839:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319016.407841:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319016.407845:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3914
00000100:00080000:3.0:1767319016.407847:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319016.407851:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319016.407861:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0380 x1853164379652352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319016.407909:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319016.407912:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319016.407913:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319016.407917:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3914
00000100:00080000:3.0:1767319016.407919:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319016.407924:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319016.407935:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1880 x1853164379652608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319016.408152:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379652224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319016.408220:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319016.408286:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319016.408292:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379652096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319016.408317:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319016.408355:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652096
00000100:00100000:1.0:1767319016.408362:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652096
00000100:00100000:1.0:1767319016.408415:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369
00000100:00100000:1.0:1767319016.408424:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379652096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319016.408481:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379652096:12345-0@lo:400:kworker.0 Request processed in 57us (162us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319016.408488:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369
00000100:00080000:1.0:1767319016.408511:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319016.408547:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379652096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319016.408563:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379652480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319016.408585:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319016.408676:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379651712:0@lo:250:kworker.0
00000400:00000100:2.0:1767319016.408700:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379651712 offset 0 length 520: 4
00000100:00100000:2.0:1767319016.408718:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379651840:0@lo:38:kworker.0
00000100:00100000:2.0:1767319016.408741:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319016.408765:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379651968:0@lo:38:kworker.0
00000100:00100000:2.0:1767319016.408786:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319016.408814:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379652352:0@lo:38:kworker.0
00000100:00100000:2.0:1767319016.408832:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319016.408846:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379652608:0@lo:38:kworker.0
00000100:00100000:2.0:1767319016.408861:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319016.408914:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379651968
00000100:00100000:2.0:1767319016.408918:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379651968
00000100:00100000:2.0:1767319016.408938:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918
00000100:00100000:2.0:1767319016.408943:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379651968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319016.408960:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319016.408989:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379651968:12345-0@lo:38:kworker.0 Request processed in 45us (201us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319016.409007:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918
00000100:00100000:2.0:1767319016.409033:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652224
00000100:00100000:2.0:1767319016.409036:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652224
00000100:00100000:2.0:1767319016.409065:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652480
00000100:00100000:2.0:1767319016.409067:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652480
00000100:00100000:2.0:1767319016.409079:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379651840
00000100:00100000:2.0:1767319016.409081:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379651840
00000100:00100000:2.0:1767319016.409089:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652352
00000100:00100000:2.0:1767319016.409091:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652352
00000100:00100000:2.0:1767319016.409098:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652608
00000100:00100000:2.0:1767319016.409100:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652608
00000100:00100000:2.0:1767319016.409108:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991
00000100:00100000:2.0:1767319016.409113:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379652224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319016.409148:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379652224:12345-0@lo:400:kworker.0 Request processed in 35us (928us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319016.409155:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991
00000100:00100000:2.0:1767319016.409165:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992
00000100:00100000:2.0:1767319016.409171:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379652480:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319016.409198:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379652480:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319016.409203:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992
00000100:00100000:2.0:1767319016.409213:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16624
00000100:00100000:2.0:1767319016.409217:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379651840:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319016.409226:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319016.409244:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379651840:12345-0@lo:38:kworker.0 Request processed in 26us (503us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319016.409250:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16624
00000100:00100000:2.0:1767319016.409258:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16625
00000100:00100000:2.0:1767319016.409262:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379652352:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319016.409270:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319016.409288:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379652352:12345-0@lo:38:kworker.0 Request processed in 25us (455us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319016.409293:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16625
00000100:00100000:2.0:1767319016.409302:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16626
00000100:00100000:2.0:1767319016.409305:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379652608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319016.409314:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319016.409332:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379652608:12345-0@lo:38:kworker.0 Request processed in 26us (471us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319016.409337:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16626
00000100:00080000:2.0:1767319016.409361:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319016.409381:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379652224:0@lo:400:kworker.0
00000100:00080000:2.0:1767319016.409404:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319016.409408:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319016.409411:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379651840:0@lo:38:kworker.0
00000100:00080000:2.0:1767319016.409420:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319016.409423:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319016.409425:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379651968:0@lo:38:kworker.0
00000100:00080000:2.0:1767319016.409431:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319016.409434:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319016.409437:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379652352:0@lo:38:kworker.0
00000100:00080000:2.0:1767319016.409442:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319016.409445:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319016.409448:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379652608:0@lo:38:kworker.0
00000100:00100000:1.0:1767319016.410125:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379652480:0@lo:400:kworker.0
00010000:00010000:3.0:1767319016.919070:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319017.947130:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319018.388610:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319018.388731:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291893632
00000100:00100000:3.0:1767319018.388741:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291893632
00000100:00100000:3.0:1767319018.388844:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16627
00000100:00100000:3.0:1767319018.388853:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291893632:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319018.388914:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319018.389041:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291893632:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 187us (441us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319018.389064:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16627
00000100:00100000:0.0:1767319018.397137:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319018.397297:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291893760
00000100:00100000:3.0:1767319018.397307:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291893760
00000100:00100000:3.0:1767319018.397463:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3993
00000100:00100000:3.0:1767319018.397476:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291893760:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319018.397568:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291893760:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 95us (440us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319018.397575:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3993
00000100:00080000:2.0:1767319018.398020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319018.968830:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319019.479140:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379652736:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319019.479216:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319019.480445:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652736
00000100:00100000:3.0:1767319019.480458:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652736
00000100:00100000:3.0:1767319019.480537:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122
00000100:00100000:3.0:1767319019.480548:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379652736:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319019.480558:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:3.0:1767319019.480580:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319019.484360:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379652736:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319019.489656:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379652736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3670us (4999us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319019.489678:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122
00010000:00010000:1.0:1767319019.992621:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319021.015127:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379652864:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319021.015202:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319021.015482:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652864
00000100:00100000:0.0:1767319021.015491:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652864
00010000:00010000:3.0:1767319021.015497:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319021.015541:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319021.015556:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123
00000100:00100000:0.0:1767319021.015567:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379652864:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319021.015598:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319021.015660:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379652864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (458us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319021.015668:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123
00000100:00100000:1.0:1767319021.015761:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379652864:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319021.527087:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319021.527099:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319021.527102:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319021.527106:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319021.527110:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319021.527118:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3918
00000100:00080000:2.0:1767319021.527124:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319021.527130:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319021.527180:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164379652992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319021.527209:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319021.527213:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319021.527215:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319021.527218:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3918
00000100:00080000:2.0:1767319021.527221:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319021.527225:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319021.527239:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efdf80 x1853164379653120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319021.527309:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379653248:0@lo:400:kworker.0
00000100:00100000:3.0:1767319021.527378:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319021.527481:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379653248
00000100:00100000:1.0:1767319021.527490:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379653248
00000100:00080000:2.0:1767319021.527501:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319021.527504:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319021.527506:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319021.527510:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3918
00000100:00080000:2.0:1767319021.527512:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319021.527517:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319021.527530:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6a00 x1853164379653504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319021.527545:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370
00000100:00080000:2.0:1767319021.527545:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319021.527548:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319021.527550:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767319021.527553:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379653248:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319021.527553:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3918
00000100:00080000:2.0:1767319021.527555:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319021.527559:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319021.527567:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7480 x1853164379653760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319021.527588:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379653632:0@lo:400:kworker.0
00000100:00100000:0.0:1767319021.527664:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379652992:0@lo:38:kworker.0
00000100:00100000:0.0:1767319021.527695:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319021.527714:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379653120:0@lo:38:kworker.0
00000100:00100000:0.0:1767319021.527736:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319021.527886:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379653504:0@lo:38:kworker.0
00000100:00100000:0.0:1767319021.527911:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319021.527927:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379653760:0@lo:38:kworker.0
00000100:00100000:0.0:1767319021.527956:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319021.528016:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379652992
00000100:00100000:0.0:1767319021.528020:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379652992
00000100:00100000:0.0:1767319021.528040:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379653504
00000100:00100000:0.0:1767319021.528042:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379653504
00000100:00100000:0.0:1767319021.528055:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379653760
00000100:00100000:0.0:1767319021.528057:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379653760
00000100:00100000:0.0:1767319021.528071:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16628
00000100:00100000:0.0:1767319021.528075:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379652992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319021.528097:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319021.528134:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379652992:12345-0@lo:38:kworker.0 Request processed in 56us (437us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319021.528141:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16628
00000100:00100000:0.0:1767319021.528158:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16629
00000100:00100000:0.0:1767319021.528162:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379653504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319021.528172:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319021.528192:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379653504:12345-0@lo:38:kworker.0 Request processed in 28us (280us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319021.528197:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16629
00000100:00100000:0.0:1767319021.528206:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16630
00000100:00100000:0.0:1767319021.528210:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379653760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319021.528218:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319021.528238:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379653760:12345-0@lo:38:kworker.0 Request processed in 26us (292us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319021.528243:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16630
00000100:00080000:0.0:1767319021.528274:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319021.528279:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319021.528282:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379652992:0@lo:38:kworker.0
00000100:00080000:0.0:1767319021.528291:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319021.528294:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319021.528297:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379653504:0@lo:38:kworker.0
00000100:00080000:0.0:1767319021.528303:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319021.528306:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319021.528309:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379653760:0@lo:38:kworker.0
00000100:00080000:0.0:1767319021.528355:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319021.528375:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379653376:0@lo:400:kworker.0
00000100:00100000:0.0:1767319021.528400:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319021.528437:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379653376
00000100:00100000:0.0:1767319021.528440:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379653376
00000100:00100000:0.0:1767319021.528468:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994
00000100:00100000:0.0:1767319021.528475:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379653376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319021.528508:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379653376:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319021.528514:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994
00000100:00080000:0.0:1767319021.528527:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319021.528546:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379653376:0@lo:400:kworker.0
00000100:00100000:0.0:1767319021.528808:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379653120
00000100:00100000:0.0:1767319021.528815:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379653120
00000100:00100000:0.0:1767319021.528841:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919
00000100:00100000:0.0:1767319021.528845:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379653120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319021.528856:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319021.528923:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379653120:12345-0@lo:38:kworker.0 Request processed in 76us (1186us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319021.528930:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919
00000100:00080000:0.0:1767319021.528966:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319021.528970:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319021.528974:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379653120:0@lo:38:kworker.0
00000100:00100000:2.0:1767319021.529444:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319021.529481:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379653632
00000100:00100000:2.0:1767319021.529485:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379653632
00000100:00100000:2.0:1767319021.529522:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995
00000100:00100000:2.0:1767319021.529528:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379653632:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319021.529563:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379653632:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319021.529569:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995
00000100:00080000:2.0:1767319021.529586:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319021.529606:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379653632:0@lo:400:kworker.0
00000100:00100000:1.0:1767319021.538730:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379653248:12345-0@lo:400:kworker.0 Request processed in 11167us (11340us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319021.538745:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370
00000100:00100000:3.0:1767319021.540191:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379653248:0@lo:400:kworker.0
00010000:00010000:2.0:1767319022.039164:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319023.063419:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319023.508721:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319023.508799:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319023.508850:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291894016
00000100:00100000:2.0:1767319023.508864:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291894016
00000100:00100000:2.0:1767319023.509019:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291893888
00000100:00100000:2.0:1767319023.509022:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291893888
00000100:00100000:2.0:1767319023.509045:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3996
00000100:00100000:2.0:1767319023.509056:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291894016:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319023.509157:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291894016:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 103us (451us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319023.509165:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3996
00000100:00100000:2.0:1767319023.509198:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16631
00000100:00100000:2.0:1767319023.509202:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291893888:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319023.509238:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319023.509265:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291893888:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 61us (466us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319023.509272:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16631
00000100:00080000:3.0:1767319023.509896:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319024.088996:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319024.600538:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319024.607587:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379653888:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319024.607665:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319024.608767:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379653888
00000100:00100000:2.0:1767319024.608775:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379653888
00000100:00100000:2.0:1767319024.608843:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124
00000100:00100000:2.0:1767319024.608850:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379653888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319024.608891:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319024.608941:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379653888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (1277us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319024.608946:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124
00000100:00080000:3.0:1767319024.609045:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319024.609108:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379653888:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319025.111118:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319026.135251:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319026.135268:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379654016:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319026.135354:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319026.135844:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319026.136156:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654016
00000100:00100000:2.0:1767319026.136164:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654016
00000100:00100000:2.0:1767319026.136234:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125
00000100:00100000:2.0:1767319026.136243:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379654016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319026.136277:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319026.136375:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379654016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (1020us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319026.136383:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125
00000100:00100000:2.0:1767319026.136433:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379654016:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319026.136587:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319026.647487:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319026.647499:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319026.647503:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319026.647507:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319026.647511:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319026.647519:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3923
00000100:00080000:3.0:1767319026.647524:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319026.647530:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319026.647570:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3800 x1853164379654144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319026.647598:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319026.647601:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319026.647604:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319026.647608:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3923
00000100:00080000:3.0:1767319026.647610:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319026.647614:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319026.647629:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0700 x1853164379654272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319026.647693:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319026.647697:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319026.647699:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319026.647703:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3923
00000100:00080000:3.0:1767319026.647705:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319026.647709:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319026.647739:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0e00 x1853164379654784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319026.647802:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319026.647805:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319026.647807:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319026.647810:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3923
00000100:00080000:3.0:1767319026.647813:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319026.647817:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319026.647827:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1180 x1853164379655040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319026.647854:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379654912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319026.647959:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319026.648026:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319026.648032:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379654656:0@lo:400:kworker.0
00000100:00100000:3.0:1767319026.648054:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319026.648218:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379654528:0@lo:400:kworker.0
00000100:00100000:2.0:1767319026.648270:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319026.648296:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319026.648302:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379654400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319026.648322:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319026.648782:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379654144:0@lo:38:kworker.0
00000100:00100000:1.0:1767319026.648812:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319026.648842:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379654272:0@lo:38:kworker.0
00000100:00100000:2.0:1767319026.648858:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654912
00000100:00100000:2.0:1767319026.648865:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654912
00000100:00100000:1.0:1767319026.648891:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319026.648930:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654656
00000100:00100000:2.0:1767319026.648934:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654656
00000100:00100000:2.0:1767319026.648946:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654144
00000100:00100000:2.0:1767319026.648947:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654144
00000100:00100000:2.0:1767319026.648958:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997
00000100:00100000:2.0:1767319026.648962:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379654912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319026.649004:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998
00000100:00100000:2.0:1767319026.649006:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379654912:12345-0@lo:400:kworker.0 Request processed in 42us (1047us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319026.649013:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997
00000100:00100000:0.0:1767319026.649019:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379654656:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319026.649029:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16632
00000100:00100000:2.0:1767319026.649033:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379654144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319026.649048:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319026.649073:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379654656:12345-0@lo:400:kworker.0 Request processed in 58us (1016us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319026.649075:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379654144:12345-0@lo:38:kworker.0 Request processed in 37us (259us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319026.649098:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998
00000100:00100000:2.0:1767319026.649208:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16632
00000100:00080000:2.0:1767319026.649227:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319026.649251:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654528
00000100:00100000:2.0:1767319026.649254:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654528
00000100:00100000:2.0:1767319026.649289:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654400
00000100:00100000:2.0:1767319026.649292:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654400
00000100:00100000:2.0:1767319026.649306:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371
00000100:00100000:2.0:1767319026.649310:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379654528:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319026.649447:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379654528:12345-0@lo:400:kworker.0 Request processed in 135us (1176us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319026.649451:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379654784:0@lo:38:kworker.0
00000100:00100000:2.0:1767319026.649455:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371
00000100:00100000:2.0:1767319026.649468:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372
00000100:00100000:2.0:1767319026.649474:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379654400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319026.649497:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379654400:12345-0@lo:400:kworker.0 Request processed in 25us (1175us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319026.649503:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372
00000100:00100000:1.0:1767319026.649508:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319026.649523:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654784
00000100:00100000:2.0:1767319026.649526:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654784
00000100:00100000:1.0:1767319026.649535:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379655040:0@lo:38:kworker.0
00000100:00100000:2.0:1767319026.649543:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16633
00000100:00100000:2.0:1767319026.649547:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379654784:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319026.649555:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319026.649562:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319026.649585:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379654784:12345-0@lo:38:kworker.0 Request processed in 36us (82us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319026.649590:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16633
00000100:00100000:2.0:1767319026.649597:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655040
00000100:00100000:2.0:1767319026.649599:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655040
00000100:00100000:2.0:1767319026.649606:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16634
00000100:00080000:1.0:1767319026.649607:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319026.649611:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379655040:12345-0@lo:38:kworker.0
00000100:00080000:1.0:1767319026.649616:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00010000:00020000:2.0:1767319026.649619:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319026.649623:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379654144:0@lo:38:kworker.0
00000100:00080000:1.0:1767319026.649637:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319026.649642:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379655040:12345-0@lo:38:kworker.0 Request processed in 29us (79us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319026.649645:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319026.649651:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16634
00000100:00100000:1.0:1767319026.649653:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379654784:0@lo:38:kworker.0
00000100:00080000:1.0:1767319026.649667:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319026.649668:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319026.649674:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319026.649679:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379655040:0@lo:38:kworker.0
00000100:00100000:2.0:1767319026.649691:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379654400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319026.649705:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379654528:0@lo:400:kworker.0
00000100:00100000:2.0:1767319026.649739:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379654272
00000100:00100000:2.0:1767319026.649741:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379654272
00000100:00100000:2.0:1767319026.649758:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920
00000100:00100000:2.0:1767319026.649762:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379654272:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319026.649768:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319026.649788:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379654272:12345-0@lo:38:kworker.0 Request processed in 26us (899us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319026.649793:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920
00000100:00080000:1.0:1767319026.649809:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319026.649815:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319026.649818:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379654272:0@lo:38:kworker.0
00000100:00100000:3.0:1767319026.651106:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379654656:0@lo:400:kworker.0
00000100:00100000:3.0:1767319026.651489:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379654912:0@lo:400:kworker.0
00010000:00010000:2.0:1767319027.159488:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319028.187125:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319028.624688:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319028.624773:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319028.624813:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291894144
00000100:00100000:0.0:1767319028.624824:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291894144
00000100:00100000:0.0:1767319028.624901:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291894272
00000100:00100000:0.0:1767319028.624905:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291894272
00000100:00100000:1.0:1767319028.624911:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16635
00000100:00100000:1.0:1767319028.624920:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291894144:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319028.624941:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319028.624965:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 3999
00000100:00100000:0.0:1767319028.624975:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291894272:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319028.625011:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291894144:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 90us (332us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319028.625019:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16635
00000100:00100000:0.0:1767319028.625025:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291894272:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319028.625035:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 3999
00000100:00080000:3.0:1767319028.625360:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319029.207135:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319029.719897:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319029.719916:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379655168:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319029.719986:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319029.720113:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655168
00000100:00100000:2.0:1767319029.720121:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655168
00000100:00100000:2.0:1767319029.720182:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126
00000100:00100000:2.0:1767319029.720191:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379655168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319029.720221:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319029.720278:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379655168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (291us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319029.720285:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126
00000100:00100000:1.0:1767319029.720396:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379655168:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319029.720468:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319030.233463:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319031.255233:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319031.257121:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379655296:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319031.257243:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319031.257462:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655296
00000100:00100000:2.0:1767319031.257470:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655296
00000100:00100000:2.0:1767319031.257531:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127
00000100:00100000:2.0:1767319031.257540:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379655296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319031.257593:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319031.257638:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379655296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (395us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319031.257645:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127
00000100:00080000:3.0:1767319031.258449:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319031.258499:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379655296:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319031.767097:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319031.767119:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319031.767123:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319031.767126:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319031.767129:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319031.767136:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3929
00000100:00080000:0.0:1767319031.767140:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319031.767148:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319031.767183:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b800 x1853164379655424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319031.767198:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319031.767200:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319031.767201:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319031.767204:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3929
00000100:00080000:0.0:1767319031.767206:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319031.767209:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319031.767218:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c80000 x1853164379655552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319031.767263:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319031.767266:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319031.767267:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319031.767269:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3929
00000100:00080000:0.0:1767319031.767271:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319031.767274:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319031.767281:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164379656064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319031.767331:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319031.767334:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319031.767336:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319031.767339:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3929
00000100:00080000:0.0:1767319031.767342:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319031.767346:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319031.767365:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b800 x1853164379656320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319031.767416:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379655936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319031.767416:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379655424:0@lo:38:kworker.0
00000100:00100000:3.0:1767319031.767489:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379655808:0@lo:400:kworker.0
00000100:00100000:2.0:1767319031.767571:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379655680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319031.771250:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319031.771383:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379656192:0@lo:400:kworker.0
00000100:00100000:3.0:1767319031.771419:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319031.771458:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656192
00000100:00100000:3.0:1767319031.771466:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656192
00000100:00100000:3.0:1767319031.771571:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000
00000100:00100000:3.0:1767319031.771582:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379656192:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319031.771641:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379656192:12345-0@lo:400:kworker.0 Request processed in 62us (221us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319031.771648:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000
00000100:00080000:3.0:1767319031.771670:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319031.772038:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379656192:0@lo:400:kworker.0
00000100:00100000:0.0:1767319031.772391:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319031.772423:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655936
00000100:00100000:3.0:1767319031.772430:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655936
00000100:00100000:3.0:1767319031.772468:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001
00000100:00100000:3.0:1767319031.772475:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379655936:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319031.772582:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655808
00000100:00100000:0.0:1767319031.772586:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655808
00000100:00100000:3.0:1767319031.772594:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379655936:12345-0@lo:400:kworker.0 Request processed in 120us (203us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319031.772601:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001
00000100:00100000:0.0:1767319031.772615:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373
00000100:00100000:0.0:1767319031.772622:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379655808:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319031.772625:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319031.772672:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379655808:12345-0@lo:400:kworker.0 Request processed in 51us (1431us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319031.772679:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373
00000100:00100000:0.0:1767319031.772709:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379655936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319031.772972:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319031.773039:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379655552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319031.773162:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319031.773191:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379656064:0@lo:38:kworker.0
00000100:00100000:1.0:1767319031.773213:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319031.773269:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319031.773271:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379655808:0@lo:400:kworker.0
00000100:00100000:2.0:1767319031.773301:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655680
00000100:00100000:3.0:1767319031.773301:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655552
00000100:00100000:2.0:1767319031.773305:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655680
00000100:00100000:3.0:1767319031.773305:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655552
00000100:00100000:2.0:1767319031.773353:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374
00000100:00100000:2.0:1767319031.773361:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379655680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319031.773387:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921
00000100:00100000:3.0:1767319031.773392:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379655552:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319031.773395:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379655680:12345-0@lo:400:kworker.0 Request processed in 36us (126us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319031.773400:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374
00010000:00020000:3.0:1767319031.773411:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319031.773417:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319031.773433:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379655680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319031.773442:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379655552:12345-0@lo:38:kworker.0 Request processed in 49us (279us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319031.773449:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921
00000100:00100000:1.0:1767319031.773645:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379656320:0@lo:38:kworker.0
00000100:00100000:1.0:1767319031.773917:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319031.773993:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379655424
00000100:00100000:0.0:1767319031.773998:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379655424
00000100:00100000:0.0:1767319031.774157:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656064
00000100:00100000:0.0:1767319031.774161:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656064
00000100:00100000:2.0:1767319031.774203:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16636
00000100:00100000:2.0:1767319031.774208:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379655424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319031.774222:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319031.774257:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379655424:12345-0@lo:38:kworker.0 Request processed in 47us (1285us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319031.774263:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16636
00000100:00100000:2.0:1767319031.774280:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16637
00000100:00100000:2.0:1767319031.774283:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379656064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319031.774292:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319031.774330:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379656064:12345-0@lo:38:kworker.0 Request processed in 27us (1098us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319031.774335:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16637
00000100:00100000:3.0:1767319031.778634:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656320
00000100:00100000:3.0:1767319031.778654:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656320
00000100:00100000:3.0:1767319031.778782:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16638
00000100:00100000:3.0:1767319031.778790:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379656320:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319031.778822:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319031.779242:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319031.779249:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319031.779254:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379655424:0@lo:38:kworker.0
00000100:00080000:1.0:1767319031.784204:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319031.784217:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319031.784221:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379655552:0@lo:38:kworker.0
00000100:00100000:3.0:1767319031.784227:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379656320:12345-0@lo:38:kworker.0 Request processed in 5436us (10551us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319031.784235:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319031.784238:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319031.784238:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16638
00000100:00100000:1.0:1767319031.784241:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379656064:0@lo:38:kworker.0
00000100:00080000:1.0:1767319031.784247:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319031.784250:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319031.784252:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379656320:0@lo:38:kworker.0
00010000:00010000:1.0:1767319032.284152:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319033.305680:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319033.743729:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319033.743925:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319033.744358:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291894528
00000100:00100000:3.0:1767319033.744370:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291894528
00000100:00100000:0.0:1767319033.744549:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291894400
00000100:00100000:0.0:1767319033.744554:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291894400
00000100:00100000:0.0:1767319033.744587:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4002
00000100:00100000:0.0:1767319033.744597:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291894528:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319033.744668:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291894528:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (948us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319033.744675:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4002
00000100:00100000:0.0:1767319033.744692:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16639
00000100:00100000:0.0:1767319033.744698:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291894400:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319033.744718:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319033.744741:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291894400:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 42us (816us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319033.744747:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16639
00000100:00080000:2.0:1767319033.745435:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319034.329981:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319034.839331:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319034.839352:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379656448:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319034.839460:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319034.839675:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656448
00000100:00100000:1.0:1767319034.839684:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656448
00000100:00100000:1.0:1767319034.839820:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128
00000100:00100000:1.0:1767319034.839831:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379656448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319034.839894:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319034.839966:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379656448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (506us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319034.839974:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128
00000100:00100000:3.0:1767319034.840096:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379656448:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319034.843742:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319035.351262:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319036.375255:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319036.375295:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379656576:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319036.375404:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319036.379086:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656576
00000100:00100000:1.0:1767319036.379101:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656576
00000100:00100000:1.0:1767319036.379209:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129
00000100:00100000:1.0:1767319036.379220:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379656576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319036.379293:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00010000:00010000:3.0:1767319036.379404:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319036.379407:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379656576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (4001us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319036.379416:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129
00000100:00080000:2.0:1767319036.379465:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319036.380642:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379656576:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319036.886998:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319036.887009:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319036.887013:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319036.887017:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319036.887021:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319036.887042:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3934
00000100:00080000:0.0:1767319036.887046:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319036.887054:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319036.887095:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289180 x1853164379656704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319036.887121:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319036.887123:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319036.887125:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319036.887128:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3934
00000100:00080000:0.0:1767319036.887131:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319036.887134:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319036.887146:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b100 x1853164379656832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319036.887215:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319036.887218:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319036.887220:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319036.887223:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3934
00000100:00080000:0.0:1767319036.887226:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319036.887229:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319036.887245:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a680 x1853164379657344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319036.887377:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379656960:0@lo:400:kworker.0
00000100:00100000:2.0:1767319036.887449:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319036.887497:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319036.887501:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379657088:0@lo:400:kworker.0
00000100:00100000:2.0:1767319036.887514:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319036.887535:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656960
00000100:00100000:2.0:1767319036.887541:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656960
00000100:00100000:2.0:1767319036.887577:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657088
00000100:00100000:2.0:1767319036.887579:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657088
00000100:00100000:2.0:1767319036.887592:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375
00000100:00100000:2.0:1767319036.887597:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379656960:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319036.887631:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379656960:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319036.887636:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375
00000100:00100000:2.0:1767319036.887649:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376
00000100:00100000:2.0:1767319036.887652:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379657088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319036.887668:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379657088:12345-0@lo:400:kworker.0 Request processed in 16us (153us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319036.887672:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376
00000100:00080000:2.0:1767319036.887685:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319036.887715:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379657088:0@lo:400:kworker.0
00000100:00100000:2.0:1767319036.887721:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379656960:0@lo:400:kworker.0
00000100:00100000:2.0:1767319036.887828:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379657216:0@lo:400:kworker.0
00000100:00100000:2.0:1767319036.887848:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319036.887985:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657216
00000100:00100000:1.0:1767319036.887990:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657216
00000100:00100000:1.0:1767319036.888035:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003
00000100:00100000:1.0:1767319036.888040:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379657216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319036.888082:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379657216:12345-0@lo:400:kworker.0 Request processed in 42us (233us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319036.888086:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003
00000100:00100000:1.0:1767319036.888103:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379656704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319036.888118:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319036.888128:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379656832:0@lo:38:kworker.0
00000100:00100000:1.0:1767319036.888171:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319036.888208:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379657216:0@lo:400:kworker.0
00000100:00100000:1.0:1767319036.888223:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656704
00000100:00100000:1.0:1767319036.888226:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656704
00000100:00100000:1.0:1767319036.888246:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16640
00000100:00100000:1.0:1767319036.888336:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379656704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319036.888356:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319036.888383:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379656704:12345-0@lo:38:kworker.0 Request processed in 49us (264us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319036.888388:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16640
00000100:00080000:1.0:1767319036.888408:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319036.888411:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319036.888413:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379656704:0@lo:38:kworker.0
00000100:00080000:0.0:1767319036.888492:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319036.888496:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319036.888498:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319036.888502:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3934
00000100:00080000:0.0:1767319036.888504:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319036.888525:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319036.888540:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ad80 x1853164379657600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319036.888623:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379656832
00000100:00100000:3.0:1767319036.888627:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379656832
00000100:00100000:3.0:1767319036.888665:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922
00000100:00100000:3.0:1767319036.888670:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379656832:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319036.888681:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319036.888743:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379656832:12345-0@lo:38:kworker.0 Request processed in 72us (571us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319036.888750:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922
00000100:00100000:3.0:1767319036.888782:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379657472:0@lo:400:kworker.0
00000100:00100000:3.0:1767319036.888808:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319036.888839:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657472
00000100:00100000:3.0:1767319036.888842:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657472
00000100:00100000:3.0:1767319036.888892:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004
00000100:00100000:3.0:1767319036.888898:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379657472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319036.888950:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379657472:12345-0@lo:400:kworker.0 Request processed in 52us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319036.888956:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004
00000100:00100000:3.0:1767319036.888982:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379657472:0@lo:400:kworker.0
00000100:00080000:2.0:1767319036.889222:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319036.889368:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379657344:0@lo:38:kworker.0
00000100:00100000:1.0:1767319036.889397:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319036.889426:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379657600:0@lo:38:kworker.0
00000100:00100000:1.0:1767319036.889446:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319036.889473:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319036.889477:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319036.889481:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379656832:0@lo:38:kworker.0
00000100:00100000:2.0:1767319036.889545:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657344
00000100:00100000:2.0:1767319036.889549:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657344
00000100:00100000:2.0:1767319036.889576:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657600
00000100:00100000:2.0:1767319036.889579:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657600
00000100:00100000:2.0:1767319036.889601:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16641
00000100:00100000:2.0:1767319036.889606:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379657344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319036.889618:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319036.889668:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379657344:12345-0@lo:38:kworker.0 Request processed in 60us (269us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319036.889674:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16641
00000100:00100000:2.0:1767319036.889688:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16642
00000100:00100000:2.0:1767319036.889692:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379657600:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319036.889701:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319036.889723:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379657600:12345-0@lo:38:kworker.0 Request processed in 30us (277us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319036.889729:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16642
00000100:00080000:1.0:1767319036.889911:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319036.889916:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319036.889918:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379657344:0@lo:38:kworker.0
00000100:00080000:1.0:1767319036.889925:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319036.889928:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319036.889931:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379657600:0@lo:38:kworker.0
00010000:00010000:1.0:1767319037.399237:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:1.0:1767319037.839850:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291894656 offset 0 length 520: 4
00000100:00100000:0.0:1767319037.844948:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319037.845000:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319037.845086:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291894784
00000100:00100000:2.0:1767319037.845096:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291894784
00000100:00100000:2.0:1767319037.845157:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291894912
00000100:00100000:2.0:1767319037.845161:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291894912
00000100:00100000:2.0:1767319037.845219:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4005
00000100:00100000:2.0:1767319037.845238:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291894912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319037.845322:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291894912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 95us (321us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319037.845331:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4005
00000100:00100000:2.0:1767319037.845353:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16643
00000100:00100000:2.0:1767319037.845358:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291894784:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319037.845383:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319037.845412:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291894784:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (475us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319037.845418:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16643
00000100:00080000:0.0:1767319037.845578:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319038.423384:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319039.452145:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319039.960744:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319039.960776:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379657728:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319039.965192:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319039.965684:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657728
00000100:00100000:1.0:1767319039.965693:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657728
00000100:00100000:1.0:1767319039.965832:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130
00000100:00100000:1.0:1767319039.965862:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379657728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319039.965927:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319039.966002:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379657728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 162us (817us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319039.966010:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130
00000100:00100000:2.0:1767319039.966156:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379657728:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319039.966363:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319040.476912:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319041.495792:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379657856:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319041.495901:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319041.496328:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657856
00000100:00100000:0.0:1767319041.496338:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657856
00000100:00080000:3.0:1767319041.496394:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319041.496778:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319041.497147:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131
00000100:00100000:0.0:1767319041.497159:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379657856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319041.497214:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319041.497294:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379657856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (1392us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319041.497302:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131
00000100:00100000:2.0:1767319041.497396:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379657856:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319042.006990:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319042.007001:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319042.007005:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319042.007009:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319042.007013:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319042.007022:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3939
00000100:00080000:0.0:1767319042.007027:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319042.007033:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319042.007074:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289500 x1853164379657984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319042.007099:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319042.007103:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319042.007105:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319042.007109:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3939
00000100:00080000:0.0:1767319042.007111:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319042.007115:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319042.007142:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289c00 x1853164379658112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319042.007206:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319042.007210:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319042.007212:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767319042.007214:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:0.0:1767319042.007216:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3939
00000100:00080000:0.0:1767319042.007229:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319042.007233:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319042.007242:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379658496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319042.007247:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164379658624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319042.007263:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379658368:0@lo:400:kworker.0
00000100:00080000:0.0:1767319042.007272:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319042.007276:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319042.007278:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319042.007283:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3939
00000100:00080000:0.0:1767319042.007285:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319042.007289:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319042.007305:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28bb80 x1853164379658880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319042.007326:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319042.007336:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379658752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319042.007413:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319016/real 1767319016]  req@ffff8b0f31c81880 x1853164379651712/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319042.007435:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f31c81880 x1853164379651712/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319042.007448:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379657984:0@lo:38:kworker.0
00000100:00100000:2.0:1767319042.010289:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319042.010377:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379658496
00000100:00100000:2.0:1767319042.010387:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379658496
00000100:00100000:2.0:1767319042.010487:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006
00000100:00100000:2.0:1767319042.010497:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379658496:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.010557:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379658496:12345-0@lo:400:kworker.0 Request processed in 62us (276us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319042.010563:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006
00000100:00100000:2.0:1767319042.010594:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379658240:0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.010624:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319042.010657:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379658240
00000100:00100000:2.0:1767319042.010660:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379658240
00000100:00100000:2.0:1767319042.010684:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377
00000100:00100000:2.0:1767319042.010690:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379658240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.010718:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379658240:12345-0@lo:400:kworker.0 Request processed in 28us (93us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319042.010724:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377
00000100:00100000:2.0:1767319042.010755:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379658240:0@lo:400:kworker.0
00000100:00100000:2.0:1767319042.010776:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379658496:0@lo:400:kworker.0
00000100:00080000:2.0:1767319042.010802:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319042.010807:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319042.012441:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319042.012512:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379658368
00000100:00100000:2.0:1767319042.012521:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379658368
00000100:00100000:2.0:1767319042.012602:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378
00000100:00100000:2.0:1767319042.012611:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379658368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319042.012849:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319042.012903:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379658112:0@lo:38:kworker.0
00000100:00100000:3.0:1767319042.012908:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379657984
00000100:00100000:3.0:1767319042.012914:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379657984
00000100:00100000:1.0:1767319042.012946:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319042.012946:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16644
00000100:00100000:3.0:1767319042.012956:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379657984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319042.012976:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319042.012981:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379658624:0@lo:38:kworker.0
00000100:00100000:1.0:1767319042.013024:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319042.013025:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379657984:12345-0@lo:38:kworker.0 Request processed in 67us (173us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319042.013035:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16644
00000100:00100000:1.0:1767319042.013050:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379658880:0@lo:38:kworker.0
00000100:00100000:3.0:1767319042.013053:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379658624
00000100:00100000:1.0:1767319042.013074:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319042.013092:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319042.013093:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379658624
00000100:00100000:3.0:1767319042.013118:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379658880
00000100:00100000:3.0:1767319042.013123:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379658880
00000100:00100000:3.0:1767319042.013153:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16645
00000100:00100000:3.0:1767319042.013158:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379658624:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319042.013169:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319042.013198:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379658624:12345-0@lo:38:kworker.0 Request processed in 37us (175us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319042.013207:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319042.013207:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16645
00000100:00100000:1.0:1767319042.013217:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379651712:0@lo:250:kworker.0
00000100:00100000:3.0:1767319042.013236:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16646
00000100:00100000:3.0:1767319042.013241:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379658880:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319042.013251:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319042.013266:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319042.013274:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319042.013278:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379657984:0@lo:38:kworker.0
00000100:00100000:3.0:1767319042.013281:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379658880:12345-0@lo:38:kworker.0 Request processed in 36us (204us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319042.013291:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16646
00000100:00080000:1.0:1767319042.013295:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319042.013301:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319042.013305:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379658624:0@lo:38:kworker.0
00000100:00080000:1.0:1767319042.013315:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319042.013319:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319042.013322:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379658880:0@lo:38:kworker.0
00000100:00100000:3.0:1767319042.013356:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379658112
00000100:00080000:1.0:1767319042.013360:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319042.013361:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379658112
00000100:00080000:1.0:1767319042.013368:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319042.013371:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319042.013375:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3918
00000100:00080000:1.0:1767319042.013379:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319042.013384:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319042.013389:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923
00000100:00100000:3.0:1767319042.013395:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379658112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319042.013405:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319042.013412:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b800 x1853164379659008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319042.013441:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379658112:12345-0@lo:38:kworker.0 Request processed in 45us (498us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319042.013449:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923
00000100:00100000:1.0:1767319042.013453:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379659008:0@lo:250:kworker.0
00000400:00000100:1.0:1767319042.013478:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379659008 offset 0 length 520: 4
00000100:00080000:1.0:1767319042.013501:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319042.013505:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319042.013507:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379658112:0@lo:38:kworker.0
00000100:00100000:2.0:1767319042.013609:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379658368:12345-0@lo:400:kworker.0 Request processed in 999us (1173us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319042.013621:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378
00000100:00100000:1.0:1767319042.013798:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379658368:0@lo:400:kworker.0
00000100:00100000:0.0:1767319042.013863:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319042.013973:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379658752
00000100:00100000:1.0:1767319042.013978:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379658752
00000100:00100000:1.0:1767319042.014068:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007
00000100:00100000:1.0:1767319042.014076:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379658752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319042.014241:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379658752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319042.014281:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379658752:12345-0@lo:400:kworker.0 Request processed in 42us (254us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319042.014290:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007
00000100:00080000:2.0:1767319042.014332:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319042.519197:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319042.963990:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319042.964043:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319042.964131:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895168
00000100:00100000:2.0:1767319042.964141:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895168
00000100:00100000:2.0:1767319042.964227:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895040
00000100:00100000:2.0:1767319042.964231:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895040
00000100:00100000:2.0:1767319042.964254:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4008
00000100:00100000:2.0:1767319042.964264:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291895168:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319042.964393:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16647
00000100:00100000:1.0:1767319042.964400:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291895040:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319042.964417:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319042.964459:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291895040:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (416us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319042.964464:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16647
00000100:00080000:3.0:1767319042.964521:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319042.964568:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291895168:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 307us (589us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319042.964574:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4008
00010000:00010000:2.0:1767319043.543232:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319044.573410:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319045.079175:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319045.079208:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379659136:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319045.079300:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319045.079434:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379659136
00000100:00100000:2.0:1767319045.079443:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379659136
00000100:00100000:2.0:1767319045.079508:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132
00000100:00100000:2.0:1767319045.079518:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379659136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319045.079565:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319045.079614:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379659136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (313us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319045.079621:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132
00000100:00100000:2.0:1767319045.079670:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379659136:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319045.079866:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319045.592037:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319046.615139:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319046.615728:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319046.615753:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379659264:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319046.615828:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319046.615974:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379659264
00000100:00100000:1.0:1767319046.615992:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379659264
00000100:00100000:1.0:1767319046.616069:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133
00000100:00100000:1.0:1767319046.616079:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379659264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319046.616112:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319046.616162:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379659264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (334us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319046.616169:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133
00000100:00100000:1.0:1767319046.616234:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379659264:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319046.616557:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319047.127109:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.127120:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319047.127123:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.127126:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.127131:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.127138:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3944
00000100:00080000:0.0:1767319047.127143:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.127150:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319047.127219:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b480 x1853164379659392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319047.127247:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.127251:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.127252:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.127257:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3944
00000100:00080000:0.0:1767319047.127259:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.127262:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319047.127275:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b800 x1853164379659520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319047.127318:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.127321:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.127323:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.127327:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3944
00000100:00080000:0.0:1767319047.127330:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.127333:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319047.127344:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289c00 x1853164379659904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319047.127365:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319047.127368:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319047.127371:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319047.127374:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3944
00000100:00080000:0.0:1767319047.127376:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319047.127380:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319047.127391:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164379660160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319047.127463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379659392:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.127539:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.127602:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379659520:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.127624:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.127649:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379659904:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.127666:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.127678:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379660160:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.127692:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.127726:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379659520
00000100:00100000:1.0:1767319047.127734:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379659520
00000100:00100000:1.0:1767319047.127768:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924
00000100:00100000:1.0:1767319047.127775:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379659520:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319047.127794:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319047.127833:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379659520:12345-0@lo:38:kworker.0 Request processed in 56us (206us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319047.127840:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924
00000100:00100000:1.0:1767319047.127864:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379659392
00000100:00100000:1.0:1767319047.127886:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379659392
00000100:00100000:1.0:1767319047.127901:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379659904
00000100:00100000:1.0:1767319047.127904:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379659904
00000100:00100000:1.0:1767319047.127912:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660160
00000100:00100000:1.0:1767319047.127914:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660160
00000100:00100000:1.0:1767319047.127926:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16648
00000100:00100000:1.0:1767319047.127930:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379659392:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319047.127938:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319047.127962:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379659392:12345-0@lo:38:kworker.0 Request processed in 30us (423us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319047.127968:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16648
00000100:00100000:1.0:1767319047.127978:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16649
00000100:00100000:1.0:1767319047.127981:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379659904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319047.127989:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319047.128005:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379659904:12345-0@lo:38:kworker.0 Request processed in 23us (338us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319047.128010:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16649
00000100:00100000:1.0:1767319047.128018:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16650
00000100:00100000:1.0:1767319047.128021:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379660160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319047.128028:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319047.128044:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379660160:12345-0@lo:38:kworker.0 Request processed in 22us (351us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319047.128049:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16650
00000100:00080000:1.0:1767319047.128084:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.128088:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.128092:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379659392:0@lo:38:kworker.0
00000100:00080000:1.0:1767319047.128100:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.128103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.128106:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379659520:0@lo:38:kworker.0
00000100:00080000:1.0:1767319047.128113:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.128115:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.128118:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379659904:0@lo:38:kworker.0
00000100:00080000:1.0:1767319047.128125:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319047.128128:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319047.128130:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379660160:0@lo:38:kworker.0
00000100:00100000:1.0:1767319047.128155:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379660032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319047.128189:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319047.128217:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660032
00000100:00100000:1.0:1767319047.128221:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660032
00000100:00100000:1.0:1767319047.128251:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009
00000100:00100000:1.0:1767319047.128256:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379660032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319047.128290:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379660032:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319047.128296:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009
00000100:00100000:1.0:1767319047.128325:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379660032:0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.128451:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379659776:0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.128477:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319047.128504:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319047.128509:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379659648:0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.128575:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319047.128610:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379659776
00000100:00100000:2.0:1767319047.128614:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379659776
00000100:00100000:2.0:1767319047.128637:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010
00000100:00100000:2.0:1767319047.128642:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379659776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319047.128669:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379659776:12345-0@lo:400:kworker.0 Request processed in 27us (191us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319047.128674:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010
00000100:00100000:2.0:1767319047.128698:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379659776:0@lo:400:kworker.0
00000100:00100000:1.0:1767319047.129337:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379659648
00000100:00100000:1.0:1767319047.129346:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379659648
00000100:00100000:1.0:1767319047.129395:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379
00000100:00100000:1.0:1767319047.129403:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379659648:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319047.129497:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379659648:12345-0@lo:400:kworker.0 Request processed in 95us (921us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319047.129504:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379
00000100:00080000:3.0:1767319047.130714:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319047.130723:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319047.137599:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379659648:0@lo:400:kworker.0
00010000:00010000:2.0:1767319047.639997:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319048.079095:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319048.079179:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895424
00000100:00100000:3.0:1767319048.079191:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895424
00000100:00100000:3.0:1767319048.079289:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4011
00000100:00100000:3.0:1767319048.079301:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291895424:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319048.079391:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291895424:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (307us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319048.079399:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4011
00000100:00080000:0.0:1767319048.079463:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319048.083737:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319048.084954:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895296
00000100:00100000:3.0:1767319048.084967:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895296
00000100:00100000:3.0:1767319048.085024:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16651
00000100:00100000:3.0:1767319048.085032:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291895296:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319048.085059:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319048.085137:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291895296:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 103us (1411us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319048.085144:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16651
00010000:00010000:3.0:1767319048.663910:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319049.690696:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319050.200546:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319050.200566:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379660288:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319050.200641:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319050.200716:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660288
00000100:00100000:0.0:1767319050.200724:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660288
00000100:00100000:0.0:1767319050.200780:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134
00000100:00100000:0.0:1767319050.200790:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379660288:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319050.200825:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319050.200911:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379660288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (268us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319050.200920:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134
00000100:00080000:1.0:1767319050.200949:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319050.200999:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379660288:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319050.711323:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319051.735493:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319051.736117:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379660416:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319051.736211:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319051.736287:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660416
00000100:00100000:0.0:1767319051.736297:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660416
00000100:00100000:0.0:1767319051.736374:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135
00000100:00100000:0.0:1767319051.736387:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379660416:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319051.736422:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319051.736480:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379660416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (270us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319051.736488:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135
00000100:00100000:3.0:1767319051.736657:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379660416:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319051.737362:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319052.248030:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319052.248044:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319052.248047:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319052.248051:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319052.248055:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319052.248064:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3949
00000100:00080000:0.0:1767319052.248069:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319052.248077:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319052.248120:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ad80 x1853164379660544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319052.248161:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319052.248165:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319052.248167:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319052.248172:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3949
00000100:00080000:0.0:1767319052.248174:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319052.248179:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319052.248198:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a680 x1853164379660672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319052.248259:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319052.248262:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319052.248264:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319052.248268:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3949
00000100:00080000:0.0:1767319052.248270:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319052.248273:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319052.248284:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289c00 x1853164379661056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319052.248298:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319052.248302:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319052.248303:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319052.248306:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3949
00000100:00080000:0.0:1767319052.248308:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319052.248312:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319052.248322:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b480 x1853164379661312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319052.248351:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379660800:0@lo:400:kworker.0
00000100:00100000:0.0:1767319052.248353:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379661184:0@lo:400:kworker.0
00000100:00100000:2.0:1767319052.248466:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379660928:0@lo:400:kworker.0
00000100:00100000:1.0:1767319052.248833:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379660544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319052.248984:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319052.249060:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660800
00000100:00100000:3.0:1767319052.249068:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660800
00000100:00100000:3.0:1767319052.249136:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380
00000100:00100000:3.0:1767319052.249146:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379660800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319052.249204:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379660800:12345-0@lo:400:kworker.0 Request processed in 60us (220us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319052.249212:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380
00000100:00080000:3.0:1767319052.249235:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319052.249267:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379660800:0@lo:400:kworker.0
00000100:00100000:2.0:1767319052.251892:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319052.254664:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660928
00000100:00100000:3.0:1767319052.254679:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660928
00000100:00100000:3.0:1767319052.254786:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012
00000100:00100000:3.0:1767319052.254798:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379660928:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319052.254926:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379660928:12345-0@lo:400:kworker.0 Request processed in 132us (3068us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319052.254933:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012
00000100:00080000:2.0:1767319052.255356:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319052.255405:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379660928:0@lo:400:kworker.0
00000100:00100000:0.0:1767319052.255971:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319052.256103:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661184
00000100:00100000:3.0:1767319052.256110:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661184
00000100:00100000:3.0:1767319052.256198:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013
00000100:00100000:3.0:1767319052.256206:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379661184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319052.256271:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379661184:12345-0@lo:400:kworker.0 Request processed in 67us (302us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319052.256278:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013
00000100:00100000:0.0:1767319052.256436:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379661184:0@lo:400:kworker.0
00000100:00080000:2.0:1767319052.256446:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319052.258322:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319052.258382:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379660672:0@lo:38:kworker.0
00000100:00100000:1.0:1767319052.258421:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319052.258464:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379661056:0@lo:38:kworker.0
00000100:00100000:1.0:1767319052.258489:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319052.258531:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379661312:0@lo:38:kworker.0
00000100:00100000:1.0:1767319052.258554:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319052.258613:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660544
00000100:00100000:1.0:1767319052.258621:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660544
00000100:00100000:1.0:1767319052.258655:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661056
00000100:00100000:1.0:1767319052.258657:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661056
00000100:00100000:1.0:1767319052.258670:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661312
00000100:00100000:1.0:1767319052.258673:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661312
00000100:00100000:1.0:1767319052.258690:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16652
00000100:00100000:1.0:1767319052.258697:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379660544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319052.258720:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319052.258790:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379660544:12345-0@lo:38:kworker.0 Request processed in 92us (473us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319052.258798:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16652
00000100:00100000:1.0:1767319052.258819:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16653
00000100:00100000:1.0:1767319052.258822:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379661056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319052.258831:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319052.258855:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379661056:12345-0@lo:38:kworker.0 Request processed in 31us (366us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319052.258861:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16653
00000100:00100000:1.0:1767319052.258896:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16654
00000100:00100000:1.0:1767319052.258900:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379661312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319052.258910:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319052.258935:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379661312:12345-0@lo:38:kworker.0 Request processed in 33us (380us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319052.258941:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16654
00000100:00080000:1.0:1767319052.258988:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319052.258993:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319052.258996:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379660544:0@lo:38:kworker.0
00000100:00080000:1.0:1767319052.259005:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319052.259008:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319052.259010:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379661056:0@lo:38:kworker.0
00000100:00080000:1.0:1767319052.259017:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319052.259020:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319052.259023:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379661312:0@lo:38:kworker.0
00000100:00100000:3.0:1767319052.260103:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379660672
00000100:00100000:3.0:1767319052.260116:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379660672
00000100:00100000:3.0:1767319052.260184:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925
00000100:00100000:3.0:1767319052.260213:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379660672:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319052.260234:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319052.260332:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379660672:12345-0@lo:38:kworker.0 Request processed in 119us (1908us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319052.260339:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925
00000100:00080000:0.0:1767319052.260434:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319052.260440:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319052.260443:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379660672:0@lo:38:kworker.0
00010000:00010000:3.0:1767319052.759223:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319053.199806:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319053.199903:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895552
00000100:00100000:3.0:1767319053.199914:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895552
00000100:00100000:3.0:1767319053.199966:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16655
00000100:00100000:3.0:1767319053.199975:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291895552:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319053.199999:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319053.200070:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291895552:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (273us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319053.200078:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16655
00000100:00100000:0.0:1767319053.202550:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319053.203076:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895680
00000100:00100000:2.0:1767319053.203087:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895680
00000100:00100000:2.0:1767319053.203214:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4014
00000100:00100000:2.0:1767319053.203225:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291895680:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319053.203354:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291895680:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 131us (812us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319053.203362:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4014
00000100:00080000:3.0:1767319053.203447:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319053.783616:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319054.807229:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319055.319281:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319055.320459:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379661440:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319055.320538:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319055.322342:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661440
00000100:00100000:0.0:1767319055.322355:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661440
00000100:00100000:0.0:1767319055.322440:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136
00000100:00100000:0.0:1767319055.322452:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379661440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319055.322484:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319055.322566:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379661440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (2028us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319055.322575:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136
00000100:00100000:2.0:1767319055.322811:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379661440:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319055.322936:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319055.831370:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319056.855462:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319056.856510:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379661568:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319056.856594:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319056.856844:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661568
00000100:00100000:1.0:1767319056.856859:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661568
00000100:00100000:1.0:1767319056.857242:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137
00000100:00100000:1.0:1767319056.857252:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379661568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319056.857286:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319056.857340:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379661568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (745us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319056.857348:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137
00000100:00100000:1.0:1767319056.857410:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379661568:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319056.857480:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319057.369114:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319057.369121:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319057.369125:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319057.369138:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319057.369142:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319057.369151:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3954
00000100:00080000:3.0:1767319057.369156:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319057.369163:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319057.370288:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1500 x1853164379661696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319057.370318:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319057.370322:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319057.370325:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319057.370329:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3954
00000100:00080000:3.0:1767319057.370333:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319057.370340:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319057.370360:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b2a00 x1853164379661824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319057.370413:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319057.370417:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319057.370418:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319057.370422:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3954
00000100:00080000:3.0:1767319057.370425:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319057.370428:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319057.370440:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1180 x1853164379662208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319057.370557:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379661952:0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.370631:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.370690:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319057.370697:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379662080:0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.370721:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.370756:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662080
00000100:00100000:0.0:1767319057.370763:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662080
00000100:00100000:0.0:1767319057.370827:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015
00000100:00100000:0.0:1767319057.370837:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379662080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.370925:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379662080:12345-0@lo:400:kworker.0 Request processed in 88us (200us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319057.370933:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015
00000100:00100000:0.0:1767319057.370979:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379662080:0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.371019:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661952
00000100:00100000:0.0:1767319057.371023:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661952
00000100:00100000:0.0:1767319057.371051:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381
00000100:00100000:0.0:1767319057.371058:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379661952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.371115:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379661952:12345-0@lo:400:kworker.0 Request processed in 57us (484us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319057.371122:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381
00000100:00100000:0.0:1767319057.371142:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379662336:0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.371169:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319057.371201:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662336
00000100:00100000:0.0:1767319057.371206:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662336
00000100:00100000:0.0:1767319057.371233:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016
00000100:00100000:0.0:1767319057.371239:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379662336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.371274:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379662336:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319057.371280:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016
00000100:00100000:0.0:1767319057.371304:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379662336:0@lo:400:kworker.0
00000100:00100000:0.0:1767319057.371327:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379661952:0@lo:400:kworker.0
00000100:00080000:0.0:1767319057.371352:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319057.371358:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319057.371969:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379661696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319057.372009:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319057.372030:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379661824:0@lo:38:kworker.0
00000100:00080000:3.0:1767319057.372050:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319057.372053:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319057.372068:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319057.372071:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319057.372075:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3954
00000100:00080000:3.0:1767319057.372088:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319057.372092:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379662208:0@lo:38:kworker.0
00000100:00080000:3.0:1767319057.372093:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319057.372113:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319057.372120:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd880 x1853164379662464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319057.372134:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379662464:0@lo:38:kworker.0
00000100:00100000:1.0:1767319057.372153:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319057.372167:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661696
00000100:00100000:3.0:1767319057.372171:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661696
00000100:00100000:1.0:1767319057.372178:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662208
00000100:00100000:1.0:1767319057.372180:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662208
00000100:00100000:3.0:1767319057.372194:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662464
00000100:00100000:3.0:1767319057.372196:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662464
00000100:00100000:1.0:1767319057.372200:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16656
00000100:00100000:1.0:1767319057.372205:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379661696:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319057.372210:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16657
00000100:00100000:3.0:1767319057.372214:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379662208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319057.372223:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319057.372267:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16658
00000100:00100000:0.0:1767319057.372272:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379662464:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319057.372331:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379661696:12345-0@lo:38:kworker.0 Request processed in 123us (320us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319057.372337:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16656
00000100:00080000:1.0:1767319057.372388:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319057.372392:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319057.372395:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379661696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319057.372628:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379661824
00000100:00100000:2.0:1767319057.372633:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379661824
00000100:00100000:2.0:1767319057.372669:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926
00000100:00100000:2.0:1767319057.372675:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379661824:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319057.372842:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319057.372934:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379662208:12345-0@lo:38:kworker.0 Request processed in 717us (819us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319057.372941:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16657
00000100:00080000:3.0:1767319057.372985:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319057.372990:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319057.372993:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379662208:0@lo:38:kworker.0
00010000:00020000:0.0:1767319057.378271:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767319057.378291:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319057.378392:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379662464:12345-0@lo:38:kworker.0 Request processed in 6115us (6234us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319057.378406:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16658
00000100:00100000:2.0:1767319057.378802:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379661824:12345-0@lo:38:kworker.0 Request processed in 6125us (6745us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319057.378813:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926
00000100:00080000:3.0:1767319057.384594:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319057.384609:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319057.384614:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379662464:0@lo:38:kworker.0
00000100:00080000:3.0:1767319057.384639:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319057.384642:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319057.384661:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379661824:0@lo:38:kworker.0
00010000:00010000:2.0:1767319057.879275:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319058.319370:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319058.319417:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319058.319496:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895808
00000100:00100000:3.0:1767319058.319507:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895808
00000100:00100000:3.0:1767319058.319599:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291895936
00000100:00100000:3.0:1767319058.319603:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291895936
00000100:00080000:2.0:1767319058.319692:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319058.323114:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4017
00000100:00100000:0.0:1767319058.323143:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291895936:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319058.323424:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291895936:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 295us (4004us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319058.323434:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4017
00000100:00100000:0.0:1767319058.323482:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16659
00000100:00100000:0.0:1767319058.323489:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291895808:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319058.323512:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319058.323543:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291895808:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (4184us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319058.323550:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16659
00010000:00010000:1.0:1767319058.903036:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319059.927095:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319060.439127:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379662592:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319060.439306:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319060.439461:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662592
00000100:00100000:1.0:1767319060.439481:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662592
00000100:00080000:2.0:1767319060.439567:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319060.439595:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138
00000100:00100000:1.0:1767319060.439611:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379662592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319060.439655:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319060.439744:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379662592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (437us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319060.439752:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138
00000100:00100000:3.0:1767319060.439952:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379662592:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319060.951655:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319061.975020:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319061.975196:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379662720:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319061.975285:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319061.975413:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662720
00000100:00100000:1.0:1767319061.975421:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662720
00000100:00100000:1.0:1767319061.975492:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139
00000100:00100000:1.0:1767319061.975500:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379662720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319061.975533:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767319061.975587:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319061.978849:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379662720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3337us (3551us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319061.978880:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139
00000100:00100000:0.0:1767319061.984682:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379662720:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319062.419357:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319062.419398:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291896064 offset 0 length 520: 4
00000100:00100000:3.0:1767319062.419423:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319062.419519:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291896320
00000100:00100000:0.0:1767319062.419531:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291896320
00000100:00100000:2.0:1767319062.419592:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291896192
00000100:00100000:2.0:1767319062.419599:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291896192
00000100:00080000:3.0:1767319062.419688:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319062.419790:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4018
00000100:00100000:0.0:1767319062.419802:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291896320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319062.419929:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291896320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 130us (583us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319062.419937:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4018
00000100:00100000:0.0:1767319062.419959:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16660
00000100:00100000:0.0:1767319062.419963:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291896192:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319062.419995:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319062.420024:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291896192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (599us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319062.420031:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16660
00000100:00080000:2.0:1767319062.487152:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319062.487163:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319062.487166:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319062.487169:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319062.487174:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319062.487181:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3959
00000100:00080000:2.0:1767319062.487185:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319062.487191:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319062.487232:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4e00 x1853164379662848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319062.487257:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319062.487260:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319062.487262:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319062.487266:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3959
00000100:00080000:2.0:1767319062.487268:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319062.487271:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319062.487293:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4700 x1853164379662976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319062.487354:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319062.487357:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319062.487359:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319062.487363:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3959
00000100:00080000:2.0:1767319062.487365:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319062.487369:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319062.487378:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6a00 x1853164379663360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319062.487392:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319062.487395:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319062.487397:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319062.487399:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3959
00000100:00080000:2.0:1767319062.487401:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319062.487405:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319062.487414:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6680 x1853164379663616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319062.487439:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379663232:0@lo:400:kworker.0
00000100:00100000:2.0:1767319062.487520:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319062.487596:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319062.487608:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379663488:0@lo:400:kworker.0
00000100:00100000:2.0:1767319062.487630:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319062.487710:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379662848:0@lo:38:kworker.0
00000100:00100000:3.0:1767319062.487741:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319062.487778:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379662976:0@lo:38:kworker.0
00000100:00100000:3.0:1767319062.487801:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319062.487824:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379663360:0@lo:38:kworker.0
00000100:00100000:3.0:1767319062.487844:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319062.487860:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379663616:0@lo:38:kworker.0
00000100:00100000:3.0:1767319062.487901:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319062.487931:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662976
00000100:00100000:3.0:1767319062.487938:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662976
00000100:00100000:3.0:1767319062.487974:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927
00000100:00100000:3.0:1767319062.487981:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379662976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319062.488019:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319062.488066:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379662976:12345-0@lo:38:kworker.0 Request processed in 83us (263us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319062.488073:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927
00000100:00100000:3.0:1767319062.488098:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379663232
00000100:00100000:3.0:1767319062.488102:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379663232
00000100:00100000:3.0:1767319062.488136:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379663488
00000100:00100000:3.0:1767319062.488139:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379663488
00000100:00100000:3.0:1767319062.488152:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379662848
00000100:00100000:3.0:1767319062.488154:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379662848
00000100:00100000:3.0:1767319062.488161:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379663360
00000100:00100000:3.0:1767319062.488163:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379663360
00000100:00100000:3.0:1767319062.488169:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379663616
00000100:00100000:3.0:1767319062.488171:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379663616
00000100:00100000:3.0:1767319062.488179:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019
00000100:00100000:3.0:1767319062.488184:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379663232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319062.488239:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379663232:12345-0@lo:400:kworker.0 Request processed in 55us (720us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319062.488245:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019
00000100:00100000:3.0:1767319062.488257:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020
00000100:00100000:3.0:1767319062.488262:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379663488:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319062.488285:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379663488:12345-0@lo:400:kworker.0 Request processed in 23us (654us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319062.488290:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020
00000100:00100000:3.0:1767319062.488299:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16661
00000100:00100000:3.0:1767319062.488303:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379662848:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319062.488312:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319062.488342:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379662848:12345-0@lo:38:kworker.0 Request processed in 37us (600us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319062.488348:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16661
00000100:00100000:3.0:1767319062.488359:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16662
00000100:00100000:3.0:1767319062.488363:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379663360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319062.488371:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319062.488391:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379663360:12345-0@lo:38:kworker.0 Request processed in 27us (547us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319062.488396:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16662
00000100:00100000:3.0:1767319062.488407:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16663
00000100:00100000:3.0:1767319062.488411:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379663616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319062.488419:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319062.488442:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379663616:12345-0@lo:38:kworker.0 Request processed in 30us (541us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319062.488447:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16663
00000100:00080000:3.0:1767319062.488471:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319062.488504:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379663488:0@lo:400:kworker.0
00000100:00100000:3.0:1767319062.488514:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379663232:0@lo:400:kworker.0
00000100:00080000:3.0:1767319062.488544:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319062.488549:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319062.488552:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379662848:0@lo:38:kworker.0
00000100:00080000:3.0:1767319062.488561:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319062.488565:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319062.488567:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379662976:0@lo:38:kworker.0
00000100:00080000:3.0:1767319062.488585:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319062.488588:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319062.488590:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379663360:0@lo:38:kworker.0
00000100:00080000:3.0:1767319062.488597:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319062.488600:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319062.488602:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379663616:0@lo:38:kworker.0
00000100:00100000:1.0:1767319062.488694:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319062.488705:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379663104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319062.488738:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319062.489055:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379663104
00000100:00100000:3.0:1767319062.489061:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379663104
00000100:00100000:3.0:1767319062.489154:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382
00000100:00100000:3.0:1767319062.489161:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379663104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319062.489208:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379663104:12345-0@lo:400:kworker.0 Request processed in 47us (469us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319062.489214:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382
00000100:00100000:2.0:1767319062.490055:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379663104:0@lo:400:kworker.0
00000100:00080000:0.0:1767319062.493279:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319062.999606:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319064.023254:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319065.047093:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319065.559400:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379663744:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319065.559506:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319065.559663:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379663744
00000100:00100000:2.0:1767319065.559675:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379663744
00000100:00100000:2.0:1767319065.559754:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140
00000100:00100000:2.0:1767319065.559766:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379663744:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319065.559809:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319065.559890:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379663744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (362us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319065.559898:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140
00000100:00100000:2.0:1767319065.559968:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379663744:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319065.560564:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319066.072794:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319067.099410:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319067.099443:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379663872:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319067.099564:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319067.099621:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379663872
00000100:00100000:3.0:1767319067.099634:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379663872
00010000:00010000:1.0:1767319067.099769:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319067.099788:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141
00000100:00100000:3.0:1767319067.099803:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379663872:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319067.099849:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319067.099979:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379663872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (413us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319067.099988:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141
00000100:00100000:1.0:1767319067.100068:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379663872:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319067.100650:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319067.535245:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319067.535293:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319067.538657:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291896576
00000100:00100000:0.0:1767319067.538674:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291896576
00000100:00100000:0.0:1767319067.538830:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291896448
00000100:00100000:0.0:1767319067.538834:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291896448
00000100:00100000:0.0:1767319067.538861:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4021
00000100:00100000:0.0:1767319067.538889:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291896576:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319067.538978:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291896576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 108us (3741us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319067.538996:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4021
00000100:00100000:0.0:1767319067.539018:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16664
00000100:00100000:0.0:1767319067.539024:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291896448:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319067.539045:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319067.539071:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291896448:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (3778us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319067.539077:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16664
00000100:00080000:1.0:1767319067.543168:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319067.607148:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319067.607161:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319042/real 1767319042]  req@ffff8b0e0c44b800 x1853164379659008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319067.607162:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319067.607171:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319067.607184:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319067.607194:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319067.607204:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3964
00000100:00080000:0.0:1767319067.607210:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319067.607230:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319067.607266:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c44b800 x1853164379659008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319067.607280:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289180 x1853164379664000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319067.607296:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319067.607314:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319067.607320:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319067.607323:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319067.607329:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3964
00000100:00080000:0.0:1767319067.607332:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319067.607339:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319067.607346:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379659008:0@lo:250:kworker.0
00000100:00100000:3.0:1767319067.607386:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379664000:0@lo:38:kworker.0
00000100:00100000:3.0:1767319067.607486:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319067.607567:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664000
00000100:00100000:2.0:1767319067.607577:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664000
00000100:00100000:2.0:1767319067.607635:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16665
00000100:00100000:2.0:1767319067.607643:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379664000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319067.607664:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319067.607759:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379664000:12345-0@lo:38:kworker.0 Request processed in 115us (283us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319067.607766:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16665
00000100:00080000:3.0:1767319067.608109:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319067.608117:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00080000:3.0:1767319067.608120:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319067.608128:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379664000:0@lo:38:kworker.0
00000100:00100000:0.0:1767319067.608140:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b100 x1853164379664128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319067.608170:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379664128:0@lo:38:kworker.0
00000100:00080000:0.0:1767319067.608205:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319067.608209:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319067.608210:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319067.608215:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3964
00000100:00080000:0.0:1767319067.608217:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319067.608228:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319067.608229:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319067.608240:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b1c00 x1853164379664640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319067.608261:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319067.608263:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319067.608265:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319067.608268:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3964
00000100:00080000:0.0:1767319067.608271:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319067.608275:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319067.608290:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b0e00 x1853164379664896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319067.608294:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379664640:0@lo:38:kworker.0
00000100:00080000:0.0:1767319067.608316:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319067.608319:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319067.608320:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319067.608322:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3944
00000100:00080000:0.0:1767319067.608324:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319067.608326:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319067.608333:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f1c0b3800 x1853164379665024/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319067.608352:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379664768:0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608470:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379664384:0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608501:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319067.608525:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319067.608528:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379664256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608541:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319067.608560:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664384
00000100:00100000:1.0:1767319067.608563:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664384
00000100:00100000:1.0:1767319067.608585:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664256
00000100:00100000:1.0:1767319067.608596:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664256
00000100:00100000:1.0:1767319067.608615:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383
00000100:00100000:1.0:1767319067.608619:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379664384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608649:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379664384:12345-0@lo:400:kworker.0 Request processed in 29us (148us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319067.608653:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383
00000100:00100000:1.0:1767319067.608664:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384
00000100:00100000:1.0:1767319067.608667:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379664256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608681:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379664256:12345-0@lo:400:kworker.0 Request processed in 14us (139us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319067.608684:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384
00000100:00080000:1.0:1767319067.608696:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319067.608717:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379664256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608722:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379664384:0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608738:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379664512:0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608753:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319067.608770:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664512
00000100:00100000:1.0:1767319067.608772:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664512
00000100:00100000:1.0:1767319067.608789:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022
00000100:00100000:1.0:1767319067.608792:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379664512:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608827:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379664512:12345-0@lo:400:kworker.0 Request processed in 34us (72us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319067.608831:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022
00000100:00100000:3.0:1767319067.608839:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319067.608843:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319067.608860:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379664512:0@lo:400:kworker.0
00000100:00100000:1.0:1767319067.608893:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664640
00000100:00100000:1.0:1767319067.608895:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664640
00000100:00100000:1.0:1767319067.608915:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16666
00000100:00100000:1.0:1767319067.608918:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379664640:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319067.608929:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379664896:0@lo:38:kworker.0
00010000:00020000:1.0:1767319067.608930:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319067.608996:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379664640:12345-0@lo:38:kworker.0 Request processed in 59us (144us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319067.609000:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319067.609013:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16666
00000100:00100000:1.0:1767319067.609032:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664896
00000100:00100000:1.0:1767319067.609037:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664896
00000100:00100000:3.0:1767319067.609043:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379665024:0@lo:250:kworker.0
00000100:00100000:1.0:1767319067.609055:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16667
00000100:00100000:1.0:1767319067.609059:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379664896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319067.609068:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000400:00000100:3.0:1767319067.609075:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379665024 offset 0 length 520: 4
00000100:00100000:1.0:1767319067.609120:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379664896:12345-0@lo:38:kworker.0 Request processed in 59us (140us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319067.609125:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16667
00000100:00080000:3.0:1767319067.609141:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319067.609149:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319067.609155:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379664640:0@lo:38:kworker.0
00000100:00080000:3.0:1767319067.609181:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319067.609201:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319067.609205:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379664896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319067.609239:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664128
00000100:00100000:3.0:1767319067.609246:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664128
00000100:00100000:3.0:1767319067.609290:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928
00000100:00100000:3.0:1767319067.609298:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379664128:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319067.609531:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:3.0:1767319067.610397:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319067.611116:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379664128:12345-0@lo:38:kworker.0 Request processed in 1812us (2890us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319067.611133:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928
00000100:00080000:0.0:1767319067.611189:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319067.611198:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319067.611201:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379664128:0@lo:38:kworker.0
00000100:00100000:2.0:1767319067.613534:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379664768
00000100:00100000:2.0:1767319067.613549:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379664768
00000100:00100000:2.0:1767319067.613768:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023
00000100:00100000:2.0:1767319067.613779:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379664768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319067.613903:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379664768:12345-0@lo:400:kworker.0 Request processed in 125us (4371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319067.613909:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023
00000100:00100000:3.0:1767319067.615601:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379664768:0@lo:400:kworker.0
00000100:00080000:1.0:1767319067.615686:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319068.119099:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319069.144158:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319070.167205:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319070.679242:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379665152:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319070.679326:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319070.683587:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379665152
00000100:00100000:1.0:1767319070.683610:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379665152
00000100:00100000:1.0:1767319070.683862:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142
00000100:00100000:1.0:1767319070.683887:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379665152:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319070.683923:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319070.684028:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379665152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (4702us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319070.684036:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142
00000100:00100000:0.0:1767319070.685010:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379665152:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319070.687100:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319071.191311:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319072.215398:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319072.215652:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379665280:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319072.215714:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319072.215911:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379665280
00000100:00100000:1.0:1767319072.215919:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379665280
00000100:00100000:1.0:1767319072.215995:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143
00000100:00100000:1.0:1767319072.216010:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379665280:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319072.216038:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319072.216081:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379665280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (367us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319072.216087:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143
00000100:00080000:2.0:1767319072.216145:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319072.216248:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379665280:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319072.656397:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319072.656489:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319072.658503:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291896832
00000100:00100000:2.0:1767319072.658521:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291896832
00000100:00080000:1.0:1767319072.660756:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319072.660773:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291896704
00000100:00100000:2.0:1767319072.660786:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291896704
00000100:00100000:2.0:1767319072.660817:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4024
00000100:00100000:1.0:1767319072.660831:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16668
00000100:00100000:2.0:1767319072.660832:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291896832:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319072.660837:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291896704:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319072.660857:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319072.661072:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291896832:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 245us (4683us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319072.661079:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4024
00000100:00100000:1.0:1767319072.667051:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291896704:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 6198us (10547us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319072.667068:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16668
00000100:00080000:1.0:1767319072.728633:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319072.728646:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319072.728649:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319072.728653:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319072.728658:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319072.728666:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3970
00000100:00080000:1.0:1767319072.728673:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319072.728680:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319072.728729:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b100 x1853164379665408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319072.728760:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319072.728763:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319072.728765:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319072.728768:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3970
00000100:00080000:1.0:1767319072.728771:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319072.728774:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319072.728787:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379665536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319072.728850:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319072.728853:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319072.728855:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319072.728858:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3970
00000100:00080000:1.0:1767319072.728860:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319072.728863:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319072.728893:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905500 x1853164379666048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319072.728908:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319072.728910:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319072.728912:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319072.728916:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3970
00000100:00080000:1.0:1767319072.728918:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319072.728921:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319072.728931:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04e00 x1853164379666304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319072.728968:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379665920:0@lo:400:kworker.0
00000100:00100000:1.0:1767319072.729033:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319072.729102:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319072.729108:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379666176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319072.729128:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319072.729161:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379665920
00000100:00100000:1.0:1767319072.729169:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379665920
00000100:00100000:1.0:1767319072.729229:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666176
00000100:00100000:1.0:1767319072.729232:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666176
00000100:00100000:1.0:1767319072.729258:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025
00000100:00100000:1.0:1767319072.729266:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379665920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319072.729334:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379665920:12345-0@lo:400:kworker.0 Request processed in 55us (287us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319072.729341:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025
00000100:00100000:1.0:1767319072.729363:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026
00000100:00100000:1.0:1767319072.729369:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379666176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319072.729398:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379666176:12345-0@lo:400:kworker.0 Request processed in 29us (269us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319072.729404:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026
00000100:00080000:1.0:1767319072.729422:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319072.729456:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379666176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319072.729467:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379665920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319072.729636:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379665408:0@lo:38:kworker.0
00000100:00100000:0.0:1767319072.729670:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319072.729703:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379665536:0@lo:38:kworker.0
00000100:00100000:0.0:1767319072.729731:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319072.729754:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379666048:0@lo:38:kworker.0
00000100:00100000:0.0:1767319072.729773:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319072.729789:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379666304:0@lo:38:kworker.0
00000100:00100000:0.0:1767319072.729807:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319072.729836:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379665536
00000100:00100000:0.0:1767319072.729839:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379665536
00000100:00100000:0.0:1767319072.729863:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929
00000100:00100000:0.0:1767319072.729890:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0912c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379665536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319072.729911:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319072.729957:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0912c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379665536:12345-0@lo:38:kworker.0 Request processed in 88us (224us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319072.729964:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929
00000100:00100000:0.0:1767319072.730147:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379665408
00000100:00100000:0.0:1767319072.730151:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379665408
00000100:00100000:0.0:1767319072.730170:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666048
00000100:00100000:0.0:1767319072.730175:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666048
00000100:00100000:0.0:1767319072.730189:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666304
00000100:00100000:0.0:1767319072.730192:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666304
00000100:00100000:0.0:1767319072.730202:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16669
00000100:00100000:0.0:1767319072.730206:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379665408:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319072.730216:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319072.730242:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379665408:12345-0@lo:38:kworker.0 Request processed in 35us (572us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319072.730248:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16669
00000100:00100000:0.0:1767319072.730261:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16670
00000100:00100000:0.0:1767319072.730264:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379666048:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319072.730273:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319072.730295:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379666048:12345-0@lo:38:kworker.0 Request processed in 28us (520us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319072.730300:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16670
00000100:00100000:0.0:1767319072.730310:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16671
00000100:00100000:0.0:1767319072.730314:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379666304:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319072.730441:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379665664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319072.730474:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319072.730496:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319072.730502:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379665792:0@lo:400:kworker.0
00000100:00100000:2.0:1767319072.730522:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319072.730545:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379665664
00000100:00100000:2.0:1767319072.730549:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379665664
00000100:00100000:2.0:1767319072.730582:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379665792
00000100:00100000:2.0:1767319072.730585:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379665792
00000100:00100000:2.0:1767319072.730603:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385
00000100:00100000:2.0:1767319072.730608:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379665664:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319072.730643:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379665664:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319072.730650:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385
00000100:00100000:2.0:1767319072.730663:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386
00000100:00100000:2.0:1767319072.730669:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379665792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319072.730693:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379665792:12345-0@lo:400:kworker.0 Request processed in 24us (170us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319072.730699:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386
00000100:00080000:2.0:1767319072.730724:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319072.730745:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379665792:0@lo:400:kworker.0
00000100:00100000:2.0:1767319072.730755:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379665664:0@lo:400:kworker.0
00000100:00080000:2.0:1767319072.730812:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319072.730817:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319072.730820:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379665408:0@lo:38:kworker.0
00000100:00080000:2.0:1767319072.730829:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319072.730833:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319072.730835:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379665536:0@lo:38:kworker.0
00000100:00080000:2.0:1767319072.730844:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319072.730847:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319072.730850:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379666048:0@lo:38:kworker.0
00010000:00020000:0.0:1767319072.730992:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319072.731022:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379666304:12345-0@lo:38:kworker.0 Request processed in 706us (1213us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319072.731029:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16671
00000100:00080000:2.0:1767319072.731557:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319072.731563:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319072.731566:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379666304:0@lo:38:kworker.0
00010000:00010000:3.0:1767319073.239166:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319074.263654:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319075.287137:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319075.803569:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319075.803592:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379666432:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319075.803662:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319075.803817:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666432
00000100:00100000:1.0:1767319075.803825:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666432
00000100:00100000:1.0:1767319075.803952:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144
00000100:00100000:1.0:1767319075.803962:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379666432:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319075.803989:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319075.804033:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379666432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (371us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319075.804040:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144
00000100:00100000:3.0:1767319075.804213:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379666432:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319075.804894:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319076.311130:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319077.335332:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319077.335355:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379666560:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319077.335423:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319077.335536:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666560
00000100:00100000:2.0:1767319077.335545:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666560
00000100:00100000:2.0:1767319077.335623:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145
00000100:00100000:2.0:1767319077.335633:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379666560:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319077.335664:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319077.335714:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379666560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (290us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319077.335721:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145
00000100:00080000:1.0:1767319077.335968:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319077.336010:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379666560:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319077.337380:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319077.776120:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319077.776178:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319077.776275:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291897088
00000100:00100000:1.0:1767319077.776286:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291897088
00000100:00080000:0.0:1767319077.776741:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319077.776851:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291896960
00000100:00100000:1.0:1767319077.776857:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291896960
00000100:00100000:2.0:1767319077.781495:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4027
00000100:00100000:2.0:1767319077.781522:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291897088:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319077.782133:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291897088:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 621us (6018us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319077.782143:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4027
00000100:00100000:2.0:1767319077.782180:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16672
00000100:00100000:2.0:1767319077.782185:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291896960:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319077.782222:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319077.782252:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291896960:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 66us (6073us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319077.782260:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16672
00000100:00080000:3.0:1767319077.847205:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319077.847226:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319077.847230:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319077.847252:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319077.847257:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319077.847265:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3975
00000100:00080000:3.0:1767319077.847270:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319077.847276:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319077.847319:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fc000 x1853164379666688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319077.847340:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319077.847344:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319077.847346:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319077.847351:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3975
00000100:00080000:3.0:1767319077.847353:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319077.847357:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319077.847370:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ffb80 x1853164379666816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319077.847452:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319077.847455:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319077.847457:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319077.847461:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3975
00000100:00080000:3.0:1767319077.847464:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319077.847467:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319077.847479:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608000 x1853164379667328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319077.847495:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319077.847506:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319077.847509:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319077.847512:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3975
00000100:00080000:3.0:1767319077.847514:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319077.847518:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319077.847531:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608380 x1853164379667584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319077.847561:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379667200:0@lo:400:kworker.0
00000100:00100000:0.0:1767319077.847631:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379667072:0@lo:400:kworker.0
00000100:00100000:3.0:1767319077.847639:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319077.847717:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379666688:0@lo:38:kworker.0
00000100:00100000:1.0:1767319077.847778:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379666944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319077.848844:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319077.848956:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667072
00000100:00100000:0.0:1767319077.848965:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667072
00000100:00100000:0.0:1767319077.849030:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387
00000100:00100000:0.0:1767319077.849039:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379667072:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319077.849101:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379667072:12345-0@lo:400:kworker.0 Request processed in 63us (259us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319077.849108:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387
00000100:00100000:0.0:1767319077.849150:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379667072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319077.849204:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379667456:0@lo:400:kworker.0
00000100:00100000:0.0:1767319077.849236:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319077.849266:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667200
00000100:00100000:0.0:1767319077.849270:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667200
00000100:00100000:0.0:1767319077.849305:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667456
00000100:00100000:0.0:1767319077.849308:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667456
00000100:00100000:0.0:1767319077.849327:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028
00000100:00100000:0.0:1767319077.849332:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379667200:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319077.849365:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379667200:12345-0@lo:400:kworker.0 Request processed in 33us (1730us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319077.849370:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028
00000100:00100000:0.0:1767319077.849381:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029
00000100:00100000:0.0:1767319077.849387:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379667456:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319077.849415:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379667456:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319077.849420:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029
00000100:00080000:0.0:1767319077.849436:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319077.849453:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379667456:0@lo:400:kworker.0
00000100:00100000:3.0:1767319077.850957:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379667200:0@lo:400:kworker.0
00000100:00100000:1.0:1767319077.852339:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319077.852339:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319077.852425:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666944
00000100:00100000:1.0:1767319077.852433:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666944
00000100:00100000:1.0:1767319077.852506:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388
00000100:00100000:2.0:1767319077.852515:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379666816:0@lo:38:kworker.0
00000100:00100000:1.0:1767319077.852517:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379666944:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319077.852570:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319077.852746:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319077.852768:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666816
00000100:00100000:3.0:1767319077.852775:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666816
00000100:00100000:0.0:1767319077.852783:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379666688
00000100:00100000:0.0:1767319077.852789:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379666688
00000100:00100000:0.0:1767319077.852815:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16673
00000100:00100000:0.0:1767319077.852821:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379666688:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319077.852851:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319077.852866:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379666944:12345-0@lo:400:kworker.0 Request processed in 351us (531us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319077.852904:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388
00000100:00100000:0.0:1767319077.852915:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379666688:12345-0@lo:38:kworker.0 Request processed in 92us (581us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319077.852924:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16673
00000100:00100000:1.0:1767319077.852959:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379666944:0@lo:400:kworker.0
00000100:00100000:3.0:1767319077.853271:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930
00000100:00100000:3.0:1767319077.853277:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379666816:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319077.853289:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319077.853324:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379666816:12345-0@lo:38:kworker.0 Request processed in 47us (754us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319077.853330:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930
00000100:00080000:2.0:1767319077.853556:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319077.853562:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319077.853566:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379666816:0@lo:38:kworker.0
00000100:00100000:2.0:1767319077.853574:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379667328:0@lo:38:kworker.0
00000100:00100000:2.0:1767319077.853747:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319077.853815:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379667584:0@lo:38:kworker.0
00000100:00100000:2.0:1767319077.853850:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319077.854047:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319077.854052:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319077.854055:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379666688:0@lo:38:kworker.0
00000100:00100000:0.0:1767319077.854146:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667328
00000100:00100000:0.0:1767319077.854153:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667328
00000100:00100000:0.0:1767319077.854202:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667584
00000100:00100000:0.0:1767319077.854206:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667584
00000100:00100000:0.0:1767319077.854240:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16674
00000100:00100000:0.0:1767319077.854246:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379667328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319077.854263:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319077.854301:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379667328:12345-0@lo:38:kworker.0 Request processed in 54us (554us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319077.854309:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16674
00000100:00100000:0.0:1767319077.854324:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16675
00000100:00100000:0.0:1767319077.854327:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379667584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319077.854337:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319077.854360:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379667584:12345-0@lo:38:kworker.0 Request processed in 31us (509us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319077.854365:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16675
00000100:00080000:2.0:1767319077.854510:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319077.854516:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319077.854519:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379667328:0@lo:38:kworker.0
00000100:00080000:2.0:1767319077.854528:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319077.854531:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319077.854534:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379667584:0@lo:38:kworker.0
00010000:00010000:1.0:1767319078.359149:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319079.383175:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319080.408517:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319080.920126:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379667712:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319080.920650:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319080.920770:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667712
00000100:00100000:3.0:1767319080.920778:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667712
00000100:00080000:0.0:1767319080.920814:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319080.920836:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146
00000100:00100000:3.0:1767319080.920847:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379667712:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319080.920914:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319080.921846:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379667712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 997us (1192us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319080.921898:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146
00000100:00100000:1.0:1767319080.922074:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379667712:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319081.431227:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319082.455046:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319082.455319:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319082.460598:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379667840:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319082.460679:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319082.460863:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667840
00000100:00100000:3.0:1767319082.460901:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667840
00000100:00080000:0.0:1767319082.460947:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319082.460979:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147
00000100:00100000:3.0:1767319082.460997:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379667840:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319082.461030:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319082.461080:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379667840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (400us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319082.461087:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147
00000100:00100000:1.0:1767319082.464084:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379667840:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319082.894793:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319082.894922:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291897344
00000100:00100000:0.0:1767319082.894938:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291897344
00000100:00100000:0.0:1767319082.895228:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4030
00000100:00100000:0.0:1767319082.895242:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291897344:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319082.895339:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291897344:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (559us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319082.895347:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4030
00000100:00080000:3.0:1767319082.898465:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319082.898574:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319082.898677:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291897216
00000100:00100000:1.0:1767319082.898690:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291897216
00000100:00100000:1.0:1767319082.898773:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16676
00000100:00100000:1.0:1767319082.898782:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291897216:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319082.898806:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319082.898907:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291897216:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 124us (338us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319082.898915:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16676
00000100:00080000:3.0:1767319082.967092:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.967108:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319082.967112:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.967116:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.967122:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.967134:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3980
00000100:00080000:3.0:1767319082.967140:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.967149:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319082.967209:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608700 x1853164379667968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319082.967239:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.967243:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.967245:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.967272:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3980
00000100:00080000:3.0:1767319082.967275:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.967280:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319082.967297:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609c00 x1853164379668096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319082.967370:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.967374:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.967375:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.967380:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3980
00000100:00080000:3.0:1767319082.967382:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.967386:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319082.967401:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b100 x1853164379668608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319082.967428:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319082.967432:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319082.967433:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319082.967436:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3980
00000100:00080000:3.0:1767319082.967439:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319082.967443:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319082.967455:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b800 x1853164379668864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319082.967497:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379668736:0@lo:400:kworker.0
00000100:00100000:3.0:1767319082.967588:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319082.967680:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319082.967694:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379668480:0@lo:400:kworker.0
00000100:00100000:3.0:1767319082.967721:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319082.967759:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668736
00000100:00100000:3.0:1767319082.967768:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668736
00000100:00100000:3.0:1767319082.967835:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668480
00000100:00100000:3.0:1767319082.967838:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668480
00000100:00100000:3.0:1767319082.967906:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031
00000100:00100000:3.0:1767319082.967916:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379668736:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319082.967984:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379668736:12345-0@lo:400:kworker.0 Request processed in 69us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319082.967992:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031
00000100:00100000:3.0:1767319082.968017:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032
00000100:00100000:3.0:1767319082.968023:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379668480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319082.968051:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379668480:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319082.968057:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032
00000100:00080000:3.0:1767319082.968076:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319082.968116:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379668480:0@lo:400:kworker.0
00000100:00100000:3.0:1767319082.968128:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379668736:0@lo:400:kworker.0
00000100:00100000:0.0:1767319082.968972:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379668352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319082.969035:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319082.969094:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319082.969101:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379668224:0@lo:400:kworker.0
00000100:00100000:0.0:1767319082.969125:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319082.969265:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668352
00000100:00100000:1.0:1767319082.969273:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668352
00000100:00100000:1.0:1767319082.969321:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668224
00000100:00100000:1.0:1767319082.969324:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668224
00000100:00100000:1.0:1767319082.969360:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389
00000100:00100000:1.0:1767319082.969370:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379668352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319082.969512:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390
00000100:00100000:0.0:1767319082.969522:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379668224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319082.969570:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379668352:12345-0@lo:400:kworker.0 Request processed in 201us (533us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319082.969579:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389
00000100:00080000:1.0:1767319082.969610:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319082.969809:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379667968:0@lo:38:kworker.0
00000100:00100000:0.0:1767319082.969918:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379668224:12345-0@lo:400:kworker.0 Request processed in 397us (790us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319082.969927:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390
00000100:00100000:1.0:1767319082.973005:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379668352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.973375:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319082.973424:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379668096:0@lo:38:kworker.0
00000100:00100000:1.0:1767319082.973453:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379668224:0@lo:400:kworker.0
00000100:00100000:2.0:1767319082.973466:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319082.973584:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379668608:0@lo:38:kworker.0
00000100:00100000:2.0:1767319082.973609:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319082.973634:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379668864:0@lo:38:kworker.0
00000100:00100000:2.0:1767319082.973661:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319082.973679:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379667968
00000100:00100000:1.0:1767319082.973691:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379667968
00000100:00100000:2.0:1767319082.973722:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668608
00000100:00100000:2.0:1767319082.973731:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668608
00000100:00100000:1.0:1767319082.973747:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668864
00000100:00100000:1.0:1767319082.973752:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668864
00000100:00100000:1.0:1767319082.973890:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16677
00000100:00100000:1.0:1767319082.973899:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379667968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319082.973929:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319082.974014:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379667968:12345-0@lo:38:kworker.0 Request processed in 113us (645us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319082.974022:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16677
00000100:00100000:1.0:1767319082.974045:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16678
00000100:00100000:1.0:1767319082.974050:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379668864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319082.974060:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319082.974159:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379668864:12345-0@lo:38:kworker.0 Request processed in 107us (499us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319082.974166:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16678
00000100:00100000:1.0:1767319082.974180:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16679
00000100:00100000:1.0:1767319082.974184:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379668608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319082.974194:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319082.974219:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379668608:12345-0@lo:38:kworker.0 Request processed in 33us (609us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319082.974225:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16679
00000100:00080000:2.0:1767319082.977693:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319082.977706:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319082.977710:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379667968:0@lo:38:kworker.0
00000100:00080000:2.0:1767319082.977725:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319082.977729:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319082.977731:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379668608:0@lo:38:kworker.0
00000100:00080000:2.0:1767319082.977738:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319082.977740:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319082.977742:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379668864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319082.982540:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668096
00000100:00100000:3.0:1767319082.982561:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668096
00000100:00100000:3.0:1767319082.982622:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931
00000100:00100000:3.0:1767319082.982636:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379668096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319082.982663:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319082.982969:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379668096:12345-0@lo:38:kworker.0 Request processed in 332us (9504us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319082.983108:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931
00000100:00080000:3.0:1767319082.983166:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319082.983172:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319082.983176:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379668096:0@lo:38:kworker.0
00010000:00010000:1.0:1767319083.479237:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319084.505341:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319085.529671:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319086.039349:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379668992:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319086.039423:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319086.039772:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379668992
00000100:00100000:2.0:1767319086.039782:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379668992
00000100:00100000:2.0:1767319086.039884:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148
00000100:00100000:2.0:1767319086.039895:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379668992:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319086.039930:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319086.039974:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379668992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (551us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319086.039982:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148
00000100:00080000:1.0:1767319086.040068:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319086.040106:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379668992:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319086.551972:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319087.575029:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319087.576461:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379669120:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319087.576552:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319087.576683:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379669120
00000100:00100000:3.0:1767319087.576693:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379669120
00000100:00100000:3.0:1767319087.576765:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149
00000100:00100000:3.0:1767319087.576774:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379669120:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319087.576815:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767319087.576900:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319087.583898:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379669120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7096us (7318us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319087.583914:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149
00000100:00100000:0.0:1767319087.584458:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379669120:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319088.015028:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767319088.015474:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291897472 offset 0 length 520: 4
00000100:00100000:2.0:1767319088.015563:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319088.020268:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291897728
00000100:00100000:0.0:1767319088.020294:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291897728
00000100:00080000:1.0:1767319088.020471:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319088.020827:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4033
00000100:00100000:0.0:1767319088.020842:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291897728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319088.020953:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291897728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 116us (5934us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319088.020961:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4033
00000100:00100000:3.0:1767319088.031828:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291897600
00000100:00100000:3.0:1767319088.031846:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291897600
00000100:00100000:3.0:1767319088.031929:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16680
00000100:00100000:3.0:1767319088.031939:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291897600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319088.031965:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319088.032045:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291897600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 106us (16480us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319088.032052:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16680
00000100:00080000:0.0:1767319088.087058:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319088.087067:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319088.087069:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319088.087073:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319088.087076:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319088.087082:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3985
00000100:00080000:0.0:1767319088.087086:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319088.087092:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319088.087138:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628a80 x1853164379669248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319088.087194:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379669248:0@lo:38:kworker.0
00000100:00100000:3.0:1767319088.087253:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319088.087377:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379669248
00000100:00100000:1.0:1767319088.087395:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379669248
00000100:00100000:1.0:1767319088.087450:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16681
00000100:00100000:1.0:1767319088.087465:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379669248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319088.087488:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319088.088338:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319088.088344:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319088.088348:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319088.088353:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3985
00000100:00080000:0.0:1767319088.088358:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319088.088364:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319088.088393:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629180 x1853164379669376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319088.092915:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379669376:0@lo:38:kworker.0
00000100:00100000:3.0:1767319088.092998:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319088.093111:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379669376
00000100:00100000:2.0:1767319088.093120:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379669376
00000100:00100000:2.0:1767319088.093166:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932
00000100:00100000:2.0:1767319088.093174:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379669376:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319088.093196:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319088.093240:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379669376:12345-0@lo:38:kworker.0 Request processed in 65us (241us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319088.093246:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932
00000100:00100000:2.0:1767319088.095177:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379669504:0@lo:400:kworker.0
00000100:00080000:0.0:1767319088.095188:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319088.095195:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319088.095199:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319088.095204:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3985
00000100:00080000:0.0:1767319088.095209:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319088.095216:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319088.095241:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd880 x1853164379669888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319088.095253:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319088.095272:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319088.095277:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319088.095279:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319088.095283:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3985
00000100:00080000:0.0:1767319088.095286:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319088.095291:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319088.095303:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe680 x1853164379670144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319088.095307:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319088.095318:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379669632:0@lo:400:kworker.0
00000100:00100000:0.0:1767319088.095340:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379670016:0@lo:400:kworker.0
00000100:00100000:2.0:1767319088.095348:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319088.095395:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319088.095406:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379669504
00000100:00100000:2.0:1767319088.095413:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379669504
00000100:00100000:0.0:1767319088.095422:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319088.095440:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379669760:0@lo:400:kworker.0
00000100:00100000:2.0:1767319088.095469:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379669632
00000100:00100000:2.0:1767319088.095473:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379669632
00000100:00100000:0.0:1767319088.095478:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319088.095503:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391
00000100:00100000:2.0:1767319088.095513:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379669504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319088.095519:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392
00000100:00100000:0.0:1767319088.095530:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379669632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319088.095637:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379669248:12345-0@lo:38:kworker.0 Request processed in 8177us (8381us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319088.095647:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16681
00000100:00100000:1.0:1767319088.095750:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379670016
00000100:00100000:1.0:1767319088.095754:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379670016
00000100:00100000:1.0:1767319088.095864:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379669760
00000100:00100000:1.0:1767319088.095882:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379669760
00000100:00100000:1.0:1767319088.095912:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034
00000100:00100000:1.0:1767319088.095919:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379670016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319088.095956:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379670016:12345-0@lo:400:kworker.0 Request processed in 37us (572us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319088.095962:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034
00000100:00100000:1.0:1767319088.095975:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035
00000100:00100000:1.0:1767319088.095986:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379669760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319088.096448:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379669760:12345-0@lo:400:kworker.0 Request processed in 466us (969us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319088.096455:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035
00000100:00100000:1.0:1767319088.096924:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379669760:0@lo:400:kworker.0
00000100:00100000:1.0:1767319088.096936:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379670016:0@lo:400:kworker.0
00000100:00100000:1.0:1767319088.096979:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379669632:0@lo:400:kworker.0
00000100:00100000:1.0:1767319088.096990:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379669504:0@lo:400:kworker.0
00000100:00100000:2.0:1767319088.097136:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379669504:12345-0@lo:400:kworker.0 Request processed in 1623us (1886us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319088.097144:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391
00000100:00080000:2.0:1767319088.097217:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319088.097223:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319088.104825:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319088.104839:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319088.104845:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379669248:0@lo:38:kworker.0
00000100:00100000:3.0:1767319088.104898:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379669888:0@lo:38:kworker.0
00000100:00100000:0.0:1767319088.105070:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379669632:12345-0@lo:400:kworker.0 Request processed in 9540us (9721us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319088.105083:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392
00000100:00100000:3.0:1767319088.105196:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319088.106831:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379670144:0@lo:38:kworker.0
00000100:00100000:3.0:1767319088.106924:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319088.106980:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319088.106985:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319088.106989:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379669376:0@lo:38:kworker.0
00000100:00100000:2.0:1767319088.108002:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379669888
00000100:00100000:2.0:1767319088.108018:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379669888
00000100:00100000:2.0:1767319088.108068:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379670144
00000100:00100000:2.0:1767319088.108072:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379670144
00000100:00100000:2.0:1767319088.108099:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16682
00000100:00100000:2.0:1767319088.108107:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379669888:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319088.108133:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319088.108202:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379669888:12345-0@lo:38:kworker.0 Request processed in 94us (3006us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319088.108210:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16682
00000100:00100000:2.0:1767319088.108229:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16683
00000100:00100000:2.0:1767319088.108233:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379670144:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319088.108243:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319088.108266:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379670144:12345-0@lo:38:kworker.0 Request processed in 31us (1342us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319088.108271:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16683
00000100:00080000:3.0:1767319088.109210:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319088.109218:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319088.109223:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379669888:0@lo:38:kworker.0
00000100:00080000:3.0:1767319088.109235:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319088.109238:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319088.109240:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379670144:0@lo:38:kworker.0
00010000:00010000:2.0:1767319088.600700:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319089.623192:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319090.649153:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319091.160020:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319091.160041:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379670272:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319091.160112:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319091.160276:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379670272
00000100:00100000:2.0:1767319091.160285:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379670272
00000100:00100000:3.0:1767319091.160484:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150
00000100:00100000:3.0:1767319091.160496:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379670272:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319091.160527:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319091.160575:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379670272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (461us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319091.160596:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150
00000100:00080000:1.0:1767319091.160655:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319091.162611:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379670272:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319091.671119:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319092.183111:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319067/real 1767319067]  req@ffff8b0f1c0b3800 x1853164379665024/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319092.183151:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f1c0b3800 x1853164379665024/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319092 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319092.183166:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319092.183194:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319092.183198:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379665024:0@lo:250:kworker.0
00000100:00080000:0.0:1767319092.183279:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319092.183284:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319092.183287:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319092.183292:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3970
00000100:00080000:0.0:1767319092.183296:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319092.183314:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319092.183348:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331f80 x1853164379670400/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319092.183374:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319092.183378:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319092.183380:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319092.183383:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3990
00000100:00080000:0.0:1767319092.183386:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319092.183389:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319092.183413:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333b80 x1853164379670528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319092.183678:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379670400:0@lo:250:kworker.0
00000400:00000100:3.0:1767319092.183727:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379670400 offset 0 length 520: 4
00000100:00080000:0.0:1767319092.183851:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319092.183855:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319092.183857:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319092.183861:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3990
00000100:00080000:0.0:1767319092.183864:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319092.183897:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319092.183916:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571f80 x1853164379670656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319092.183983:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379670784:0@lo:400:kworker.0
00000100:00100000:1.0:1767319092.184025:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.184095:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379670528:0@lo:38:kworker.0
00000100:00100000:3.0:1767319092.184124:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.184143:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379670656:0@lo:38:kworker.0
00000100:00100000:3.0:1767319092.184166:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.184199:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379670528
00000100:00100000:3.0:1767319092.184207:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379670528
00000100:00100000:3.0:1767319092.184248:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16684
00000100:00100000:3.0:1767319092.184267:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379670528:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319092.184288:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319092.184339:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379670528:12345-0@lo:38:kworker.0 Request processed in 82us (213us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319092.184346:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16684
00000100:00100000:2.0:1767319092.184380:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379670784
00000100:00080000:3.0:1767319092.184385:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319092.184387:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379670784
00000100:00080000:3.0:1767319092.184405:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319092.184409:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379670528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319092.184426:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393
00000100:00100000:2.0:1767319092.184435:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379670784:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.184550:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379670656
00000100:00100000:3.0:1767319092.184555:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379670656
00000100:00100000:3.0:1767319092.184576:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933
00000100:00100000:3.0:1767319092.184581:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379670656:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319092.184592:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319092.184623:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379670656:12345-0@lo:38:kworker.0 Request processed in 40us (457us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319092.184629:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933
00000100:00080000:3.0:1767319092.184651:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319092.184654:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319092.184657:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379670656:0@lo:38:kworker.0
00000100:00080000:0.0:1767319092.184784:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319092.184787:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319092.184790:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319092.184794:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3990
00000100:00080000:0.0:1767319092.184797:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319092.184801:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319092.184816:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f100 x1853164379671168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319092.184887:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379671296:0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.184916:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.184947:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671296
00000100:00100000:3.0:1767319092.184952:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671296
00000100:00100000:3.0:1767319092.184984:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036
00000100:00100000:3.0:1767319092.184992:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379671296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.185026:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379671296:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319092.185032:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036
00000100:00080000:3.0:1767319092.185048:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319092.185069:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379671296:0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.185088:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379671168:0@lo:38:kworker.0
00000100:00100000:3.0:1767319092.185118:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.185143:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671168
00000100:00100000:3.0:1767319092.185147:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671168
00000100:00100000:3.0:1767319092.185164:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16685
00000100:00100000:3.0:1767319092.185168:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379671168:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319092.185179:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319092.185208:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379671168:12345-0@lo:38:kworker.0 Request processed in 38us (89us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319092.185214:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16685
00000100:00080000:3.0:1767319092.185236:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319092.185240:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319092.185243:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379671168:0@lo:38:kworker.0
00000100:00100000:3.0:1767319092.185270:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379671040:0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.185293:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.185310:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319092.185315:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379670912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.185337:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.185360:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379670912
00000100:00100000:3.0:1767319092.185364:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379670912
00000100:00100000:3.0:1767319092.185395:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394
00000100:00100000:3.0:1767319092.185401:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379670912:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.185434:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379670912:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319092.185944:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394
00000100:00080000:3.0:1767319092.185966:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319092.185988:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379670912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.186020:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671040
00000100:00100000:3.0:1767319092.186024:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671040
00000100:00100000:3.0:1767319092.186053:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037
00000100:00100000:3.0:1767319092.186060:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379671040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319092.186100:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379671040:12345-0@lo:400:kworker.0 Request processed in 41us (806us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319092.186106:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037
00000100:00080000:3.0:1767319092.186120:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319092.186136:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379671040:0@lo:400:kworker.0
00000100:00080000:0.0:1767319092.192277:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319092.192288:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319092.192293:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319092.192309:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3990
00000100:00080000:0.0:1767319092.192314:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319092.192322:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319092.192362:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28d500 x1853164379671424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319092.192432:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379671424:0@lo:38:kworker.0
00000100:00100000:0.0:1767319092.192507:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319092.192562:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671424
00000100:00100000:0.0:1767319092.192569:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671424
00000100:00100000:0.0:1767319092.192609:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16686
00000100:00100000:0.0:1767319092.192617:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379671424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319092.192640:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319092.192648:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379670784:12345-0@lo:400:kworker.0 Request processed in 8211us (8619us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319092.192662:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393
00000100:00100000:0.0:1767319092.192691:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379671424:12345-0@lo:38:kworker.0 Request processed in 71us (182us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319092.192699:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16686
00000100:00080000:0.0:1767319092.192740:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319092.192745:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319092.192748:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379671424:0@lo:38:kworker.0
00000100:00100000:1.0:1767319092.194196:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379670784:0@lo:400:kworker.0
00010000:00010000:3.0:1767319092.695338:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319092.695348:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319092.695370:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379671552:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319092.695439:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319092.695707:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671552
00000100:00100000:3.0:1767319092.695717:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671552
00000100:00100000:3.0:1767319092.695808:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151
00000100:00100000:3.0:1767319092.695819:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379671552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319092.695851:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319092.695968:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379671552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (528us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319092.695975:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151
00000100:00100000:2.0:1767319092.696083:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379671552:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319093.137762:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319093.137812:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319093.138122:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291897856
00000100:00100000:0.0:1767319093.138132:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291897856
00000100:00100000:0.0:1767319093.138188:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291897984
00000100:00100000:0.0:1767319093.138192:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291897984
00000100:00100000:0.0:1767319093.138237:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4038
00000100:00100000:0.0:1767319093.138257:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291897984:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319093.138338:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291897984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (525us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319093.138345:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4038
00000100:00100000:0.0:1767319093.138363:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16687
00000100:00100000:0.0:1767319093.138367:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291897856:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319093.138390:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319093.138566:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291897856:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (674us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319093.138575:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16687
00000100:00080000:3.0:1767319093.139784:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319093.719796:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319094.744179:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319095.767363:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319096.279365:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319096.281912:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379671680:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319096.281993:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319096.282179:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671680
00000100:00100000:3.0:1767319096.282188:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671680
00000100:00100000:3.0:1767319096.282267:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152
00000100:00100000:3.0:1767319096.282277:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379671680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319096.282314:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319096.282369:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379671680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (375us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319096.282376:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152
00000100:00100000:2.0:1767319096.282481:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379671680:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319096.283079:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319096.791332:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319097.303185:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319097.303197:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319097.303200:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319097.303204:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319097.303208:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319097.303217:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3994
00000100:00080000:2.0:1767319097.303222:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319097.303237:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319097.303278:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f31c83b80 x1853164379671808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319097.303299:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319097.303303:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319097.303305:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319097.303309:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3994
00000100:00080000:2.0:1767319097.303311:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319097.303315:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319097.303328:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379671808:0@lo:38:kworker.0
00000100:00100000:2.0:1767319097.303332:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858e00 x1853164379671936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319097.303396:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319097.303396:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319097.303399:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319097.303401:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319097.303404:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3994
00000100:00080000:2.0:1767319097.303407:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319097.303409:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319097.303419:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433800 x1853164379672448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319097.303433:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319097.303436:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319097.303438:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319097.303441:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3994
00000100:00080000:2.0:1767319097.303443:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319097.303446:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319097.303456:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433480 x1853164379672704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319097.303476:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379672192:0@lo:400:kworker.0
00000100:00100000:1.0:1767319097.303489:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379672320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.303536:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379671936:0@lo:38:kworker.0
00000100:00100000:2.0:1767319097.304048:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319097.304055:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319097.304093:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671808
00000100:00100000:2.0:1767319097.304093:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672192
00000100:00100000:1.0:1767319097.304101:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671808
00000100:00100000:1.0:1767319097.304130:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672320
00000100:00100000:1.0:1767319097.304133:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672320
00000100:00100000:1.0:1767319097.304172:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039
00000100:00100000:1.0:1767319097.304182:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379672320:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319097.304186:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16688
00000100:00100000:3.0:1767319097.304192:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379671808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319097.304211:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319097.304245:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379672320:12345-0@lo:400:kworker.0 Request processed in 64us (188us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319097.304253:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039
00000100:00100000:3.0:1767319097.304255:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379671808:12345-0@lo:38:kworker.0 Request processed in 63us (859us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319097.304260:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16688
00000100:00080000:1.0:1767319097.304280:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319097.304280:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379672064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319097.304292:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379672576:0@lo:400:kworker.0
00000100:00100000:3.0:1767319097.304304:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319097.304312:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319097.304332:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672576
00000100:00100000:3.0:1767319097.304332:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672064
00000100:00100000:1.0:1767319097.304335:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672576
00000100:00100000:3.0:1767319097.304335:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672064
00000100:00100000:1.0:1767319097.304359:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040
00000100:00100000:3.0:1767319097.304359:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395
00000100:00100000:3.0:1767319097.304364:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379672064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319097.304365:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379672576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319097.304396:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379672576:12345-0@lo:400:kworker.0 Request processed in 31us (83us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319097.304396:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379672064:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319097.304403:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040
00000100:00100000:3.0:1767319097.304403:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395
00000100:00080000:1.0:1767319097.304416:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319097.304445:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379672064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.304609:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319097.304643:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379672448:0@lo:38:kworker.0
00000100:00100000:0.0:1767319097.304665:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319097.304689:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379672704:0@lo:38:kworker.0
00000100:00100000:0.0:1767319097.304708:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319097.304742:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319097.304747:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319097.304751:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f31c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379671808:0@lo:38:kworker.0
00000100:00100000:0.0:1767319097.304783:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672448
00000100:00100000:0.0:1767319097.304786:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672448
00000100:00100000:0.0:1767319097.304802:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672704
00000100:00100000:0.0:1767319097.304804:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672704
00000100:00100000:0.0:1767319097.304820:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16689
00000100:00100000:0.0:1767319097.304825:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379672448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319097.304836:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319097.304842:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672192
00000100:00100000:0.0:1767319097.304863:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379672448:12345-0@lo:38:kworker.0 Request processed in 36us (196us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319097.304893:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16689
00000100:00100000:0.0:1767319097.304908:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16690
00000100:00100000:0.0:1767319097.304912:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379672704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319097.304921:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319097.304945:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379672704:12345-0@lo:38:kworker.0 Request processed in 32us (236us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319097.304950:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16690
00000100:00100000:2.0:1767319097.304958:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396
00000100:00100000:2.0:1767319097.304965:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379672192:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319097.304975:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379672320:0@lo:400:kworker.0
00000100:00080000:0.0:1767319097.304995:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319097.304998:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379672192:12345-0@lo:400:kworker.0 Request processed in 35us (951us total) trans 0 rc 0/0
00000100:00080000:0.0:1767319097.304999:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319097.305002:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379672448:0@lo:38:kworker.0
00000100:00100000:2.0:1767319097.305005:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396
00000100:00080000:0.0:1767319097.305009:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319097.305012:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319097.305015:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379672704:0@lo:38:kworker.0
00000100:00080000:2.0:1767319097.305020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319097.305037:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379672192:0@lo:400:kworker.0
00000100:00100000:3.0:1767319097.305217:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379671936
00000100:00100000:3.0:1767319097.305221:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379671936
00000100:00100000:3.0:1767319097.305249:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934
00000100:00100000:3.0:1767319097.305253:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379671936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319097.305264:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319097.305299:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379671936:12345-0@lo:38:kworker.0 Request processed in 44us (690us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319097.305305:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934
00000100:00080000:3.0:1767319097.305338:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319097.305343:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319097.305346:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379671936:0@lo:38:kworker.0
00000100:00100000:1.0:1767319097.305597:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379672576:0@lo:400:kworker.0
00000100:00100000:1.0:1767319097.815082:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319097.815106:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379672832:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319097.815175:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319097.815221:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672832
00000100:00100000:3.0:1767319097.815229:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672832
00000100:00100000:3.0:1767319097.815314:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153
00000100:00100000:3.0:1767319097.815324:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379672832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319097.815358:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319097.815422:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379672832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (245us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319097.815430:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153
00000100:00100000:1.0:1767319097.815461:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379672832:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319097.818889:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319098.255993:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319098.256095:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319098.256192:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291898240
00000100:00100000:0.0:1767319098.256205:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291898240
00000100:00100000:0.0:1767319098.256279:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291898112
00000100:00100000:0.0:1767319098.256283:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291898112
00000100:00100000:0.0:1767319098.256307:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4041
00000100:00100000:0.0:1767319098.256318:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291898240:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319098.256388:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291898240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (406us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319098.256397:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4041
00000100:00100000:0.0:1767319098.256415:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16691
00000100:00100000:0.0:1767319098.256420:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291898112:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319098.256441:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319098.256482:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291898112:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 60us (387us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319098.256489:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16691
00000100:00080000:2.0:1767319098.257201:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319098.839851:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319099.863858:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319100.887569:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319101.400004:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319101.400026:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379672960:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319101.400113:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319101.400252:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379672960
00000100:00100000:3.0:1767319101.400262:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379672960
00000100:00080000:2.0:1767319101.400341:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319101.400348:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154
00000100:00100000:3.0:1767319101.400362:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379672960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319101.400396:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319101.400469:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379672960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (356us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319101.400476:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154
00000100:00100000:2.0:1767319101.400566:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379672960:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319101.911109:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319102.428767:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319102.428778:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319102.428781:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319102.428786:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319102.428790:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319102.428798:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3999
00000100:00080000:3.0:1767319102.428803:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319102.428821:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319102.428864:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858e00 x1853164379673088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319102.428965:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319102.428970:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319102.428971:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319102.428976:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3999
00000100:00080000:3.0:1767319102.428978:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319102.428982:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319102.429001:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b480 x1853164379673216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319102.429028:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379673088:0@lo:38:kworker.0
00000100:00080000:3.0:1767319102.429065:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319102.429069:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319102.429071:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319102.429075:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3999
00000100:00080000:3.0:1767319102.429078:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319102.429081:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319102.429105:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680000 x1853164379673728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319102.429114:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319102.429134:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319102.429138:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319102.429140:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319102.429144:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3999
00000100:00080000:3.0:1767319102.429147:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319102.429152:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319102.429164:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02683100 x1853164379673984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319102.429194:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379673216:0@lo:38:kworker.0
00000100:00100000:3.0:1767319102.429204:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379673600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319102.429225:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319102.429260:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379673728:0@lo:38:kworker.0
00000100:00100000:1.0:1767319102.429282:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319102.429297:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379673984:0@lo:38:kworker.0
00000100:00100000:1.0:1767319102.429321:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319102.429370:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673088
00000100:00100000:1.0:1767319102.429377:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673088
00000100:00100000:2.0:1767319102.429400:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379673344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319102.429439:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319102.429465:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319102.429470:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379673856:0@lo:400:kworker.0
00000100:00100000:2.0:1767319102.429502:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319102.429547:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379673472:0@lo:400:kworker.0
00000100:00100000:3.0:1767319102.429572:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319102.429613:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673344
00000100:00100000:3.0:1767319102.429618:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673344
00000100:00100000:3.0:1767319102.429651:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673472
00000100:00100000:3.0:1767319102.429654:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673472
00000100:00100000:3.0:1767319102.436860:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397
00000100:00100000:3.0:1767319102.436903:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379673344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319102.437006:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379673344:12345-0@lo:400:kworker.0 Request processed in 121us (7565us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319102.437014:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397
00000100:00100000:3.0:1767319102.437032:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398
00000100:00100000:3.0:1767319102.437041:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379673472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319102.437078:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379673472:12345-0@lo:400:kworker.0 Request processed in 39us (7505us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319102.437096:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398
00000100:00100000:3.0:1767319102.437153:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379673472:0@lo:400:kworker.0
00000100:00080000:3.0:1767319102.437212:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319102.440170:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673728
00000100:00100000:2.0:1767319102.440187:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673728
00000100:00100000:2.0:1767319102.440231:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673984
00000100:00100000:2.0:1767319102.442879:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673984
00000100:00100000:2.0:1767319102.442932:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673856
00000100:00100000:2.0:1767319102.442935:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673856
00000100:00100000:2.0:1767319102.442986:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042
00000100:00100000:2.0:1767319102.442999:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379673856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319102.443096:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379673856:12345-0@lo:400:kworker.0 Request processed in 90us (13581us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319102.443103:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042
00000100:00100000:2.0:1767319102.443124:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16692
00000100:00100000:2.0:1767319102.443129:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379673088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319102.443150:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319102.443187:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379673088:12345-0@lo:38:kworker.0 Request processed in 56us (14076us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319102.443193:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16692
00000100:00100000:2.0:1767319102.443210:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16693
00000100:00100000:2.0:1767319102.443215:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379673728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319102.443225:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319102.443445:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379673728:12345-0@lo:38:kworker.0 Request processed in 228us (14161us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319102.443453:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16693
00000100:00100000:2.0:1767319102.443466:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16694
00000100:00100000:2.0:1767319102.443470:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379673984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319102.443480:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319102.443516:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379673984:12345-0@lo:38:kworker.0 Request processed in 44us (14194us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319102.443522:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16694
00000100:00080000:2.0:1767319102.443553:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319102.443570:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319102.443622:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673600
00000100:00100000:2.0:1767319102.443627:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673600
00000100:00100000:2.0:1767319102.443656:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043
00000100:00100000:2.0:1767319102.443663:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379673600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319102.443715:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379673600:12345-0@lo:400:kworker.0 Request processed in 52us (144us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319102.443721:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043
00000100:00080000:2.0:1767319102.443735:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319102.443765:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379673600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319102.443796:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379673856:0@lo:400:kworker.0
00000100:00100000:2.0:1767319102.443808:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379673344:0@lo:400:kworker.0
00000100:00080000:2.0:1767319102.443861:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319102.443867:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319102.443902:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379673728:0@lo:38:kworker.0
00000100:00080000:2.0:1767319102.443913:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319102.443917:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319102.443920:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379673984:0@lo:38:kworker.0
00000100:00080000:2.0:1767319102.443931:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319102.443935:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319102.443938:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379673088:0@lo:38:kworker.0
00000100:00100000:2.0:1767319102.450651:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379673216
00000100:00100000:2.0:1767319102.450676:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379673216
00000100:00100000:2.0:1767319102.450736:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935
00000100:00100000:2.0:1767319102.450745:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379673216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319102.450771:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319102.450858:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379673216:12345-0@lo:38:kworker.0 Request processed in 113us (21633us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319102.450866:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935
00000100:00080000:2.0:1767319102.450955:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319102.450961:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319102.450965:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379673216:0@lo:38:kworker.0
00000100:00100000:3.0:1767319102.935302:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319102.935325:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379674112:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319102.935399:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319102.935541:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379674112
00000100:00100000:1.0:1767319102.935551:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379674112
00000100:00100000:1.0:1767319102.935608:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155
00000100:00100000:1.0:1767319102.935619:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379674112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319102.935649:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319102.935710:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379674112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (309us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319102.935718:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155
00000100:00100000:3.0:1767319102.935821:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379674112:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319102.936810:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319103.376519:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319103.376580:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319103.376618:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291898496
00000100:00100000:3.0:1767319103.376628:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291898496
00000100:00100000:3.0:1767319103.376722:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291898368
00000100:00100000:3.0:1767319103.376726:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291898368
00000100:00100000:3.0:1767319103.376747:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4044
00000100:00100000:3.0:1767319103.376759:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291898496:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319103.376867:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291898496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319103.376902:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16695
00000100:00100000:1.0:1767319103.376913:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291898368:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:3.0:1767319103.376916:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4044
00010000:00020000:1.0:1767319103.376941:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319103.376975:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291898368:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 61us (394us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319103.376982:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16695
00000100:00080000:2.0:1767319103.377117:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319103.960496:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319104.983408:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319106.007102:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319106.519283:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319106.519305:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379674240:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319106.519385:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319106.519809:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379674240
00000100:00100000:3.0:1767319106.519818:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379674240
00000100:00100000:3.0:1767319106.519948:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156
00000100:00100000:3.0:1767319106.519957:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379674240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319106.520093:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319106.520153:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379674240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 197us (768us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319106.520161:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156
00000100:00100000:1.0:1767319106.520245:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379674240:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319106.520681:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319107.032727:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319107.543424:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.543436:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319107.543440:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.543445:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.543451:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.543460:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4004
00000100:00080000:2.0:1767319107.543467:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.543478:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319107.543539:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433800 x1853164379674368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319107.543558:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.543561:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.543563:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.543568:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4004
00000100:00080000:2.0:1767319107.543571:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.543574:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319107.543584:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a433480 x1853164379674496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319107.543649:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.543652:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.543654:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.543657:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4004
00000100:00080000:2.0:1767319107.543660:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.543663:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319107.543671:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc000 x1853164379675008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319107.543684:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319107.543687:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319107.543689:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319107.543692:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4004
00000100:00080000:2.0:1767319107.543695:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319107.543698:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319107.543706:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff800 x1853164379675264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319107.544026:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379674752:0@lo:400:kworker.0
00000100:00100000:3.0:1767319107.544087:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319107.544145:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319107.544150:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379674880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319107.544171:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319107.544201:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379674880
00000100:00100000:3.0:1767319107.544207:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379674880
00000100:00080000:3.0:1767319107.544238:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319107.544279:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045
00000100:00100000:3.0:1767319107.544288:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379674880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319107.544333:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379674880:12345-0@lo:400:kworker.0 Request processed in 47us (161us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319107.544340:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045
00000100:00100000:3.0:1767319107.544381:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379674880:0@lo:400:kworker.0
00000100:00100000:2.0:1767319107.544507:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379674752
00000100:00100000:1.0:1767319107.544618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379674368:0@lo:38:kworker.0
00000100:00100000:1.0:1767319107.544657:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.544679:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379674496:0@lo:38:kworker.0
00000100:00100000:1.0:1767319107.544699:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.544719:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379675008:0@lo:38:kworker.0
00000100:00100000:1.0:1767319107.544735:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.544745:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379675264:0@lo:38:kworker.0
00000100:00100000:1.0:1767319107.544760:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319107.544934:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379674496
00000100:00100000:1.0:1767319107.544938:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379674496
00000100:00100000:1.0:1767319107.544961:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936
00000100:00100000:1.0:1767319107.544965:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379674496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319107.544984:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319107.545015:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379674496:12345-0@lo:38:kworker.0 Request processed in 48us (315us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319107.545021:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936
00000100:00080000:1.0:1767319107.545046:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319107.545050:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319107.545053:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379674496:0@lo:38:kworker.0
00000100:00100000:2.0:1767319107.545174:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379674752
00000100:00100000:2.0:1767319107.545215:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399
00000100:00100000:2.0:1767319107.545221:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379674752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319107.545323:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379674752:12345-0@lo:400:kworker.0 Request processed in 102us (1236us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319107.545330:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399
00000100:00100000:0.0:1767319107.545733:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379674624:0@lo:400:kworker.0
00000100:00100000:0.0:1767319107.545776:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319107.545809:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319107.545815:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379675136:0@lo:400:kworker.0
00000100:00100000:2.0:1767319107.545838:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379674624
00000100:00100000:0.0:1767319107.545844:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319107.545846:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379674624
00000100:00100000:2.0:1767319107.545903:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400
00000100:00100000:2.0:1767319107.545913:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379674624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319107.545924:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379674368
00000100:00100000:0.0:1767319107.545930:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379674368
00000100:00100000:0.0:1767319107.545958:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675008
00000100:00100000:0.0:1767319107.545961:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675008
00000100:00100000:2.0:1767319107.545965:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379674624:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319107.545975:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400
00000100:00100000:0.0:1767319107.545985:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675264
00000100:00100000:0.0:1767319107.545990:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675264
00000100:00100000:0.0:1767319107.546003:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675136
00000100:00100000:0.0:1767319107.546005:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675136
00000100:00100000:2.0:1767319107.546024:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16696
00000100:00100000:2.0:1767319107.546029:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379674368:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319107.546043:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319107.546064:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319107.546070:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319107.546082:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379674368:12345-0@lo:38:kworker.0 Request processed in 49us (1422us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319107.546243:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f1c0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379674624:0@lo:400:kworker.0
00000100:00100000:0.0:1767319107.548044:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046
00000100:00100000:0.0:1767319107.548064:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379675136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319107.548072:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16696
00000100:00100000:2.0:1767319107.548100:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16697
00000100:00100000:2.0:1767319107.548107:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379675008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319107.548128:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319107.548433:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379675008:12345-0@lo:38:kworker.0 Request processed in 324us (3695us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319107.548440:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16697
00000100:00100000:2.0:1767319107.548455:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16698
00000100:00100000:2.0:1767319107.548460:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379675264:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319107.548473:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319107.548481:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379675136:12345-0@lo:400:kworker.0 Request processed in 424us (2635us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319107.548494:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046
00000100:00100000:2.0:1767319107.548504:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379675264:12345-0@lo:38:kworker.0 Request processed in 41us (3741us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319107.548832:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16698
00000100:00080000:2.0:1767319107.548896:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319107.548902:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319107.548908:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379674368:0@lo:38:kworker.0
00000100:00080000:2.0:1767319107.548919:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319107.548922:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319107.548925:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379675008:0@lo:38:kworker.0
00000100:00080000:2.0:1767319107.548933:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319107.548935:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319107.548938:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379675264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319107.549027:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379675136:0@lo:400:kworker.0
00000100:00100000:2.0:1767319107.549080:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379674752:0@lo:400:kworker.0
00010000:00010000:1.0:1767319108.055254:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319108.056657:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319108.056687:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379675392:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319108.056777:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319108.059246:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675392
00000100:00100000:3.0:1767319108.059263:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675392
00000100:00100000:3.0:1767319108.059336:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157
00000100:00100000:3.0:1767319108.059348:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379675392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319108.059383:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319108.059479:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379675392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (2701us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319108.059487:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157
00000100:00100000:0.0:1767319108.059556:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379675392:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319108.495517:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319108.495679:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291898752
00000100:00100000:0.0:1767319108.495690:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291898752
00000100:00100000:0.0:1767319108.495848:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4047
00000100:00100000:0.0:1767319108.495862:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291898752:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319108.495986:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291898752:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 128us (480us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319108.495994:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4047
00000100:00100000:2.0:1767319108.505723:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319108.505794:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291898624
00000100:00100000:3.0:1767319108.505805:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291898624
00000100:00100000:3.0:1767319108.506069:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16699
00000100:00100000:3.0:1767319108.506079:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291898624:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319108.506111:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319108.506230:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291898624:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 150us (515us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319108.506239:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16699
00000100:00080000:1.0:1767319108.506262:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319109.083181:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319110.107230:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319111.129107:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319111.639842:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319111.641932:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379675520:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319111.642012:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319111.642447:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675520
00000100:00100000:1.0:1767319111.642457:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675520
00000100:00100000:1.0:1767319111.642600:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158
00000100:00100000:1.0:1767319111.642610:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379675520:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319111.642645:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319111.642710:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379675520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (697us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319111.642718:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158
00000100:00100000:2.0:1767319111.642982:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379675520:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319111.643326:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319112.151132:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319112.591605:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767319112.591651:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291898880 offset 0 length 520: 4
00000100:00100000:2.0:1767319112.591678:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319112.591736:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899136
00000100:00100000:0.0:1767319112.591745:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899136
00000100:00100000:3.0:1767319112.591747:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899008
00000100:00100000:3.0:1767319112.591752:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899008
00000100:00100000:3.0:1767319112.591828:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4048
00000100:00080000:1.0:1767319112.591829:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319112.591842:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291899136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319112.591899:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16700
00000100:00100000:0.0:1767319112.591905:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291899008:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319112.591923:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319112.591967:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291899136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 128us (373us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319112.591976:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4048
00000100:00100000:0.0:1767319112.592219:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291899008:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 312us (540us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319112.592224:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16700
00000100:00080000:2.0:1767319112.667532:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319112.667543:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319112.667546:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319112.667550:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319112.667554:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319112.667562:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4009
00000100:00080000:2.0:1767319112.667566:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319112.667582:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319112.667625:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164379675648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319112.667643:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319112.667647:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319112.667648:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319112.667652:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4009
00000100:00080000:2.0:1767319112.667655:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319112.667658:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319112.667672:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafed80 x1853164379675776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319112.667761:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319112.667764:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319112.667766:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319112.667771:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4009
00000100:00080000:2.0:1767319112.667773:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319112.667776:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319112.667787:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9dc00 x1853164379676288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319112.667802:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319112.667805:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319112.667807:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319112.667810:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4009
00000100:00080000:2.0:1767319112.667812:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319112.667816:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319112.667825:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9d500 x1853164379676544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319112.668407:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379675904:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.668479:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319112.668554:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319112.668561:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379676416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.668599:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319112.668632:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379676032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.668657:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319112.668678:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319112.668683:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379676160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.668702:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319112.668745:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675904
00000100:00100000:0.0:1767319112.668752:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675904
00000100:00100000:0.0:1767319112.668792:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379676032
00000100:00100000:0.0:1767319112.668795:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379676032
00000100:00100000:0.0:1767319112.668824:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401
00000100:00100000:0.0:1767319112.668832:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379675904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.668925:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379675904:12345-0@lo:400:kworker.0 Request processed in 93us (446us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319112.668933:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401
00000100:00100000:0.0:1767319112.668950:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402
00000100:00100000:0.0:1767319112.668956:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379676032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.669512:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379676032:12345-0@lo:400:kworker.0 Request processed in 554us (851us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319112.669521:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402
00000100:00100000:0.0:1767319112.669548:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379676416
00000100:00100000:0.0:1767319112.669552:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379676416
00000100:00100000:0.0:1767319112.669676:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379676160
00000100:00100000:0.0:1767319112.669680:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379676160
00000100:00100000:0.0:1767319112.669707:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049
00000100:00100000:0.0:1767319112.669713:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379676416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.669763:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379676416:12345-0@lo:400:kworker.0 Request processed in 49us (1162us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319112.669769:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049
00000100:00100000:0.0:1767319112.669780:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050
00000100:00100000:0.0:1767319112.669786:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379676160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.669812:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379676160:12345-0@lo:400:kworker.0 Request processed in 26us (1108us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319112.669817:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050
00000100:00080000:0.0:1767319112.669833:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319112.669837:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319112.670387:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379676160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.670410:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379676032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.670450:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379676416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319112.670461:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379675904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319112.674719:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379675648:0@lo:38:kworker.0
00000100:00100000:1.0:1767319112.675420:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319112.675525:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379675776:0@lo:38:kworker.0
00000100:00100000:1.0:1767319112.675555:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319112.675605:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379676288:0@lo:38:kworker.0
00000100:00100000:1.0:1767319112.675629:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319112.675679:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675776
00000100:00100000:2.0:1767319112.675687:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675776
00000100:00100000:2.0:1767319112.675742:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937
00000100:00100000:2.0:1767319112.675750:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379675776:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319112.675772:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319112.675812:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379675776:12345-0@lo:38:kworker.0 Request processed in 61us (255us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319112.675819:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937
00000100:00100000:3.0:1767319112.684669:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379675648
00000100:00100000:1.0:1767319112.684689:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379676544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319112.684691:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379675648
00000100:00100000:1.0:1767319112.684764:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319112.684822:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379676288
00000100:00080000:1.0:1767319112.684827:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319112.684829:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379676288
00000100:00080000:1.0:1767319112.684835:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319112.684838:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379675776:0@lo:38:kworker.0
00000100:00100000:2.0:1767319112.684858:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379676544
00000100:00100000:2.0:1767319112.684863:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379676544
00000100:00100000:1.0:1767319112.684894:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16701
00000100:00100000:1.0:1767319112.684900:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379675648:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319112.684916:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16702
00010000:00020000:1.0:1767319112.684921:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319112.684926:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f1c0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379676288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319112.684939:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319112.684961:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379675648:12345-0@lo:38:kworker.0 Request processed in 59us (9541us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319112.684967:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16701
00000100:00100000:1.0:1767319112.684983:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16703
00000100:00100000:1.0:1767319112.684985:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379676544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319112.684994:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319112.684996:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f1c0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379676288:12345-0@lo:38:kworker.0 Request processed in 56us (9348us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319112.685005:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16702
00000100:00100000:1.0:1767319112.685013:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379676544:12345-0@lo:38:kworker.0 Request processed in 24us (248us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319112.685019:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16703
00000100:00080000:1.0:1767319112.685045:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319112.685049:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319112.685053:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379675648:0@lo:38:kworker.0
00000100:00080000:1.0:1767319112.685063:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319112.685066:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319112.685069:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379676288:0@lo:38:kworker.0
00000100:00080000:1.0:1767319112.685075:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319112.685078:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319112.685081:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379676544:0@lo:38:kworker.0
00010000:00010000:3.0:1767319113.175294:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319113.175483:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379676672:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319113.176438:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319113.176550:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379676672
00000100:00100000:0.0:1767319113.176561:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379676672
00000100:00100000:0.0:1767319113.176627:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159
00000100:00100000:0.0:1767319113.176639:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379676672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319113.176670:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319113.176735:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379676672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (298us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319113.176744:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159
00000100:00100000:3.0:1767319113.176895:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379676672:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319114.199755:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319115.223243:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319116.249243:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319116.759254:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379676800:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319116.759337:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319116.759463:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379676800
00000100:00100000:2.0:1767319116.759472:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379676800
00000100:00100000:2.0:1767319116.759569:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160
00000100:00080000:0.0:1767319116.759603:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319116.759636:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379676800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319116.759670:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319116.759727:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379676800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319116.759796:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379676800:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319116.762701:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160
00010000:00010000:3.0:1767319117.271167:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319117.713205:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319117.713315:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899392
00000100:00100000:0.0:1767319117.713325:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899392
00000100:00100000:0.0:1767319117.713433:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4051
00000100:00100000:0.0:1767319117.713448:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291899392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319117.713558:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291899392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 115us (364us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319117.713567:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4051
00000100:00100000:2.0:1767319117.713629:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319117.714145:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899264
00000100:00100000:0.0:1767319117.714156:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899264
00000100:00100000:0.0:1767319117.714202:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16704
00000100:00100000:0.0:1767319117.714210:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291899264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319117.714239:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319117.714302:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291899264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 91us (681us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319117.714309:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16704
00000100:00080000:1.0:1767319117.717037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319117.783030:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319092/real 1767319092]  req@ffff8b0e07331f80 x1853164379670400/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319117 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319117.783071:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e07331f80 x1853164379670400/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319117 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319117.783093:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319117.783133:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319117.783137:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379670400:0@lo:250:kworker.0
00000100:00080000:3.0:1767319117.783358:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319117.783369:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319117.783374:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319117.783382:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 3994
00000100:00080000:3.0:1767319117.783387:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319117.783396:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319117.783442:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682d80 x1853164379676928/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319117.783478:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319117.783482:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319117.783484:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319117.783487:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767319117.783490:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319117.783493:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319117.783513:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680700 x1853164379677056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319117.783521:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319117.783524:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319117.783536:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319117.783541:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767319117.783543:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319117.783548:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319117.783559:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681500 x1853164379677184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319117.783624:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319117.783628:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319117.783630:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319117.783633:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767319117.783636:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319117.783639:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319117.783648:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680380 x1853164379677696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319117.783665:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319117.783669:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319117.783670:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319117.783674:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4015
00000100:00080000:3.0:1767319117.783676:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319117.783680:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319117.783689:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858e00 x1853164379677952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319117.783717:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379677440:0@lo:400:kworker.0
00000100:00100000:3.0:1767319117.783797:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319117.783964:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379677312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.784001:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319117.784059:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379677568:0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.784088:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319117.784168:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379676928:0@lo:250:kworker.0
00000400:00000100:1.0:1767319117.784204:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379676928 offset 0 length 520: 4
00000100:00100000:0.0:1767319117.784463:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319117.784470:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379677824:0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.784494:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319117.784543:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677568
00000100:00100000:0.0:1767319117.784552:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677568
00000100:00100000:0.0:1767319117.784615:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677824
00000100:00100000:0.0:1767319117.784617:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677824
00000100:00100000:0.0:1767319117.784637:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052
00000100:00100000:0.0:1767319117.784645:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379677568:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.784697:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379677568:12345-0@lo:400:kworker.0 Request processed in 52us (608us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319117.784705:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052
00000100:00100000:0.0:1767319117.784722:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053
00000100:00100000:0.0:1767319117.784727:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379677824:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319117.784815:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379677568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319117.784846:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379677056:0@lo:38:kworker.0
00000100:00100000:1.0:1767319117.784899:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319117.784916:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379677184:0@lo:38:kworker.0
00000100:00100000:1.0:1767319117.784942:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319117.784958:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379677696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319117.784976:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319117.784988:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379677952:0@lo:38:kworker.0
00000100:00100000:1.0:1767319117.785005:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319117.785030:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677056
00000100:00100000:1.0:1767319117.785033:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677056
00000100:00100000:1.0:1767319117.785050:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677696
00000100:00100000:1.0:1767319117.785052:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677696
00000100:00100000:1.0:1767319117.785059:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677952
00000100:00100000:1.0:1767319117.785061:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677952
00000100:00100000:1.0:1767319117.785070:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16705
00000100:00100000:1.0:1767319117.785075:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379677056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319117.785096:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319117.785128:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379677056:12345-0@lo:38:kworker.0 Request processed in 52us (228us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319117.785134:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16705
00000100:00100000:1.0:1767319117.785152:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16706
00000100:00100000:1.0:1767319117.785155:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379677696:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319117.785163:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319117.785179:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379677696:12345-0@lo:38:kworker.0 Request processed in 23us (202us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319117.785184:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16706
00000100:00100000:3.0:1767319117.785379:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677184
00000100:00100000:3.0:1767319117.785384:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677184
00000100:00100000:3.0:1767319117.785405:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938
00000100:00100000:3.0:1767319117.785410:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379677184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319117.785420:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319117.785453:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379677184:12345-0@lo:38:kworker.0 Request processed in 42us (510us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319117.785458:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938
00000100:00080000:3.0:1767319117.785474:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319117.785487:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16707
00000100:00100000:3.0:1767319117.785491:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379677952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319117.785500:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319117.785520:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379677952:12345-0@lo:38:kworker.0 Request processed in 28us (514us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319117.785526:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16707
00000100:00080000:3.0:1767319117.785585:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319117.785591:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.785594:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379677056:0@lo:38:kworker.0
00000100:00080000:3.0:1767319117.785602:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319117.785606:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.785609:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379677184:0@lo:38:kworker.0
00000100:00080000:3.0:1767319117.785616:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319117.785619:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.785622:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379677696:0@lo:38:kworker.0
00000100:00080000:3.0:1767319117.785628:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319117.785631:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319117.785634:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379677952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319117.785772:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677440
00000100:00100000:2.0:1767319117.785777:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677440
00000100:00100000:2.0:1767319117.785826:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379677312
00000100:00100000:2.0:1767319117.785830:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379677312
00000100:00100000:2.0:1767319117.785852:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403
00000100:00100000:2.0:1767319117.785859:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379677440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319117.785930:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379677440:12345-0@lo:400:kworker.0 Request processed in 72us (2133us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319117.785937:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403
00000100:00100000:2.0:1767319117.785949:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404
00000100:00100000:2.0:1767319117.785955:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379677312:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319117.789857:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319117.790064:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379677440:0@lo:400:kworker.0
00000100:00100000:0.0:1767319117.795890:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379677824:12345-0@lo:400:kworker.0 Request processed in 11118us (11351us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319117.795910:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053
00000100:00100000:2.0:1767319117.796237:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379677312:12345-0@lo:400:kworker.0 Request processed in 10279us (12232us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319117.796250:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404
00000100:00100000:1.0:1767319117.800017:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379677824:0@lo:400:kworker.0
00000100:00100000:1.0:1767319117.800068:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379677312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319118.297470:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319118.297501:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379678080:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319118.297609:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319118.298011:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678080
00000100:00100000:2.0:1767319118.298022:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678080
00000100:00100000:2.0:1767319118.298094:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161
00000100:00100000:2.0:1767319118.298105:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379678080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319118.298145:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319118.298226:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379678080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (615us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319118.298234:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161
00000100:00100000:1.0:1767319118.298346:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379678080:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319118.298640:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319119.321613:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319120.343159:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319121.367582:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319121.882391:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379678208:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319121.882605:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319121.882660:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678208
00000100:00100000:3.0:1767319121.882672:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678208
00000100:00080000:1.0:1767319121.882716:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319121.882745:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162
00000100:00100000:3.0:1767319121.882756:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379678208:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319121.882791:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319121.882858:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379678208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319121.882865:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162
00000100:00100000:1.0:1767319121.882954:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379678208:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319122.395606:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319122.831565:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319122.831705:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899648
00000100:00100000:0.0:1767319122.831719:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899648
00000100:00100000:3.0:1767319122.831790:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:1.0:1767319122.831851:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319122.835936:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899520
00000100:00100000:0.0:1767319122.835959:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899520
00000100:00100000:0.0:1767319122.836059:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4054
00000100:00100000:0.0:1767319122.836082:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291899648:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319122.836219:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291899648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 148us (4671us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319122.836236:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4054
00000100:00100000:0.0:1767319122.836261:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16708
00000100:00100000:0.0:1767319122.836267:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291899520:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319122.836292:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319122.836323:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291899520:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (4533us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319122.836330:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16708
00000100:00080000:0.0:1767319122.904232:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319122.904247:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319122.904251:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319122.904255:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319122.904260:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319122.904271:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4020
00000100:00080000:0.0:1767319122.904277:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319122.904285:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319122.904338:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5880 x1853164379678336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319122.904372:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319122.904376:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319122.904378:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319122.904382:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4020
00000100:00080000:0.0:1767319122.904385:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319122.904389:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319122.904401:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4a80 x1853164379678464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319122.904498:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319122.904501:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319122.904503:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319122.904507:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4020
00000100:00080000:0.0:1767319122.904511:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319122.904514:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319122.904526:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafdc00 x1853164379678976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319122.904543:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319122.904546:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319122.904549:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319122.904553:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4020
00000100:00080000:0.0:1767319122.904556:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319122.904560:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319122.904575:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3a435880 x1853164379679232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319122.904607:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379678848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319122.904694:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319122.904895:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379678592:0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.904934:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319122.904966:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319122.904983:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379679104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.905005:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319122.905039:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678848
00000100:00100000:1.0:1767319122.905047:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678848
00000100:00100000:1.0:1767319122.905109:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379679104
00000100:00100000:1.0:1767319122.905111:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379679104
00000100:00100000:1.0:1767319122.905135:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055
00000100:00100000:1.0:1767319122.905143:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379678848:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.905204:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379678848:12345-0@lo:400:kworker.0 Request processed in 61us (510us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319122.905212:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055
00000100:00100000:1.0:1767319122.905236:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056
00000100:00100000:1.0:1767319122.905244:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379679104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319122.905275:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379679104:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319122.905281:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056
00000100:00080000:1.0:1767319122.905298:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319122.905329:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379679104:0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.905516:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379678336:0@lo:38:kworker.0
00000100:00100000:3.0:1767319122.905554:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319122.905591:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379678464:0@lo:38:kworker.0
00000100:00100000:0.0:1767319122.905606:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319122.905619:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379678720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.905627:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.905657:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319122.905667:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379678976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319122.905690:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379678848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.905702:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.905715:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678592
00000100:00100000:0.0:1767319122.905720:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678592
00000100:00100000:3.0:1767319122.905728:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3a435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379679232:0@lo:38:kworker.0
00000100:00100000:0.0:1767319122.905753:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678720
00000100:00100000:0.0:1767319122.905757:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678720
00000100:00100000:3.0:1767319122.905758:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319122.905793:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405
00000100:00100000:0.0:1767319122.905802:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379678592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319122.905804:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678464
00000100:00100000:3.0:1767319122.905811:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678464
00000100:00100000:0.0:1767319122.905844:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379678592:12345-0@lo:400:kworker.0 Request processed in 43us (909us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319122.905856:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939
00000100:00100000:3.0:1767319122.905864:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379678464:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319122.905903:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319122.905943:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379678464:12345-0@lo:38:kworker.0 Request processed in 79us (320us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319122.905950:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939
00000100:00100000:3.0:1767319122.905975:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678336
00000100:00100000:3.0:1767319122.905979:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678336
00000100:00100000:3.0:1767319122.905997:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379678976
00000100:00100000:3.0:1767319122.906000:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379678976
00000100:00100000:3.0:1767319122.906014:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379679232
00000100:00100000:3.0:1767319122.906016:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379679232
00000100:00100000:3.0:1767319122.906026:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16709
00000100:00100000:3.0:1767319122.906030:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379678336:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319122.906041:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319122.906070:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379678336:12345-0@lo:38:kworker.0 Request processed in 38us (516us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319122.906077:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16709
00000100:00100000:3.0:1767319122.906088:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16710
00000100:00100000:3.0:1767319122.906092:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379678976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319122.906101:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319122.906130:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379678976:12345-0@lo:38:kworker.0 Request processed in 35us (427us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319122.906136:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16710
00000100:00100000:3.0:1767319122.906164:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16711
00000100:00100000:3.0:1767319122.906168:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379679232:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319122.906178:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319122.906206:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379679232:12345-0@lo:38:kworker.0 Request processed in 35us (449us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319122.906212:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16711
00000100:00100000:0.0:1767319122.906250:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405
00000100:00080000:3.0:1767319122.906264:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319122.906282:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319122.906286:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379678336:0@lo:38:kworker.0
00000100:00080000:3.0:1767319122.906296:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319122.906300:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319122.906302:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379678464:0@lo:38:kworker.0
00000100:00080000:3.0:1767319122.906309:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319122.906312:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319122.906314:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379678976:0@lo:38:kworker.0
00000100:00080000:3.0:1767319122.906321:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319122.906324:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319122.906327:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3a435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379679232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319122.910206:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406
00000100:00100000:2.0:1767319122.910302:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379678720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319122.910439:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379678720:12345-0@lo:400:kworker.0 Request processed in 218us (4782us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319122.910448:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406
00000100:00100000:2.0:1767319122.910558:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379678592:0@lo:400:kworker.0
00000100:00080000:1.0:1767319122.912162:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319122.912254:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379678720:0@lo:400:kworker.0
00000100:00100000:1.0:1767319123.415559:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379679360:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319123.415657:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319123.415950:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379679360
00000100:00100000:2.0:1767319123.415960:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379679360
00000100:00100000:2.0:1767319123.416028:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163
00000100:00100000:2.0:1767319123.416039:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379679360:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319123.416077:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319123.416142:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379679360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (484us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319123.416150:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163
00010000:00010000:1.0:1767319123.416252:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319123.416742:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379679360:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319124.439343:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319125.463518:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319126.490625:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319126.999439:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379679488:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319126.999553:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319127.000315:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379679488
00000100:00100000:3.0:1767319127.000331:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379679488
00000100:00100000:3.0:1767319127.000425:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164
00000100:00100000:3.0:1767319127.000437:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379679488:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319127.000481:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319127.000569:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379679488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (1016us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319127.000576:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164
00000100:00080000:1.0:1767319127.000830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319127.000897:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379679488:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319127.512251:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319127.951347:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319127.951493:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319127.952738:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899904
00000100:00100000:3.0:1767319127.952762:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899904
00000100:00100000:3.0:1767319127.953494:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291899776
00000100:00100000:3.0:1767319127.953501:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291899776
00000100:00080000:2.0:1767319127.953543:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319127.953629:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4057
00000100:00100000:1.0:1767319127.953645:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291899904:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319127.953724:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291899904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (2388us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319127.953732:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4057
00000100:00100000:1.0:1767319127.953766:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16712
00000100:00100000:1.0:1767319127.953771:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291899776:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319127.953791:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319127.953817:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291899776:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (2325us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319127.953824:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16712
00000100:00080000:3.0:1767319128.023080:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319128.023091:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319128.023094:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319128.023098:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319128.023103:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319128.023123:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4025
00000100:00080000:3.0:1767319128.023128:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319128.023135:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319128.023184:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681500 x1853164379679616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319128.023201:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319128.023205:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319128.023207:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319128.023211:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4025
00000100:00080000:3.0:1767319128.023213:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319128.023217:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319128.023242:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680700 x1853164379679744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319128.023369:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379679616:0@lo:38:kworker.0
00000100:00100000:0.0:1767319128.023456:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319128.023513:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379679744:0@lo:38:kworker.0
00000100:00100000:0.0:1767319128.023542:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319128.023591:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379679744
00000100:00100000:0.0:1767319128.023598:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379679744
00000100:00100000:0.0:1767319128.023633:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940
00000100:00100000:0.0:1767319128.023640:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379679744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319128.023662:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319128.023705:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379679744:12345-0@lo:38:kworker.0 Request processed in 63us (161us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319128.023712:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940
00000100:00080000:0.0:1767319128.023753:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319128.023758:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319128.023761:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379679744:0@lo:38:kworker.0
00000100:00080000:3.0:1767319128.023902:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319128.023906:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319128.023908:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319128.023912:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4025
00000100:00080000:3.0:1767319128.023914:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319128.023919:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319128.023934:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85dc00 x1853164379680256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319128.024254:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379679872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024291:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319128.024317:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319128.024323:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379680384:0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024348:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319128.024376:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379679616
00000100:00100000:1.0:1767319128.024381:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379679616
00000100:00100000:1.0:1767319128.024403:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680384
00000100:00100000:1.0:1767319128.024405:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680384
00000100:00100000:1.0:1767319128.024453:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058
00000100:00100000:1.0:1767319128.024461:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379680384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024504:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379680384:12345-0@lo:400:kworker.0 Request processed in 45us (155us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319128.024510:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058
00000100:00100000:1.0:1767319128.024528:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16713
00000100:00100000:1.0:1767319128.024532:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3a437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379679616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319128.024543:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319128.024567:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3a437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379679616:12345-0@lo:38:kworker.0 Request processed in 34us (1112us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319128.024573:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16713
00000100:00080000:1.0:1767319128.024597:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319128.024619:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379680384:0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024663:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379679872
00000100:00100000:1.0:1767319128.024668:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379679872
00000100:00100000:1.0:1767319128.024694:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407
00000100:00100000:1.0:1767319128.024701:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379679872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024736:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379679872:12345-0@lo:400:kworker.0 Request processed in 35us (444us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319128.024742:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407
00000100:00100000:1.0:1767319128.024760:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379680128:0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024787:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319128.024806:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319128.024811:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379680000:0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024833:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319128.024853:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680000
00000100:00100000:1.0:1767319128.024857:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680000
00000100:00100000:1.0:1767319128.024905:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408
00000100:00100000:1.0:1767319128.024911:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379680000:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.024942:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379680000:12345-0@lo:400:kworker.0 Request processed in 31us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319128.024948:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408
00000100:00080000:1.0:1767319128.024965:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319128.024981:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379680000:0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.025001:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379679872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.025017:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379680256:0@lo:38:kworker.0
00000100:00100000:1.0:1767319128.025040:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319128.025063:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319128.025068:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319128.025071:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379679616:0@lo:38:kworker.0
00000100:00100000:1.0:1767319128.025091:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680128
00000100:00100000:1.0:1767319128.025095:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680128
00000100:00100000:1.0:1767319128.025133:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680256
00000100:00100000:1.0:1767319128.025137:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680256
00000100:00100000:1.0:1767319128.025153:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059
00000100:00100000:1.0:1767319128.025159:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379680128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319128.025192:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379680128:12345-0@lo:400:kworker.0 Request processed in 33us (404us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319128.025197:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059
00000100:00100000:1.0:1767319128.025210:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16714
00000100:00100000:1.0:1767319128.025213:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379680256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319128.025224:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319128.025251:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379680256:12345-0@lo:38:kworker.0 Request processed in 35us (209us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319128.025257:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16714
00000100:00080000:1.0:1767319128.025275:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319128.025289:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379680128:0@lo:400:kworker.0
00000100:00080000:1.0:1767319128.025310:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319128.025313:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319128.025315:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379680256:0@lo:38:kworker.0
00000100:00080000:3.0:1767319128.026736:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319128.026745:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319128.026748:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319128.026754:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4025
00000100:00080000:3.0:1767319128.026757:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319128.026763:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319128.026799:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e300 x1853164379680512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319128.026886:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379680512:0@lo:38:kworker.0
00000100:00100000:0.0:1767319128.026941:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319128.027098:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680512
00000100:00100000:2.0:1767319128.027105:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680512
00000100:00100000:2.0:1767319128.027149:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16715
00000100:00100000:2.0:1767319128.027155:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379680512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319128.027173:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319128.027978:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379680512:12345-0@lo:38:kworker.0 Request processed in 818us (1033us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319128.027997:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16715
00000100:00080000:0.0:1767319128.028080:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319128.028084:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319128.028087:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379680512:0@lo:38:kworker.0
00000100:00100000:3.0:1767319128.535745:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379680640:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319128.535815:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319128.536038:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319128.536089:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680640
00000100:00100000:2.0:1767319128.536098:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680640
00000100:00100000:2.0:1767319128.536159:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165
00000100:00100000:2.0:1767319128.536169:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379680640:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319128.536198:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319128.536254:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379680640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (438us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319128.536261:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165
00000100:00100000:1.0:1767319128.536423:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379680640:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319129.559233:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319130.583519:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319131.607056:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319132.119178:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319132.119196:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379680768:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319132.119463:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319132.119683:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680768
00000100:00100000:3.0:1767319132.119692:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680768
00000100:00100000:3.0:1767319132.119969:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166
00000100:00100000:3.0:1767319132.119980:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379680768:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319132.120011:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319132.120070:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379680768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (607us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319132.120130:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379680768:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319132.120236:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166
00000100:00080000:2.0:1767319132.120566:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319132.631968:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319133.070981:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319133.071081:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291900160
00000100:00100000:1.0:1767319133.071093:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291900160
00000100:00100000:1.0:1767319133.071180:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4060
00000100:00100000:1.0:1767319133.071190:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291900160:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319133.071272:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291900160:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (299us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319133.071279:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4060
00000100:00080000:2.0:1767319133.071498:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319133.071894:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319133.072003:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291900032
00000100:00100000:3.0:1767319133.072009:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291900032
00000100:00100000:3.0:1767319133.072043:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16716
00000100:00100000:3.0:1767319133.072049:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291900032:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319133.072070:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319133.072114:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291900032:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 64us (244us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319133.072121:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16716
00000100:00080000:2.0:1767319133.143361:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.143373:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319133.143376:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.143380:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.143385:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.143402:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4030
00000100:00080000:2.0:1767319133.143407:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.143415:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319133.143463:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798e00 x1853164379680896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319133.143489:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.143493:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.143495:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.143499:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4030
00000100:00080000:2.0:1767319133.143501:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.143505:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319133.143518:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379ad80 x1853164379681024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319133.143579:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.143582:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.143585:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.143588:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4030
00000100:00080000:2.0:1767319133.143591:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.143595:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319133.143605:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379a300 x1853164379681536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319133.143621:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319133.143624:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319133.143626:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319133.143629:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4030
00000100:00080000:2.0:1767319133.143632:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319133.143636:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319133.143645:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379aa00 x1853164379681792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319133.143683:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379681664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.143750:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319133.143810:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319133.143817:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379681152:0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.143843:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319133.143896:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379681408:0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.143919:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319133.143936:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319133.143941:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379681280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.143962:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319133.143995:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681152
00000100:00100000:2.0:1767319133.144002:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681152
00000100:00100000:2.0:1767319133.144041:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681280
00000100:00100000:2.0:1767319133.144045:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681280
00000100:00100000:2.0:1767319133.144075:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409
00000100:00100000:2.0:1767319133.144083:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379681152:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.144135:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379681152:12345-0@lo:400:kworker.0 Request processed in 53us (291us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319133.144142:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409
00000100:00100000:2.0:1767319133.144159:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410
00000100:00100000:2.0:1767319133.144164:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379681280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.144194:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379681280:12345-0@lo:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319133.144200:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410
00000100:00080000:2.0:1767319133.144223:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319133.144254:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379681280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319133.144281:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379681152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319133.144362:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681664
00000100:00100000:3.0:1767319133.144367:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681664
00000100:00100000:3.0:1767319133.144416:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681408
00000100:00100000:3.0:1767319133.144420:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681408
00000100:00100000:3.0:1767319133.144444:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061
00000100:00100000:3.0:1767319133.144456:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379681664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319133.144505:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379681664:12345-0@lo:400:kworker.0 Request processed in 50us (754us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319133.144512:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061
00000100:00100000:3.0:1767319133.144530:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062
00000100:00100000:3.0:1767319133.144537:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379681408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319133.144572:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379681664:0@lo:400:kworker.0
00000100:00100000:3.0:1767319133.144580:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379681408:12345-0@lo:400:kworker.0 Request processed in 42us (658us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319133.144588:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062
00000100:00100000:0.0:1767319133.144617:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379681408:0@lo:400:kworker.0
00000100:00100000:1.0:1767319133.144684:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379680896:0@lo:38:kworker.0
00000100:00100000:1.0:1767319133.144716:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319133.144744:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379681024:0@lo:38:kworker.0
00000100:00100000:1.0:1767319133.144766:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319133.144791:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379681536:0@lo:38:kworker.0
00000100:00100000:1.0:1767319133.144804:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319133.144814:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379681792:0@lo:38:kworker.0
00000100:00100000:1.0:1767319133.144824:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319133.144839:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379680896
00000100:00100000:1.0:1767319133.144842:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379680896
00000100:00100000:1.0:1767319133.144854:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681536
00000100:00100000:1.0:1767319133.144855:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681536
00000100:00100000:1.0:1767319133.144861:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681792
00000100:00100000:1.0:1767319133.144863:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681792
00000100:00100000:1.0:1767319133.144885:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16717
00000100:00100000:1.0:1767319133.144888:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379680896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319133.144902:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319133.144925:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f26f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379680896:12345-0@lo:38:kworker.0 Request processed in 36us (209us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319133.144928:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16717
00000100:00100000:1.0:1767319133.144938:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16718
00000100:00100000:1.0:1767319133.144940:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379681536:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319133.144948:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319133.144959:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379681536:12345-0@lo:38:kworker.0 Request processed in 18us (155us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319133.144962:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16718
00000100:00100000:1.0:1767319133.144968:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16719
00000100:00100000:1.0:1767319133.144970:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379681792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319133.144975:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319133.144986:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379681792:12345-0@lo:38:kworker.0 Request processed in 14us (161us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319133.144989:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16719
00000100:00080000:1.0:1767319133.145015:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319133.145020:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319133.145023:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379680896:0@lo:38:kworker.0
00000100:00080000:1.0:1767319133.145031:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319133.145039:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319133.145043:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379681536:0@lo:38:kworker.0
00000100:00080000:1.0:1767319133.145050:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319133.145053:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319133.145056:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379681792:0@lo:38:kworker.0
00000100:00100000:3.0:1767319133.145148:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681024
00000100:00100000:3.0:1767319133.145151:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681024
00000100:00100000:3.0:1767319133.145171:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941
00000100:00100000:3.0:1767319133.145176:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379681024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319133.145186:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319133.145224:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379681024:12345-0@lo:38:kworker.0 Request processed in 46us (456us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319133.145230:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941
00000100:00080000:1.0:1767319133.145327:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319133.145332:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319133.145335:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379681024:0@lo:38:kworker.0
00000100:00080000:2.0:1767319133.145737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319133.655746:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319133.655949:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379681920:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319133.656032:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319133.656237:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379681920
00000100:00100000:3.0:1767319133.656244:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379681920
00000100:00100000:3.0:1767319133.656298:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167
00000100:00100000:3.0:1767319133.656308:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379681920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319133.656337:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319133.658920:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379681920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2602us (2877us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319133.658937:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167
00000100:00100000:1.0:1767319133.659145:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379681920:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319134.679643:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319135.704950:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319136.727345:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319137.239332:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379682048:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319137.239447:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319137.239610:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682048
00000100:00100000:3.0:1767319137.239634:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682048
00000100:00080000:1.0:1767319137.239725:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319137.239732:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168
00000100:00100000:3.0:1767319137.239746:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379682048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319137.239789:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319137.240361:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379682048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 607us (903us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319137.240371:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168
00000100:00100000:0.0:1767319137.243081:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379682048:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319137.752408:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319138.193192:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319138.193232:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767319138.193268:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291900544 offset 0 length 520: 4
00000100:00100000:3.0:1767319138.193782:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291900416
00000100:00100000:3.0:1767319138.193794:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291900416
00000100:00100000:3.0:1767319138.193909:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291900288
00000100:00100000:3.0:1767319138.193912:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291900288
00000100:00100000:3.0:1767319138.193933:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4063
00000100:00100000:3.0:1767319138.193943:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291900416:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319138.194026:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291900416:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (858us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319138.194033:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4063
00000100:00100000:3.0:1767319138.194048:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16720
00000100:00100000:3.0:1767319138.194050:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291900288:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319138.194070:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319138.194089:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291900288:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 37us (857us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319138.194093:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16720
00000100:00080000:1.0:1767319138.194277:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319138.265734:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319138.265744:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319138.265747:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319138.265751:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319138.265755:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319138.265763:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4035
00000100:00080000:3.0:1767319138.265767:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319138.265773:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319138.265811:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d180 x1853164379682176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319138.265851:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319138.265855:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319138.265856:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319138.265860:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4035
00000100:00080000:3.0:1767319138.265863:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319138.265905:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319138.265926:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e300 x1853164379682304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319138.265937:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379682176:0@lo:38:kworker.0
00000100:00080000:3.0:1767319138.266010:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319138.266015:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319138.266017:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319138.266021:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4035
00000100:00080000:3.0:1767319138.266024:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319138.266029:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319138.266044:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729df80 x1853164379682816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319138.266059:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319138.266084:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319138.266089:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319138.266092:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319138.266098:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4035
00000100:00080000:3.0:1767319138.266101:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319138.266106:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319138.266119:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164379683072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319138.266160:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379682304:0@lo:38:kworker.0
00000100:00100000:3.0:1767319138.266173:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379682688:0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.266195:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319138.266274:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379682432:0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.266327:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379682816:0@lo:38:kworker.0
00000100:00100000:1.0:1767319138.266365:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319138.266383:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379683072:0@lo:38:kworker.0
00000100:00100000:1.0:1767319138.266401:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319138.266436:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682176
00000100:00100000:1.0:1767319138.266445:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682176
00000100:00100000:1.0:1767319138.266479:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682816
00000100:00100000:1.0:1767319138.266481:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682816
00000100:00100000:1.0:1767319138.266492:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379683072
00000100:00100000:1.0:1767319138.266494:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379683072
00000100:00100000:1.0:1767319138.266509:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16721
00000100:00100000:1.0:1767319138.266517:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379682176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319138.266542:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.266597:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379682176:12345-0@lo:38:kworker.0 Request processed in 74us (542us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.266605:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16721
00000100:00100000:1.0:1767319138.266628:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16722
00000100:00100000:1.0:1767319138.266632:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379682816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319138.266642:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.266669:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379682816:12345-0@lo:38:kworker.0 Request processed in 35us (303us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.266675:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16722
00000100:00100000:1.0:1767319138.266684:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16723
00000100:00100000:1.0:1767319138.266688:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379683072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319138.266697:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.266724:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379683072:12345-0@lo:38:kworker.0 Request processed in 25us (312us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.266729:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16723
00000100:00080000:1.0:1767319138.266777:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.266781:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.266785:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379682816:0@lo:38:kworker.0
00000100:00080000:1.0:1767319138.266793:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.266796:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.266799:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379683072:0@lo:38:kworker.0
00000100:00080000:1.0:1767319138.266806:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.266809:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.266812:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379682176:0@lo:38:kworker.0
00000100:00100000:1.0:1767319138.266890:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682304
00000100:00100000:1.0:1767319138.266893:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682304
00000100:00100000:1.0:1767319138.266916:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942
00000100:00100000:1.0:1767319138.266921:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379682304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319138.266931:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319138.266957:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379682304:12345-0@lo:38:kworker.0 Request processed in 35us (766us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319138.266963:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942
00000100:00100000:1.0:1767319138.266979:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379682560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.267005:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319138.267036:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319138.267040:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319138.267043:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379682304:0@lo:38:kworker.0
00000100:00100000:1.0:1767319138.267230:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682560
00000100:00100000:1.0:1767319138.267234:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682560
00000100:00100000:1.0:1767319138.267277:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411
00000100:00100000:1.0:1767319138.267282:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379682560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.267324:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379682560:12345-0@lo:400:kworker.0 Request processed in 42us (318us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319138.267351:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411
00000100:00080000:1.0:1767319138.267369:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319138.267390:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379682560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319138.267590:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379682944:0@lo:400:kworker.0
00000100:00100000:2.0:1767319138.267627:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319138.267992:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682944
00000100:00100000:1.0:1767319138.267998:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682944
00000100:00100000:1.0:1767319138.268042:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064
00000100:00100000:1.0:1767319138.268047:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379682944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.268082:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379682944:12345-0@lo:400:kworker.0 Request processed in 35us (455us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319138.268088:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064
00000100:00080000:2.0:1767319138.268146:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319138.268168:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379682944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319138.269960:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319138.270395:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319138.270495:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682688
00000100:00100000:1.0:1767319138.270507:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682688
00000100:00100000:1.0:1767319138.270601:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065
00000100:00100000:1.0:1767319138.270613:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379682688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319138.270698:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379682688:12345-0@lo:400:kworker.0 Request processed in 89us (310us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319138.270706:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065
00000100:00080000:3.0:1767319138.270977:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319138.271025:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379682688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319138.271542:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379682432
00000100:00100000:2.0:1767319138.271549:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379682432
00000100:00100000:2.0:1767319138.271595:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412
00000100:00100000:2.0:1767319138.271605:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379682432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319138.271849:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379682432:12345-0@lo:400:kworker.0 Request processed in 243us (1893us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319138.271857:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412
00000100:00100000:0.0:1767319138.272103:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379682432:0@lo:400:kworker.0
00010000:00010000:1.0:1767319138.776374:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319138.776603:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379683200:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319138.776701:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319138.777365:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379683200
00000100:00100000:2.0:1767319138.777379:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379683200
00000100:00100000:2.0:1767319138.777497:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169
00000100:00100000:2.0:1767319138.777509:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379683200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319138.777553:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319138.777628:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379683200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (926us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319138.777636:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169
00000100:00100000:0.0:1767319138.777904:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379683200:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319139.799264:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319140.823955:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319141.847276:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319142.359104:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319117/real 1767319117]  req@ffff8b0e02682d80 x1853164379676928/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319142.359146:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e02682d80 x1853164379676928/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319142.359172:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319142.359201:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319142.359206:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379676928:0@lo:250:kworker.0
00000100:00100000:0.0:1767319142.359511:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319142.359536:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379683328:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319142.359620:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319142.359777:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379683328
00000100:00100000:2.0:1767319142.359789:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379683328
00000100:00100000:2.0:1767319142.359889:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170
00000100:00100000:2.0:1767319142.359900:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379683328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319142.359937:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319142.359990:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379683328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (369us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319142.359997:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170
00000100:00080000:0.0:1767319142.360183:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319142.360223:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379683328:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319142.360503:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319142.360509:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319142.360513:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319142.360518:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4020
00000100:00080000:1.0:1767319142.360523:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319142.360529:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319142.360556:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85c000 x1853164379683456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319142.360582:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319142.360586:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319142.360587:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319142.360590:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4040
00000100:00080000:1.0:1767319142.360593:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319142.360597:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319142.360613:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e300 x1853164379683584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319142.360621:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319142.360625:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319142.360627:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319142.360631:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4040
00000100:00080000:1.0:1767319142.360633:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319142.360637:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319142.360649:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85dc00 x1853164379683712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319142.360702:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319142.360706:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319142.360707:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319142.360711:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4040
00000100:00080000:1.0:1767319142.360714:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319142.360717:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319142.360727:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164379684096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319142.360742:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319142.360745:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319142.360747:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319142.360749:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4040
00000100:00080000:1.0:1767319142.360752:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319142.360755:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319142.360765:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45180 x1853164379684352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319142.360795:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379683968:0@lo:400:kworker.0
00000100:00100000:1.0:1767319142.360839:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319142.360898:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319142.360905:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379684224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319142.360928:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319142.360959:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379683968
00000100:00100000:1.0:1767319142.360965:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379683968
00000100:00100000:1.0:1767319142.361030:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684224
00000100:00100000:1.0:1767319142.361035:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684224
00000100:00100000:1.0:1767319142.361056:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066
00000100:00100000:1.0:1767319142.361063:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379683968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319142.361106:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379683968:12345-0@lo:400:kworker.0 Request processed in 42us (266us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319142.361113:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066
00000100:00100000:1.0:1767319142.361132:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067
00000100:00100000:1.0:1767319142.361138:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379684224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319142.361164:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379684224:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319142.361170:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067
00000100:00100000:1.0:1767319142.361209:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379684224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319142.361219:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379683968:0@lo:400:kworker.0
00000100:00100000:2.0:1767319142.361319:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379683456:0@lo:250:kworker.0
00000400:00000100:2.0:1767319142.361348:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379683456 offset 0 length 520: 4
00000100:00100000:2.0:1767319142.361371:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379683584:0@lo:38:kworker.0
00000100:00100000:2.0:1767319142.361394:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319142.361419:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379683712:0@lo:38:kworker.0
00000100:00100000:2.0:1767319142.361444:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319142.361463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379684096:0@lo:38:kworker.0
00000100:00100000:2.0:1767319142.361483:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319142.361500:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379684352:0@lo:38:kworker.0
00000100:00100000:2.0:1767319142.361517:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319142.361549:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379683712
00000100:00100000:2.0:1767319142.361553:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379683712
00000100:00100000:2.0:1767319142.361576:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943
00000100:00100000:2.0:1767319142.361582:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379683712:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319142.361602:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319142.361639:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379683712:12345-0@lo:38:kworker.0 Request processed in 56us (195us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319142.361645:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943
00000100:00100000:2.0:1767319142.361664:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379683584
00000100:00100000:2.0:1767319142.361667:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379683584
00000100:00100000:2.0:1767319142.361685:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684096
00000100:00100000:2.0:1767319142.361687:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684096
00000100:00100000:2.0:1767319142.361698:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684352
00000100:00100000:2.0:1767319142.361700:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684352
00000100:00100000:2.0:1767319142.361709:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16724
00000100:00100000:2.0:1767319142.361713:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379683584:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319142.361721:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319142.361746:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379683584:12345-0@lo:38:kworker.0 Request processed in 31us (351us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319142.361751:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16724
00000100:00100000:2.0:1767319142.361761:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16725
00000100:00100000:2.0:1767319142.361765:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379684096:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319142.361774:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319142.361797:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379684096:12345-0@lo:38:kworker.0 Request processed in 30us (313us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319142.361802:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16725
00000100:00100000:2.0:1767319142.361813:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16726
00000100:00100000:2.0:1767319142.361817:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379684352:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319142.361826:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319142.361847:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379684352:12345-0@lo:38:kworker.0 Request processed in 28us (328us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319142.361852:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16726
00000100:00080000:2.0:1767319142.361916:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319142.361923:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319142.361926:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379683584:0@lo:38:kworker.0
00000100:00080000:2.0:1767319142.361936:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319142.361939:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319142.361942:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379683712:0@lo:38:kworker.0
00000100:00080000:2.0:1767319142.361949:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319142.361952:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319142.361955:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379684096:0@lo:38:kworker.0
00000100:00080000:2.0:1767319142.361962:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319142.361965:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319142.361967:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379684352:0@lo:38:kworker.0
00000100:00080000:0.0:1767319142.362182:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319142.362204:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379683840:0@lo:400:kworker.0
00000100:00100000:0.0:1767319142.362245:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319142.363250:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379683840
00000100:00100000:2.0:1767319142.363262:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379683840
00000100:00100000:2.0:1767319142.363355:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413
00000100:00100000:2.0:1767319142.363365:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379683840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319142.363455:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379683840:12345-0@lo:400:kworker.0 Request processed in 93us (1209us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319142.363464:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413
00000100:00100000:3.0:1767319142.363566:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379683840:0@lo:400:kworker.0
00000100:00080000:0.0:1767319142.363643:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319142.871238:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319143.316363:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319143.316431:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319143.316540:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291900672
00000100:00100000:2.0:1767319143.316554:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291900672
00000100:00100000:2.0:1767319143.316613:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291900800
00000100:00100000:2.0:1767319143.316616:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291900800
00000100:00100000:2.0:1767319143.316676:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4068
00000100:00100000:2.0:1767319143.316688:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291900800:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319143.316792:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291900800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (359us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319143.316800:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4068
00000100:00100000:2.0:1767319143.316823:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16727
00000100:00100000:2.0:1767319143.316828:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291900672:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319143.316855:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319143.316935:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291900672:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 104us (589us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319143.316942:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16727
00000100:00080000:0.0:1767319143.317196:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319143.900955:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319143.904381:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379684480:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319143.904499:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319143.904709:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684480
00000100:00100000:1.0:1767319143.904721:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684480
00000100:00100000:1.0:1767319143.904804:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171
00000100:00100000:1.0:1767319143.904817:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379684480:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319143.904860:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319143.904948:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379684480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (449us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319143.904956:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171
00000100:00100000:3.0:1767319143.905154:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379684480:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319144.919255:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319145.943907:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319146.967095:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319147.479529:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319147.479540:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319147.479544:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319147.479548:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319147.479553:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319147.479562:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4044
00000100:00080000:1.0:1767319147.479568:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319147.479575:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319147.479621:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7ad80 x1853164379684608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319147.479650:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319147.479653:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319147.479655:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319147.479659:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4044
00000100:00080000:1.0:1767319147.479661:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319147.479664:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319147.479678:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78a80 x1853164379684736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319147.479727:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319147.479731:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319147.479733:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319147.479736:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4044
00000100:00080000:1.0:1767319147.479738:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319147.479741:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319147.479751:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164379685248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319147.479766:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319147.479769:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319147.479771:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319147.479774:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4044
00000100:00080000:1.0:1767319147.479776:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319147.479779:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319147.479787:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164379685504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319147.479816:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379685120:0@lo:400:kworker.0
00000100:00100000:1.0:1767319147.479909:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319147.479969:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319147.479975:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379684992:0@lo:400:kworker.0
00000100:00100000:1.0:1767319147.480001:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319147.480039:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684992
00000100:00100000:1.0:1767319147.480046:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684992
00000100:00100000:2.0:1767319147.480088:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379684608:0@lo:38:kworker.0
00000100:00100000:1.0:1767319147.480108:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414
00000100:00100000:1.0:1767319147.480132:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379684992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319147.480170:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319147.480216:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379684992:12345-0@lo:400:kworker.0 Request processed in 96us (211us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319147.480219:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379684736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319147.480243:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414
00000100:00100000:1.0:1767319147.480298:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379684992:0@lo:400:kworker.0
00000100:00100000:2.0:1767319147.481423:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319147.481479:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379685248:0@lo:38:kworker.0
00000100:00100000:2.0:1767319147.481512:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319147.481543:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379685504:0@lo:38:kworker.0
00000100:00100000:2.0:1767319147.481570:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319147.481644:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379685120
00000100:00100000:3.0:1767319147.481645:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379685376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319147.481655:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379685120
00000100:00100000:3.0:1767319147.481709:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319147.481818:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379684864:0@lo:400:kworker.0
00000100:00100000:1.0:1767319147.481913:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684736
00000100:00100000:1.0:1767319147.481920:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684736
00000100:00100000:1.0:1767319147.481953:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944
00000100:00100000:1.0:1767319147.481958:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379684736:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319147.481979:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319147.482086:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684608
00000100:00100000:2.0:1767319147.482094:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684608
00000100:00100000:2.0:1767319147.482110:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379685248
00000100:00100000:2.0:1767319147.482113:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379685248
00000100:00100000:2.0:1767319147.482120:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379685504
00000100:00100000:2.0:1767319147.482123:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379685504
00000100:00100000:2.0:1767319147.482130:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379685376
00000100:00100000:2.0:1767319147.482133:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379685376
00000100:00100000:2.0:1767319147.482156:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069
00000100:00100000:2.0:1767319147.482165:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379685120:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319147.484529:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319147.484608:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319147.484615:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319147.484637:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070
00000100:00100000:0.0:1767319147.484651:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379685376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319147.484707:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379685376:12345-0@lo:400:kworker.0 Request processed in 62us (3001us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319147.484714:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070
00000100:00100000:0.0:1767319147.484737:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16728
00000100:00100000:0.0:1767319147.484741:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379684608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319147.484760:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319147.484797:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379684608:12345-0@lo:38:kworker.0 Request processed in 54us (4629us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319147.484802:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16728
00000100:00100000:0.0:1767319147.484814:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16729
00000100:00100000:0.0:1767319147.484818:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379685248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319147.484827:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319147.484849:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379685248:12345-0@lo:38:kworker.0 Request processed in 30us (3337us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319147.484854:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16729
00000100:00100000:0.0:1767319147.484864:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16730
00000100:00100000:0.0:1767319147.484884:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379685504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319147.484894:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319147.484919:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379685504:12345-0@lo:38:kworker.0 Request processed in 34us (3348us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319147.484924:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16730
00000100:00100000:0.0:1767319147.484976:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379684864
00000100:00100000:0.0:1767319147.484983:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379684864
00000100:00100000:0.0:1767319147.485023:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415
00000100:00100000:0.0:1767319147.485029:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379684864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319147.485060:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379684864:12345-0@lo:400:kworker.0 Request processed in 31us (538us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319147.485066:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415
00000100:00080000:0.0:1767319147.485080:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319147.485093:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379685632:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319147.485493:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319147.485542:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379684864:0@lo:400:kworker.0
00000100:00100000:0.0:1767319147.485593:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379685632
00000100:00100000:0.0:1767319147.485597:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379685632
00000100:00100000:0.0:1767319147.485624:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172
00000100:00100000:0.0:1767319147.485631:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379685632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319147.485652:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319147.485686:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379685632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (193us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319147.485693:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172
00000100:00100000:0.0:1767319147.485725:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379685632:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319147.485799:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319147.485804:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319147.485808:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379684608:0@lo:38:kworker.0
00000100:00080000:0.0:1767319147.485818:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319147.485821:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319147.485824:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379685248:0@lo:38:kworker.0
00000100:00080000:0.0:1767319147.485834:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319147.485837:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319147.485840:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379685504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319147.485998:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379685376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319147.486381:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379684736:12345-0@lo:38:kworker.0 Request processed in 4420us (4960us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319147.486390:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944
00000100:00080000:0.0:1767319147.486443:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319147.486447:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319147.486450:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379684736:0@lo:38:kworker.0
00000100:00100000:2.0:1767319147.489795:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379685120:12345-0@lo:400:kworker.0 Request processed in 7613us (9868us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319147.489816:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069
00000100:00100000:1.0:1767319147.489929:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379685120:0@lo:400:kworker.0
00010000:00010000:1.0:1767319147.991848:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319148.442375:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319148.442452:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319148.444433:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291901056
00000100:00100000:3.0:1767319148.444449:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291901056
00000100:00100000:3.0:1767319148.446097:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291900928
00000100:00100000:3.0:1767319148.446110:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291900928
00000100:00100000:3.0:1767319148.446160:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4071
00000100:00100000:3.0:1767319148.446175:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291901056:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319148.446275:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291901056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (3916us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319148.446282:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4071
00000100:00100000:3.0:1767319148.446302:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16731
00000100:00100000:3.0:1767319148.446307:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291900928:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319148.446328:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319148.446356:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291900928:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (3902us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319148.446362:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16731
00000100:00080000:1.0:1767319148.447359:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319149.015264:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319149.016292:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319149.016318:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379685760:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319149.016391:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319149.016536:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379685760
00000100:00100000:0.0:1767319149.016545:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379685760
00000100:00100000:0.0:1767319149.016618:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173
00000100:00100000:0.0:1767319149.016629:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379685760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319149.016660:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319149.016706:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379685760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (314us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319149.016713:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173
00000100:00080000:1.0:1767319149.018014:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319149.018079:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379685760:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319150.039552:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319151.063271:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319152.087189:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319152.599798:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319152.599808:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319152.599811:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319152.599815:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319152.599820:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319152.599828:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4049
00000100:00080000:1.0:1767319152.599833:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319152.599839:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319152.599897:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164379685888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319152.599914:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319152.599917:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319152.599918:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319152.599922:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4049
00000100:00080000:1.0:1767319152.599924:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319152.599927:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319152.599940:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164379686016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319152.600001:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319152.600013:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379686144:0@lo:400:kworker.0
00000100:00080000:1.0:1767319152.600097:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319152.600099:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319152.600105:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319152.600107:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319152.600112:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4049
00000100:00080000:1.0:1767319152.600115:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319152.600120:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319152.600133:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7a680 x1853164379686528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319152.600154:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319152.600158:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319152.600160:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319152.600165:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4049
00000100:00100000:2.0:1767319152.600165:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379686656:0@lo:400:kworker.0
00000100:00080000:1.0:1767319152.600171:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319152.600176:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319152.600195:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319152.600226:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b95f80 x1853164379686784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319152.600954:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379686400:0@lo:400:kworker.0
00000100:00100000:0.0:1767319152.600998:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319152.601019:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319152.601033:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379686272:0@lo:400:kworker.0
00000100:00100000:0.0:1767319152.601053:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319152.601279:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686656
00000100:00100000:1.0:1767319152.601286:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686656
00000100:00100000:1.0:1767319152.601339:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686400
00000100:00100000:1.0:1767319152.601343:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686400
00000100:00100000:1.0:1767319152.601364:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072
00000100:00100000:1.0:1767319152.601372:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379686656:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319152.601524:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379686656:12345-0@lo:400:kworker.0 Request processed in 151us (1327us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319152.601532:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072
00000100:00100000:1.0:1767319152.601552:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073
00000100:00100000:1.0:1767319152.601558:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379686400:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319152.601592:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686144
00000100:00100000:0.0:1767319152.601598:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686144
00000100:00100000:0.0:1767319152.601628:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686272
00000100:00100000:0.0:1767319152.601631:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686272
00000100:00100000:1.0:1767319152.601659:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379686400:12345-0@lo:400:kworker.0 Request processed in 99us (658us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319152.601666:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073
00000100:00100000:0.0:1767319152.601674:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416
00000100:00100000:0.0:1767319152.601684:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379686144:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319152.601689:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319152.601695:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319152.601699:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319152.601723:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379686144:12345-0@lo:400:kworker.0 Request processed in 41us (1625us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319152.601733:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416
00000100:00100000:1.0:1767319152.601794:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417
00000100:00100000:1.0:1767319152.601807:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379686272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319152.601894:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379686912:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319152.601972:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379686656:0@lo:400:kworker.0
00000100:00100000:1.0:1767319152.605951:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379686272:12345-0@lo:400:kworker.0 Request processed in 4136us (4883us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319152.605967:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319152.605975:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417
00000100:00100000:1.0:1767319152.606064:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379685888:0@lo:38:kworker.0
00000100:00100000:1.0:1767319152.606101:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319152.606125:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379686016:0@lo:38:kworker.0
00000100:00100000:1.0:1767319152.606149:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319152.606171:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379686528:0@lo:38:kworker.0
00000100:00100000:1.0:1767319152.606190:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319152.606204:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379686784:0@lo:38:kworker.0
00000100:00100000:1.0:1767319152.606239:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319152.606304:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686912
00000100:00100000:3.0:1767319152.606312:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686912
00000100:00100000:3.0:1767319152.606376:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174
00000100:00100000:3.0:1767319152.606385:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379686912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319152.606425:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319152.606471:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379686912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (508us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319152.606478:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174
00000100:00100000:3.0:1767319152.606499:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379685888
00000100:00100000:3.0:1767319152.606502:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379685888
00000100:00100000:3.0:1767319152.606522:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686528
00000100:00100000:3.0:1767319152.606524:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686528
00000100:00100000:3.0:1767319152.606537:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686784
00000100:00100000:3.0:1767319152.606540:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686784
00000100:00100000:3.0:1767319152.606555:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16732
00000100:00100000:3.0:1767319152.606559:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379685888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319152.606577:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319152.606609:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379685888:12345-0@lo:38:kworker.0 Request processed in 48us (507us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319152.606615:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16732
00000100:00100000:3.0:1767319152.606625:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16733
00000100:00100000:3.0:1767319152.606629:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379686528:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319152.606637:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319152.606972:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379686528:12345-0@lo:38:kworker.0 Request processed in 340us (780us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319152.606978:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16733
00000100:00100000:3.0:1767319152.606990:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16734
00000100:00100000:3.0:1767319152.606994:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379686784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319152.607004:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319152.607036:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379686784:12345-0@lo:38:kworker.0 Request processed in 40us (797us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319152.607042:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16734
00000100:00100000:3.0:1767319152.607094:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379686912:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319152.607298:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379686016
00000100:00100000:3.0:1767319152.607303:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379686016
00000100:00100000:3.0:1767319152.607328:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945
00000100:00100000:3.0:1767319152.607333:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379686016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319152.607342:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319152.607385:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379686016:12345-0@lo:38:kworker.0 Request processed in 50us (1234us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319152.607390:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945
00000100:00100000:2.0:1767319152.607765:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379686144:0@lo:400:kworker.0
00000100:00100000:0.0:1767319152.608256:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379686400:0@lo:400:kworker.0
00000100:00080000:1.0:1767319152.608269:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319152.608276:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319152.608281:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379685888:0@lo:38:kworker.0
00000100:00080000:1.0:1767319152.608294:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319152.608297:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319152.608300:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379686016:0@lo:38:kworker.0
00000100:00080000:1.0:1767319152.608309:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319152.608312:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319152.608315:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379686528:0@lo:38:kworker.0
00000100:00080000:1.0:1767319152.608324:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319152.608327:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319152.608330:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379686784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319152.608517:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379686272:0@lo:400:kworker.0
00010000:00010000:1.0:1767319153.111573:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319153.551415:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319153.551628:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291901312
00000100:00100000:3.0:1767319153.551647:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291901312
00000100:00100000:2.0:1767319153.551983:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319153.552550:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291901184
00000100:00100000:0.0:1767319153.552562:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291901184
00000100:00100000:0.0:1767319153.552668:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16735
00000100:00100000:0.0:1767319153.552679:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291901184:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319153.552716:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319153.552918:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291901184:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 237us (935us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319153.552926:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16735
00000100:00100000:0.0:1767319153.552947:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4074
00000100:00100000:0.0:1767319153.552958:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291901312:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319153.552998:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291901312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 44us (1909us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319153.553005:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4074
00000100:00080000:1.0:1767319153.556458:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319154.135118:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319154.135387:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379687040:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319154.135480:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319154.135536:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687040
00000100:00100000:3.0:1767319154.135547:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687040
00000100:00080000:1.0:1767319154.135622:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319154.135642:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175
00000100:00100000:3.0:1767319154.135655:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379687040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319154.135695:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319154.135769:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379687040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (289us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319154.135778:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175
00000100:00100000:0.0:1767319154.135983:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379687040:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319155.159355:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319156.183197:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319157.207551:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319157.719085:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319157.719105:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319157.719110:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319157.719115:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319157.719122:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319157.719135:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4055
00000100:00080000:1.0:1767319157.719141:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319157.719150:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319157.719250:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b97480 x1853164379687168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319157.719285:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319157.719289:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319157.719291:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319157.719296:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4055
00000100:00080000:1.0:1767319157.719299:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319157.719303:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319157.719331:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b97b80 x1853164379687296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319157.719410:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319157.719415:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319157.719416:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319157.719420:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4055
00000100:00080000:1.0:1767319157.719424:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319157.719428:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319157.719440:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b94e00 x1853164379687808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319157.719462:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319157.719465:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319157.719467:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319157.719471:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4055
00000100:00080000:1.0:1767319157.719474:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319157.719478:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319157.719490:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b95500 x1853164379688064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319157.719530:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379687936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319157.719634:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319157.719721:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319157.719728:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379687424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319157.719762:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319157.719806:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379687552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319157.719833:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319157.719857:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319157.719863:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379687680:0@lo:400:kworker.0
00000100:00100000:1.0:1767319157.719913:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319157.719947:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687424
00000100:00100000:1.0:1767319157.719956:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687424
00000100:00100000:1.0:1767319157.720027:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687552
00000100:00100000:1.0:1767319157.720032:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687552
00000100:00100000:1.0:1767319157.720066:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418
00000100:00100000:1.0:1767319157.720078:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379687424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319157.720147:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379687424:12345-0@lo:400:kworker.0 Request processed in 71us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319157.720154:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418
00000100:00100000:1.0:1767319157.720189:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419
00000100:00100000:1.0:1767319157.720195:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379687552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319157.720225:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379687552:12345-0@lo:400:kworker.0 Request processed in 30us (390us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319157.720231:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419
00000100:00080000:1.0:1767319157.720254:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319157.720260:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319157.720305:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379687552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319157.720333:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379687424:0@lo:400:kworker.0
00000100:00100000:2.0:1767319157.724027:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379687168:0@lo:38:kworker.0
00000100:00100000:2.0:1767319157.724150:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319157.724243:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379687296:0@lo:38:kworker.0
00000100:00100000:2.0:1767319157.724279:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319157.724314:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379687808:0@lo:38:kworker.0
00000100:00100000:2.0:1767319157.724341:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319157.724357:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379688064:0@lo:38:kworker.0
00000100:00100000:2.0:1767319157.724381:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319157.724606:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687936
00000100:00100000:3.0:1767319157.724618:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687936
00000100:00100000:2.0:1767319157.724654:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319157.724665:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379688192:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319157.724694:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687680
00000100:00100000:3.0:1767319157.724699:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687680
00000100:00100000:2.0:1767319157.724700:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319157.724720:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687168
00000100:00100000:3.0:1767319157.724723:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687168
00000100:00100000:3.0:1767319157.724734:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687808
00000100:00100000:3.0:1767319157.724737:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687808
00000100:00100000:3.0:1767319157.724745:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688064
00000100:00100000:3.0:1767319157.724747:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688064
00000100:00100000:3.0:1767319157.724760:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075
00000100:00100000:3.0:1767319157.724902:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379687936:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319157.724993:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379687936:12345-0@lo:400:kworker.0 Request processed in 225us (5358us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319157.725050:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076
00000100:00100000:2.0:1767319157.725060:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379687680:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319157.725108:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379687680:12345-0@lo:400:kworker.0 Request processed in 50us (5194us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319157.725115:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076
00000100:00100000:2.0:1767319157.725139:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16736
00000100:00100000:2.0:1767319157.725144:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379687168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319157.725177:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319157.725211:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379687168:12345-0@lo:38:kworker.0 Request processed in 65us (1062us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319157.725218:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16736
00000100:00100000:2.0:1767319157.725229:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16737
00000100:00100000:2.0:1767319157.725233:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379687808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319157.725242:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319157.725262:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379687808:12345-0@lo:38:kworker.0 Request processed in 28us (921us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319157.725267:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16737
00000100:00100000:2.0:1767319157.725277:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16738
00000100:00100000:2.0:1767319157.725280:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379688064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319157.725288:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319157.725306:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379688064:12345-0@lo:38:kworker.0 Request processed in 25us (924us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319157.725311:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16738
00000100:00100000:2.0:1767319157.725335:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379687296
00000100:00100000:2.0:1767319157.725339:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379687296
00000100:00100000:2.0:1767319157.725363:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946
00000100:00100000:2.0:1767319157.725368:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379687296:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319157.725377:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319157.725401:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379687296:12345-0@lo:38:kworker.0 Request processed in 31us (1121us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319157.725406:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946
00000100:00100000:2.0:1767319157.725456:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379687680:0@lo:400:kworker.0
00000100:00080000:2.0:1767319157.725494:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319157.725499:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319157.725503:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379687168:0@lo:38:kworker.0
00000100:00080000:2.0:1767319157.725510:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319157.725514:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319157.725516:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379687296:0@lo:38:kworker.0
00000100:00080000:2.0:1767319157.725524:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319157.725526:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319157.725528:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379687808:0@lo:38:kworker.0
00000100:00080000:2.0:1767319157.725535:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319157.725538:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319157.725541:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379688064:0@lo:38:kworker.0
00000100:00100000:2.0:1767319157.725582:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688192
00000100:00100000:2.0:1767319157.725586:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688192
00000100:00100000:2.0:1767319157.730133:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176
00000100:00100000:2.0:1767319157.730184:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379688192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319157.730238:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319157.730357:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379688192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 207us (5654us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319157.730366:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176
00000100:00080000:2.0:1767319157.730421:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319157.730514:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379688192:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319157.730540:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379687936:0@lo:400:kworker.0
00000100:00100000:3.0:1767319157.742004:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075
00010000:00010000:3.0:1767319158.231099:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319158.671591:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319158.672123:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291901568
00000100:00100000:0.0:1767319158.672134:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291901568
00000100:00100000:0.0:1767319158.672220:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4077
00000100:00100000:0.0:1767319158.672232:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291901568:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767319158.672272:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319158.672331:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291901568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (752us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319158.672340:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4077
00000100:00100000:3.0:1767319158.673112:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319158.678124:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291901440
00000100:00100000:1.0:1767319158.678150:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291901440
00000100:00100000:1.0:1767319158.678273:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16739
00000100:00100000:1.0:1767319158.678284:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291901440:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319158.678320:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319158.678430:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291901440:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 145us (5324us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319158.678439:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16739
00000100:00100000:0.0:1767319159.257815:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319159.257851:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379688320:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319159.257959:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319159.259735:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688320
00000100:00100000:1.0:1767319159.259749:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688320
00000100:00100000:1.0:1767319159.259824:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177
00000100:00100000:1.0:1767319159.259833:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379688320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319159.259861:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319159.259969:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379688320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (2010us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319159.259977:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177
00000100:00080000:2.0:1767319159.260116:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319159.260262:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379688320:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319159.261271:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319160.279594:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319161.303099:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319162.327116:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767319162.769425:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291901696 offset 0 length 520: 4
00000100:00100000:2.0:1767319162.769470:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319162.769563:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319162.770732:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291901824
00000100:00100000:0.0:1767319162.770745:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291901824
00000100:00100000:0.0:1767319162.771074:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291901952
00000100:00100000:0.0:1767319162.771079:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291901952
00000100:00100000:2.0:1767319162.771163:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16740
00000100:00100000:2.0:1767319162.771172:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291901824:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319162.771195:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319162.771241:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319162.771259:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291901824:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 86us (1788us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319162.774763:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4078
00000100:00100000:0.0:1767319162.774959:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291901952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319162.775268:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16740
00000100:00100000:0.0:1767319162.775531:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291901952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 756us (5967us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319162.775538:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4078
00000100:00080000:2.0:1767319162.839791:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319162.839801:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319162.839804:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319162.839808:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319162.839812:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319162.839820:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4060
00000100:00080000:2.0:1767319162.839825:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319162.839831:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319162.839900:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7b480 x1853164379688448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319162.839916:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319162.839919:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319162.839921:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319162.839924:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4060
00000100:00080000:2.0:1767319162.839926:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319162.839930:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319162.839943:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18a80 x1853164379688576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319162.840023:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319162.840027:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319162.840029:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319162.840033:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4060
00000100:00080000:2.0:1767319162.840035:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319162.840038:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319162.840049:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1c00 x1853164379689088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319162.840062:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319162.840065:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319162.840067:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319162.840070:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4060
00000100:00080000:2.0:1767319162.840072:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319162.840075:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319162.840083:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e3800 x1853164379689344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319162.840109:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379688832:0@lo:400:kworker.0
00000100:00100000:2.0:1767319162.840183:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319162.840198:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379688704:0@lo:400:kworker.0
00000100:00100000:1.0:1767319162.840236:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319162.840253:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319162.840262:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379688960:0@lo:400:kworker.0
00000100:00100000:1.0:1767319162.840264:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319162.840273:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379689216:0@lo:400:kworker.0
00000100:00100000:2.0:1767319162.840293:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319162.840316:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688832
00000100:00100000:1.0:1767319162.840324:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688832
00000100:00100000:2.0:1767319162.840370:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688704
00000100:00100000:2.0:1767319162.840375:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688704
00000100:00100000:1.0:1767319162.840387:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420
00000100:00100000:1.0:1767319162.840399:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379688832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319162.840410:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421
00000100:00100000:2.0:1767319162.840419:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379688704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319162.840457:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379688832:12345-0@lo:400:kworker.0 Request processed in 60us (273us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319162.840464:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379688704:12345-0@lo:400:kworker.0 Request processed in 45us (226us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319162.840469:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420
00000100:00100000:2.0:1767319162.840477:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421
00000100:00080000:1.0:1767319162.840512:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319162.840516:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319162.840531:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319162.840547:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379688832:0@lo:400:kworker.0
00000100:00100000:1.0:1767319162.840565:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379688704:0@lo:400:kworker.0
00000100:00100000:2.0:1767319162.840584:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688960
00000100:00100000:2.0:1767319162.840588:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688960
00000100:00080000:1.0:1767319162.840613:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319162.840635:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379689216
00000100:00100000:2.0:1767319162.840641:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379689216
00000100:00100000:1.0:1767319162.840651:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079
00000100:00100000:1.0:1767319162.840672:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379688960:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319162.840673:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080
00000100:00100000:2.0:1767319162.840686:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379689216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319162.840722:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379689216:12345-0@lo:400:kworker.0 Request processed in 40us (192us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319162.840728:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080
00000100:00080000:0.0:1767319162.841090:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319162.841106:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379689472:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319162.841145:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319162.841181:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379689216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319162.841203:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379689472
00000100:00100000:0.0:1767319162.841206:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379689472
00000100:00100000:0.0:1767319162.841234:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178
00000100:00100000:0.0:1767319162.841241:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379689472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319162.841266:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319162.841290:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379688960:12345-0@lo:400:kworker.0 Request processed in 630us (996us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319162.841319:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079
00000100:00100000:0.0:1767319162.841320:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379689472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (172us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319162.841330:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178
00000100:00100000:1.0:1767319162.841360:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379688960:0@lo:400:kworker.0
00000100:00100000:0.0:1767319162.841376:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379689472:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319162.841507:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379688448:0@lo:38:kworker.0
00000100:00100000:3.0:1767319162.841540:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319162.841570:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379688576:0@lo:38:kworker.0
00000100:00100000:3.0:1767319162.841592:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319162.841631:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379689088:0@lo:38:kworker.0
00000100:00100000:3.0:1767319162.841650:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319162.841667:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379689344:0@lo:38:kworker.0
00000100:00100000:3.0:1767319162.841685:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319162.841712:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688448
00000100:00100000:3.0:1767319162.841716:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688448
00000100:00100000:3.0:1767319162.841735:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379689088
00000100:00100000:3.0:1767319162.841738:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379689088
00000100:00100000:3.0:1767319162.841750:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379689344
00000100:00100000:3.0:1767319162.841752:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379689344
00000100:00100000:3.0:1767319162.841766:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16741
00000100:00100000:3.0:1767319162.841770:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379688448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319162.841787:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319162.841821:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379688448:12345-0@lo:38:kworker.0 Request processed in 50us (281us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319162.841827:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16741
00000100:00100000:3.0:1767319162.841839:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16742
00000100:00100000:3.0:1767319162.841842:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379689088:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319162.841851:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319162.841898:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16743
00000100:00100000:1.0:1767319162.841904:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379689344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319162.841917:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319162.841917:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379689088:12345-0@lo:38:kworker.0 Request processed in 71us (264us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319162.841926:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16742
00000100:00100000:1.0:1767319162.841952:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379689344:12345-0@lo:38:kworker.0 Request processed in 45us (265us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319162.841959:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16743
00000100:00080000:3.0:1767319162.841963:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319162.841970:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319162.841974:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379688448:0@lo:38:kworker.0
00000100:00080000:3.0:1767319162.841985:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319162.841989:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319162.841993:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379689088:0@lo:38:kworker.0
00000100:00080000:3.0:1767319162.842004:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319162.842007:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319162.842010:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379689344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319162.842210:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379688576
00000100:00100000:0.0:1767319162.842215:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379688576
00000100:00100000:0.0:1767319162.842248:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947
00000100:00100000:0.0:1767319162.842252:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379688576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319162.842262:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319162.842303:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379688576:12345-0@lo:38:kworker.0 Request processed in 48us (709us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319162.842316:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947
00000100:00080000:1.0:1767319162.842924:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319162.842930:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319162.842935:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379688576:0@lo:38:kworker.0
00010000:00010000:3.0:1767319163.351422:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319164.375537:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319164.375764:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379689600:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319164.375832:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319164.375969:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379689600
00000100:00100000:1.0:1767319164.375978:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379689600
00000100:00100000:1.0:1767319164.376047:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179
00000100:00100000:1.0:1767319164.376056:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379689600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319164.376096:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319164.376192:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379689600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (360us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319164.376199:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179
00000100:00080000:2.0:1767319164.376436:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319164.377074:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379689600:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319165.402973:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319166.423269:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319167.447377:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319167.887758:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319167.887812:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319167.888820:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902208
00000100:00100000:0.0:1767319167.888835:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902208
00000100:00100000:0.0:1767319167.888998:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902080
00000100:00100000:0.0:1767319167.889002:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902080
00000100:00100000:2.0:1767319167.889039:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4081
00000100:00100000:2.0:1767319167.889084:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291902208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767319167.889098:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319167.889171:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16744
00000100:00100000:0.0:1767319167.889181:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291902080:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:2.0:1767319167.889201:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291902208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 144us (1454us total) trans 0 rc 0/0
00010000:00020000:0.0:1767319167.889210:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319167.889218:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4081
00000100:00100000:0.0:1767319167.889286:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291902080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 104us (1470us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319167.889312:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16744
00000100:00100000:3.0:1767319167.959027:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319142/real 1767319142]  req@ffff8b0e0c85c000 x1853164379683456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319167 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319167.959084:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c85c000 x1853164379683456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319167.959109:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319167.959195:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319167.959222:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379689728:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319167.959305:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319167.959310:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379683456:0@lo:250:kworker.0
00000100:00100000:1.0:1767319167.959328:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319167.959611:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379689728
00000100:00100000:2.0:1767319167.959623:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379689728
00000100:00100000:2.0:1767319167.959704:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180
00000100:00100000:2.0:1767319167.959715:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379689728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319167.959754:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319167.959813:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379689728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (487us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319167.959822:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180
00000100:00100000:2.0:1767319167.959900:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379689728:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319167.960064:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319167.960078:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319167.960082:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319167.960088:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4044
00000100:00080000:0.0:1767319167.960092:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319167.960098:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319167.960136:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93480 x1853164379689856/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319167.960164:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319167.960167:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319167.960169:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319167.960173:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4065
00000100:00080000:0.0:1767319167.960175:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319167.960179:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319167.960192:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93b80 x1853164379689984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319167.960201:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319167.960204:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319167.960206:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319167.960209:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4065
00000100:00080000:0.0:1767319167.960211:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319167.960214:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319167.960227:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92680 x1853164379690112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319167.960266:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319167.960269:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319167.960271:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319167.960275:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4065
00000100:00080000:0.0:1767319167.960277:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319167.960280:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319167.960290:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90e00 x1853164379690496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319167.960313:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319167.960407:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319167.960409:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319167.960413:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4065
00000100:00080000:0.0:1767319167.960415:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319167.960420:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319167.960438:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91500 x1853164379690752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319167.960468:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379690368:0@lo:400:kworker.0
00000100:00100000:0.0:1767319167.960527:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319167.960563:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319167.960569:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379690240:0@lo:400:kworker.0
00000100:00100000:0.0:1767319167.960934:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319167.961040:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379690240
00000100:00100000:1.0:1767319167.961050:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379690240
00000100:00100000:1.0:1767319167.961124:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422
00000100:00100000:1.0:1767319167.961133:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379690240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319167.961200:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379690240:12345-0@lo:400:kworker.0 Request processed in 67us (265us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319167.961208:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422
00000100:00100000:1.0:1767319167.961246:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379689856:0@lo:250:kworker.0
00000400:00000100:1.0:1767319167.961276:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379689856 offset 0 length 520: 4
00000100:00100000:2.0:1767319167.961381:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319167.961394:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379690624:0@lo:400:kworker.0
00000100:00100000:2.0:1767319167.961430:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319167.962588:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319167.962598:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319167.962626:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379690368
00000100:00100000:3.0:1767319167.962636:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379690368
00000100:00100000:3.0:1767319167.962707:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379690624
00000100:00100000:3.0:1767319167.962711:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379690624
00000100:00100000:3.0:1767319167.962744:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082
00000100:00100000:3.0:1767319167.962753:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379690368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319167.962841:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379690368:12345-0@lo:400:kworker.0 Request processed in 89us (2313us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319167.962848:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082
00000100:00100000:3.0:1767319167.962865:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083
00000100:00100000:3.0:1767319167.962899:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379690624:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319167.962930:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379690624:12345-0@lo:400:kworker.0 Request processed in 33us (1500us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319167.962937:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083
00000100:00080000:3.0:1767319167.962952:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319167.967384:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379690240:0@lo:400:kworker.0
00000100:00100000:0.0:1767319167.967406:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379690368:0@lo:400:kworker.0
00000100:00100000:1.0:1767319167.969203:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379689984:0@lo:38:kworker.0
00000100:00100000:1.0:1767319167.969320:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319167.969380:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379690112:0@lo:38:kworker.0
00000100:00100000:1.0:1767319167.969407:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319167.969439:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379690496:0@lo:38:kworker.0
00000100:00100000:1.0:1767319167.969460:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319167.969483:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379690752:0@lo:38:kworker.0
00000100:00100000:1.0:1767319167.969505:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319167.969563:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379689984
00000100:00100000:1.0:1767319167.969572:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379689984
00000100:00100000:1.0:1767319167.969611:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379690496
00000100:00100000:1.0:1767319167.969614:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379690496
00000100:00100000:1.0:1767319167.969627:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379690752
00000100:00100000:1.0:1767319167.969630:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379690752
00000100:00100000:1.0:1767319167.969649:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16745
00000100:00100000:1.0:1767319167.969657:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379689984:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319167.969684:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319167.969731:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379689984:12345-0@lo:38:kworker.0 Request processed in 72us (421us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319167.969740:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16745
00000100:00100000:1.0:1767319167.969764:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16746
00000100:00100000:1.0:1767319167.969768:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379690496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319167.969778:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319167.969799:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379690496:12345-0@lo:38:kworker.0 Request processed in 29us (338us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319167.969805:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16746
00000100:00100000:1.0:1767319167.969815:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16747
00000100:00100000:1.0:1767319167.969819:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379690752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319167.969828:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319167.969848:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379690752:12345-0@lo:38:kworker.0 Request processed in 27us (342us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319167.969854:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16747
00000100:00100000:0.0:1767319167.969943:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379690112
00000100:00080000:1.0:1767319167.969952:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767319167.969958:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379690112
00000100:00080000:1.0:1767319167.969961:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319167.969967:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379689984:0@lo:38:kworker.0
00000100:00080000:1.0:1767319167.969977:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319167.969980:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319167.969986:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379690496:0@lo:38:kworker.0
00000100:00080000:1.0:1767319167.969995:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319167.970000:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319167.970004:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379690752:0@lo:38:kworker.0
00000100:00100000:0.0:1767319167.970019:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948
00000100:00100000:0.0:1767319167.970030:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379690112:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319167.970059:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319167.970159:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379690112:12345-0@lo:38:kworker.0 Request processed in 130us (749us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319167.970166:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948
00000100:00080000:1.0:1767319167.970340:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319167.970348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319167.970351:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379690112:0@lo:38:kworker.0
00000100:00100000:2.0:1767319167.975486:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379690624:0@lo:400:kworker.0
00010000:00010000:2.0:1767319168.471257:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319169.495298:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319169.495515:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379690880:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319169.495612:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319169.495800:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379690880
00000100:00100000:1.0:1767319169.495815:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379690880
00000100:00100000:1.0:1767319169.495928:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181
00000100:00100000:1.0:1767319169.495940:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379690880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319169.495979:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319169.496047:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379690880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (435us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319169.496067:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181
00000100:00080000:3.0:1767319169.496119:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319169.496290:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379690880:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319170.520069:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319171.545700:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319172.567239:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319173.009731:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319173.011573:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319173.026102:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902464
00000100:00100000:3.0:1767319173.026126:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902464
00000100:00080000:0.0:1767319173.026367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319173.028622:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902336
00000100:00100000:3.0:1767319173.028643:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902336
00000100:00100000:3.0:1767319173.028703:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4084
00000100:00100000:3.0:1767319173.028722:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291902464:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319173.028849:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291902464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 137us (19134us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319173.028858:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4084
00000100:00100000:3.0:1767319173.028900:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16748
00000100:00100000:3.0:1767319173.028904:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291902336:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319173.028931:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319173.028961:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291902336:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (17399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319173.028968:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16748
00000100:00100000:3.0:1767319173.079413:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319173.079448:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379691008:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319173.079551:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319173.079642:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691008
00000100:00100000:1.0:1767319173.079653:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691008
00000100:00100000:1.0:1767319173.079744:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182
00000100:00100000:1.0:1767319173.079755:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379691008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319173.079793:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319173.079847:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379691008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (296us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319173.079856:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182
00000100:00080000:0.0:1767319173.079948:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319173.080056:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379691008:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319173.080104:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.080112:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319173.080115:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.080120:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319173.080125:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.080132:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4070
00000100:00080000:2.0:1767319173.080137:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319173.080142:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319173.080175:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1180 x1853164379691136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319173.080241:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379691136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319173.080288:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319173.080361:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691136
00000100:00100000:1.0:1767319173.080367:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691136
00000100:00100000:1.0:1767319173.080402:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16749
00000100:00080000:2.0:1767319173.080402:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319173.080408:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379691136:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767319173.080408:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319173.080411:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.080415:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4070
00000100:00080000:2.0:1767319173.080418:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319173.080422:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00010000:00020000:1.0:1767319173.080431:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319173.080448:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e3100 x1853164379691264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319173.082111:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379691264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319173.082200:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319173.083277:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.083284:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1767319173.083288:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379691136:12345-0@lo:38:kworker.0 Request processed in 2874us (2993us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767319173.083288:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.083294:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4070
00000100:00080000:2.0:1767319173.083299:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319173.083305:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16749
00000100:00080000:2.0:1767319173.083307:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319173.083331:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e3b80 x1853164379691648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319173.083351:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319173.083354:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319173.083356:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319173.083360:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4070
00000100:00080000:2.0:1767319173.083362:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319173.083366:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319173.083378:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e0380 x1853164379691904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319173.083415:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379691520:0@lo:400:kworker.0
00000100:00100000:2.0:1767319173.083479:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319173.083513:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319173.083519:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379691776:0@lo:400:kworker.0
00000100:00100000:2.0:1767319173.083541:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319173.083576:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691520
00000100:00100000:2.0:1767319173.083584:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691520
00000100:00100000:2.0:1767319173.083645:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691776
00000100:00100000:2.0:1767319173.083648:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691776
00000100:00100000:2.0:1767319173.083672:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085
00000100:00100000:2.0:1767319173.083679:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379691520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319173.083732:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379691520:12345-0@lo:400:kworker.0 Request processed in 53us (252us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319173.083738:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085
00000100:00100000:2.0:1767319173.083751:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086
00000100:00100000:2.0:1767319173.083756:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379691776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319173.083777:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379691776:12345-0@lo:400:kworker.0 Request processed in 21us (235us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319173.083782:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086
00000100:00080000:2.0:1767319173.083796:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319173.083830:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379691776:0@lo:400:kworker.0
00000100:00100000:2.0:1767319173.083839:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379691520:0@lo:400:kworker.0
00000100:00100000:2.0:1767319173.083861:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319173.083889:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379691392:0@lo:400:kworker.0
00000100:00100000:2.0:1767319173.083916:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319173.084131:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691392
00000100:00100000:1.0:1767319173.084137:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691392
00000100:00100000:1.0:1767319173.084192:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423
00000100:00100000:1.0:1767319173.084200:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379691392:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319173.084242:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379691392:12345-0@lo:400:kworker.0 Request processed in 43us (324us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319173.084248:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423
00000100:00100000:1.0:1767319173.084280:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379691392:0@lo:400:kworker.0
00000100:00080000:2.0:1767319173.084599:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319173.084789:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691264
00000100:00100000:3.0:1767319173.084796:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691264
00000100:00100000:3.0:1767319173.084822:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949
00000100:00100000:3.0:1767319173.084829:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379691264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319173.084852:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319173.084918:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379691264:12345-0@lo:38:kworker.0 Request processed in 87us (2716us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319173.084928:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949
00000100:00080000:0.0:1767319173.092551:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319173.092571:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319173.092578:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379691136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319173.092634:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379691648:0@lo:38:kworker.0
00000100:00100000:0.0:1767319173.092731:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319173.092787:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379691904:0@lo:38:kworker.0
00000100:00100000:0.0:1767319173.092812:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319173.092858:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319173.092862:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319173.092867:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379691264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319173.093422:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691648
00000100:00100000:2.0:1767319173.093433:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691648
00000100:00100000:2.0:1767319173.093490:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379691904
00000100:00100000:2.0:1767319173.093494:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379691904
00000100:00100000:2.0:1767319173.093526:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16750
00000100:00100000:2.0:1767319173.093536:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379691648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319173.093566:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319173.093635:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379691648:12345-0@lo:38:kworker.0 Request processed in 99us (903us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319173.093644:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16750
00000100:00100000:2.0:1767319173.093665:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16751
00000100:00100000:2.0:1767319173.093670:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379691904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319173.093679:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319173.093701:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379691904:12345-0@lo:38:kworker.0 Request processed in 30us (888us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319173.093706:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16751
00000100:00080000:0.0:1767319173.094895:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319173.094904:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319173.094910:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379691648:0@lo:38:kworker.0
00000100:00080000:0.0:1767319173.094925:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319173.094929:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319173.094933:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379691904:0@lo:38:kworker.0
00010000:00010000:2.0:1767319173.591364:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319174.618789:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379692032:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319174.618942:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319174.619035:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692032
00000100:00100000:3.0:1767319174.619047:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692032
00000100:00100000:3.0:1767319174.619312:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183
00000100:00100000:3.0:1767319174.619324:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379692032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319174.619367:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319174.619435:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379692032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (493us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319174.619442:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183
00000100:00100000:2.0:1767319174.619568:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379692032:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319174.619652:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319175.639344:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319176.666331:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319177.687359:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319178.128589:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319178.131823:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319178.136692:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902720
00000100:00100000:3.0:1767319178.136715:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902720
00000100:00100000:0.0:1767319178.137452:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902592
00000100:00100000:0.0:1767319178.137461:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902592
00000100:00100000:0.0:1767319178.137573:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16752
00000100:00100000:0.0:1767319178.137595:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291902592:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319178.137628:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319178.137729:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291902592:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 135us (5921us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319178.137738:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16752
00000100:00100000:0.0:1767319178.137768:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4087
00000100:00080000:2.0:1767319178.137777:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319178.137778:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291902720:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319178.137835:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291902720:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 60us (9262us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319178.137842:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4087
00000100:00080000:2.0:1767319178.200099:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319178.200115:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319178.200119:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319178.200124:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319178.200130:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319178.200141:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4075
00000100:00080000:2.0:1767319178.200147:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319178.200156:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319178.200214:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1500 x1853164379692160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319178.200259:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319178.200264:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319178.200266:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319178.200271:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4075
00000100:00080000:2.0:1767319178.200274:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319178.200278:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319178.200294:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e2a00 x1853164379692288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319178.200382:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319178.200385:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319178.200387:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319178.200391:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4075
00000100:00080000:2.0:1767319178.200394:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319178.200398:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319178.200409:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e3100 x1853164379692800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319178.200424:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319178.200428:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319178.200430:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319178.200433:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4075
00000100:00080000:2.0:1767319178.200435:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319178.200439:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319178.200449:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e2300 x1853164379693056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319178.200489:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379692672:0@lo:400:kworker.0
00000100:00100000:2.0:1767319178.200605:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319178.200692:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319178.200698:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379692544:0@lo:400:kworker.0
00000100:00100000:2.0:1767319178.200732:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319178.201206:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379692160:0@lo:38:kworker.0
00000100:00100000:0.0:1767319178.201248:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319178.201289:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379692288:0@lo:38:kworker.0
00000100:00100000:0.0:1767319178.201316:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319178.201349:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379692800:0@lo:38:kworker.0
00000100:00100000:0.0:1767319178.201376:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319178.201386:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379692928:0@lo:400:kworker.0
00000100:00100000:0.0:1767319178.201398:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379693056:0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.201430:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319178.201451:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692288
00000100:00100000:0.0:1767319178.201461:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692288
00000100:00100000:1.0:1767319178.201472:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319178.201479:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379692416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319178.201512:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950
00000100:00100000:1.0:1767319178.201512:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319178.201526:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379692288:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.201548:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692544
00000100:00100000:1.0:1767319178.201553:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692544
00010000:00020000:0.0:1767319178.201555:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319178.201610:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379692288:12345-0@lo:38:kworker.0 Request processed in 83us (291us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319178.201613:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692416
00000100:00100000:1.0:1767319178.201617:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692416
00000100:00100000:0.0:1767319178.201623:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950
00000100:00100000:1.0:1767319178.201648:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424
00000100:00100000:1.0:1767319178.201657:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379692544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319178.201661:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692672
00000100:00100000:0.0:1767319178.201667:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692672
00000100:00100000:0.0:1767319178.201713:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692160
00000100:00100000:0.0:1767319178.201717:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692160
00000100:00100000:1.0:1767319178.201719:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379692544:12345-0@lo:400:kworker.0 Request processed in 63us (985us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319178.201729:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424
00000100:00100000:0.0:1767319178.201738:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692800
00000100:00100000:0.0:1767319178.201742:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692800
00000100:00100000:1.0:1767319178.201753:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425
00000100:00100000:0.0:1767319178.201757:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379692928
00000100:00100000:0.0:1767319178.201762:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379692928
00000100:00100000:1.0:1767319178.201763:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379692416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319178.201786:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088
00000100:00100000:0.0:1767319178.201793:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379692672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319178.201829:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379692672:12345-0@lo:400:kworker.0 Request processed in 35us (1224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319178.201835:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088
00000100:00100000:0.0:1767319178.201848:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089
00000100:00100000:0.0:1767319178.201855:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379692928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319178.202091:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379692928:12345-0@lo:400:kworker.0 Request processed in 236us (660us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319178.202099:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089
00000100:00100000:0.0:1767319178.202118:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16753
00000100:00100000:1.0:1767319178.202124:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379692416:12345-0@lo:400:kworker.0 Request processed in 361us (612us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319178.202128:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379692160:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319178.202138:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425
00010000:00020000:0.0:1767319178.202145:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319178.202174:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379692160:12345-0@lo:38:kworker.0 Request processed in 47us (925us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319178.202180:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16753
00000100:00100000:1.0:1767319178.202197:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16754
00000100:00100000:3.0:1767319178.202379:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379693184:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319178.202417:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319178.202467:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693184
00000100:00100000:3.0:1767319178.202472:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693184
00000100:00100000:3.0:1767319178.202506:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184
00000100:00100000:3.0:1767319178.202512:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379693184:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319178.202543:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319178.202582:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379693184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (165us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319178.202589:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184
00000100:00100000:3.0:1767319178.202645:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379693184:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319178.202720:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319178.202727:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319178.202730:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319178.202743:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319178.202782:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319178.202788:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319178.202791:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379692160:0@lo:38:kworker.0
00000100:00080000:3.0:1767319178.202803:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319178.202807:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319178.202810:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379692288:0@lo:38:kworker.0
00000100:00100000:3.0:1767319178.202843:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379692544:0@lo:400:kworker.0
00000100:00100000:3.0:1767319178.202856:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379692672:0@lo:400:kworker.0
00000100:00100000:3.0:1767319178.202907:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693056
00000100:00100000:3.0:1767319178.202912:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693056
00000100:00100000:2.0:1767319178.203003:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379692416:0@lo:400:kworker.0
00000100:00100000:2.0:1767319178.203537:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379692928:0@lo:400:kworker.0
00000100:00100000:1.0:1767319178.203651:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379692800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319178.203675:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319178.203738:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379692800:12345-0@lo:38:kworker.0 Request processed in 1533us (2363us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767319178.204002:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319178.204016:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319178.204020:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379692800:0@lo:38:kworker.0
00000100:00100000:3.0:1767319178.207748:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16755
00000100:00100000:3.0:1767319178.207767:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379693056:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319178.207799:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319178.207889:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16754
00000100:00100000:3.0:1767319178.207950:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379693056:12345-0@lo:38:kworker.0 Request processed in 183us (5205us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319178.207957:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16755
00000100:00080000:2.0:1767319178.208181:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319178.208189:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319178.208194:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379693056:0@lo:38:kworker.0
00010000:00010000:3.0:1767319178.711287:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319179.735849:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319179.738382:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379693312:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319179.738492:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319179.738733:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693312
00000100:00100000:2.0:1767319179.738744:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693312
00000100:00100000:2.0:1767319179.738801:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185
00000100:00100000:2.0:1767319179.738811:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379693312:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319179.738849:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319179.738926:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379693312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (434us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319179.738934:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185
00000100:00100000:1.0:1767319179.739163:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379693312:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319180.759163:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319181.789778:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319182.807602:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319183.253609:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319183.253669:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319183.253777:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902976
00000100:00100000:3.0:1767319183.253789:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902976
00000100:00100000:3.0:1767319183.253912:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291902848
00000100:00100000:3.0:1767319183.253917:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291902848
00000100:00100000:0.0:1767319183.253921:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4090
00000100:00100000:0.0:1767319183.253947:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291902976:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319183.253954:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16756
00000100:00100000:3.0:1767319183.253960:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291902848:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319183.253984:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319183.254046:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319183.254051:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291902976:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 119us (458us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319183.254059:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4090
00000100:00100000:3.0:1767319183.255391:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291902848:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1420us (1711us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319183.255405:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16756
00000100:00100000:1.0:1767319183.319353:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319183.319379:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379693440:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319183.319476:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319183.320124:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693440
00000100:00100000:3.0:1767319183.320136:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693440
00000100:00100000:3.0:1767319183.320240:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186
00000100:00100000:3.0:1767319183.320254:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379693440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319183.320297:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319183.320368:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379693440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (892us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319183.320377:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186
00000100:00080000:0.0:1767319183.320430:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319183.320954:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.320960:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319183.320963:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.320968:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319183.320972:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.320978:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4080
00000100:00080000:0.0:1767319183.320983:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319183.320988:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319183.321023:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91880 x1853164379693568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319183.321050:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.321055:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319183.321056:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.321062:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4080
00000100:00080000:0.0:1767319183.321065:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319183.321065:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379693440:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319183.321068:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319183.321082:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91c00 x1853164379693696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319183.321155:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379693824:0@lo:400:kworker.0
00000100:00100000:1.0:1767319183.321204:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319183.321280:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693824
00000100:00100000:3.0:1767319183.321285:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693824
00000100:00100000:2.0:1767319183.321329:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379693568:0@lo:38:kworker.0
00000100:00100000:3.0:1767319183.321335:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426
00000100:00100000:3.0:1767319183.321343:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379693824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319183.321372:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319183.321398:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379693696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319183.321423:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319183.321458:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693696
00000100:00100000:2.0:1767319183.321462:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693696
00000100:00100000:2.0:1767319183.321486:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951
00000100:00100000:2.0:1767319183.321491:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379693696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319183.321511:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319183.321542:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379693696:12345-0@lo:38:kworker.0 Request processed in 50us (118us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319183.321548:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951
00000100:00080000:2.0:1767319183.321577:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319183.321581:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319183.321585:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379693696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319183.321617:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379693952:0@lo:400:kworker.0
00000100:00100000:2.0:1767319183.321641:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319183.321667:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319183.321684:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693568
00000100:00100000:2.0:1767319183.321688:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693568
00000100:00100000:2.0:1767319183.321706:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379693952
00000100:00100000:2.0:1767319183.321708:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379693952
00000100:00100000:2.0:1767319183.321737:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091
00000100:00100000:2.0:1767319183.321743:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379693952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319183.321791:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379693952:12345-0@lo:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319183.321797:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091
00000100:00100000:2.0:1767319183.321808:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16757
00000100:00100000:2.0:1767319183.321812:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379693568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319183.321821:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319183.321858:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379693568:12345-0@lo:38:kworker.0 Request processed in 44us (485us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319183.321864:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16757
00000100:00080000:2.0:1767319183.321905:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319183.321923:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379693952:0@lo:400:kworker.0
00000100:00080000:2.0:1767319183.321955:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319183.321959:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319183.321962:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379693568:0@lo:38:kworker.0
00000100:00100000:3.0:1767319183.328795:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379693824:12345-0@lo:400:kworker.0 Request processed in 7437us (7574us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319183.328816:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426
00000100:00080000:0.0:1767319183.329515:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.329524:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319183.329529:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.329549:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4080
00000100:00080000:0.0:1767319183.329555:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319183.329562:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319183.329617:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90a80 x1853164379694080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319183.329685:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319183.329692:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767319183.329692:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379694080:0@lo:38:kworker.0
00000100:00080000:0.0:1767319183.329694:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319183.329704:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4080
00000100:00080000:0.0:1767319183.329707:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319183.329712:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319183.329727:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90e00 x1853164379694336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319183.329791:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319183.329792:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319183.329825:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379694208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319183.329848:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379694336:0@lo:38:kworker.0
00000100:00100000:0.0:1767319183.329864:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319183.331092:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694080
00000100:00100000:3.0:1767319183.331117:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694080
00000100:00100000:3.0:1767319183.331168:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694208
00000100:00100000:3.0:1767319183.331172:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694208
00000100:00100000:3.0:1767319183.331226:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092
00000100:00100000:3.0:1767319183.331238:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379694208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319183.331377:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319183.331428:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694336
00000100:00100000:2.0:1767319183.331433:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694336
00000100:00100000:2.0:1767319183.331457:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16758
00000100:00100000:2.0:1767319183.331463:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379694080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319183.331488:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319183.331530:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379694080:12345-0@lo:38:kworker.0 Request processed in 66us (1740us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319183.331538:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16758
00000100:00100000:2.0:1767319183.331556:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16759
00000100:00100000:2.0:1767319183.331560:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379694336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319183.331570:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319183.331591:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379694336:12345-0@lo:38:kworker.0 Request processed in 30us (215us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319183.331596:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16759
00000100:00080000:2.0:1767319183.331618:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319183.331657:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319183.331662:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319183.331666:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379694336:0@lo:38:kworker.0
00000100:00080000:2.0:1767319183.331677:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319183.331681:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319183.331683:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379694080:0@lo:38:kworker.0
00000100:00100000:1.0:1767319183.335234:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379693824:0@lo:400:kworker.0
00000100:00100000:0.0:1767319183.338225:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379694208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319183.338236:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379694208:12345-0@lo:400:kworker.0 Request processed in 6995us (8366us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319183.338252:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092
00010000:00010000:3.0:1767319183.831669:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319184.855466:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379694464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319184.855576:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319184.855897:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694464
00000100:00100000:1.0:1767319184.855909:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694464
00000100:00100000:1.0:1767319184.855986:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187
00000100:00100000:1.0:1767319184.856005:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379694464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319184.856046:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319184.856107:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379694464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (530us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319184.856116:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187
00000100:00100000:1.0:1767319184.856181:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379694464:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319184.856409:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319185.879246:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319186.903948:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319187.927090:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319188.374370:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767319188.374452:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291903104 offset 0 length 520: 4
00000100:00100000:2.0:1767319188.374473:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319188.374762:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291903360
00000100:00100000:3.0:1767319188.374775:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291903360
00000100:00100000:3.0:1767319188.374865:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291903232
00000100:00100000:3.0:1767319188.374922:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291903232
00000100:00080000:2.0:1767319188.374935:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319188.374956:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4093
00000100:00100000:3.0:1767319188.374970:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291903360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319188.375082:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291903360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 115us (724us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319188.375983:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16760
00000100:00100000:2.0:1767319188.375992:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291903232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319188.376016:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319188.376916:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291903232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 71us (1590us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319188.376931:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16760
00000100:00100000:3.0:1767319188.387012:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4093
00000100:00080000:0.0:1767319188.439046:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319188.439062:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319188.439066:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319188.439071:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319188.439075:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319188.439086:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4085
00000100:00080000:0.0:1767319188.439092:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319188.439101:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319188.439156:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93100 x1853164379694592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319188.439192:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319188.439196:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319188.439198:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319188.439203:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4085
00000100:00080000:0.0:1767319188.439206:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319188.439210:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319188.439226:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90380 x1853164379694720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319188.439297:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379694592:0@lo:38:kworker.0
00000100:00080000:0.0:1767319188.439311:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319188.439316:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319188.439318:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319188.439324:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4085
00000100:00080000:0.0:1767319188.439327:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319188.439331:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319188.439349:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92d80 x1853164379695232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319188.439370:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319188.439374:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319188.439380:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319188.439384:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4085
00000100:00080000:0.0:1767319188.439386:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319188.439391:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319188.439408:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319188.439468:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379694720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319188.439496:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319188.439514:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379695360:0@lo:400:kworker.0
00000100:00100000:2.0:1767319188.439522:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379695232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319188.439546:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319188.439563:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319188.439570:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379695104:0@lo:400:kworker.0
00000100:00100000:2.0:1767319188.439596:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319188.439621:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694592
00000100:00100000:1.0:1767319188.439632:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694592
00000100:00100000:2.0:1767319188.439639:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694720
00000100:00100000:2.0:1767319188.439643:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694720
00000100:00100000:2.0:1767319188.439671:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952
00000100:00100000:1.0:1767319188.439673:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379695232
00000100:00100000:2.0:1767319188.439679:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379694720:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319188.439680:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379695232
00000100:00100000:1.0:1767319188.439701:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379695360
00010000:00020000:2.0:1767319188.439702:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319188.439707:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379695360
00000100:00100000:1.0:1767319188.439752:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379695104
00000100:00100000:1.0:1767319188.439756:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379695104
00000100:00100000:2.0:1767319188.439761:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379694720:12345-0@lo:38:kworker.0 Request processed in 80us (267us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319188.439770:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952
00000100:00100000:1.0:1767319188.439777:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094
00000100:00100000:1.0:1767319188.439805:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379695360:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319188.439809:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095
00000100:00100000:2.0:1767319188.439822:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379695104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319188.439959:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16761
00000100:00100000:3.0:1767319188.439965:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379694592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319188.439976:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319188.440341:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebf800 x1853164379695488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319188.440382:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379694976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319188.445767:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379694592:12345-0@lo:38:kworker.0 Request processed in 5784us (6344us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319188.445789:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16761
00000100:00100000:3.0:1767319188.445844:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16762
00000100:00100000:3.0:1767319188.445853:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379695232:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319188.445911:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319188.445965:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379695232:12345-0@lo:38:kworker.0 Request processed in 112us (6417us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319188.445972:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16762
00000100:00100000:3.0:1767319188.446427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379695488:0@lo:38:kworker.0
00000100:00100000:3.0:1767319188.446471:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319188.446585:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319188.446590:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319188.446593:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379695232:0@lo:38:kworker.0
00000100:00080000:3.0:1767319188.446602:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319188.446605:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319188.446607:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379694592:0@lo:38:kworker.0
00000100:00080000:3.0:1767319188.446617:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319188.446619:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319188.446622:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379694720:0@lo:38:kworker.0
00000100:00100000:3.0:1767319188.446731:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379695488
00000100:00100000:3.0:1767319188.446739:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379695488
00000100:00100000:3.0:1767319188.446777:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16763
00000100:00100000:3.0:1767319188.446784:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379695488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319188.446801:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319188.446829:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379695488:12345-0@lo:38:kworker.0 Request processed in 46us (358us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319188.446833:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16763
00000100:00080000:3.0:1767319188.446851:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319188.446855:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319188.446859:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379695488:0@lo:38:kworker.0
00000100:00100000:3.0:1767319188.446960:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379694848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319188.446986:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319188.447031:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319188.447060:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694976
00000100:00100000:0.0:1767319188.447065:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694976
00000100:00100000:0.0:1767319188.447114:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379694848
00000100:00100000:0.0:1767319188.447118:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379694848
00000100:00100000:0.0:1767319188.447140:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427
00000100:00100000:0.0:1767319188.447149:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379694976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319188.447199:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379694976:12345-0@lo:400:kworker.0 Request processed in 52us (214us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319188.447205:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427
00000100:00100000:0.0:1767319188.447221:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428
00000100:00100000:0.0:1767319188.447226:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379694848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319188.447254:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379694848:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319188.447260:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428
00000100:00100000:0.0:1767319188.447391:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379694976:0@lo:400:kworker.0
00000100:00080000:0.0:1767319188.447422:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319188.447427:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319188.447430:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319188.448341:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379695104:12345-0@lo:400:kworker.0 Request processed in 8516us (8738us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319188.448355:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095
00000100:00100000:0.0:1767319188.448434:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379695104:0@lo:400:kworker.0
00000100:00100000:3.0:1767319188.448467:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379695616:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319188.448561:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319188.448598:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379694848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319188.448741:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379695616
00000100:00100000:0.0:1767319188.448748:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379695616
00000100:00100000:0.0:1767319188.448802:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188
00000100:00100000:0.0:1767319188.448810:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379695616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319188.448846:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319188.448943:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379695616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (381us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319188.448951:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188
00000100:00100000:3.0:1767319188.449000:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379695616:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319188.453136:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379695360:12345-0@lo:400:kworker.0 Request processed in 13322us (13563us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319188.453153:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094
00000100:00100000:3.0:1767319188.453591:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379695360:0@lo:400:kworker.0
00010000:00010000:3.0:1767319188.952442:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319189.975939:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319189.977045:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379695744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319189.977148:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319189.978020:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379695744
00000100:00100000:2.0:1767319189.978036:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379695744
00000100:00100000:2.0:1767319189.978127:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189
00000100:00100000:2.0:1767319189.978139:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379695744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319189.978192:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319189.979826:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379695744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1678us (2666us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319189.980771:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379695744:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319189.980959:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189
00010000:00010000:3.0:1767319190.999093:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319192.023185:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319192.535794:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319167/real 1767319167]  req@ffff8b0f10b93480 x1853164379689856/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319192.535842:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f10b93480 x1853164379689856/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319192.537062:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319192.537097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319192.537104:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379689856:0@lo:250:kworker.0
00000100:00080000:2.0:1767319192.537250:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319192.537258:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319192.537261:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319192.537267:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4070
00000100:00080000:2.0:1767319192.537272:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319192.537279:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319192.537344:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e6680 x1853164379695872/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319192.537371:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319192.537374:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319192.537376:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319192.537380:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4090
00000100:00080000:2.0:1767319192.537383:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319192.537386:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319192.537404:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e4380 x1853164379696000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319192.537419:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319192.537422:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319192.537424:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319192.537428:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4090
00000100:00080000:2.0:1767319192.537430:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319192.537434:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319192.537446:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e6d80 x1853164379696128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319192.537530:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379696256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319192.537630:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319192.537757:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696256
00000100:00100000:3.0:1767319192.537767:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696256
00000100:00100000:3.0:1767319192.537840:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429
00000100:00100000:3.0:1767319192.537864:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379696256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319192.537984:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379695872:0@lo:250:kworker.0
00000400:00000100:0.0:1767319192.538011:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379695872 offset 0 length 520: 4
00000100:00100000:0.0:1767319192.538031:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379696000:0@lo:38:kworker.0
00000100:00100000:0.0:1767319192.538054:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319192.538074:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379696128:0@lo:38:kworker.0
00000100:00100000:0.0:1767319192.538097:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319192.538128:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319192.538141:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696128
00000100:00100000:0.0:1767319192.538145:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696128
00000100:00100000:0.0:1767319192.538171:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953
00000100:00100000:0.0:1767319192.538177:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379696128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319192.538203:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319192.538240:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379696128:12345-0@lo:38:kworker.0 Request processed in 63us (142us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319192.538248:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953
00000100:00080000:0.0:1767319192.538295:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319192.538300:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319192.538304:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379696128:0@lo:38:kworker.0
00000100:00100000:0.0:1767319192.538343:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696000
00000100:00100000:0.0:1767319192.538346:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696000
00000100:00100000:0.0:1767319192.538370:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16764
00000100:00100000:0.0:1767319192.538376:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379696000:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319192.538386:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319192.538414:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379696000:12345-0@lo:38:kworker.0 Request processed in 38us (359us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319192.538421:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16764
00000100:00080000:0.0:1767319192.538440:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319192.538444:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319192.538447:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379696000:0@lo:38:kworker.0
00000100:00100000:0.0:1767319192.538716:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379696384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319192.538748:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319192.538779:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696384
00000100:00100000:0.0:1767319192.538782:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696384
00000100:00100000:0.0:1767319192.538814:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430
00000100:00100000:0.0:1767319192.538820:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379696384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319192.538887:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379696384:12345-0@lo:400:kworker.0 Request processed in 50us (121us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319192.538893:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430
00000100:00080000:0.0:1767319192.538907:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319192.538930:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379696384:0@lo:400:kworker.0
00000100:00100000:3.0:1767319192.540914:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379696256:12345-0@lo:400:kworker.0 Request processed in 3040us (3269us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319192.540935:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429
00000100:00100000:1.0:1767319192.541138:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379696256:0@lo:400:kworker.0
00000100:00100000:3.0:1767319192.541365:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379696512:0@lo:400:kworker.0
00000100:00100000:3.0:1767319192.541437:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319192.541705:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696512
00000100:00100000:0.0:1767319192.541715:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696512
00000100:00100000:0.0:1767319192.541803:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096
00000100:00100000:0.0:1767319192.541814:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379696512:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319192.542015:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319192.542144:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319192.542150:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319192.542155:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319192.542161:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4090
00000100:00080000:2.0:1767319192.542165:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319192.542171:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319192.542200:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e4e00 x1853164379696640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319192.542259:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379696640:0@lo:38:kworker.0
00000100:00100000:1.0:1767319192.542297:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319192.542506:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379696768:0@lo:400:kworker.0
00000100:00080000:2.0:1767319192.542829:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319192.542834:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319192.542836:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319192.542841:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4090
00000100:00080000:2.0:1767319192.542843:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319192.542859:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319192.542897:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e6d80 x1853164379696896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319192.542954:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696640
00000100:00100000:2.0:1767319192.542961:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696640
00000100:00100000:2.0:1767319192.542997:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16765
00000100:00100000:2.0:1767319192.543004:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379696640:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319192.543030:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319192.543126:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379696512:0@lo:400:kworker.0
00000100:00100000:0.0:1767319192.543228:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379696512:12345-0@lo:400:kworker.0 Request processed in 1415us (1791us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319192.543239:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096
00000100:00100000:0.0:1767319192.543278:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379696896:0@lo:38:kworker.0
00000100:00100000:0.0:1767319192.543318:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319192.543488:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696896
00000100:00100000:3.0:1767319192.543494:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696896
00000100:00100000:3.0:1767319192.543523:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16766
00000100:00100000:3.0:1767319192.543543:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379696896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319192.543558:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319192.543593:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379696896:12345-0@lo:38:kworker.0 Request processed in 63us (274us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319192.543599:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16766
00000100:00080000:0.0:1767319192.543926:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319192.543932:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319192.543935:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379696896:0@lo:38:kworker.0
00000100:00100000:1.0:1767319192.550692:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319192.555920:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379696768
00000100:00100000:0.0:1767319192.555943:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379696768
00000100:00100000:0.0:1767319192.556045:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097
00000100:00100000:0.0:1767319192.556057:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379696768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319192.556186:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379696768:12345-0@lo:400:kworker.0 Request processed in 131us (5506us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319192.556194:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097
00000100:00100000:0.0:1767319192.556267:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379696768:0@lo:400:kworker.0
00000100:00080000:3.0:1767319192.557492:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319192.557966:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379696640:12345-0@lo:38:kworker.0 Request processed in 14954us (15662us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319192.557981:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16765
00000100:00080000:0.0:1767319192.558167:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319192.558174:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319192.558179:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379696640:0@lo:38:kworker.0
00010000:00010000:3.0:1767319193.047514:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319193.487370:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319193.487547:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291903616
00000100:00100000:2.0:1767319193.487561:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291903616
00000100:00100000:2.0:1767319193.487656:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4098
00000100:00100000:2.0:1767319193.487669:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291903616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319193.487777:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291903616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 111us (421us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319193.487785:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4098
00000100:00080000:3.0:1767319193.488049:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319193.490046:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319193.490110:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291903488
00000100:00100000:1.0:1767319193.490122:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291903488
00000100:00100000:1.0:1767319193.490219:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16767
00000100:00100000:1.0:1767319193.490228:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291903488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319193.490260:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319193.490356:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291903488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 127us (320us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319193.490364:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16767
00000100:00100000:0.0:1767319193.563603:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319193.563636:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379697024:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319193.563729:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319193.564462:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697024
00000100:00100000:3.0:1767319193.564473:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697024
00000100:00100000:3.0:1767319193.564539:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190
00000100:00100000:3.0:1767319193.564549:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379697024:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319193.564587:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319193.564729:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379697024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 181us (999us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319193.564750:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190
00000100:00100000:3.0:1767319193.564814:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379697024:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319194.073394:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319195.095214:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319195.098672:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379697152:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319195.098752:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319195.098954:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697152
00000100:00100000:0.0:1767319195.098963:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697152
00000100:00100000:0.0:1767319195.099049:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191
00000100:00100000:0.0:1767319195.099059:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379697152:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319195.099095:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319195.099145:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379697152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (392us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319195.099155:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191
00000100:00080000:3.0:1767319195.099308:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319195.099353:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379697152:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319196.119340:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319197.143196:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319197.655054:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319197.655070:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319197.655074:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319197.655079:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319197.655085:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319197.655096:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4094
00000100:00080000:1.0:1767319197.655101:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319197.655110:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319197.655161:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45500 x1853164379697280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319197.655196:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319197.655201:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319197.655203:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319197.655210:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4094
00000100:00080000:1.0:1767319197.655213:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319197.655218:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319197.655236:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46a00 x1853164379697408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319197.655312:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319197.655316:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319197.655318:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319197.655322:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4094
00000100:00080000:1.0:1767319197.655325:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319197.655329:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319197.655342:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44e00 x1853164379697920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319197.655358:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319197.655361:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319197.655363:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319197.655366:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4094
00000100:00080000:1.0:1767319197.655369:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319197.655373:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319197.655392:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682300 x1853164379698176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319197.655415:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379697536:0@lo:400:kworker.0
00000100:00100000:1.0:1767319197.655434:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379697792:0@lo:400:kworker.0
00000100:00100000:0.0:1767319197.655507:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379697280:0@lo:38:kworker.0
00000100:00100000:3.0:1767319197.655637:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379697664:0@lo:400:kworker.0
00000100:00100000:1.0:1767319197.660338:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319197.660421:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319197.660459:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319197.660480:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379698048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319197.660494:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379697408:0@lo:38:kworker.0
00000100:00100000:1.0:1767319197.660555:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319197.660562:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319197.660619:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697792
00000100:00100000:0.0:1767319197.660624:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379697920:0@lo:38:kworker.0
00000100:00100000:1.0:1767319197.660631:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697792
00000100:00100000:0.0:1767319197.660662:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319197.660694:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379698176:0@lo:38:kworker.0
00000100:00100000:1.0:1767319197.660716:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697280
00000100:00100000:0.0:1767319197.660723:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319197.660724:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697280
00000100:00100000:1.0:1767319197.660748:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698048
00000100:00100000:1.0:1767319197.660752:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698048
00000100:00100000:0.0:1767319197.660789:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697920
00000100:00100000:1.0:1767319197.660790:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698176
00000100:00100000:0.0:1767319197.660808:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697920
00000100:00100000:1.0:1767319197.660811:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698176
00000100:00100000:1.0:1767319197.660863:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099
00000100:00100000:1.0:1767319197.660901:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379697792:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319197.660902:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100
00000100:00100000:0.0:1767319197.660927:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379698048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319197.660995:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379697792:12345-0@lo:400:kworker.0 Request processed in 98us (667us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319197.661004:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099
00000100:00100000:1.0:1767319197.661032:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16768
00000100:00100000:1.0:1767319197.661037:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379697280:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319197.661063:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319197.661103:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379697280:12345-0@lo:38:kworker.0 Request processed in 64us (693us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319197.661110:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16768
00000100:00100000:1.0:1767319197.661126:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16769
00000100:00100000:1.0:1767319197.661132:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379697920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319197.661143:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319197.661157:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379698048:12345-0@lo:400:kworker.0 Request processed in 237us (601us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319197.661167:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100
00000100:00100000:1.0:1767319197.661188:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379697920:12345-0@lo:38:kworker.0 Request processed in 53us (524us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319197.661199:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16769
00000100:00100000:0.0:1767319197.661208:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16770
00000100:00100000:0.0:1767319197.661215:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379698176:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319197.661237:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319197.661259:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379698048:0@lo:400:kworker.0
00000100:00100000:1.0:1767319197.661275:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379697792:0@lo:400:kworker.0
00000100:00100000:0.0:1767319197.661422:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379698176:12345-0@lo:38:kworker.0 Request processed in 203us (697us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319197.661433:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16770
00000100:00100000:1.0:1767319197.661443:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697408
00000100:00100000:1.0:1767319197.661450:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697408
00000100:00100000:1.0:1767319197.661485:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954
00000100:00080000:0.0:1767319197.661488:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319197.661495:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379697408:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767319197.661502:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319197.661511:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379697920:0@lo:38:kworker.0
00010000:00020000:1.0:1767319197.661515:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319197.661535:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319197.661541:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319197.661545:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379698176:0@lo:38:kworker.0
00000100:00080000:0.0:1767319197.661568:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319197.661576:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379697408:12345-0@lo:38:kworker.0 Request processed in 78us (1010us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767319197.661581:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319197.661594:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379697280:0@lo:38:kworker.0
00000100:00100000:1.0:1767319197.661595:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954
00000100:00080000:0.0:1767319197.661616:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319197.661622:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319197.661626:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379697408:0@lo:38:kworker.0
00000100:00080000:1.0:1767319197.661715:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319197.661793:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319197.662129:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697536
00000100:00100000:0.0:1767319197.662137:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697536
00000100:00100000:0.0:1767319197.662232:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431
00000100:00100000:0.0:1767319197.662240:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379697536:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319197.662582:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319197.662778:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379697664
00000100:00100000:2.0:1767319197.662785:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379697664
00000100:00100000:0.0:1767319197.662836:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379697536:12345-0@lo:400:kworker.0 Request processed in 595us (1041us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319197.662847:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431
00000100:00100000:3.0:1767319197.662983:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432
00000100:00100000:3.0:1767319197.662995:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379697664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319197.663070:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379697664:12345-0@lo:400:kworker.0 Request processed in 78us (490us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319197.663078:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432
00000100:00080000:1.0:1767319197.664025:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319197.664032:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319197.664103:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379697536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319197.667304:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379697664:0@lo:400:kworker.0
00010000:00010000:1.0:1767319198.167479:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319198.607327:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319198.607388:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319198.607581:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291903872
00000100:00100000:1.0:1767319198.607594:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291903872
00000100:00100000:1.0:1767319198.607676:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291903744
00000100:00100000:1.0:1767319198.607679:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291903744
00000100:00100000:1.0:1767319198.607698:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4101
00000100:00100000:1.0:1767319198.607709:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291903872:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319198.607811:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291903872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (501us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319198.607819:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4101
00000100:00100000:1.0:1767319198.607844:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16771
00000100:00100000:1.0:1767319198.607849:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291903744:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319198.607908:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319198.607935:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291903744:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 85us (548us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319198.607941:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16771
00000100:00080000:3.0:1767319198.608662:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319198.679327:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319198.679363:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379698304:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319198.679461:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319198.679722:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698304
00000100:00100000:3.0:1767319198.679733:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698304
00000100:00100000:3.0:1767319198.679807:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192
00000100:00100000:3.0:1767319198.679819:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379698304:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319198.679857:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319198.679932:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379698304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (470us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319198.679940:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192
00000100:00100000:0.0:1767319198.681058:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379698304:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319199.191115:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319200.216733:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319200.216978:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319200.217001:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379698432:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319200.217072:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319200.217457:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698432
00000100:00100000:2.0:1767319200.217467:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698432
00000100:00080000:3.0:1767319200.217702:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319200.217764:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193
00000100:00100000:2.0:1767319200.217787:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379698432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319200.217817:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319200.217898:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379698432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (824us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319200.217906:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193
00000100:00100000:1.0:1767319200.219652:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379698432:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319201.239301:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319202.263173:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319202.775094:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319202.775105:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319202.775108:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319202.775113:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319202.775117:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319202.775125:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4100
00000100:00080000:1.0:1767319202.775129:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319202.775136:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319202.775178:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680380 x1853164379698560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319202.775217:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319202.775221:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319202.775223:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319202.775236:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4100
00000100:00080000:1.0:1767319202.775239:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319202.775243:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319202.775257:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681500 x1853164379698688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319202.775479:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319202.775498:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379698816:0@lo:400:kworker.0
00000100:00100000:0.0:1767319202.775563:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319202.775787:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319202.775791:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319202.775793:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319202.775797:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4100
00000100:00080000:1.0:1767319202.775799:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319202.775803:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319202.775817:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46a00 x1853164379699200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319202.775833:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319202.775836:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319202.775838:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319202.775842:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4100
00000100:00080000:1.0:1767319202.775844:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319202.775848:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319202.775861:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44e00 x1853164379699456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319202.775906:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379699072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319202.775935:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319202.775959:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319202.775965:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379699328:0@lo:400:kworker.0
00000100:00100000:1.0:1767319202.775987:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319202.776017:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699072
00000100:00100000:1.0:1767319202.776024:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699072
00000100:00100000:1.0:1767319202.776073:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699328
00000100:00100000:1.0:1767319202.776076:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699328
00000100:00100000:1.0:1767319202.776101:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102
00000100:00100000:1.0:1767319202.776109:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379699072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319202.776161:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379699072:12345-0@lo:400:kworker.0 Request processed in 52us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319202.776168:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102
00000100:00100000:1.0:1767319202.776188:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103
00000100:00100000:0.0:1767319202.776316:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379698944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319202.776345:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319202.776378:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698816
00000100:00100000:0.0:1767319202.776382:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698816
00000100:00100000:0.0:1767319202.776406:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698944
00000100:00100000:0.0:1767319202.776410:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698944
00000100:00100000:0.0:1767319202.776432:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433
00000100:00100000:0.0:1767319202.776438:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379698816:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319202.776471:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379698816:12345-0@lo:400:kworker.0 Request processed in 34us (909us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319202.776477:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433
00000100:00100000:0.0:1767319202.776489:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434
00000100:00100000:0.0:1767319202.776495:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379698944:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319202.776520:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379698944:12345-0@lo:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319202.776525:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434
00000100:00100000:0.0:1767319202.776561:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379698944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319202.776572:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379698816:0@lo:400:kworker.0
00000100:00100000:0.0:1767319202.776634:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379699072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319202.776903:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379699328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319202.776948:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379699328:12345-0@lo:400:kworker.0 Request processed in 755us (960us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319202.776955:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103
00000100:00080000:3.0:1767319202.777057:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319202.777061:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319202.777064:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319202.777154:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379698560:0@lo:38:kworker.0
00000100:00100000:2.0:1767319202.777186:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319202.777221:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379698688:0@lo:38:kworker.0
00000100:00100000:2.0:1767319202.777245:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319202.777265:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379699200:0@lo:38:kworker.0
00000100:00100000:2.0:1767319202.777286:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319202.777432:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379699456:0@lo:38:kworker.0
00000100:00100000:2.0:1767319202.777457:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319202.777487:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698560
00000100:00100000:2.0:1767319202.777491:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698560
00000100:00100000:2.0:1767319202.777510:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699200
00000100:00100000:2.0:1767319202.777513:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699200
00000100:00100000:2.0:1767319202.777525:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699456
00000100:00100000:2.0:1767319202.777527:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699456
00000100:00100000:2.0:1767319202.777539:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16772
00000100:00100000:2.0:1767319202.777543:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379698560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319202.777561:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319202.777591:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379698560:12345-0@lo:38:kworker.0 Request processed in 46us (404us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319202.777596:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16772
00000100:00100000:2.0:1767319202.777609:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16773
00000100:00100000:2.0:1767319202.777613:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379699200:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319202.777622:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319202.777717:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379699200:12345-0@lo:38:kworker.0 Request processed in 30us (358us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319202.777724:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16773
00000100:00100000:2.0:1767319202.777737:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16774
00000100:00100000:2.0:1767319202.777740:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379699456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319202.777750:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319202.777786:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379699456:12345-0@lo:38:kworker.0 Request processed in 44us (328us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319202.777793:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16774
00000100:00080000:2.0:1767319202.777821:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319202.777826:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319202.777829:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379698560:0@lo:38:kworker.0
00000100:00080000:2.0:1767319202.777836:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319202.777839:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319202.777842:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379699200:0@lo:38:kworker.0
00000100:00080000:2.0:1767319202.777849:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319202.777852:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319202.777854:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379699456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319202.777940:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379698688
00000100:00100000:1.0:1767319202.777945:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379698688
00000100:00100000:1.0:1767319202.777972:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955
00000100:00100000:1.0:1767319202.777977:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379698688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319202.777987:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319202.778017:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379698688:12345-0@lo:38:kworker.0 Request processed in 39us (771us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319202.778024:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955
00000100:00080000:1.0:1767319202.778051:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319202.778056:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319202.778059:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379698688:0@lo:38:kworker.0
00000100:00100000:0.0:1767319202.778705:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379699328:0@lo:400:kworker.0
00010000:00010000:3.0:1767319203.287150:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319203.734176:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319203.734265:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319203.734486:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291904128
00000100:00100000:1.0:1767319203.734497:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291904128
00000100:00100000:1.0:1767319203.734575:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291904000
00000100:00100000:1.0:1767319203.734579:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291904000
00000100:00100000:1.0:1767319203.734599:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4104
00000100:00100000:1.0:1767319203.734608:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291904128:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319203.734678:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291904128:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 71us (511us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319203.734686:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4104
00000100:00100000:1.0:1767319203.734707:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16775
00000100:00100000:1.0:1767319203.734711:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291904000:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319203.734732:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319203.734770:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291904000:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (504us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319203.734777:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16775
00000100:00080000:0.0:1767319203.734866:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319203.800364:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319203.800387:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379699584:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319203.800466:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319203.800614:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699584
00000100:00100000:3.0:1767319203.800624:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699584
00000100:00100000:3.0:1767319203.800680:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194
00000100:00100000:3.0:1767319203.800690:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379699584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319203.800720:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319203.800787:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379699584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (321us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319203.800795:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194
00000100:00100000:0.0:1767319203.801034:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379699584:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319204.311244:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319205.335365:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319205.336247:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319205.336269:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379699712:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319205.336334:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319205.336442:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699712
00000100:00100000:2.0:1767319205.336451:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699712
00000100:00100000:2.0:1767319205.336515:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195
00000100:00100000:2.0:1767319205.336534:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379699712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319205.336565:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319205.336609:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379699712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (275us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319205.336616:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195
00000100:00080000:3.0:1767319205.336757:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319205.336958:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379699712:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319206.359268:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319207.383177:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319207.897423:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319207.897435:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319207.897438:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319207.897443:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319207.897446:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319207.897454:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4105
00000100:00080000:2.0:1767319207.897459:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319207.897467:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319207.897504:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4380 x1853164379699840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319207.897538:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319207.897542:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319207.897544:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319207.897548:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4105
00000100:00080000:2.0:1767319207.897551:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319207.897556:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319207.897574:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4e00 x1853164379699968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319207.897589:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379699840:0@lo:38:kworker.0
00000100:00080000:2.0:1767319207.897644:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319207.897649:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319207.897652:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319207.897657:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4105
00000100:00080000:2.0:1767319207.897660:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319207.897665:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319207.897680:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6a00 x1853164379700480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319207.897698:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319207.897741:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319207.897747:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319207.897749:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319207.897760:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4105
00000100:00080000:2.0:1767319207.897763:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319207.897769:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319207.897790:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4a80 x1853164379700736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319207.897804:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379699968:0@lo:38:kworker.0
00000100:00100000:2.0:1767319207.897830:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379700608:0@lo:400:kworker.0
00000100:00100000:0.0:1767319207.897845:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319207.897938:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319207.897980:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319207.897986:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379700352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319207.898011:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319207.898043:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699840
00000100:00100000:2.0:1767319207.898051:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699840
00000100:00100000:0.0:1767319207.898087:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379700480:0@lo:38:kworker.0
00000100:00100000:2.0:1767319207.898089:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700608
00000100:00100000:2.0:1767319207.898096:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700608
00000100:00100000:0.0:1767319207.898132:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319207.898152:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700352
00000100:00100000:2.0:1767319207.898158:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700352
00000100:00100000:0.0:1767319207.898173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379700736:0@lo:38:kworker.0
00000100:00100000:3.0:1767319207.898173:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379700224:0@lo:400:kworker.0
00000100:00100000:2.0:1767319207.898188:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700480
00000100:00100000:2.0:1767319207.898194:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700480
00000100:00100000:0.0:1767319207.898208:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319207.898216:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700736
00000100:00100000:2.0:1767319207.898222:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700736
00000100:00100000:2.0:1767319207.898242:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105
00000100:00100000:2.0:1767319207.898252:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379700608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319207.898281:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106
00000100:00100000:3.0:1767319207.898292:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319207.898296:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379700352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319207.898329:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319207.898336:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379700096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319207.898400:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16776
00000100:00100000:1.0:1767319207.898410:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379699840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319207.898429:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319207.899573:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379700608:12345-0@lo:400:kworker.0 Request processed in 1316us (1631us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319207.899587:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319207.899597:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105
00000100:00080000:3.0:1767319207.899649:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319207.899867:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700224
00000100:00100000:3.0:1767319207.899901:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700224
00000100:00100000:3.0:1767319207.899970:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700096
00000100:00100000:3.0:1767319207.899973:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700096
00000100:00100000:3.0:1767319207.900002:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435
00000100:00100000:3.0:1767319207.900012:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379700224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319207.900069:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379700224:12345-0@lo:400:kworker.0 Request processed in 60us (1777us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319207.900077:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435
00000100:00100000:3.0:1767319207.900094:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436
00000100:00100000:3.0:1767319207.900100:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379700096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319207.900323:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379700096:12345-0@lo:400:kworker.0 Request processed in 222us (745us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319207.900334:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436
00000100:00080000:3.0:1767319207.900359:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319207.900363:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319207.900403:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379700096:0@lo:400:kworker.0
00000100:00100000:3.0:1767319207.900419:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379700224:0@lo:400:kworker.0
00000100:00100000:3.0:1767319207.900621:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379700608:0@lo:400:kworker.0
00000100:00100000:3.0:1767319207.900760:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16777
00000100:00100000:3.0:1767319207.900860:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379700480:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319207.900908:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319207.900964:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379700480:12345-0@lo:38:kworker.0 Request processed in 195us (2832us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319207.900971:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16777
00000100:00100000:3.0:1767319207.900991:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16778
00000100:00100000:3.0:1767319207.900996:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379700736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319207.901007:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319207.901032:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379700736:12345-0@lo:38:kworker.0 Request processed in 35us (2828us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319207.901038:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16778
00000100:00100000:3.0:1767319207.901085:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379699968
00000100:00100000:3.0:1767319207.901091:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379699968
00000100:00100000:3.0:1767319207.901295:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956
00000100:00100000:3.0:1767319207.901301:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379699968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319207.901312:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319207.901346:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379699968:12345-0@lo:38:kworker.0 Request processed in 44us (3503us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319207.901353:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956
00000100:00080000:2.0:1767319207.901532:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319207.901546:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319207.901552:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379700736:0@lo:38:kworker.0
00000100:00080000:2.0:1767319207.901569:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319207.901573:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319207.901576:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379699968:0@lo:38:kworker.0
00000100:00080000:2.0:1767319207.901587:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319207.901591:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319207.901594:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379700480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319207.901814:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379699840:12345-0@lo:38:kworker.0 Request processed in 3401us (4118us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319207.901825:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16776
00000100:00080000:2.0:1767319207.904925:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319207.904941:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319207.904946:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379699840:0@lo:38:kworker.0
00000100:00100000:0.0:1767319207.906257:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379700352:12345-0@lo:400:kworker.0 Request processed in 7954us (8232us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319207.906277:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106
00000100:00100000:3.0:1767319207.909448:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379700352:0@lo:400:kworker.0
00010000:00010000:3.0:1767319208.408133:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319208.850802:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319208.850983:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319208.851111:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291904384
00000100:00100000:1.0:1767319208.851126:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291904384
00000100:00100000:1.0:1767319208.851225:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291904256
00000100:00100000:1.0:1767319208.851229:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291904256
00000100:00100000:1.0:1767319208.851256:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4107
00000100:00100000:1.0:1767319208.851267:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291904384:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319208.851375:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291904384:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (587us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319208.851388:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4107
00000100:00100000:1.0:1767319208.851417:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16779
00000100:00100000:1.0:1767319208.851422:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291904256:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319208.851449:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319208.851481:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291904256:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (498us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319208.851488:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16779
00000100:00080000:3.0:1767319208.852084:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319208.920176:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319208.920204:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379700864:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319208.920322:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319208.920683:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700864
00000100:00100000:3.0:1767319208.920694:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700864
00000100:00100000:3.0:1767319208.920775:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196
00000100:00100000:3.0:1767319208.920787:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379700864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319208.920825:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319208.920933:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379700864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 148us (611us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319208.920950:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196
00000100:00100000:0.0:1767319208.921657:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379700864:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319209.439145:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319210.455395:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319210.455571:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319210.455597:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379700992:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319210.455702:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319210.456403:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379700992
00000100:00100000:2.0:1767319210.456418:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379700992
00000100:00100000:2.0:1767319210.456555:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197
00000100:00100000:2.0:1767319210.456567:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379700992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319210.456605:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319210.456696:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379700992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (993us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319210.456706:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197
00000100:00100000:0.0:1767319210.456830:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379700992:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319210.457233:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319211.481160:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319212.504061:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319213.015192:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319213.015205:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319213.015209:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319213.015213:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319213.015218:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319213.015238:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4110
00000100:00080000:0.0:1767319213.015244:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319213.015253:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319213.015308:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44aa00 x1853164379701120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319213.015337:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319213.015341:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319213.015343:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319213.015348:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4110
00000100:00080000:0.0:1767319213.015350:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319213.015354:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319213.015375:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379701248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319213.015456:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319213.015461:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319213.015463:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319213.015466:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4110
00000100:00080000:0.0:1767319213.015469:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319213.015473:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319213.015484:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448700 x1853164379701760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319213.015501:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319213.015504:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319213.015506:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319213.015509:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4110
00000100:00080000:0.0:1767319213.015512:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319213.015516:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319213.015526:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448e00 x1853164379702016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319213.015557:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379701632:0@lo:400:kworker.0
00000100:00100000:0.0:1767319213.015648:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319213.015740:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319213.015747:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379701888:0@lo:400:kworker.0
00000100:00100000:0.0:1767319213.015772:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319213.015811:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379701632
00000100:00100000:0.0:1767319213.015821:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379701632
00000100:00100000:0.0:1767319213.015914:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379701888
00000100:00100000:0.0:1767319213.015918:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379701888
00000100:00100000:0.0:1767319213.015948:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108
00000100:00100000:0.0:1767319213.015958:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379701632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319213.016017:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379701632:12345-0@lo:400:kworker.0 Request processed in 60us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319213.016026:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108
00000100:00100000:0.0:1767319213.016046:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109
00000100:00100000:0.0:1767319213.016053:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379701888:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319213.016081:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379701888:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319213.016087:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109
00000100:00100000:0.0:1767319213.016129:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379701888:0@lo:400:kworker.0
00000100:00100000:0.0:1767319213.016142:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379701632:0@lo:400:kworker.0
00000100:00100000:1.0:1767319213.016807:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379701376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319213.016864:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319213.016964:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319213.016970:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379701504:0@lo:400:kworker.0
00000100:00100000:1.0:1767319213.016994:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319213.017645:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379701120:0@lo:38:kworker.0
00000100:00100000:2.0:1767319213.017699:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319213.017735:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379701248:0@lo:38:kworker.0
00000100:00100000:2.0:1767319213.017761:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319213.017787:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379701760:0@lo:38:kworker.0
00000100:00100000:2.0:1767319213.017805:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319213.017820:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379702016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319213.017837:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319213.017890:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379701248
00000100:00100000:2.0:1767319213.017897:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379701248
00000100:00100000:2.0:1767319213.017927:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957
00000100:00100000:2.0:1767319213.017934:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379701248:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319213.017959:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319213.018003:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379701248:12345-0@lo:38:kworker.0 Request processed in 69us (240us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319213.018011:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957
00000100:00100000:2.0:1767319213.018034:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379701120
00000100:00100000:2.0:1767319213.018037:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379701120
00000100:00100000:2.0:1767319213.018052:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379701760
00000100:00100000:2.0:1767319213.018054:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379701760
00000100:00100000:2.0:1767319213.018064:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379702016
00000100:00100000:2.0:1767319213.018067:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379702016
00000100:00100000:2.0:1767319213.018077:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16780
00000100:00100000:2.0:1767319213.018081:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379701120:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319213.018244:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16781
00000100:00100000:1.0:1767319213.018250:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379701760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319213.018260:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319213.018291:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379701760:12345-0@lo:38:kworker.0 Request processed in 39us (484us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319213.018295:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16781
00000100:00100000:1.0:1767319213.018310:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16782
00000100:00100000:1.0:1767319213.018315:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379702016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319213.018323:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319213.018345:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379702016:12345-0@lo:38:kworker.0 Request processed in 29us (507us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319213.018350:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16782
00000100:00080000:1.0:1767319213.018415:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319213.018421:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319213.018426:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379701248:0@lo:38:kworker.0
00000100:00080000:1.0:1767319213.018435:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319213.018438:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319213.018440:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379701760:0@lo:38:kworker.0
00000100:00080000:1.0:1767319213.018447:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319213.018450:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319213.018453:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379702016:0@lo:38:kworker.0
00010000:00020000:2.0:1767319213.020351:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319213.020449:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379701120:12345-0@lo:38:kworker.0 Request processed in 2364us (2748us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319213.020458:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16780
00000100:00080000:1.0:1767319213.021043:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319213.021051:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319213.021055:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379701120:0@lo:38:kworker.0
00000100:00100000:0.0:1767319213.021456:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379701376
00000100:00100000:0.0:1767319213.021465:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379701376
00000100:00100000:0.0:1767319213.021538:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379701504
00000100:00100000:0.0:1767319213.021542:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379701504
00000100:00100000:0.0:1767319213.021579:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437
00000100:00100000:0.0:1767319213.021591:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379701376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319213.021670:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379701376:12345-0@lo:400:kworker.0 Request processed in 73us (4796us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319213.021677:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437
00000100:00100000:0.0:1767319213.021694:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438
00000100:00100000:0.0:1767319213.021701:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379701504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319213.021734:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379701504:12345-0@lo:400:kworker.0 Request processed in 34us (4739us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319213.021747:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438
00000100:00100000:1.0:1767319213.021940:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379701504:0@lo:400:kworker.0
00000100:00100000:1.0:1767319213.021954:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379701376:0@lo:400:kworker.0
00000100:00080000:3.0:1767319213.024466:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319213.024480:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319213.024485:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319213.527557:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319213.971264:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319213.971321:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319213.973294:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291904640
00000100:00100000:0.0:1767319213.973310:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291904640
00000100:00100000:0.0:1767319213.973420:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291904512
00000100:00100000:0.0:1767319213.973424:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291904512
00000100:00100000:0.0:1767319213.973447:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4110
00000100:00100000:0.0:1767319213.973458:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291904640:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319213.973555:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291904640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (2299us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319213.973562:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4110
00000100:00100000:0.0:1767319213.973580:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16783
00000100:00100000:0.0:1767319213.973585:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291904512:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319213.973606:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319213.973632:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291904512:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (2311us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319213.973638:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16783
00000100:00080000:1.0:1767319213.974103:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:1.0:1767319213.974856:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291904768 offset 0 length 520: 4
00000100:00100000:2.0:1767319214.040558:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319214.040575:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379702144:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319214.040641:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319214.040890:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379702144
00000100:00100000:3.0:1767319214.040899:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379702144
00000100:00100000:3.0:1767319214.040953:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198
00000100:00100000:3.0:1767319214.040963:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379702144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319214.040992:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319214.041054:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379702144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (412us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319214.041061:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198
00000100:00100000:1.0:1767319214.041158:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379702144:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319214.552600:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319215.575261:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319215.575285:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379702272:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319215.575366:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319215.575514:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379702272
00000100:00100000:2.0:1767319215.575523:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379702272
00000100:00100000:2.0:1767319215.575586:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199
00000100:00100000:2.0:1767319215.575596:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379702272:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319215.575625:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319215.575681:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379702272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (315us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319215.575689:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199
00000100:00080000:0.0:1767319215.575998:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319215.576038:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379702272:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319215.576153:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319216.600082:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319217.111507:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319192/real 1767319192]  req@ffff8b0f336e6680 x1853164379695872/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319217 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319217.111543:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f336e6680 x1853164379695872/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319217 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319217.111563:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319217.111585:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319217.111599:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379695872:0@lo:250:kworker.0
00000100:00080000:0.0:1767319217.113556:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319217.113567:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319217.113570:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319217.113576:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4094
00000100:00080000:0.0:1767319217.113581:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319217.113587:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319217.113634:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44bb80 x1853164379702400/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319217.113665:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319217.113669:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319217.113671:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319217.113675:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4115
00000100:00080000:0.0:1767319217.113678:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319217.113681:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319217.113697:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b800 x1853164379702528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319217.113707:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319217.113710:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319217.113712:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319217.113715:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4115
00000100:00080000:0.0:1767319217.113718:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319217.113721:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319217.113733:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449c00 x1853164379702656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319217.113807:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319217.113809:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379702400:0@lo:250:kworker.0
00000100:00080000:0.0:1767319217.113812:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319217.113816:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319217.113823:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4115
00000100:00080000:0.0:1767319217.113825:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319217.113830:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319217.113842:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448e00 x1853164379703168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319217.113861:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319217.113865:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319217.113866:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319217.113893:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4115
00000100:00080000:0.0:1767319217.113896:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000400:00000100:1.0:1767319217.113900:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379702400 offset 0 length 520: 4
00000100:00080000:0.0:1767319217.113904:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319217.113927:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379703424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319217.113954:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379703040:0@lo:400:kworker.0
00000100:00100000:1.0:1767319217.113962:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379702528:0@lo:38:kworker.0
00000100:00100000:0.0:1767319217.114002:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319217.114038:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379703296:0@lo:400:kworker.0
00000100:00100000:0.0:1767319217.114058:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703040
00000100:00100000:0.0:1767319217.114067:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703040
00000100:00100000:1.0:1767319217.114072:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319217.114129:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703296
00000100:00100000:0.0:1767319217.114132:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703296
00000100:00100000:0.0:1767319217.114157:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111
00000100:00100000:0.0:1767319217.114165:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379703040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319217.114213:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379703040:12345-0@lo:400:kworker.0 Request processed in 48us (212us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319217.114221:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111
00000100:00100000:0.0:1767319217.114237:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112
00000100:00100000:0.0:1767319217.114243:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379703296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319217.114271:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379703296:12345-0@lo:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319217.114277:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112
00000100:00080000:0.0:1767319217.114295:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319217.114296:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379703296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319217.114381:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379702784:0@lo:400:kworker.0
00000100:00100000:3.0:1767319217.114394:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379702912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319217.114415:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379703040:0@lo:400:kworker.0
00000100:00100000:1.0:1767319217.122971:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319217.123077:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379702656:0@lo:38:kworker.0
00000100:00100000:1.0:1767319217.123426:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319217.123474:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379703168:0@lo:38:kworker.0
00000100:00100000:1.0:1767319217.123504:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319217.123539:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379703424:0@lo:38:kworker.0
00000100:00100000:1.0:1767319217.123558:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319217.123763:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379702528
00000100:00100000:1.0:1767319217.123771:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379702528
00000100:00100000:1.0:1767319217.123816:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703168
00000100:00100000:1.0:1767319217.123820:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703168
00000100:00100000:1.0:1767319217.123834:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703424
00000100:00100000:1.0:1767319217.123837:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703424
00000100:00100000:1.0:1767319217.123855:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16784
00000100:00100000:1.0:1767319217.123862:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379702528:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319217.123903:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319217.123946:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379702528:12345-0@lo:38:kworker.0 Request processed in 83us (984us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319217.123953:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16784
00000100:00100000:1.0:1767319217.123973:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16785
00000100:00100000:1.0:1767319217.123977:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379703168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319217.123986:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319217.124010:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379703168:12345-0@lo:38:kworker.0 Request processed in 31us (505us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319217.124016:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16785
00000100:00100000:1.0:1767319217.124028:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16786
00000100:00100000:1.0:1767319217.124032:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379703424:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319217.124042:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319217.124065:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379703424:12345-0@lo:38:kworker.0 Request processed in 30us (505us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319217.124070:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16786
00000100:00080000:1.0:1767319217.124463:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319217.124469:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319217.124473:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379703168:0@lo:38:kworker.0
00000100:00080000:1.0:1767319217.124483:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319217.124486:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319217.124488:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379703424:0@lo:38:kworker.0
00000100:00080000:1.0:1767319217.124496:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319217.124500:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319217.124502:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379702528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319217.124665:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319217.124730:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379702656
00000100:00100000:2.0:1767319217.124736:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379702656
00000100:00100000:2.0:1767319217.124758:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958
00000100:00100000:2.0:1767319217.124763:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379702656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319217.124772:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319217.124815:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379702656:12345-0@lo:38:kworker.0 Request processed in 51us (1388us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319217.124824:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958
00000100:00100000:2.0:1767319217.124853:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379702784
00000100:00100000:2.0:1767319217.124857:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379702784
00000100:00100000:2.0:1767319217.124915:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439
00000100:00100000:2.0:1767319217.124921:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379702784:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319217.124975:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379702784:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319217.124981:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439
00000100:00100000:2.0:1767319217.125012:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379702784:0@lo:400:kworker.0
00000100:00080000:1.0:1767319217.126265:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319217.126273:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319217.126276:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379702656:0@lo:38:kworker.0
00000100:00080000:0.0:1767319217.126402:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319217.133769:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319217.133910:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379702912
00000100:00100000:2.0:1767319217.133923:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379702912
00000100:00100000:2.0:1767319217.134016:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440
00000100:00100000:2.0:1767319217.134026:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379702912:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319217.134096:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379702912:12345-0@lo:400:kworker.0 Request processed in 72us (336us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319217.134103:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440
00000100:00100000:3.0:1767319217.134207:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379702912:0@lo:400:kworker.0
00000100:00080000:0.0:1767319217.134246:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319217.623539:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319218.647049:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319219.093538:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319219.098320:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291905024
00000100:00100000:0.0:1767319219.098346:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291905024
00000100:00100000:0.0:1767319219.098498:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4113
00000100:00100000:0.0:1767319219.098511:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291905024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319219.098640:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291905024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 131us (5115us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319219.098649:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4113
00000100:00100000:3.0:1767319219.099332:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319219.099625:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291904896
00000100:00100000:0.0:1767319219.099633:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291904896
00000100:00100000:0.0:1767319219.099676:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16787
00000100:00100000:0.0:1767319219.099683:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291904896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319219.099713:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319219.099760:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291904896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 76us (433us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319219.099768:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16787
00000100:00080000:2.0:1767319219.100034:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319219.159411:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319219.159445:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379703552:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319219.159545:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319219.159805:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703552
00000100:00100000:3.0:1767319219.159818:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703552
00000100:00100000:3.0:1767319219.159930:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200
00000100:00100000:3.0:1767319219.159942:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379703552:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319219.159980:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319219.160041:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379703552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (496us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319219.160049:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200
00000100:00080000:0.0:1767319219.160134:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319219.160183:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379703552:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319219.671288:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319220.695222:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319220.695227:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379703680:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319220.695337:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319220.695581:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703680
00000100:00100000:0.0:1767319220.695600:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703680
00000100:00100000:0.0:1767319220.695681:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201
00000100:00100000:0.0:1767319220.695693:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379703680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319220.695731:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319220.695799:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379703680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (462us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319220.695807:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201
00000100:00080000:2.0:1767319220.696023:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319220.696072:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379703680:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319221.719255:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319222.231162:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319222.231177:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319222.231181:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319222.231185:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319222.231192:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319222.231204:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4119
00000100:00080000:0.0:1767319222.231211:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319222.231220:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319222.231278:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7800 x1853164379703808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319222.231315:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319222.231319:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319222.231320:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319222.231325:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4119
00000100:00080000:0.0:1767319222.231328:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319222.231332:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319222.231347:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7b80 x1853164379703936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319222.231394:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379703808:0@lo:38:kworker.0
00000100:00080000:0.0:1767319222.231421:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319222.231424:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319222.231426:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319222.231430:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4119
00000100:00080000:0.0:1767319222.231433:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319222.231437:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319222.231451:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5180 x1853164379704448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319222.231467:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319222.231469:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319222.231472:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319222.231475:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4119
00000100:00080000:0.0:1767319222.231477:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319222.231481:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319222.231485:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319222.231490:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4a80 x1853164379704704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319222.231512:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379704576:0@lo:400:kworker.0
00000100:00100000:0.0:1767319222.231542:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319222.231552:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379703936:0@lo:38:kworker.0
00000100:00100000:1.0:1767319222.231587:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319222.231617:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379704448:0@lo:38:kworker.0
00000100:00100000:1.0:1767319222.231638:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319222.231654:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379704704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319222.231671:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319222.231704:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703808
00000100:00100000:1.0:1767319222.231712:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703808
00000100:00100000:1.0:1767319222.231749:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704576
00000100:00100000:1.0:1767319222.231751:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704576
00000100:00100000:2.0:1767319222.231758:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379704064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319222.231795:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704448
00000100:00100000:2.0:1767319222.231795:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319222.231797:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704448
00000100:00100000:1.0:1767319222.231805:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704704
00000100:00100000:1.0:1767319222.231808:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704704
00000100:00100000:1.0:1767319222.231831:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114
00000100:00100000:2.0:1767319222.231840:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319222.231842:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379704576:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319222.231846:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379704192:0@lo:400:kworker.0
00000100:00100000:2.0:1767319222.231867:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319222.231919:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379704576:12345-0@lo:400:kworker.0 Request processed in 78us (375us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319222.231920:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379703936
00000100:00100000:2.0:1767319222.231923:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379703936
00000100:00100000:1.0:1767319222.231927:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114
00000100:00100000:2.0:1767319222.231947:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959
00000100:00100000:2.0:1767319222.231952:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379703936:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319222.231962:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16788
00000100:00100000:1.0:1767319222.231965:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379703808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319222.231973:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767319222.231974:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319222.232042:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379704320:0@lo:400:kworker.0
00000100:00100000:2.0:1767319222.232103:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379703936:12345-0@lo:38:kworker.0 Request processed in 149us (515us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319222.232110:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959
00000100:00080000:2.0:1767319222.232233:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319222.232248:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704064
00000100:00100000:2.0:1767319222.232252:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704064
00000100:00100000:2.0:1767319222.232289:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704192
00000100:00100000:2.0:1767319222.232292:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704192
00000100:00100000:2.0:1767319222.232316:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441
00000100:00100000:2.0:1767319222.232323:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379704064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319222.232361:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379704064:12345-0@lo:400:kworker.0 Request processed in 39us (565us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319222.232367:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441
00000100:00100000:2.0:1767319222.232378:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442
00000100:00100000:2.0:1767319222.232384:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379704192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319222.232411:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379704192:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319222.232417:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442
00000100:00080000:2.0:1767319222.232444:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319222.232446:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319222.232479:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379704192:0@lo:400:kworker.0
00000100:00100000:2.0:1767319222.232490:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379704064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319222.232643:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16789
00000100:00100000:2.0:1767319222.232648:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379704448:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319222.232660:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319222.232689:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379704448:12345-0@lo:38:kworker.0 Request processed in 40us (1050us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319222.232694:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16789
00000100:00100000:2.0:1767319222.232709:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16790
00000100:00100000:2.0:1767319222.232713:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379704704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319222.232721:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319222.232742:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379704704:12345-0@lo:38:kworker.0 Request processed in 28us (1070us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319222.232747:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16790
00000100:00100000:0.0:1767319222.233820:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379704576:0@lo:400:kworker.0
00000100:00080000:0.0:1767319222.234146:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319222.234153:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319222.234158:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379704448:0@lo:38:kworker.0
00000100:00080000:0.0:1767319222.234170:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319222.234174:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319222.234177:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379704704:0@lo:38:kworker.0
00000100:00080000:0.0:1767319222.234189:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319222.234193:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319222.234196:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379703936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319222.237719:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319222.237976:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704320
00000100:00100000:2.0:1767319222.238110:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704320
00000100:00100000:2.0:1767319222.238191:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115
00000100:00100000:2.0:1767319222.238202:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379704320:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319222.238234:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319222.238369:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379703808:12345-0@lo:38:kworker.0 Request processed in 6399us (6881us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319222.238380:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16788
00000100:00080000:0.0:1767319222.238693:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319222.238699:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319222.238704:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379703808:0@lo:38:kworker.0
00000100:00100000:2.0:1767319222.242239:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379704320:12345-0@lo:400:kworker.0 Request processed in 4024us (4518us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319222.242260:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115
00000100:00100000:3.0:1767319222.246500:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379704320:0@lo:400:kworker.0
00010000:00010000:1.0:1767319222.744673:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319223.767519:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319224.207343:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319224.207425:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291905280
00000100:00100000:0.0:1767319224.207444:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291905280
00000100:00080000:2.0:1767319224.207537:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319224.207690:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319224.207753:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291905152
00000100:00100000:2.0:1767319224.207764:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291905152
00000100:00100000:2.0:1767319224.208049:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4116
00000100:00100000:2.0:1767319224.208067:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291905280:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319224.208179:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291905280:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 120us (852us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319224.208188:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4116
00000100:00100000:2.0:1767319224.208212:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16791
00000100:00100000:2.0:1767319224.208218:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291905152:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319224.208244:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319224.208283:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291905152:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 62us (598us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319224.208290:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16791
00000100:00100000:1.0:1767319224.279853:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319224.279888:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379704832:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319224.279947:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319224.280008:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704832
00000100:00100000:1.0:1767319224.280015:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704832
00000100:00100000:1.0:1767319224.280059:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202
00000100:00100000:1.0:1767319224.280065:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379704832:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319224.280088:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319224.280119:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379704832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (172us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319224.280125:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202
00000100:00080000:1.0:1767319224.280147:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319224.280174:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379704832:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319224.792573:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319225.815256:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319225.816162:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379704960:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319225.816227:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319225.816420:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379704960
00000100:00100000:2.0:1767319225.816429:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379704960
00000100:00100000:2.0:1767319225.816633:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203
00000100:00100000:2.0:1767319225.816645:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379704960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319225.816673:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319225.816729:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379704960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (501us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319225.816736:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203
00000100:00100000:3.0:1767319225.816823:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379704960:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319225.816933:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319226.839151:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319227.353290:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319227.353300:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319227.353312:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319227.353316:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319227.353321:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319227.353330:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4124
00000100:00080000:1.0:1767319227.353334:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319227.353341:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319227.353388:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc000 x1853164379705088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319227.353416:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319227.353420:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319227.353421:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319227.353426:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4124
00000100:00100000:0.0:1767319227.353567:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379705088:0@lo:38:kworker.0
00000100:00100000:0.0:1767319227.353641:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319227.353778:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705088
00000100:00100000:2.0:1767319227.353786:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705088
00000100:00100000:2.0:1767319227.353825:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16792
00000100:00100000:2.0:1767319227.353832:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379705088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319227.353852:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319227.353928:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379705088:12345-0@lo:38:kworker.0 Request processed in 95us (287us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319227.353934:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16792
00000100:00080000:0.0:1767319227.354072:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319227.354077:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319227.354080:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379705088:0@lo:38:kworker.0
00000100:00080000:1.0:1767319227.354223:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319227.354229:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319227.354249:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcea00 x1853164379705216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319227.354382:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379705472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319227.354417:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319227.354447:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319227.354454:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379705344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319227.354477:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319227.354513:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379705216:0@lo:38:kworker.0
00000100:00100000:0.0:1767319227.354545:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319227.354620:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705472
00000100:00100000:3.0:1767319227.354625:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705472
00000100:00100000:3.0:1767319227.354674:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705344
00000100:00100000:3.0:1767319227.354678:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705344
00000100:00100000:3.0:1767319227.354698:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443
00000100:00100000:3.0:1767319227.354705:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379705472:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319227.354911:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319227.354916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319227.354968:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379705472:12345-0@lo:400:kworker.0 Request processed in 49us (337us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319227.354978:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443
00000100:00100000:3.0:1767319227.354993:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444
00000100:00100000:3.0:1767319227.355000:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379705344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319227.355031:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379705344:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319227.355037:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444
00000100:00100000:3.0:1767319227.355066:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379705344:0@lo:400:kworker.0
00000100:00100000:3.0:1767319227.355075:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379705472:0@lo:400:kworker.0
00000100:00080000:1.0:1767319227.355193:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319227.355197:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319227.355200:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319227.355205:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4124
00000100:00080000:1.0:1767319227.355207:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319227.355211:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319227.355228:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164379705728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319227.355250:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319227.355253:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319227.355255:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319227.355258:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4124
00000100:00080000:1.0:1767319227.355261:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319227.355265:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319227.355276:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164379705984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319227.355385:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379705856:0@lo:400:kworker.0
00000100:00100000:0.0:1767319227.355416:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319227.355434:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319227.355440:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379705600:0@lo:400:kworker.0
00000100:00100000:0.0:1767319227.355460:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319227.355482:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379705728:0@lo:38:kworker.0
00000100:00100000:0.0:1767319227.355501:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319227.355515:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379705984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319227.355543:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319227.355653:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705216
00000100:00100000:2.0:1767319227.355658:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705216
00000100:00100000:2.0:1767319227.355689:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960
00000100:00100000:2.0:1767319227.355694:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379705216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319227.355710:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319227.355956:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705856
00000100:00100000:0.0:1767319227.355961:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705856
00000100:00100000:0.0:1767319227.355997:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705600
00000100:00100000:0.0:1767319227.356000:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705600
00000100:00100000:0.0:1767319227.356018:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705728
00000100:00100000:0.0:1767319227.356021:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705728
00000100:00100000:0.0:1767319227.356029:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379705984
00000100:00100000:0.0:1767319227.356031:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379705984
00000100:00100000:0.0:1767319227.356041:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117
00000100:00100000:0.0:1767319227.356047:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379705856:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319227.356085:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379705856:12345-0@lo:400:kworker.0 Request processed in 38us (668us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319227.356092:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117
00000100:00100000:0.0:1767319227.356105:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118
00000100:00100000:0.0:1767319227.356111:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379705600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319227.356135:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379705600:12345-0@lo:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319227.356139:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118
00000100:00100000:0.0:1767319227.356150:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16793
00000100:00100000:0.0:1767319227.356154:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379705728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319227.356164:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319227.356183:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379705728:12345-0@lo:38:kworker.0 Request processed in 27us (680us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319227.356188:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16793
00000100:00100000:0.0:1767319227.356196:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16794
00000100:00100000:0.0:1767319227.356199:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379705984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319227.356206:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319227.356223:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379705984:12345-0@lo:38:kworker.0 Request processed in 22us (679us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319227.356228:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16794
00000100:00080000:0.0:1767319227.356240:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319227.356259:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379705600:0@lo:400:kworker.0
00000100:00100000:0.0:1767319227.356268:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379705856:0@lo:400:kworker.0
00000100:00100000:2.0:1767319227.356414:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379705216:12345-0@lo:38:kworker.0 Request processed in 60us (1208us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319227.356422:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960
00000100:00080000:1.0:1767319227.356488:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319227.356493:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319227.356496:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379705728:0@lo:38:kworker.0
00000100:00080000:1.0:1767319227.356504:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319227.356507:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319227.356510:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379705984:0@lo:38:kworker.0
00000100:00080000:1.0:1767319227.356518:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319227.356521:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319227.356523:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379705216:0@lo:38:kworker.0
00010000:00010000:3.0:1767319227.863491:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319228.887087:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319229.327238:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319229.327280:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319229.327354:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291905408
00000100:00100000:0.0:1767319229.327375:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291905408
00000100:00100000:0.0:1767319229.327420:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291905536
00000100:00100000:0.0:1767319229.327424:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291905536
00000100:00100000:0.0:1767319229.327483:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4119
00000100:00100000:0.0:1767319229.327493:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291905536:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767319229.327559:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319229.327584:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291905536:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319229.327594:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4119
00000100:00100000:1.0:1767319229.327603:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16795
00000100:00100000:1.0:1767319229.327611:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291905408:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319229.327634:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319229.327668:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291905408:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 56us (439us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319229.327675:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16795
00000100:00100000:1.0:1767319229.403101:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319229.403125:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379706112:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319229.403193:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319229.403478:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379706112
00000100:00100000:0.0:1767319229.403487:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379706112
00000100:00100000:0.0:1767319229.403559:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204
00000100:00100000:0.0:1767319229.403568:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379706112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319229.403599:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319229.403662:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379706112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (469us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319229.403669:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204
00000100:00080000:1.0:1767319229.403760:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319229.403852:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379706112:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319229.911083:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319230.935285:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379706240:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319230.935373:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319230.935906:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319230.936241:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379706240
00000100:00100000:2.0:1767319230.936250:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379706240
00000100:00080000:1.0:1767319230.936308:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319230.936371:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205
00000100:00100000:2.0:1767319230.936382:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379706240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319230.936434:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319230.936494:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379706240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1120us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319230.936516:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205
00000100:00100000:3.0:1767319230.936599:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379706240:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319231.959029:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319232.471316:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319232.471328:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319232.471331:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319232.471335:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319232.471340:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319232.471348:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4129
00000100:00080000:0.0:1767319232.471448:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319232.471457:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319232.471599:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164379706368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319232.471627:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319232.471630:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319232.471632:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319232.471635:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4129
00000100:00080000:0.0:1767319232.471638:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319232.471641:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319232.471655:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6300 x1853164379706496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319232.471723:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319232.471958:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379706368:0@lo:38:kworker.0
00000100:00100000:1.0:1767319232.472036:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319232.472094:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379706496:0@lo:38:kworker.0
00000100:00100000:1.0:1767319232.472122:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319232.472142:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379706368
00000100:00100000:3.0:1767319232.472161:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379706368
00000100:00100000:3.0:1767319232.472218:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16796
00000100:00100000:3.0:1767319232.472227:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379706368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319232.472251:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319232.472321:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379706368:12345-0@lo:38:kworker.0 Request processed in 84us (274us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319232.472329:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16796
00000100:00080000:3.0:1767319232.472373:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319232.472378:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319232.472381:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379706368:0@lo:38:kworker.0
00000100:00100000:3.0:1767319232.472419:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379706496
00000100:00100000:3.0:1767319232.472423:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379706496
00000100:00100000:3.0:1767319232.472446:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961
00000100:00100000:3.0:1767319232.472450:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379706496:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319232.472460:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319232.472501:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379706496:12345-0@lo:38:kworker.0 Request processed in 49us (379us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319232.472507:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961
00000100:00080000:3.0:1767319232.472531:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319232.472535:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319232.472537:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379706496:0@lo:38:kworker.0
00000100:00100000:3.0:1767319232.477893:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379706752:0@lo:400:kworker.0
00000100:00100000:3.0:1767319232.477974:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319232.478015:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379706624:0@lo:400:kworker.0
00000100:00080000:0.0:1767319232.478032:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319232.478040:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1767319232.478040:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319232.478046:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319232.478054:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4129
00000100:00080000:0.0:1767319232.478059:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319232.478066:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319232.478080:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379706752
00000100:00100000:0.0:1767319232.478089:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288a80 x1853164379707008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319232.478089:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379706752
00000100:00080000:0.0:1767319232.478123:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319232.478126:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319232.478129:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319232.478133:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4129
00000100:00080000:0.0:1767319232.478136:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767319232.478139:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379706624
00000100:00080000:0.0:1767319232.478141:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319232.478143:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379706624
00000100:00100000:0.0:1767319232.478155:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a300 x1853164379707264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319232.478179:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445
00000100:00100000:3.0:1767319232.478187:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379706752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319232.478235:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379706752:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319232.478242:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445
00000100:00100000:3.0:1767319232.478257:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446
00000100:00100000:3.0:1767319232.478262:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379706624:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319232.478284:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379706624:12345-0@lo:400:kworker.0 Request processed in 22us (246us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319232.478293:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446
00000100:00080000:1.0:1767319232.478417:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319232.478421:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319232.478456:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379707008:0@lo:38:kworker.0
00000100:00100000:0.0:1767319232.478586:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319232.478617:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379707264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319232.478644:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319232.478699:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379706752:0@lo:400:kworker.0
00000100:00100000:0.0:1767319232.478710:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379706624:0@lo:400:kworker.0
00000100:00100000:3.0:1767319232.478715:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379707136:0@lo:400:kworker.0
00000100:00100000:3.0:1767319232.478747:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319232.478748:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707008
00000100:00100000:0.0:1767319232.478753:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707008
00000100:00100000:3.0:1767319232.478771:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319232.478780:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707264
00000100:00100000:3.0:1767319232.478780:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379706880:0@lo:400:kworker.0
00000100:00100000:0.0:1767319232.478785:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707264
00000100:00100000:3.0:1767319232.478804:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319232.478969:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707136
00000100:00100000:0.0:1767319232.478974:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707136
00000100:00100000:3.0:1767319232.478986:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379706880
00000100:00100000:3.0:1767319232.478991:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379706880
00000100:00100000:0.0:1767319232.479025:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120
00000100:00100000:3.0:1767319232.479033:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121
00000100:00100000:0.0:1767319232.479038:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379707136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319232.479045:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379706880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319232.479098:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379707136:12345-0@lo:400:kworker.0 Request processed in 62us (348us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319232.479098:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379706880:12345-0@lo:400:kworker.0 Request processed in 55us (291us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319232.479114:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120
00000100:00100000:3.0:1767319232.479120:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121
00000100:00100000:0.0:1767319232.479137:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16797
00000100:00100000:0.0:1767319232.479146:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379707008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319232.479176:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319232.479208:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379707008:12345-0@lo:38:kworker.0 Request processed in 64us (707us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319232.479216:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16798
00000100:00100000:0.0:1767319232.479225:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16797
00000100:00100000:3.0:1767319232.479226:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379707264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319232.479240:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319232.479262:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319232.479269:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319232.479275:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379707008:0@lo:38:kworker.0
00000100:00100000:3.0:1767319232.479276:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379707264:12345-0@lo:38:kworker.0 Request processed in 49us (629us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319232.479287:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16798
00000100:00080000:0.0:1767319232.479290:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319232.479295:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319232.479299:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379707264:0@lo:38:kworker.0
00000100:00080000:0.0:1767319232.479330:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319232.479335:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379706880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319232.479347:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379707136:0@lo:400:kworker.0
00010000:00010000:1.0:1767319232.984187:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319234.007111:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319234.450272:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319234.450336:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319234.450441:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291905792
00000100:00100000:2.0:1767319234.450451:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291905792
00000100:00100000:2.0:1767319234.450543:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291905664
00000100:00100000:2.0:1767319234.450546:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291905664
00000100:00100000:2.0:1767319234.450567:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4122
00000100:00100000:2.0:1767319234.450591:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291905792:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319234.450686:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291905792:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (427us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319234.450695:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4122
00000100:00100000:2.0:1767319234.450716:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16799
00000100:00100000:2.0:1767319234.450721:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291905664:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319234.450740:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319234.450766:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291905664:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (430us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319234.450772:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16799
00000100:00080000:0.0:1767319234.451083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319234.519170:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319234.519191:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379707392:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319234.519264:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319234.524452:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707392
00000100:00100000:1.0:1767319234.524480:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707392
00000100:00100000:1.0:1767319234.524570:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206
00000100:00100000:1.0:1767319234.524583:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379707392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319234.524620:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319234.524724:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379707392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (5460us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319234.524740:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206
00000100:00100000:0.0:1767319234.524789:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379707392:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319234.524854:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319235.031292:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319236.056184:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319236.056433:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379707520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319236.056546:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319236.057021:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707520
00000100:00100000:1.0:1767319236.057030:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707520
00000100:00100000:1.0:1767319236.057103:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207
00000100:00100000:1.0:1767319236.057112:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379707520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319236.057151:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767319236.057228:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319236.057692:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379707520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 580us (1145us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319236.057701:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207
00000100:00100000:3.0:1767319236.058059:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379707520:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319237.079129:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319237.591224:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319237.591237:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319237.591241:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319237.591245:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319237.591250:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319237.591260:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4134
00000100:00080000:1.0:1767319237.591266:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319237.591275:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319237.591331:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce680 x1853164379707648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319237.591359:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319237.591363:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319237.591365:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319237.591369:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4134
00000100:00080000:1.0:1767319237.591371:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319237.591375:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319237.591389:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcfb80 x1853164379707776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319237.591466:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319237.591469:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379707904:0@lo:400:kworker.0
00000100:00080000:1.0:1767319237.591470:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319237.591471:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319237.591475:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4134
00000100:00080000:1.0:1767319237.591477:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319237.591480:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319237.591490:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc000 x1853164379708288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319237.591504:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319237.591507:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319237.591509:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319237.591512:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4134
00000100:00080000:1.0:1767319237.591515:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319237.591518:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319237.591527:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebed80 x1853164379708544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319237.591535:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319237.591547:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379708160:0@lo:400:kworker.0
00000100:00100000:1.0:1767319237.591578:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319237.591600:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319237.591600:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319237.591607:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379708416:0@lo:400:kworker.0
00000100:00100000:3.0:1767319237.591607:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379708032:0@lo:400:kworker.0
00000100:00100000:2.0:1767319237.591680:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379707648:0@lo:38:kworker.0
00000100:00100000:0.0:1767319237.591736:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708160
00000100:00100000:0.0:1767319237.591744:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708160
00000100:00100000:0.0:1767319237.591812:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123
00000100:00100000:0.0:1767319237.591834:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379708160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319237.592639:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319237.592689:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708416
00000100:00100000:1.0:1767319237.592694:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708416
00000100:00100000:1.0:1767319237.592733:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124
00000100:00100000:1.0:1767319237.592741:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379708416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319237.592785:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379708416:12345-0@lo:400:kworker.0 Request processed in 44us (147us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319237.592793:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124
00000100:00100000:1.0:1767319237.592855:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379708416:0@lo:400:kworker.0
00000100:00100000:1.0:1767319237.592934:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707904
00000100:00100000:1.0:1767319237.592939:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707904
00000100:00100000:1.0:1767319237.592968:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447
00000100:00100000:1.0:1767319237.592975:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379707904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319237.593010:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379707904:12345-0@lo:400:kworker.0 Request processed in 36us (1474us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319237.593017:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447
00000100:00080000:1.0:1767319237.593047:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319237.593053:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319237.595446:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319237.595539:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379707904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319237.597360:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708032
00000100:00100000:1.0:1767319237.597373:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708032
00000100:00100000:1.0:1767319237.597459:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448
00000100:00100000:1.0:1767319237.597470:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379708032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319237.597560:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379708032:12345-0@lo:400:kworker.0 Request processed in 92us (2131us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319237.597568:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448
00000100:00100000:3.0:1767319237.597598:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379708032:0@lo:400:kworker.0
00000100:00100000:2.0:1767319237.603117:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319237.603173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379707776:0@lo:38:kworker.0
00000100:00100000:2.0:1767319237.603202:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319237.603244:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379708288:0@lo:38:kworker.0
00000100:00100000:2.0:1767319237.603265:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319237.603284:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379708544:0@lo:38:kworker.0
00000100:00100000:2.0:1767319237.603301:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319237.603342:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707648
00000100:00100000:2.0:1767319237.603349:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707648
00000100:00100000:2.0:1767319237.603381:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708288
00000100:00100000:2.0:1767319237.603383:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708288
00000100:00100000:2.0:1767319237.603393:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708544
00000100:00100000:2.0:1767319237.603395:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708544
00000100:00100000:2.0:1767319237.603406:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16800
00000100:00100000:2.0:1767319237.603412:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379707648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319237.603433:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319237.603487:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379707648:12345-0@lo:38:kworker.0 Request processed in 73us (376us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319237.603494:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16800
00000100:00100000:2.0:1767319237.603510:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16801
00000100:00100000:2.0:1767319237.603514:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379708288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319237.603522:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319237.603544:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379708288:12345-0@lo:38:kworker.0 Request processed in 28us (278us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319237.603549:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16801
00000100:00100000:2.0:1767319237.603559:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16802
00000100:00100000:2.0:1767319237.603563:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379708544:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319237.603571:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319237.603591:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379708544:12345-0@lo:38:kworker.0 Request processed in 26us (289us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319237.603595:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16802
00000100:00080000:2.0:1767319237.603636:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319237.603642:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319237.603645:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379707648:0@lo:38:kworker.0
00000100:00080000:2.0:1767319237.603654:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319237.603657:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319237.603660:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379708288:0@lo:38:kworker.0
00000100:00080000:2.0:1767319237.603667:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319237.603670:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319237.603673:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379708544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319237.603786:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379707776
00000100:00100000:3.0:1767319237.603790:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379707776
00000100:00100000:3.0:1767319237.603820:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962
00000100:00100000:3.0:1767319237.603825:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379707776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319237.603835:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319237.603909:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379707776:12345-0@lo:38:kworker.0 Request processed in 44us (667us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319237.603918:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962
00000100:00080000:2.0:1767319237.604159:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319237.604164:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319237.604167:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379707776:0@lo:38:kworker.0
00000100:00100000:0.0:1767319237.604470:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379708160:12345-0@lo:400:kworker.0 Request processed in 12649us (12889us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319237.604479:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123
00000100:00100000:1.0:1767319237.604558:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379708160:0@lo:400:kworker.0
00010000:00010000:1.0:1767319238.106001:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767319238.552273:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291905920 offset 0 length 520: 4
00000100:00100000:0.0:1767319238.552313:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319238.552357:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319238.552423:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906176
00000100:00100000:3.0:1767319238.552441:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906176
00000100:00100000:3.0:1767319238.552510:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906048
00000100:00100000:3.0:1767319238.552513:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906048
00000100:00100000:3.0:1767319238.552530:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4125
00000100:00100000:3.0:1767319238.552540:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291906176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319238.552612:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291906176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (298us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319238.552619:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4125
00000100:00100000:3.0:1767319238.552639:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16803
00000100:00100000:3.0:1767319238.552645:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291906048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319238.552668:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319238.552697:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291906048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (339us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319238.552704:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16803
00000100:00080000:2.0:1767319238.553009:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319239.127144:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319239.639320:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319239.639343:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379708672:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319239.639428:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319239.639636:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708672
00000100:00100000:1.0:1767319239.639646:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708672
00000100:00100000:1.0:1767319239.639765:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208
00000100:00100000:1.0:1767319239.639776:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379708672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319239.639809:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319239.639863:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379708672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (444us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319239.639894:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208
00000100:00080000:2.0:1767319239.639948:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319239.641574:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379708672:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319240.151454:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319241.176642:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319241.176663:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379708800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319241.176740:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319241.176912:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708800
00000100:00100000:0.0:1767319241.176920:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708800
00000100:00100000:0.0:1767319241.176982:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209
00000100:00100000:0.0:1767319241.176991:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379708800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319241.177016:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319241.177062:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379708800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (322us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319241.177069:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209
00000100:00100000:0.0:1767319241.177118:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379708800:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319241.178006:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319241.178293:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319242.199282:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319242.710982:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319242.710992:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319242.710995:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319242.711000:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319242.711004:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319242.711011:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4139
00000100:00080000:1.0:1767319242.711017:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319242.711024:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319242.711063:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681180 x1853164379708928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319242.711090:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319242.711093:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319242.711095:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319242.711099:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4139
00000100:00080000:1.0:1767319242.711101:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319242.711105:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319242.711118:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681f80 x1853164379709056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319242.711192:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319242.711195:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319242.711197:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319242.711201:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4139
00000100:00080000:1.0:1767319242.711203:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319242.711207:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319242.711220:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebed80 x1853164379709568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319242.711235:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319242.711238:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319242.711240:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319242.711243:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4139
00000100:00080000:1.0:1767319242.711246:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319242.711250:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319242.711260:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebca80 x1853164379709824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319242.711315:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379709440:0@lo:400:kworker.0
00000100:00100000:1.0:1767319242.711382:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319242.711473:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319242.711479:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379709696:0@lo:400:kworker.0
00000100:00100000:1.0:1767319242.711499:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319242.711527:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379709440
00000100:00100000:1.0:1767319242.711533:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379709440
00000100:00100000:1.0:1767319242.711575:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379709696
00000100:00100000:1.0:1767319242.711578:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379709696
00000100:00100000:1.0:1767319242.711597:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126
00000100:00100000:1.0:1767319242.711604:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379709440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319242.711819:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379709440:12345-0@lo:400:kworker.0 Request processed in 214us (436us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319242.711827:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126
00000100:00100000:1.0:1767319242.711849:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127
00000100:00100000:1.0:1767319242.711855:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379709696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319242.711908:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379709696:12345-0@lo:400:kworker.0 Request processed in 53us (407us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319242.711913:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127
00000100:00100000:1.0:1767319242.711949:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379709696:0@lo:400:kworker.0
00000100:00100000:1.0:1767319242.711958:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379709440:0@lo:400:kworker.0
00000100:00100000:3.0:1767319242.712058:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379709312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319242.712093:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319242.712129:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319242.712134:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379709184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319242.712155:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319242.712194:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379709312
00000100:00100000:3.0:1767319242.712198:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379709312
00000100:00100000:3.0:1767319242.712226:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379709184
00000100:00100000:3.0:1767319242.712229:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379709184
00000100:00100000:3.0:1767319242.712250:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449
00000100:00100000:3.0:1767319242.712257:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379709312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319242.712293:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379709312:12345-0@lo:400:kworker.0 Request processed in 37us (200us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319242.712299:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449
00000100:00100000:3.0:1767319242.712322:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450
00000100:00100000:3.0:1767319242.712328:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379709184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319242.712354:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379709184:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319242.712360:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450
00000100:00100000:3.0:1767319242.712398:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379709184:0@lo:400:kworker.0
00000100:00100000:3.0:1767319242.712410:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379709312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319242.713134:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319217/real 1767319217]  req@ffff8b0e0c44bb80 x1853164379702400/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319242 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319242.713158:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c44bb80 x1853164379702400/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319242 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319242.713173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379708928:0@lo:38:kworker.0
00000100:00100000:0.0:1767319242.713211:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319242.713238:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379709056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319242.713261:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319242.713287:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379709568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319242.713897:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319242.713920:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379709824:0@lo:38:kworker.0
00000100:00100000:0.0:1767319242.713941:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319242.713956:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319242.713968:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319242.713971:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379702400:0@lo:250:kworker.0
00000100:00100000:0.0:1767319242.714010:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379709056
00000100:00100000:0.0:1767319242.714016:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379709056
00000100:00100000:0.0:1767319242.714040:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963
00000100:00100000:0.0:1767319242.714045:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379709056:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319242.714064:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319242.714099:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379709056:12345-0@lo:38:kworker.0 Request processed in 53us (837us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319242.714106:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963
00000100:00100000:0.0:1767319242.714130:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379708928
00000100:00100000:0.0:1767319242.714133:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379708928
00000100:00100000:0.0:1767319242.714149:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379709568
00000100:00100000:0.0:1767319242.714153:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379709568
00000100:00100000:0.0:1767319242.714163:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379709824
00000100:00100000:0.0:1767319242.714166:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379709824
00000100:00100000:0.0:1767319242.714174:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16804
00000100:00100000:0.0:1767319242.714179:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379708928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319242.714188:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319242.714213:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379708928:12345-0@lo:38:kworker.0 Request processed in 33us (1002us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319242.714219:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16804
00000100:00100000:0.0:1767319242.714230:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16805
00000100:00100000:0.0:1767319242.714234:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379709568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319242.714243:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319242.714264:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379709568:12345-0@lo:38:kworker.0 Request processed in 29us (368us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319242.714270:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16805
00000100:00100000:0.0:1767319242.714280:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16806
00000100:00100000:0.0:1767319242.714283:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379709824:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767319242.714581:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319242.714586:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319242.714589:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379708928:0@lo:38:kworker.0
00000100:00080000:3.0:1767319242.714599:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319242.714602:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319242.714605:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379709056:0@lo:38:kworker.0
00000100:00080000:3.0:1767319242.714611:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319242.714625:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319242.714628:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379709568:0@lo:38:kworker.0
00010000:00020000:0.0:1767319242.714750:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319242.714787:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379709824:12345-0@lo:38:kworker.0 Request processed in 502us (845us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319242.714794:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16806
00000100:00080000:2.0:1767319242.714901:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319242.714907:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319242.714991:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319242.714996:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319242.714999:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319242.715003:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4119
00000100:00080000:1.0:1767319242.715007:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319242.715011:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319242.715034:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164379709952/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319242.715173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379709952:0@lo:250:kworker.0
00000400:00000100:3.0:1767319242.715198:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379709952 offset 0 length 520: 4
00000100:00080000:3.0:1767319242.715227:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319242.715230:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319242.715233:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379709824:0@lo:38:kworker.0
00010000:00010000:1.0:1767319243.224082:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319243.664743:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319243.664917:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906432
00000100:00100000:2.0:1767319243.664929:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906432
00000100:00100000:2.0:1767319243.665029:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4128
00000100:00100000:2.0:1767319243.665041:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291906432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767319243.665104:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319243.665138:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291906432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 100us (408us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319243.665148:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4128
00000100:00100000:0.0:1767319243.670456:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319243.672511:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906304
00000100:00100000:1.0:1767319243.672528:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906304
00000100:00100000:1.0:1767319243.672597:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16807
00000100:00100000:1.0:1767319243.672606:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291906304:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319243.672636:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319243.672727:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291906304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 120us (2286us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319243.672735:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16807
00010000:00010000:3.0:1767319244.247100:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319244.759143:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379710080:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319244.759214:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319244.759346:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710080
00000100:00100000:3.0:1767319244.759355:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710080
00000100:00100000:3.0:1767319244.759444:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210
00000100:00100000:3.0:1767319244.759455:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379710080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319244.759496:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319244.759554:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379710080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319244.759561:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210
00000100:00080000:2.0:1767319244.759684:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319244.759722:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379710080:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319245.271896:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319246.298802:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379710208:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319246.298907:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319246.299055:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710208
00000100:00100000:1.0:1767319246.299064:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710208
00000100:00100000:1.0:1767319246.299133:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211
00000100:00100000:1.0:1767319246.299142:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379710208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319246.299176:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319246.299234:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379710208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319246.299245:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211
00010000:00010000:2.0:1767319246.299549:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319246.303610:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319246.303713:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379710208:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319247.319384:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319247.833846:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319247.833858:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319247.833861:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319247.833865:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319247.833881:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319247.833889:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4145
00000100:00080000:0.0:1767319247.833894:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319247.833901:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319247.833942:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28bb80 x1853164379710336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319247.833973:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319247.833978:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319247.833979:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319247.833983:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4145
00000100:00080000:0.0:1767319247.833985:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319247.833988:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319247.834002:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288a80 x1853164379710464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319247.834070:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319247.834073:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319247.834075:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319247.834078:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4145
00000100:00080000:0.0:1767319247.834081:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319247.834084:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319247.834094:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288e00 x1853164379710976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319247.834101:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379710720:0@lo:400:kworker.0
00000100:00080000:0.0:1767319247.834108:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319247.834111:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319247.834113:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319247.834115:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4145
00000100:00080000:0.0:1767319247.834117:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319247.834121:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319247.834131:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333b80 x1853164379711232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319247.834153:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379711104:0@lo:400:kworker.0
00000100:00100000:0.0:1767319247.834183:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319247.834183:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319247.834236:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379710592:0@lo:400:kworker.0
00000100:00100000:3.0:1767319247.834245:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379710336:0@lo:38:kworker.0
00000100:00100000:2.0:1767319247.837144:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379710848:0@lo:400:kworker.0
00000100:00100000:2.0:1767319247.837575:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319247.837625:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379711104
00000100:00100000:2.0:1767319247.837633:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379711104
00000100:00100000:2.0:1767319247.837686:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710848
00000100:00100000:2.0:1767319247.837689:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710848
00000100:00100000:2.0:1767319247.837805:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4129
00000100:00100000:2.0:1767319247.837819:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379711104:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319247.838651:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379711104:12345-0@lo:400:kworker.0 Request processed in 832us (4463us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319247.838662:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4129
00000100:00100000:2.0:1767319247.838689:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4130
00000100:00100000:2.0:1767319247.838698:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379710848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319247.838760:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379710848:12345-0@lo:400:kworker.0 Request processed in 64us (1185us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319247.838767:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4130
00000100:00080000:2.0:1767319247.838796:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319247.838834:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379710848:0@lo:400:kworker.0
00000100:00100000:2.0:1767319247.838899:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710720
00000100:00100000:2.0:1767319247.838905:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710720
00000100:00100000:2.0:1767319247.838952:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451
00000100:00100000:2.0:1767319247.838960:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379710720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319247.838998:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379710720:12345-0@lo:400:kworker.0 Request processed in 39us (4815us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319247.839004:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451
00000100:00100000:2.0:1767319247.839032:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379710720:0@lo:400:kworker.0
00000100:00100000:0.0:1767319247.839577:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379711104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319247.843823:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319247.844591:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710592
00000100:00100000:2.0:1767319247.844602:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710592
00000100:00100000:2.0:1767319247.844683:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452
00000100:00100000:2.0:1767319247.844694:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379710592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319247.844766:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379710592:12345-0@lo:400:kworker.0 Request processed in 75us (954us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319247.844773:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452
00000100:00080000:0.0:1767319247.844846:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319247.845551:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379710592:0@lo:400:kworker.0
00000100:00100000:3.0:1767319247.846474:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319247.846527:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379710464:0@lo:38:kworker.0
00000100:00100000:3.0:1767319247.846566:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319247.846598:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379710976:0@lo:38:kworker.0
00000100:00100000:3.0:1767319247.846617:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319247.846642:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379711232:0@lo:38:kworker.0
00000100:00100000:3.0:1767319247.846658:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319247.846698:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710336
00000100:00100000:3.0:1767319247.846703:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710336
00000100:00100000:3.0:1767319247.846729:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710976
00000100:00100000:3.0:1767319247.846731:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710976
00000100:00100000:3.0:1767319247.846742:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379711232
00000100:00100000:3.0:1767319247.846744:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379711232
00000100:00100000:3.0:1767319247.846756:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16808
00000100:00100000:3.0:1767319247.846762:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379710336:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319247.846782:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319247.846818:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379710336:12345-0@lo:38:kworker.0 Request processed in 54us (347us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319247.846824:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16808
00000100:00100000:3.0:1767319247.846837:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16809
00000100:00100000:3.0:1767319247.846840:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379710976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319247.846849:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319247.846866:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379710976:12345-0@lo:38:kworker.0 Request processed in 24us (248us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319247.846887:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16809
00000100:00100000:3.0:1767319247.846897:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16810
00000100:00100000:3.0:1767319247.846900:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379711232:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319247.846920:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319247.846939:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379711232:12345-0@lo:38:kworker.0 Request processed in 38us (280us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319247.846945:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16810
00000100:00080000:3.0:1767319247.846981:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319247.846986:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319247.846990:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379710336:0@lo:38:kworker.0
00000100:00080000:3.0:1767319247.846996:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319247.847000:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319247.847003:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379710976:0@lo:38:kworker.0
00000100:00080000:3.0:1767319247.847009:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319247.847011:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319247.847014:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379711232:0@lo:38:kworker.0
00000100:00100000:0.0:1767319247.847172:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379710464
00000100:00100000:0.0:1767319247.847177:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379710464
00000100:00100000:0.0:1767319247.847198:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964
00000100:00100000:0.0:1767319247.847203:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379710464:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319247.847213:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319247.847251:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379710464:12345-0@lo:38:kworker.0 Request processed in 47us (684us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319247.847257:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964
00000100:00080000:3.0:1767319247.847584:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319247.847589:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319247.847592:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379710464:0@lo:38:kworker.0
00010000:00010000:1.0:1767319248.343845:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319248.783493:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319248.785913:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319248.790790:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906560
00000100:00100000:2.0:1767319248.790805:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906560
00000100:00100000:2.0:1767319248.791057:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906688
00000100:00100000:2.0:1767319248.791062:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906688
00000100:00100000:2.0:1767319248.791153:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4131
00000100:00100000:2.0:1767319248.791177:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291906688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319248.791286:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291906688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 123us (5380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319248.791294:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4131
00000100:00100000:2.0:1767319248.791315:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16811
00000100:00100000:2.0:1767319248.791320:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291906560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319248.791351:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319248.791378:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291906560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (7895us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319248.791385:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16811
00000100:00080000:0.0:1767319248.792442:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319249.367536:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319249.881809:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319249.881841:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379711360:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319249.881933:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319249.884668:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379711360
00000100:00100000:3.0:1767319249.884685:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379711360
00000100:00100000:3.0:1767319249.884776:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212
00000100:00100000:3.0:1767319249.884788:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379711360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319249.884824:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319249.884963:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379711360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 177us (3028us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319249.884970:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212
00000100:00100000:2.0:1767319249.885001:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379711360:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319249.885855:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319250.392849:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319251.416562:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319251.416586:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379711488:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319251.416655:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319251.416729:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379711488
00000100:00100000:1.0:1767319251.416737:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379711488
00000100:00100000:1.0:1767319251.416801:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213
00000100:00100000:1.0:1767319251.416810:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379711488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319251.416837:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319251.416900:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379711488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (245us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319251.416909:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213
00000100:00080000:1.0:1767319251.416933:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319251.416966:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379711488:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319251.417283:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319252.439217:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319252.951164:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319252.951173:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319252.951177:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319252.951181:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319252.951185:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319252.951199:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4150
00000100:00080000:2.0:1767319252.951204:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319252.951210:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319252.951327:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44bb80 x1853164379711616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319252.951354:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319252.951358:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319252.951359:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319252.951363:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4150
00000100:00080000:2.0:1767319252.951365:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319252.951368:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319252.951383:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288a80 x1853164379711744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319252.951462:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379711872:0@lo:400:kworker.0
00000100:00100000:3.0:1767319252.951533:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319252.951638:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379711872
00000100:00100000:0.0:1767319252.951647:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379711872
00000100:00100000:0.0:1767319252.951722:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453
00000100:00100000:0.0:1767319252.951731:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379711872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319252.951815:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379711616:0@lo:38:kworker.0
00000100:00100000:1.0:1767319252.951846:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319252.951886:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379711744:0@lo:38:kworker.0
00000100:00100000:1.0:1767319252.951911:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319252.951948:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379711616
00000100:00100000:1.0:1767319252.951952:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379711616
00000100:00100000:1.0:1767319252.951975:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16812
00000100:00100000:1.0:1767319252.951980:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379711616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319252.951999:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319252.952033:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379711616:12345-0@lo:38:kworker.0 Request processed in 52us (186us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319252.952040:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16812
00000100:00080000:1.0:1767319252.952077:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319252.952081:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319252.952084:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379711616:0@lo:38:kworker.0
00000100:00080000:1.0:1767319252.952120:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319252.952139:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379711744
00000100:00100000:1.0:1767319252.952142:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379711744
00000100:00100000:1.0:1767319252.952163:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965
00000100:00100000:1.0:1767319252.952168:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379711744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319252.952177:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319252.952206:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379711744:12345-0@lo:38:kworker.0 Request processed in 37us (294us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319252.952225:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965
00000100:00080000:1.0:1767319252.952250:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319252.952254:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319252.952257:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379711744:0@lo:38:kworker.0
00000100:00100000:1.0:1767319252.953894:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379712000:0@lo:400:kworker.0
00000100:00100000:1.0:1767319252.953950:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319252.954006:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712000
00000100:00100000:1.0:1767319252.954012:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712000
00000100:00100000:1.0:1767319252.954054:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454
00000100:00100000:1.0:1767319252.954062:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379712000:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319252.954110:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379712000:12345-0@lo:400:kworker.0 Request processed in 49us (159us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319252.954116:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454
00000100:00100000:1.0:1767319252.954157:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379712000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319252.954475:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379711872:12345-0@lo:400:kworker.0 Request processed in 2744us (2940us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319252.954483:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453
00000100:00100000:3.0:1767319252.959499:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379711872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319252.960553:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379712128:0@lo:400:kworker.0
00000100:00100000:1.0:1767319252.960631:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319252.960704:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319252.960710:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319252.960714:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319252.960719:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4150
00000100:00080000:2.0:1767319252.960723:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319252.960729:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319252.960753:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289f80 x1853164379712256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319252.960829:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379712384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319252.960861:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319252.960932:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712128
00000100:00100000:0.0:1767319252.960939:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712128
00000100:00100000:0.0:1767319252.960990:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712384
00000100:00100000:0.0:1767319252.960994:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712384
00000100:00100000:0.0:1767319252.961020:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4132
00000100:00100000:0.0:1767319252.961028:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379712128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319252.961115:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4133
00000100:00100000:3.0:1767319252.961126:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379712384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319252.961169:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379712384:12345-0@lo:400:kworker.0 Request processed in 45us (307us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319252.961176:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4133
00000100:00100000:3.0:1767319252.961237:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379712256:0@lo:38:kworker.0
00000100:00100000:3.0:1767319252.961263:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319252.961290:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712256
00000100:00100000:3.0:1767319252.961302:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712256
00000100:00100000:3.0:1767319252.961320:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16813
00000100:00100000:3.0:1767319252.961325:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379712256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319252.961343:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319252.961376:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379712256:12345-0@lo:38:kworker.0 Request processed in 50us (112us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319252.961383:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16813
00000100:00080000:3.0:1767319252.961417:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319252.961422:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319252.961425:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379712256:0@lo:38:kworker.0
00000100:00080000:3.0:1767319252.961457:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319252.961488:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379712384:0@lo:400:kworker.0
00000100:00080000:2.0:1767319252.965448:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319252.965460:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319252.965464:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319252.965472:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4150
00000100:00080000:2.0:1767319252.965476:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319252.965484:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319252.965523:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a300 x1853164379712512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319252.967841:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379712512:0@lo:38:kworker.0
00000100:00100000:3.0:1767319252.967984:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319252.968380:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712512
00000100:00100000:2.0:1767319252.968389:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712512
00000100:00100000:2.0:1767319252.968434:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16814
00000100:00100000:2.0:1767319252.968441:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379712512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319252.968463:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319252.968515:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379712512:12345-0@lo:38:kworker.0 Request processed in 73us (530us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319252.968522:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16814
00000100:00080000:2.0:1767319252.968567:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319252.968572:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319252.968577:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379712512:0@lo:38:kworker.0
00000100:00100000:0.0:1767319252.974501:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379712128:12345-0@lo:400:kworker.0 Request processed in 13462us (13858us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319252.974518:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4132
00000100:00100000:1.0:1767319252.976519:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379712128:0@lo:400:kworker.0
00010000:00010000:1.0:1767319253.463459:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319253.904688:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319253.905012:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906816
00000100:00100000:1.0:1767319253.905022:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906816
00000100:00100000:1.0:1767319253.905078:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16815
00000100:00100000:1.0:1767319253.905088:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291906816:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319253.905115:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319253.905189:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291906816:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 101us (511us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319253.905197:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16815
00000100:00100000:3.0:1767319253.915771:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319253.915937:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291906944
00000100:00100000:0.0:1767319253.915948:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291906944
00000100:00100000:0.0:1767319253.916026:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4134
00000100:00100000:0.0:1767319253.916038:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291906944:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319253.916121:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291906944:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (361us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319253.916130:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4134
00000100:00080000:3.0:1767319253.916469:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319254.488662:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319254.999320:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319254.999339:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379712640:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319254.999409:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319254.999614:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712640
00000100:00100000:3.0:1767319254.999623:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712640
00000100:00100000:3.0:1767319254.999692:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214
00000100:00100000:3.0:1767319254.999702:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379712640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319254.999741:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319254.999800:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379712640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (388us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319254.999807:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214
00000100:00080000:1.0:1767319254.999884:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319255.000551:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379712640:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319255.512665:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319256.535118:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379712768:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319256.535182:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319256.535197:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319256.535246:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712768
00000100:00100000:2.0:1767319256.535255:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712768
00000100:00100000:2.0:1767319256.535341:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215
00000100:00100000:2.0:1767319256.535354:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379712768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319256.535386:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319256.535457:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379712768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (260us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319256.535465:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215
00000100:00080000:0.0:1767319256.535480:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319256.535615:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379712768:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319257.560280:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319258.071985:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319258.071993:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319258.071996:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319258.072000:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319258.072003:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319258.072010:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4155
00000100:00080000:0.0:1767319258.072015:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319258.072021:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319258.072055:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332a00 x1853164379712896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319258.072081:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319258.072085:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319258.072087:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319258.072090:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4155
00000100:00080000:0.0:1767319258.072092:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319258.072096:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319258.072109:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333100 x1853164379713024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319258.072181:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379713152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319258.072394:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319258.072931:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379712896:0@lo:38:kworker.0
00000100:00100000:2.0:1767319258.072968:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319258.072990:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379713024:0@lo:38:kworker.0
00000100:00100000:2.0:1767319258.073015:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319258.073057:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713024
00000100:00100000:2.0:1767319258.073065:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713024
00000100:00100000:2.0:1767319258.073100:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966
00000100:00100000:2.0:1767319258.073108:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379713024:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319258.073129:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319258.073170:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379713024:12345-0@lo:38:kworker.0 Request processed in 61us (153us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319258.073177:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966
00000100:00080000:2.0:1767319258.073230:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319258.073237:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319258.073241:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379713024:0@lo:38:kworker.0
00000100:00100000:2.0:1767319258.073280:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713152
00000100:00100000:2.0:1767319258.073284:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713152
00000100:00100000:2.0:1767319258.073319:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455
00000100:00100000:2.0:1767319258.073324:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379713152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319258.073425:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379712896
00000100:00100000:1.0:1767319258.073430:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379712896
00000100:00100000:1.0:1767319258.073454:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16816
00000100:00100000:1.0:1767319258.073459:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379712896:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319258.073469:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319258.073502:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379712896:12345-0@lo:38:kworker.0 Request processed in 42us (533us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319258.073509:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16816
00000100:00080000:1.0:1767319258.073550:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319258.073555:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319258.073558:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379712896:0@lo:38:kworker.0
00000100:00080000:1.0:1767319258.073581:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319258.073866:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379713280:0@lo:400:kworker.0
00000100:00100000:1.0:1767319258.073915:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319258.073944:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713280
00000100:00100000:1.0:1767319258.073948:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713280
00000100:00100000:1.0:1767319258.073977:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456
00000100:00100000:1.0:1767319258.073983:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379713280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319258.074018:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379713280:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319258.074024:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456
00000100:00080000:1.0:1767319258.074040:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319258.074063:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379713280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319258.075832:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379713152:12345-0@lo:400:kworker.0 Request processed in 2499us (3429us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319258.075846:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455
00000100:00080000:0.0:1767319258.076325:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319258.076330:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319258.076334:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319258.076340:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4155
00000100:00080000:0.0:1767319258.076345:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319258.076350:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319258.076499:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379713408:0@lo:400:kworker.0
00000100:00100000:1.0:1767319258.076557:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319258.076608:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713408
00000100:00100000:1.0:1767319258.076616:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713408
00000100:00100000:1.0:1767319258.076661:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4135
00000100:00100000:1.0:1767319258.076669:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379713408:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319258.076714:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379713408:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319258.076720:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4135
00000100:00080000:1.0:1767319258.076741:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319258.076774:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379713408:0@lo:400:kworker.0
00000100:00100000:0.0:1767319258.076844:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379713536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319258.076901:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319258.076905:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319258.076906:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319258.076910:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4155
00000100:00080000:0.0:1767319258.076913:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319258.076917:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319258.076929:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331180 x1853164379713792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319258.076951:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319258.076958:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379713664:0@lo:400:kworker.0
00000100:00100000:0.0:1767319258.076998:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319258.077024:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713664
00000100:00100000:0.0:1767319258.077028:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713664
00000100:00100000:1.0:1767319258.077170:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379713536:0@lo:38:kworker.0
00000100:00100000:1.0:1767319258.077198:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319258.077215:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379713792:0@lo:38:kworker.0
00000100:00100000:1.0:1767319258.077236:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319258.077273:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713536
00000100:00100000:1.0:1767319258.077277:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713536
00000100:00100000:1.0:1767319258.077298:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713792
00000100:00100000:1.0:1767319258.077301:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713792
00000100:00100000:1.0:1767319258.077320:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16817
00000100:00100000:1.0:1767319258.077325:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379713536:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319258.077342:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319258.077394:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379713536:12345-0@lo:38:kworker.0 Request processed in 68us (195us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319258.077400:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16817
00000100:00100000:1.0:1767319258.077415:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16818
00000100:00100000:1.0:1767319258.077420:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379713792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319258.077431:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319258.077452:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379713792:12345-0@lo:38:kworker.0 Request processed in 31us (216us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319258.077457:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16818
00000100:00080000:1.0:1767319258.077485:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319258.077490:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319258.077494:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379713536:0@lo:38:kworker.0
00000100:00080000:1.0:1767319258.077502:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319258.077506:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319258.077508:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379713792:0@lo:38:kworker.0
00000100:00080000:1.0:1767319258.077536:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319258.077738:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4136
00000100:00100000:0.0:1767319258.077747:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379713664:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319258.077786:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379713664:12345-0@lo:400:kworker.0 Request processed in 41us (799us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319258.077792:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4136
00000100:00100000:0.0:1767319258.077820:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379713664:0@lo:400:kworker.0
00000100:00100000:3.0:1767319258.078527:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379713152:0@lo:400:kworker.0
00010000:00010000:2.0:1767319258.583089:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319259.024836:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319259.024932:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319259.025007:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291907200
00000100:00100000:1.0:1767319259.025012:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291907072
00000100:00100000:1.0:1767319259.025019:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291907072
00000100:00100000:2.0:1767319259.025019:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291907200
00000100:00100000:1.0:1767319259.025071:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16819
00000100:00100000:1.0:1767319259.025080:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291907072:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319259.025104:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319259.025135:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4137
00000100:00100000:2.0:1767319259.025142:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291907200:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319259.025195:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291907200:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 53us (367us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319259.025203:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4137
00000100:00100000:1.0:1767319259.025614:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291907072:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 533us (680us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319259.025622:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16819
00000100:00080000:3.0:1767319259.025810:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319259.607430:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319260.119074:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379713920:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319260.119141:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319260.119267:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379713920
00000100:00100000:2.0:1767319260.119276:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379713920
00000100:00100000:2.0:1767319260.119343:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216
00000100:00100000:2.0:1767319260.119353:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379713920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319260.119388:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319260.119442:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379713920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (300us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319260.119450:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216
00000100:00100000:0.0:1767319260.119626:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379713920:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319260.119709:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319260.631362:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319261.655743:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319261.668340:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379714048:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319261.668438:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319261.669559:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714048
00000100:00100000:3.0:1767319261.669573:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714048
00000100:00100000:3.0:1767319261.669664:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217
00000100:00100000:3.0:1767319261.669675:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379714048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319261.669715:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767319261.669814:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319261.673176:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379714048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3494us (4728us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319261.673191:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217
00000100:00100000:1.0:1767319261.673742:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379714048:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319262.680226:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319263.191686:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319263.191696:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319263.191700:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319263.191703:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319263.191707:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319263.191715:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4160
00000100:00080000:1.0:1767319263.191720:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319263.191726:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319263.191763:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fc000 x1853164379714176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319263.191797:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319263.191801:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319263.191803:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319263.191806:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4160
00000100:00080000:1.0:1767319263.191808:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319263.191812:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319263.191824:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ffb80 x1853164379714304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319263.191918:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319263.191922:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319263.191924:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319263.191927:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4160
00000100:00100000:0.0:1767319263.191929:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379714432:0@lo:400:kworker.0
00000100:00080000:1.0:1767319263.191929:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319263.191932:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319263.191944:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46680 x1853164379714816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319263.191958:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319263.191961:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319263.191962:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319263.191966:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4160
00000100:00080000:1.0:1767319263.191968:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319263.191971:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319263.191978:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44700 x1853164379715072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319263.191994:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319263.192049:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379714944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319263.192050:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319263.192055:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379714560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319263.192080:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319263.192092:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319263.192110:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319263.192115:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379714688:0@lo:400:kworker.0
00000100:00100000:0.0:1767319263.192130:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714944
00000100:00100000:1.0:1767319263.192135:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319263.192137:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714944
00000100:00100000:1.0:1767319263.192173:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714432
00000100:00100000:1.0:1767319263.192177:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714432
00000100:00100000:1.0:1767319263.192228:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714560
00000100:00100000:1.0:1767319263.192232:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714560
00000100:00100000:0.0:1767319263.192234:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714688
00000100:00100000:0.0:1767319263.192237:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714688
00000100:00100000:0.0:1767319263.192255:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4138
00000100:00100000:1.0:1767319263.192255:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457
00000100:00100000:0.0:1767319263.192263:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379714944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319263.192263:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379714432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319263.192310:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379714432:12345-0@lo:400:kworker.0 Request processed in 46us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319263.192314:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379714944:12345-0@lo:400:kworker.0 Request processed in 52us (234us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319263.192317:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457
00000100:00100000:0.0:1767319263.192319:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4138
00000100:00100000:0.0:1767319263.192336:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4139
00000100:00100000:1.0:1767319263.192336:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458
00000100:00100000:0.0:1767319263.192341:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379714688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319263.192342:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379714560:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319263.192365:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379714688:12345-0@lo:400:kworker.0 Request processed in 24us (228us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319263.192365:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379714560:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319263.192371:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4139
00000100:00100000:1.0:1767319263.192371:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458
00000100:00100000:0.0:1767319263.192411:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379714560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319263.192411:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379714688:0@lo:400:kworker.0
00000100:00100000:0.0:1767319263.192421:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379714432:0@lo:400:kworker.0
00000100:00100000:1.0:1767319263.192421:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379714944:0@lo:400:kworker.0
00000100:00080000:2.0:1767319263.193033:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319263.193039:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319263.193041:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319263.193055:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379714176:0@lo:38:kworker.0
00000100:00100000:2.0:1767319263.193754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319263.193901:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714176
00000100:00100000:3.0:1767319263.193908:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714176
00000100:00100000:3.0:1767319263.193947:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16820
00000100:00100000:3.0:1767319263.193954:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379714176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319263.193974:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319263.194017:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379714176:12345-0@lo:38:kworker.0 Request processed in 62us (264us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319263.194023:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16820
00000100:00080000:2.0:1767319263.194187:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319263.194193:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319263.194196:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379714176:0@lo:38:kworker.0
00000100:00100000:2.0:1767319263.194215:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379714304:0@lo:38:kworker.0
00000100:00100000:2.0:1767319263.194244:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319263.194282:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379714816:0@lo:38:kworker.0
00000100:00100000:2.0:1767319263.194304:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319263.194373:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379715072:0@lo:38:kworker.0
00000100:00100000:2.0:1767319263.194395:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319263.195499:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714304
00000100:00100000:1.0:1767319263.195512:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714304
00000100:00100000:1.0:1767319263.195556:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967
00000100:00100000:1.0:1767319263.195562:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379714304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319263.195580:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319263.195649:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379714304:12345-0@lo:38:kworker.0 Request processed in 86us (1404us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319263.195656:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967
00000100:00080000:2.0:1767319263.207258:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319263.207272:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319263.207278:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379714304:0@lo:38:kworker.0
00000100:00100000:3.0:1767319263.208815:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379714816
00000100:00100000:3.0:1767319263.208831:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379714816
00000100:00100000:3.0:1767319263.208917:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379715072
00000100:00100000:3.0:1767319263.208921:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379715072
00000100:00100000:3.0:1767319263.208944:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16821
00000100:00100000:3.0:1767319263.208950:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379714816:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319263.208973:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319263.209046:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379714816:12345-0@lo:38:kworker.0 Request processed in 96us (14742us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319263.209051:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16821
00000100:00100000:3.0:1767319263.209063:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16822
00000100:00100000:3.0:1767319263.209067:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379715072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319263.209076:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319263.209313:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379715072:12345-0@lo:38:kworker.0 Request processed in 244us (14916us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319263.209320:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16822
00000100:00080000:2.0:1767319263.209653:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319263.209657:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319263.209661:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379714816:0@lo:38:kworker.0
00000100:00080000:2.0:1767319263.209667:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319263.209670:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319263.209672:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379715072:0@lo:38:kworker.0
00010000:00010000:2.0:1767319263.703295:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319264.144811:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319264.145103:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319264.145851:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291907328
00000100:00100000:1.0:1767319264.145862:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291907328
00000100:00100000:2.0:1767319264.148899:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291907456
00000100:00100000:2.0:1767319264.148914:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291907456
00000100:00100000:2.0:1767319264.149002:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4140
00000100:00100000:2.0:1767319264.149014:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291907456:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767319264.149618:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319264.149639:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16823
00000100:00100000:0.0:1767319264.149646:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291907328:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319264.149668:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319264.149734:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291907456:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 722us (4631us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319264.149742:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4140
00000100:00100000:0.0:1767319264.151815:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291907328:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2157us (7004us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319264.151829:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16823
00000400:00000100:3.0:1767319264.155448:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291907584 offset 0 length 520: 4
00010000:00010000:2.0:1767319264.727089:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319265.241194:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379715200:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319265.241259:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319265.241562:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379715200
00000100:00100000:2.0:1767319265.241570:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379715200
00000100:00080000:1.0:1767319265.241621:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319265.241639:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218
00000100:00100000:2.0:1767319265.241649:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379715200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319265.241679:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319265.241731:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379715200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319265.241738:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218
00000100:00100000:1.0:1767319265.241803:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379715200:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319265.751957:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319266.775305:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319266.775549:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379715328:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319266.775619:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319266.775759:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379715328
00000100:00100000:2.0:1767319266.775769:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379715328
00000100:00100000:2.0:1767319266.775844:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219
00000100:00100000:2.0:1767319266.775854:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379715328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319266.775901:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319266.775951:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379715328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (332us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319266.775957:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219
00000100:00100000:2.0:1767319266.776006:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379715328:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319266.776494:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319267.286996:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319242/real 1767319242]  req@ffff8b0e08ebd500 x1853164379709952/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319267 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319267.287037:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e08ebd500 x1853164379709952/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319267 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319267.287052:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319267.287081:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319267.287085:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379709952:0@lo:250:kworker.0
00000100:00080000:0.0:1767319267.287109:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319267.287116:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319267.287120:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319267.287125:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4145
00000100:00080000:0.0:1767319267.287130:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319267.287145:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319267.287187:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609180 x1853164379715456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319267.287215:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319267.287218:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319267.287220:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319267.287224:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4165
00000100:00080000:0.0:1767319267.287226:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319267.287230:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319267.287246:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164379715584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319267.287262:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379715456:0@lo:250:kworker.0
00000400:00000100:3.0:1767319267.287308:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379715456 offset 0 length 520: 4
00000100:00080000:0.0:1767319267.287396:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319267.287400:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319267.287402:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319267.287405:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4165
00000100:00080000:0.0:1767319267.287408:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319267.287411:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319267.287428:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608380 x1853164379715712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319267.287477:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319267.287481:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319267.287483:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319267.287486:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4165
00000100:00080000:0.0:1767319267.287488:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319267.287492:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319267.287507:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164379716096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319267.287515:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379715968:0@lo:400:kworker.0
00000100:00080000:0.0:1767319267.287539:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319267.287544:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319267.287546:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319267.287550:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4165
00000100:00080000:0.0:1767319267.287552:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319267.287556:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319267.287571:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b800 x1853164379716352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319267.287596:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379716224:0@lo:400:kworker.0
00000100:00100000:3.0:1767319267.287681:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379715584:0@lo:38:kworker.0
00000100:00100000:2.0:1767319267.287744:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319267.287752:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379715840:0@lo:400:kworker.0
00000100:00100000:1.0:1767319267.287790:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319267.287851:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379715840
00000100:00100000:3.0:1767319267.287859:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379715840
00000100:00100000:3.0:1767319267.287936:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459
00000100:00100000:3.0:1767319267.287946:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379715840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319267.288048:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379715968
00000100:00100000:0.0:1767319267.288053:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379715968
00000100:00080000:1.0:1767319267.292102:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319267.292130:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319267.292179:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379715712:0@lo:38:kworker.0
00000100:00100000:2.0:1767319267.292237:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319267.292263:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379716096:0@lo:38:kworker.0
00000100:00100000:2.0:1767319267.292285:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319267.292301:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379716352:0@lo:38:kworker.0
00000100:00100000:2.0:1767319267.292320:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319267.292339:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379715712
00000100:00100000:1.0:1767319267.292349:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379715712
00000100:00100000:2.0:1767319267.292367:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379715584
00000100:00100000:2.0:1767319267.292374:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379715584
00000100:00100000:1.0:1767319267.292394:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968
00000100:00100000:2.0:1767319267.292402:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716096
00000100:00100000:1.0:1767319267.292403:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379715712:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319267.292407:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716096
00000100:00100000:2.0:1767319267.292421:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716352
00000100:00100000:2.0:1767319267.292424:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716352
00010000:00020000:1.0:1767319267.292430:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319267.292437:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16824
00000100:00100000:2.0:1767319267.292444:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379715584:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319267.292456:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319267.292485:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379715712:12345-0@lo:38:kworker.0 Request processed in 81us (245us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319267.292498:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968
00000100:00100000:2.0:1767319267.292499:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379715584:12345-0@lo:38:kworker.0 Request processed in 50us (368us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319267.292508:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16824
00000100:00100000:1.0:1767319267.292528:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16825
00000100:00100000:1.0:1767319267.292538:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379716096:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319267.292538:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16826
00000100:00100000:2.0:1767319267.292548:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379716352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319267.292552:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767319267.292562:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319267.292594:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379716096:12345-0@lo:38:kworker.0 Request processed in 59us (307us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319267.292601:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16825
00000100:00100000:2.0:1767319267.292612:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379716352:12345-0@lo:38:kworker.0 Request processed in 63us (289us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319267.292620:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16826
00000100:00080000:1.0:1767319267.292645:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319267.292651:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319267.292655:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379715584:0@lo:38:kworker.0
00000100:00080000:1.0:1767319267.292666:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319267.292670:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319267.292673:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379715712:0@lo:38:kworker.0
00000100:00080000:1.0:1767319267.292680:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319267.292684:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319267.292687:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379716096:0@lo:38:kworker.0
00000100:00080000:1.0:1767319267.292695:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319267.292698:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319267.292701:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379716352:0@lo:38:kworker.0
00000100:00080000:1.0:1767319267.292737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319267.292755:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4141
00000100:00100000:2.0:1767319267.292764:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379715968:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319267.292807:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379715968:12345-0@lo:400:kworker.0 Request processed in 45us (5239us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319267.292814:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4141
00000100:00100000:1.0:1767319267.292828:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379715968:0@lo:400:kworker.0
00000100:00100000:3.0:1767319267.292929:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379715840:12345-0@lo:400:kworker.0 Request processed in 4984us (5138us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319267.292938:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459
00000100:00100000:0.0:1767319267.294389:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319267.294416:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379715840:0@lo:400:kworker.0
00000100:00100000:2.0:1767319267.294511:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716224
00000100:00100000:2.0:1767319267.294519:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716224
00000100:00100000:2.0:1767319267.294594:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4142
00000100:00100000:2.0:1767319267.294604:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379716224:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319267.294699:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319267.294719:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379716224:12345-0@lo:400:kworker.0 Request processed in 115us (336us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319267.294727:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4142
00000100:00100000:0.0:1767319267.294788:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379716224:0@lo:400:kworker.0
00010000:00010000:2.0:1767319267.799101:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319268.824264:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319269.264547:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319269.264785:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291907712
00000100:00100000:3.0:1767319269.264796:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291907712
00000100:00100000:3.0:1767319269.264844:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16827
00000100:00100000:3.0:1767319269.264853:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291907712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319269.264906:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319269.264972:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291907712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 118us (447us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319269.264979:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16827
00000100:00100000:0.0:1767319269.265099:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319269.266945:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291907840
00000100:00100000:3.0:1767319269.266968:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291907840
00000100:00080000:1.0:1767319269.267064:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319269.267086:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4143
00000100:00100000:3.0:1767319269.267103:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291907840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319269.267234:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291907840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 135us (2138us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319269.267243:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4143
00010000:00010000:1.0:1767319269.847240:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319270.359301:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319270.359320:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379716480:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319270.359398:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319270.359539:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716480
00000100:00100000:2.0:1767319270.359549:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716480
00000100:00100000:2.0:1767319270.359632:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220
00000100:00100000:2.0:1767319270.359641:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379716480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319270.359672:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319270.359717:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379716480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (319us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319270.359724:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220
00000100:00080000:1.0:1767319270.359829:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319270.359866:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379716480:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319270.871120:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319271.895185:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319271.895319:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319271.895339:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379716608:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319271.895407:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319271.895449:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716608
00000100:00100000:3.0:1767319271.895458:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716608
00000100:00100000:3.0:1767319271.895567:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221
00000100:00100000:3.0:1767319271.895579:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379716608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319271.895609:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767319271.895638:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319271.895662:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379716608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (253us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319271.895669:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221
00000100:00100000:2.0:1767319271.895745:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379716608:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319272.408294:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319272.408301:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319272.408305:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319272.408309:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319272.408313:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319272.408322:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4169
00000100:00080000:2.0:1767319272.408328:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319272.408334:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319272.408370:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ee300 x1853164379716736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319272.408401:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319272.408404:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319272.408406:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319272.408409:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4169
00000100:00080000:2.0:1767319272.408412:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319272.408415:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319272.408426:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2efb80 x1853164379716864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319272.408464:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319272.408467:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319272.408469:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319272.408472:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4169
00000100:00080000:2.0:1767319272.408474:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319272.408478:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319272.408487:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec000 x1853164379717248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319272.408508:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319272.408511:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319272.408513:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319272.408516:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4169
00000100:00080000:2.0:1767319272.408518:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319272.408521:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319272.408531:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eea00 x1853164379717504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319272.408554:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379716992:0@lo:400:kworker.0
00000100:00100000:2.0:1767319272.408622:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319272.408701:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379717120:0@lo:400:kworker.0
00000100:00100000:2.0:1767319272.408732:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319272.408763:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319272.408771:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716992
00000100:00100000:2.0:1767319272.408772:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379717376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319272.408810:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319272.408841:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379717120
00000100:00100000:2.0:1767319272.408847:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379717120
00000100:00100000:2.0:1767319272.408924:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379717376
00000100:00100000:2.0:1767319272.408928:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379717376
00000100:00100000:2.0:1767319272.408951:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4144
00000100:00100000:2.0:1767319272.408959:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379717120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319272.409003:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379717120:12345-0@lo:400:kworker.0 Request processed in 45us (272us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319272.409011:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4144
00000100:00100000:2.0:1767319272.409026:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4145
00000100:00100000:2.0:1767319272.409031:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379717376:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319272.409051:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379717376:12345-0@lo:400:kworker.0 Request processed in 20us (252us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319272.409056:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4145
00000100:00100000:2.0:1767319272.409092:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379717376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319272.409100:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379717120:0@lo:400:kworker.0
00000100:00100000:3.0:1767319272.409190:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716992
00000100:00100000:3.0:1767319272.409268:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460
00000100:00100000:3.0:1767319272.409280:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379716992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319272.409399:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379716736:0@lo:38:kworker.0
00000100:00100000:0.0:1767319272.409435:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319272.409463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379716864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319272.409485:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319272.409503:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379717248:0@lo:38:kworker.0
00000100:00100000:0.0:1767319272.409518:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319272.409530:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379717504:0@lo:38:kworker.0
00000100:00100000:0.0:1767319272.409544:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319272.409565:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716736
00000100:00100000:0.0:1767319272.409569:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716736
00000100:00100000:0.0:1767319272.409587:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379717248
00000100:00100000:0.0:1767319272.409589:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379717248
00000100:00100000:0.0:1767319272.409599:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379717504
00000100:00100000:0.0:1767319272.409601:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379717504
00000100:00100000:0.0:1767319272.409612:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16828
00000100:00100000:0.0:1767319272.409617:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379716736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319272.409634:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319272.409663:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379716736:12345-0@lo:38:kworker.0 Request processed in 44us (227us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319272.409669:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16828
00000100:00100000:0.0:1767319272.409682:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16829
00000100:00100000:0.0:1767319272.409685:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379717248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319272.409694:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319272.409710:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379717248:12345-0@lo:38:kworker.0 Request processed in 23us (191us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319272.409715:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16829
00000100:00100000:0.0:1767319272.409723:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16830
00000100:00100000:0.0:1767319272.409727:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379717504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319272.409735:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319272.409753:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379717504:12345-0@lo:38:kworker.0 Request processed in 25us (208us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319272.409758:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16830
00000100:00080000:0.0:1767319272.409782:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319272.409787:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319272.409802:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319272.409807:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319272.409810:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379716736:0@lo:38:kworker.0
00000100:00080000:0.0:1767319272.409818:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319272.409821:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319272.409823:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379717248:0@lo:38:kworker.0
00000100:00080000:0.0:1767319272.409829:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319272.409831:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319272.409834:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379717504:0@lo:38:kworker.0
00000100:00100000:1.0:1767319272.410183:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379716864
00000100:00100000:1.0:1767319272.410188:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379716864
00000100:00100000:1.0:1767319272.410210:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969
00000100:00100000:1.0:1767319272.410215:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379716864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319272.410226:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319272.410263:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379716864:12345-0@lo:38:kworker.0 Request processed in 47us (777us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319272.410268:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969
00000100:00080000:1.0:1767319272.410300:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319272.410304:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319272.410307:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379716864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319272.411097:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379716992:12345-0@lo:400:kworker.0 Request processed in 1812us (2465us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319272.411109:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460
00000100:00100000:0.0:1767319272.411566:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379716992:0@lo:400:kworker.0
00010000:00010000:2.0:1767319272.919261:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319273.943269:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319274.383588:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319274.383720:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291907968
00000100:00100000:3.0:1767319274.383736:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291907968
00000100:00100000:3.0:1767319274.383817:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16831
00000100:00100000:3.0:1767319274.383829:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291907968:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319274.383863:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319274.383992:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291907968:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 163us (419us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319274.384001:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16831
00000100:00100000:0.0:1767319274.384783:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319274.384853:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291908096
00000100:00100000:3.0:1767319274.384861:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291908096
00000100:00100000:3.0:1767319274.384955:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4146
00000100:00100000:3.0:1767319274.384965:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291908096:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319274.385037:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291908096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (257us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319274.385045:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4146
00000100:00080000:0.0:1767319274.385117:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319274.969333:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319275.479210:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379717632:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319275.479317:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319275.479565:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379717632
00000100:00100000:3.0:1767319275.479576:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379717632
00000100:00100000:3.0:1767319275.479685:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2222
00000100:00100000:3.0:1767319275.479694:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379717632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319275.479727:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767319275.484433:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319275.485632:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379717632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5925us (6301us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319275.485650:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2222
00000100:00100000:1.0:1767319275.493833:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379717632:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319275.993854:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319277.015646:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379717760:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319277.015756:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319277.015905:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379717760
00000100:00100000:3.0:1767319277.015915:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379717760
00000100:00100000:3.0:1767319277.016000:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2223
00000100:00100000:3.0:1767319277.016024:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379717760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319277.016066:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767319277.016084:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767319277.016235:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319277.017905:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379717760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1884us (2138us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319277.017922:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2223
00000100:00100000:2.0:1767319277.018625:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379717760:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319277.527164:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319277.527176:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319277.527180:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319277.527184:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319277.527189:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319277.527200:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4174
00000100:00080000:2.0:1767319277.527206:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319277.527214:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319277.527273:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edc00 x1853164379717888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319277.527311:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319277.527315:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319277.527317:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319277.527321:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4174
00000100:00080000:2.0:1767319277.527324:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319277.527328:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319277.527344:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eca80 x1853164379718016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319277.527411:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319277.527414:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319277.527416:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319277.527420:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4174
00000100:00080000:2.0:1767319277.527422:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319277.527426:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319277.527437:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec000 x1853164379718400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319277.527475:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319277.527478:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319277.527479:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319277.527483:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4174
00000100:00080000:2.0:1767319277.527485:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319277.527488:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319277.527499:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef100 x1853164379718656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319277.527525:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319277.527546:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379718528:0@lo:400:kworker.0
00000100:00100000:2.0:1767319277.527631:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319277.527762:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379718272:0@lo:400:kworker.0
00000100:00100000:1.0:1767319277.527912:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319277.527944:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319277.527952:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379718144:0@lo:400:kworker.0
00000100:00100000:1.0:1767319277.527982:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319277.528024:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718528
00000100:00100000:1.0:1767319277.528033:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718528
00000100:00100000:0.0:1767319277.528202:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379717888:0@lo:38:kworker.0
00000100:00100000:1.0:1767319277.528203:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718272
00000100:00100000:1.0:1767319277.528210:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718272
00000100:00100000:0.0:1767319277.528246:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319277.528250:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4147
00000100:00100000:1.0:1767319277.528262:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379718528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319277.528273:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379718016:0@lo:38:kworker.0
00000100:00100000:0.0:1767319277.528305:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319277.528331:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379718528:12345-0@lo:400:kworker.0 Request processed in 70us (698us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319277.528341:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4147
00000100:00100000:0.0:1767319277.528350:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379718400:0@lo:38:kworker.0
00000100:00100000:1.0:1767319277.528366:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379717888
00000100:00100000:1.0:1767319277.528371:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379717888
00000100:00100000:0.0:1767319277.528379:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319277.528468:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718016
00000100:00100000:3.0:1767319277.528473:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718016
00000100:00100000:3.0:1767319277.528501:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970
00000100:00100000:3.0:1767319277.528507:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379718016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319277.528530:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319277.528577:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379718016:12345-0@lo:38:kworker.0 Request processed in 69us (271us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319277.528583:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970
00000100:00100000:0.0:1767319277.535354:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379718656:0@lo:38:kworker.0
00000100:00100000:0.0:1767319277.535456:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319277.535575:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718400
00000100:00100000:1.0:1767319277.535589:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718400
00000100:00100000:1.0:1767319277.535662:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4148
00000100:00100000:1.0:1767319277.536187:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379718272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319277.536289:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379718272:12345-0@lo:400:kworker.0 Request processed in 114us (8376us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319277.536298:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4148
00000100:00100000:1.0:1767319277.536332:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16832
00000100:00100000:1.0:1767319277.536337:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379717888:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319277.536362:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319277.536397:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379717888:12345-0@lo:38:kworker.0 Request processed in 59us (8153us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319277.536404:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16832
00000100:00100000:1.0:1767319277.536417:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16833
00000100:00100000:1.0:1767319277.536421:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379718400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319277.536430:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319277.536455:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379718400:12345-0@lo:38:kworker.0 Request processed in 32us (8076us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319277.536461:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16833
00000100:00100000:1.0:1767319277.536504:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718144
00000100:00100000:1.0:1767319277.536511:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718144
00000100:00100000:1.0:1767319277.536565:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461
00000100:00100000:1.0:1767319277.536574:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379718144:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319277.536616:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379718144:12345-0@lo:400:kworker.0 Request processed in 45us (8634us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319277.536622:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461
00000100:00080000:1.0:1767319277.536642:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319277.536649:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319277.538157:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379718144:0@lo:400:kworker.0
00000100:00100000:1.0:1767319277.538186:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379718272:0@lo:400:kworker.0
00000100:00100000:1.0:1767319277.538247:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379718528:0@lo:400:kworker.0
00000100:00080000:0.0:1767319277.549930:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319277.549950:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319277.549956:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379717888:0@lo:38:kworker.0
00000100:00080000:0.0:1767319277.549974:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319277.549978:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319277.549981:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379718016:0@lo:38:kworker.0
00000100:00080000:0.0:1767319277.549994:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319277.549998:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319277.550001:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379718400:0@lo:38:kworker.0
00000100:00100000:3.0:1767319277.550199:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718656
00000100:00100000:3.0:1767319277.550210:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718656
00000100:00100000:3.0:1767319277.550276:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16834
00000100:00100000:3.0:1767319277.550286:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379718656:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319277.550314:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319277.550409:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379718656:12345-0@lo:38:kworker.0 Request processed in 123us (14954us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319277.550417:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16834
00000100:00080000:0.0:1767319277.550588:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319277.550593:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319277.550597:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379718656:0@lo:38:kworker.0
00010000:00010000:1.0:1767319278.039380:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319279.063384:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319279.504442:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319279.504486:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319279.505085:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291908352
00000100:00100000:3.0:1767319279.505097:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291908352
00000100:00100000:3.0:1767319279.505226:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291908224
00000100:00100000:3.0:1767319279.505230:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291908224
00000100:00100000:3.0:1767319279.505254:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4149
00000100:00100000:3.0:1767319279.505265:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291908352:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319279.505346:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291908352:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (915us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319279.505354:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4149
00000100:00100000:3.0:1767319279.505371:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16835
00000100:00100000:3.0:1767319279.505375:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291908224:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319279.505397:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319279.505419:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291908224:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (933us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319279.505426:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16835
00000100:00080000:1.0:1767319279.506285:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319280.087639:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319280.600507:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319280.600524:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379718784:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319280.600608:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319280.600674:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718784
00000100:00100000:2.0:1767319280.600683:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718784
00000100:00100000:2.0:1767319280.600753:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2224
00000100:00100000:2.0:1767319280.600762:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379718784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319280.600790:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319280.600833:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379718784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (224us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319280.600840:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2224
00000100:00080000:3.0:1767319280.601225:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319280.601263:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379718784:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319281.111176:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319282.135142:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319282.135618:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319282.135639:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379718912:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319282.135709:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319282.135892:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379718912
00000100:00100000:0.0:1767319282.135904:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379718912
00000100:00100000:0.0:1767319282.135972:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2225
00000100:00100000:0.0:1767319282.135981:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379718912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319282.136015:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319282.136073:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379718912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (363us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319282.136080:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2225
00000100:00100000:0.0:1767319282.136129:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379718912:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319282.136197:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319282.646996:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319282.647008:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319282.647012:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319282.647016:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319282.647020:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319282.647055:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4179
00000100:00080000:2.0:1767319282.647060:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319282.647067:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319282.647108:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799880 x1853164379719040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319282.647131:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319282.647134:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319282.647136:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319282.647140:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4179
00000100:00080000:2.0:1767319282.647142:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319282.647146:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319282.647157:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b800 x1853164379719168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319282.647219:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319282.647222:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319282.647223:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319282.647227:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4179
00000100:00080000:2.0:1767319282.647229:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319282.647232:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319282.647241:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799f80 x1853164379719680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319282.647256:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319282.647259:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319282.647261:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319282.647263:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4179
00000100:00080000:2.0:1767319282.647266:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319282.647269:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319282.647276:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798700 x1853164379719936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319282.647318:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379719808:0@lo:400:kworker.0
00000100:00100000:2.0:1767319282.647382:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319282.647448:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319282.647454:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379719296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319282.647482:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319282.647524:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719808
00000100:00100000:2.0:1767319282.647531:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719808
00000100:00100000:2.0:1767319282.647583:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4150
00000100:00100000:2.0:1767319282.647592:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379719808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319282.647752:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379719552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319282.647785:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319282.647805:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319282.647810:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379719424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319282.647832:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319282.647859:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719296
00000100:00100000:1.0:1767319282.647862:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719296
00000100:00100000:1.0:1767319282.647918:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719424
00000100:00100000:1.0:1767319282.647921:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719424
00000100:00100000:1.0:1767319282.647940:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462
00000100:00100000:1.0:1767319282.647946:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379719296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319282.647987:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379719296:12345-0@lo:400:kworker.0 Request processed in 41us (504us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319282.647995:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462
00000100:00100000:1.0:1767319282.648013:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463
00000100:00100000:1.0:1767319282.648019:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379719424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319282.648060:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379719424:12345-0@lo:400:kworker.0 Request processed in 41us (227us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319282.648066:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463
00000100:00080000:1.0:1767319282.648082:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319282.648087:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319282.648125:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379719424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319282.648151:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379719296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319282.648259:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379719808:12345-0@lo:400:kworker.0 Request processed in 668us (876us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319282.648266:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4150
00000100:00100000:2.0:1767319282.648278:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719552
00000100:00100000:2.0:1767319282.648281:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719552
00000100:00100000:2.0:1767319282.648307:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4151
00000100:00100000:2.0:1767319282.648313:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379719552:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319282.648341:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379719552:12345-0@lo:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319282.648346:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4151
00000100:00080000:2.0:1767319282.648357:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319282.648371:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379719552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319282.648438:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379719808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319282.648671:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379719040:0@lo:38:kworker.0
00000100:00100000:0.0:1767319282.648709:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319282.648727:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379719168:0@lo:38:kworker.0
00000100:00100000:0.0:1767319282.648752:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319282.648787:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379719680:0@lo:38:kworker.0
00000100:00100000:0.0:1767319282.648808:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319282.648824:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379719936:0@lo:38:kworker.0
00000100:00100000:0.0:1767319282.648844:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319282.648886:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719040
00000100:00100000:0.0:1767319282.648891:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719040
00000100:00100000:0.0:1767319282.648910:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719680
00000100:00100000:0.0:1767319282.648912:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719680
00000100:00100000:0.0:1767319282.648923:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719936
00000100:00100000:0.0:1767319282.648926:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719936
00000100:00100000:0.0:1767319282.648948:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16836
00000100:00100000:0.0:1767319282.648953:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379719040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319282.648974:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319282.649009:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379719040:12345-0@lo:38:kworker.0 Request processed in 55us (299us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319282.649015:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16836
00000100:00100000:0.0:1767319282.649046:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16837
00000100:00100000:0.0:1767319282.649050:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379719680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319282.649058:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319282.649081:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379719680:12345-0@lo:38:kworker.0 Request processed in 30us (272us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319282.649086:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16837
00000100:00100000:0.0:1767319282.649095:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16838
00000100:00100000:0.0:1767319282.649098:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379719936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319282.649106:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319282.649124:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379719936:12345-0@lo:38:kworker.0 Request processed in 24us (279us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319282.649129:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16838
00000100:00080000:0.0:1767319282.649178:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319282.649183:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319282.649187:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379719040:0@lo:38:kworker.0
00000100:00080000:0.0:1767319282.649196:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319282.649200:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319282.649203:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379719680:0@lo:38:kworker.0
00000100:00080000:0.0:1767319282.649210:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319282.649212:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319282.649215:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379719936:0@lo:38:kworker.0
00000100:00100000:2.0:1767319282.649501:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379719168
00000100:00100000:2.0:1767319282.649506:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379719168
00000100:00100000:2.0:1767319282.649537:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971
00000100:00100000:2.0:1767319282.649542:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379719168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319282.649553:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319282.649595:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379719168:12345-0@lo:38:kworker.0 Request processed in 52us (842us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319282.649601:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971
00000100:00080000:1.0:1767319282.649729:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319282.649734:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319282.649737:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379719168:0@lo:38:kworker.0
00010000:00010000:1.0:1767319283.159043:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319284.183183:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319284.637988:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319284.638045:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319284.638173:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291908608
00000100:00100000:3.0:1767319284.638192:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291908608
00000100:00100000:3.0:1767319284.638271:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291908480
00000100:00100000:3.0:1767319284.638275:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291908480
00000100:00100000:3.0:1767319284.638295:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4152
00000100:00100000:3.0:1767319284.638305:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291908608:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319284.638373:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291908608:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (395us total) trans 0 rc 0/0
00000100:00080000:2.0:1767319284.638473:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319284.638512:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16839
00000100:00100000:2.0:1767319284.638519:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291908480:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319284.638539:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319284.638566:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291908480:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (521us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319284.638570:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4152
00000100:00100000:2.0:1767319284.638573:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16839
00010000:00010000:0.0:1767319285.207348:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319285.719225:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379720064:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319285.719715:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319285.721091:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720064
00000100:00100000:0.0:1767319285.721106:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720064
00000100:00100000:0.0:1767319285.721178:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2226
00000100:00100000:0.0:1767319285.721188:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379720064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319285.721220:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319285.721302:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379720064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (1589us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319285.721311:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2226
00000100:00100000:3.0:1767319285.721713:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379720064:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319285.722066:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319286.231115:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319287.255257:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00010000:00010000:1.0:1767319287.255578:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319287.255729:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379720192:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319287.255798:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319287.256528:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720192
00000100:00100000:1.0:1767319287.256539:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720192
00000100:00100000:1.0:1767319287.256650:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227
00000100:00100000:1.0:1767319287.256660:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379720192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319287.256694:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319287.256760:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379720192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (962us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319287.256768:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227
00000100:00100000:3.0:1767319287.256857:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379720192:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319287.257065:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319287.770117:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319287.770127:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319287.770130:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319287.770134:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319287.770139:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319287.770146:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4185
00000100:00080000:0.0:1767319287.770151:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319287.770159:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319287.770197:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ce00 x1853164379720320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319287.770328:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319287.770332:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319287.770333:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319287.770338:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4185
00000100:00080000:0.0:1767319287.770340:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319287.770344:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319287.770436:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ed80 x1853164379720448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319287.770512:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319287.770515:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319287.770517:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319287.770521:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4185
00000100:00080000:0.0:1767319287.770523:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319287.770527:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319287.770538:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e300 x1853164379720960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319287.770554:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319287.770557:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319287.770559:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319287.770562:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4185
00000100:00080000:0.0:1767319287.770565:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319287.770569:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319287.770582:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ed80 x1853164379721216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319287.770687:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379721088:0@lo:400:kworker.0
00000100:00100000:2.0:1767319287.770753:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319287.770825:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319287.770831:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379720576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319287.770856:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319287.771129:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721088
00000100:00100000:0.0:1767319287.771138:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721088
00000100:00100000:0.0:1767319287.771203:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4153
00000100:00100000:0.0:1767319287.771215:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379721088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319287.771469:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720576
00000100:00100000:1.0:1767319287.771475:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720576
00000100:00100000:1.0:1767319287.771507:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464
00000100:00100000:1.0:1767319287.771515:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379720576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319287.771568:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379720576:12345-0@lo:400:kworker.0 Request processed in 54us (710us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319287.771579:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464
00000100:00100000:1.0:1767319287.771612:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379720320:0@lo:38:kworker.0
00000100:00100000:1.0:1767319287.771639:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319287.771657:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379720448:0@lo:38:kworker.0
00000100:00100000:1.0:1767319287.771677:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319287.771700:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379720960:0@lo:38:kworker.0
00000100:00100000:1.0:1767319287.771720:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319287.771737:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379721216:0@lo:38:kworker.0
00000100:00100000:1.0:1767319287.771754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319287.771782:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720448
00000100:00100000:1.0:1767319287.771786:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720448
00000100:00100000:1.0:1767319287.771805:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972
00000100:00100000:1.0:1767319287.771810:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379720448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319287.771827:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319287.771857:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379720448:12345-0@lo:38:kworker.0 Request processed in 46us (178us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319287.771863:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972
00000100:00100000:1.0:1767319287.771904:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720320
00000100:00100000:1.0:1767319287.771907:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720320
00000100:00100000:1.0:1767319287.771924:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720960
00000100:00100000:1.0:1767319287.771927:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720960
00000100:00100000:1.0:1767319287.771934:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721216
00000100:00100000:1.0:1767319287.771936:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721216
00000100:00100000:1.0:1767319287.771946:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16840
00000100:00100000:1.0:1767319287.771963:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379720320:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319287.771972:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319287.772005:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379720320:12345-0@lo:38:kworker.0 Request processed in 42us (364us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767319287.772662:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319287.772668:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319287.772687:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16841
00000100:00100000:2.0:1767319287.772692:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379720960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319287.772703:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319287.772741:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379720960:12345-0@lo:38:kworker.0 Request processed in 47us (1020us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319287.772747:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16841
00000100:00100000:2.0:1767319287.772763:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16842
00000100:00100000:2.0:1767319287.772767:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379721216:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319287.772776:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319287.772798:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379721216:12345-0@lo:38:kworker.0 Request processed in 30us (1043us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319287.772803:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16842
00000100:00080000:2.0:1767319287.772884:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319287.772890:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319287.772893:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379720320:0@lo:38:kworker.0
00000100:00080000:2.0:1767319287.772904:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319287.772908:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319287.772910:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379720448:0@lo:38:kworker.0
00000100:00080000:2.0:1767319287.772917:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319287.772920:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319287.772922:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379720960:0@lo:38:kworker.0
00000100:00080000:2.0:1767319287.772930:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319287.772932:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319287.772935:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379721216:0@lo:38:kworker.0
00000100:00100000:2.0:1767319287.772974:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379720576:0@lo:400:kworker.0
00000100:00100000:1.0:1767319287.773203:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16840
00000100:00100000:3.0:1767319287.773660:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379720704:0@lo:400:kworker.0
00000100:00100000:3.0:1767319287.773709:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319287.773746:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319287.773753:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379720832:0@lo:400:kworker.0
00000100:00100000:3.0:1767319287.773774:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319287.773809:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720832
00000100:00100000:3.0:1767319287.773815:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720832
00000100:00100000:3.0:1767319287.773860:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4154
00000100:00100000:3.0:1767319287.773866:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379720832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319287.773923:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379720832:12345-0@lo:400:kworker.0 Request processed in 56us (147us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319287.773929:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4154
00000100:00080000:3.0:1767319287.773956:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319287.773987:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379720832:0@lo:400:kworker.0
00000100:00100000:1.0:1767319287.775185:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379720704
00000100:00100000:1.0:1767319287.775195:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379720704
00000100:00100000:1.0:1767319287.775253:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465
00000100:00100000:1.0:1767319287.775261:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379720704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319287.775323:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379720704:12345-0@lo:400:kworker.0 Request processed in 63us (1613us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319287.775331:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465
00000100:00100000:1.0:1767319287.775505:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379720704:0@lo:400:kworker.0
00000100:00100000:0.0:1767319287.775974:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379721088:12345-0@lo:400:kworker.0 Request processed in 4760us (5219us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319287.775993:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4153
00000100:00100000:2.0:1767319287.776439:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379721088:0@lo:400:kworker.0
00010000:00010000:2.0:1767319288.279125:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319288.720535:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319288.720705:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291908992
00000100:00100000:0.0:1767319288.720716:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291908992
00000100:00100000:0.0:1767319288.720795:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4155
00000100:00100000:0.0:1767319288.720818:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291908992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319288.720937:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291908992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (411us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319288.720951:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4155
00000100:00080000:3.0:1767319288.721588:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767319288.729576:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291908736 offset 0 length 520: 4
00000100:00100000:3.0:1767319288.729646:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319288.729739:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291908864
00000100:00100000:2.0:1767319288.729754:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291908864
00000100:00100000:2.0:1767319288.729818:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16843
00000100:00100000:2.0:1767319288.729830:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291908864:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319288.729859:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319288.730012:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291908864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 182us (365us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319288.730020:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16843
00010000:00010000:0.0:1767319289.303151:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319290.327425:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319290.839689:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319290.839716:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379721344:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319290.839809:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319290.840424:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721344
00000100:00100000:2.0:1767319290.840435:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721344
00000100:00100000:2.0:1767319290.840542:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2228
00000100:00100000:2.0:1767319290.840552:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379721344:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319290.840600:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319290.840674:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379721344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (863us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319290.840681:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2228
00000100:00100000:0.0:1767319290.840815:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379721344:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319290.841839:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319291.351111:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319292.376240:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00010000:00010000:3.0:1767319292.376439:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319292.378915:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379721472:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319292.379072:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319292.379236:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721472
00000100:00100000:3.0:1767319292.379246:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721472
00000100:00100000:3.0:1767319292.379318:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2229
00000100:00100000:3.0:1767319292.379331:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379721472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319292.379363:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319292.379435:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379721472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (364us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319292.379441:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2229
00000100:00080000:2.0:1767319292.379494:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319292.379543:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379721472:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319292.887253:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319292.887264:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319292.887267:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319292.887272:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319292.887276:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319292.887284:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4190
00000100:00080000:1.0:1767319292.887290:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319292.887296:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319292.887373:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2efb80 x1853164379721600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319292.887391:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319292.887394:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319292.887396:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319292.887400:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4190
00000100:00080000:1.0:1767319292.887403:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319292.887408:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319292.887409:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319267/real 1767319267]  req@ffff8b0e03609180 x1853164379715456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319292 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319292.887446:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e03609180 x1853164379715456/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319292 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319292.887465:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379721600:0@lo:38:kworker.0
00000100:00100000:2.0:1767319292.887540:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319292.887590:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ffb80 x1853164379721728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319292.887613:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319292.887629:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319292.887634:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379715456:0@lo:250:kworker.0
00000100:00080000:1.0:1767319292.887658:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767319292.887660:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379721728:0@lo:38:kworker.0
00000100:00080000:1.0:1767319292.887665:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319292.887669:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319292.887673:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4190
00000100:00080000:1.0:1767319292.887676:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319292.887680:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319292.887697:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fc700 x1853164379722240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319292.887729:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319292.887740:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319292.887742:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319292.887745:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4190
00000100:00080000:1.0:1767319292.887747:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319292.887751:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319292.887762:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6680 x1853164379722496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319292.887774:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319292.887777:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319292.887779:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319292.887781:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4169
00000100:00080000:1.0:1767319292.887784:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319292.887787:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319292.887796:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4a80 x1853164379722624/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319292.887821:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379722368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.887855:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379721856:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.887913:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319292.887967:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379722112:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.887992:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319292.888026:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319292.888033:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379721984:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.888057:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319292.888088:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721856
00000100:00100000:3.0:1767319292.888095:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721856
00000100:00100000:3.0:1767319292.888149:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721984
00000100:00100000:3.0:1767319292.888153:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721984
00000100:00100000:1.0:1767319292.888195:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319292.888200:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466
00000100:00100000:3.0:1767319292.888211:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379721856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.888273:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379721856:12345-0@lo:400:kworker.0 Request processed in 62us (358us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319292.888279:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467
00000100:00100000:3.0:1767319292.888287:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466
00000100:00100000:1.0:1767319292.888292:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379721984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319292.888333:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379721984:12345-0@lo:400:kworker.0 Request processed in 46us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319292.888336:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721600
00000100:00100000:1.0:1767319292.888341:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467
00000100:00100000:3.0:1767319292.888342:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721600
00000100:00100000:3.0:1767319292.888369:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379722112
00000100:00100000:3.0:1767319292.888372:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379722112
00000100:00080000:1.0:1767319292.888373:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319292.888393:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319292.888408:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379722368
00000100:00100000:3.0:1767319292.888412:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379722368
00000100:00100000:2.0:1767319292.888841:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319292.888888:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379722240:0@lo:38:kworker.0
00000100:00100000:2.0:1767319292.888916:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319292.888945:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379722496:0@lo:38:kworker.0
00000100:00100000:2.0:1767319292.888966:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319292.888977:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379722624:0@lo:250:kworker.0
00000400:00000100:2.0:1767319292.888993:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379722624 offset 0 length 520: 4
00000100:00100000:2.0:1767319292.889034:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379722240
00000100:00100000:2.0:1767319292.889039:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379722240
00000100:00100000:1.0:1767319292.889479:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4156
00000100:00100000:1.0:1767319292.889495:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379722112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319292.889544:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379722112:12345-0@lo:400:kworker.0 Request processed in 54us (1549us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319292.892021:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379722496
00000100:00100000:3.0:1767319292.892036:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379722496
00000100:00100000:3.0:1767319292.892068:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4157
00000100:00100000:3.0:1767319292.892083:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379722368:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.892185:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379722368:12345-0@lo:400:kworker.0 Request processed in 109us (3991us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319292.892193:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4157
00000100:00100000:3.0:1767319292.892213:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16844
00000100:00100000:3.0:1767319292.892218:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379721600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319292.892237:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319292.892273:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379721600:12345-0@lo:38:kworker.0 Request processed in 53us (4733us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319292.892279:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16844
00000100:00100000:3.0:1767319292.892289:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16845
00000100:00100000:3.0:1767319292.892293:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379722496:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319292.892301:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319292.892320:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379722496:12345-0@lo:38:kworker.0 Request processed in 25us (3353us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319292.892325:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16845
00000100:00080000:3.0:1767319292.892346:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319292.892387:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379721856:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.892424:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379721984:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.892436:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379722112:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.892458:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379722368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319292.892512:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379721728
00000100:00100000:3.0:1767319292.892515:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379721728
00000100:00100000:3.0:1767319292.892544:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973
00000100:00100000:3.0:1767319292.892548:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379721728:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319292.892558:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319292.892582:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379721728:12345-0@lo:38:kworker.0 Request processed in 33us (3742us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319292.892588:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973
00000100:00080000:3.0:1767319292.892630:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319292.892635:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319292.892639:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379722496:0@lo:38:kworker.0
00000100:00080000:3.0:1767319292.892648:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319292.892651:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319292.892654:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379721728:0@lo:38:kworker.0
00000100:00080000:3.0:1767319292.892662:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319292.892665:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319292.892668:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379721600:0@lo:38:kworker.0
00000100:00100000:2.0:1767319292.893192:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16846
00000100:00100000:2.0:1767319292.893199:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379722240:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319292.893212:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319292.893258:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379722240:12345-0@lo:38:kworker.0 Request processed in 58us (4341us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319292.893264:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16846
00000100:00080000:3.0:1767319292.893370:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319292.893374:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319292.893378:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379722240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319292.894970:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4156
00010000:00010000:0.0:1767319293.399155:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319293.842995:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319293.843121:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291909248
00000100:00100000:1.0:1767319293.843131:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291909248
00000100:00100000:1.0:1767319293.843216:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4158
00000100:00100000:1.0:1767319293.843226:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291909248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767319293.843337:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319293.849244:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291909248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 6007us (6244us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319293.849263:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4158
00000100:00100000:0.0:1767319293.852271:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319293.852560:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291909120
00000100:00100000:3.0:1767319293.852571:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291909120
00000100:00100000:3.0:1767319293.852622:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16847
00000100:00100000:3.0:1767319293.852632:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291909120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319293.852660:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319293.852740:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291909120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 107us (479us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319293.852748:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16847
00010000:00010000:1.0:1767319294.424909:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319295.447114:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319295.959214:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319295.959233:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379722752:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319295.959319:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319295.959437:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379722752
00000100:00100000:2.0:1767319295.959445:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379722752
00000100:00100000:2.0:1767319295.959513:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2230
00000100:00100000:2.0:1767319295.959524:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379722752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319295.959557:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319295.959607:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379722752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (288us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319295.959616:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2230
00000100:00100000:2.0:1767319295.959678:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379722752:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319295.959960:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319296.471226:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319297.495799:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319297.496220:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319297.496247:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379722880:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319297.496337:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319297.497141:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379722880
00000100:00100000:0.0:1767319297.497162:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379722880
00000100:00100000:0.0:1767319297.497240:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2231
00000100:00100000:0.0:1767319297.497251:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379722880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319297.497292:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319297.497358:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379722880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1020us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319297.497365:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2231
00000100:00100000:0.0:1767319297.497414:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379722880:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319297.497596:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319298.010246:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319298.010258:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319298.010261:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319298.010336:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319298.010341:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319298.010349:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4195
00000100:00080000:3.0:1767319298.010354:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319298.010361:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319298.010405:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90000 x1853164379723008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319298.010506:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379723008:0@lo:38:kworker.0
00000100:00100000:2.0:1767319298.010587:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319298.011229:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319298.011235:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319298.011237:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319298.011242:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4195
00000100:00080000:3.0:1767319298.011246:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319298.011250:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319298.011273:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91180 x1853164379723136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319298.011666:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319298.011669:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319298.011671:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319298.011675:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4195
00000100:00080000:3.0:1767319298.011677:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319298.011681:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319298.011693:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91c00 x1853164379723648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319298.011789:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379723136:0@lo:38:kworker.0
00000100:00080000:3.0:1767319298.011793:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319298.011796:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319298.011797:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319298.011801:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4195
00000100:00080000:3.0:1767319298.011803:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319298.011807:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319298.011817:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91880 x1853164379723904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319298.011837:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319298.011848:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379723776:0@lo:400:kworker.0
00000100:00100000:2.0:1767319298.011897:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379723648:0@lo:38:kworker.0
00000100:00100000:3.0:1767319298.011903:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319298.011923:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379723392:0@lo:400:kworker.0
00000100:00100000:2.0:1767319298.011947:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319298.012066:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319298.012073:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379723520:0@lo:400:kworker.0
00000100:00100000:2.0:1767319298.012138:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723136
00000100:00100000:2.0:1767319298.012146:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723136
00000100:00100000:2.0:1767319298.012184:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974
00000100:00100000:2.0:1767319298.012192:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379723136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319298.012212:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319298.012252:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379723136:12345-0@lo:38:kworker.0 Request processed in 59us (414us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319298.012258:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974
00000100:00100000:3.0:1767319298.014399:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319298.014583:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379723264:0@lo:400:kworker.0
00000100:00100000:3.0:1767319298.014642:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319298.014832:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723008
00000100:00100000:0.0:1767319298.014840:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723008
00000100:00100000:0.0:1767319298.014893:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723776
00000100:00100000:0.0:1767319298.014897:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723776
00000100:00100000:0.0:1767319298.014938:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4159
00000100:00100000:0.0:1767319298.014948:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379723776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319298.015231:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379723776:12345-0@lo:400:kworker.0 Request processed in 285us (3325us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319298.015238:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4159
00000100:00100000:0.0:1767319298.015259:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16848
00000100:00100000:0.0:1767319298.015330:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379723008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319298.015351:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319298.015407:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379723008:12345-0@lo:38:kworker.0 Request processed in 142us (4819us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319298.015413:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16848
00000100:00080000:0.0:1767319298.015437:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319298.016163:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379723776:0@lo:400:kworker.0
00000100:00100000:3.0:1767319298.016214:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319298.016248:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723520
00000100:00100000:3.0:1767319298.016253:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723520
00000100:00100000:3.0:1767319298.016295:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4160
00000100:00100000:3.0:1767319298.016314:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379723520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319298.016363:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379723520:12345-0@lo:400:kworker.0 Request processed in 50us (148us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319298.016369:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4160
00000100:00100000:3.0:1767319298.016401:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379723520:0@lo:400:kworker.0
00000100:00080000:0.0:1767319298.016503:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319298.016690:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723392
00000100:00100000:1.0:1767319298.016695:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723392
00000100:00100000:0.0:1767319298.016760:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723264
00000100:00100000:0.0:1767319298.016764:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723264
00000100:00100000:1.0:1767319298.016772:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468
00000100:00100000:1.0:1767319298.016779:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379723392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319298.016797:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469
00000100:00100000:0.0:1767319298.016803:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379723264:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319298.016823:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379723392:12345-0@lo:400:kworker.0 Request processed in 44us (4875us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319298.016829:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468
00000100:00100000:0.0:1767319298.016840:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379723264:12345-0@lo:400:kworker.0 Request processed in 38us (2198us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319298.016845:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469
00000100:00080000:0.0:1767319298.016859:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319298.016860:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379723392:0@lo:400:kworker.0
00000100:00100000:0.0:1767319298.016908:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379723264:0@lo:400:kworker.0
00000100:00100000:2.0:1767319298.017177:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319298.017212:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379723904:0@lo:38:kworker.0
00000100:00100000:2.0:1767319298.017247:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319298.017389:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319298.017394:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319298.017398:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379723136:0@lo:38:kworker.0
00000100:00080000:2.0:1767319298.017408:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319298.017411:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319298.017548:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379723008:0@lo:38:kworker.0
00000100:00100000:1.0:1767319298.019309:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723648
00000100:00100000:1.0:1767319298.019323:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723648
00000100:00100000:1.0:1767319298.019376:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379723904
00000100:00100000:1.0:1767319298.019381:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379723904
00000100:00100000:1.0:1767319298.019409:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16849
00000100:00100000:1.0:1767319298.019425:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379723648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319298.019448:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319298.019699:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379723648:12345-0@lo:38:kworker.0 Request processed in 281us (2521us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319298.019708:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16849
00000100:00100000:1.0:1767319298.019729:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16850
00000100:00100000:1.0:1767319298.019733:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379723904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319298.019743:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319298.019767:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379723904:12345-0@lo:38:kworker.0 Request processed in 32us (2520us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319298.019772:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16850
00000100:00080000:2.0:1767319298.019997:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319298.020003:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319298.020007:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379723648:0@lo:38:kworker.0
00000100:00080000:2.0:1767319298.020018:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319298.020026:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319298.020030:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379723904:0@lo:38:kworker.0
00010000:00010000:1.0:1767319298.523070:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319298.959923:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319298.960035:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291909376
00000100:00100000:0.0:1767319298.960048:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291909376
00000100:00100000:0.0:1767319298.960126:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16851
00000100:00100000:0.0:1767319298.960136:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291909376:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319298.960172:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319298.960260:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291909376:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 116us (381us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319298.960267:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16851
00000100:00100000:0.0:1767319298.962613:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319298.962729:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291909504
00000100:00100000:2.0:1767319298.962740:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291909504
00000100:00100000:2.0:1767319298.962818:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4161
00000100:00100000:2.0:1767319298.962829:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291909504:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319298.962960:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291909504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 132us (355us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319298.962969:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4161
00000100:00080000:0.0:1767319298.963620:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319299.544225:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319300.567258:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319301.079349:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379724032:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319301.079454:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319301.079593:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724032
00000100:00100000:2.0:1767319301.079613:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724032
00000100:00100000:2.0:1767319301.079689:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2232
00000100:00100000:2.0:1767319301.079699:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379724032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319301.079751:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319301.079798:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379724032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (344us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319301.079806:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2232
00000100:00080000:3.0:1767319301.079891:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319301.079931:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379724032:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319301.591112:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319302.615502:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379724160:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319302.615615:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319302.615770:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724160
00000100:00100000:3.0:1767319302.615779:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724160
00000100:00100000:3.0:1767319302.615922:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2233
00000100:00100000:3.0:1767319302.615932:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379724160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319302.615976:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319302.616047:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379724160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (431us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319302.616055:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2233
00000100:00100000:3.0:1767319302.616103:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379724160:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319302.616275:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319302.616533:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319303.130015:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319303.130026:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319303.130029:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319303.130033:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319303.130037:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319303.130071:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4200
00000100:00080000:2.0:1767319303.130076:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319303.130083:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319303.130137:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d880 x1853164379724288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319303.130184:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319303.130189:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319303.130191:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319303.130195:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4200
00000100:00080000:2.0:1767319303.130198:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319303.130202:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319303.130217:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85dc00 x1853164379724416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319303.130289:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319303.130293:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319303.130295:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319303.130314:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4200
00000100:00080000:2.0:1767319303.130318:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319303.130322:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319303.130335:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ed80 x1853164379724800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319303.130351:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319303.130354:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319303.130356:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319303.130359:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4200
00000100:00080000:2.0:1767319303.130361:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319303.130365:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319303.130378:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ea00 x1853164379725056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319303.130415:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379724672:0@lo:400:kworker.0
00000100:00100000:1.0:1767319303.130440:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319303.130467:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379724544:0@lo:400:kworker.0
00000100:00100000:2.0:1767319303.130503:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319303.130514:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319303.130591:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379724928:0@lo:400:kworker.0
00000100:00100000:3.0:1767319303.130623:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319303.130633:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379724288:0@lo:38:kworker.0
00000100:00100000:1.0:1767319303.130676:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724672
00000100:00100000:3.0:1767319303.130678:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724928
00000100:00100000:1.0:1767319303.130682:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724672
00000100:00100000:3.0:1767319303.130684:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724928
00000100:00100000:3.0:1767319303.130734:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4162
00000100:00100000:3.0:1767319303.130743:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379724928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319303.130825:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724544
00000100:00100000:2.0:1767319303.130829:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724544
00000100:00100000:2.0:1767319303.130928:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470
00000100:00100000:2.0:1767319303.130936:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379724544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319303.132123:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319303.132289:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379724416:0@lo:38:kworker.0
00000100:00100000:0.0:1767319303.132371:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319303.132397:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379724800:0@lo:38:kworker.0
00000100:00100000:0.0:1767319303.132418:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319303.132435:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724288
00000100:00100000:1.0:1767319303.132442:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724288
00000100:00100000:1.0:1767319303.132476:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4163
00000100:00100000:1.0:1767319303.132486:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379724672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319303.132624:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379725056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319303.132648:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319303.135371:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724800
00000100:00100000:0.0:1767319303.135387:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724800
00000100:00100000:0.0:1767319303.135418:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725056
00000100:00100000:0.0:1767319303.135421:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725056
00000100:00100000:0.0:1767319303.135436:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16852
00000100:00100000:0.0:1767319303.135445:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379724288:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319303.135472:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319303.135633:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379724672:12345-0@lo:400:kworker.0 Request processed in 433us (2413us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319303.135642:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4163
00000100:00100000:1.0:1767319303.135902:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16853
00000100:00100000:1.0:1767319303.135907:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379724800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319303.136224:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319303.136305:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379724800:12345-0@lo:38:kworker.0 Request processed in 397us (3885us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319303.136310:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16853
00000100:00100000:1.0:1767319303.136324:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16854
00000100:00100000:1.0:1767319303.136327:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379725056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319303.136335:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319303.136350:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379725056:12345-0@lo:38:kworker.0 Request processed in 22us (3703us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319303.136354:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16854
00000100:00080000:1.0:1767319303.136369:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319303.136374:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319303.136411:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379724672:0@lo:400:kworker.0
00000100:00080000:1.0:1767319303.136449:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319303.136455:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319303.136458:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379724800:0@lo:38:kworker.0
00000100:00080000:1.0:1767319303.136467:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319303.136470:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319303.136472:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379725056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319303.136618:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379724288:12345-0@lo:38:kworker.0 Request processed in 1174us (4501us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319303.136624:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16852
00000100:00080000:0.0:1767319303.136644:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319303.136647:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319303.136649:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379724288:0@lo:38:kworker.0
00000100:00100000:3.0:1767319303.136982:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379724928:12345-0@lo:400:kworker.0 Request processed in 6237us (6356us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319303.136990:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4162
00000100:00100000:2.0:1767319303.137919:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379724544:12345-0@lo:400:kworker.0 Request processed in 6980us (7401us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319303.137930:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470
00000100:00100000:3.0:1767319303.138030:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379724544:0@lo:400:kworker.0
00000100:00100000:0.0:1767319303.139149:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379724928:0@lo:400:kworker.0
00000100:00100000:1.0:1767319303.139651:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379724416
00000100:00100000:1.0:1767319303.139667:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379724416
00000100:00100000:2.0:1767319303.139886:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975
00000100:00100000:2.0:1767319303.139894:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0912ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379724416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319303.139916:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319303.139982:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0912ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379724416:12345-0@lo:38:kworker.0 Request processed in 90us (7612us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319303.139988:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975
00000100:00080000:0.0:1767319303.140618:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319303.140625:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319303.140628:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379724416:0@lo:38:kworker.0
00010000:00010000:1.0:1767319303.639594:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319304.086134:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319304.086755:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319304.086968:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291909632
00000100:00100000:3.0:1767319304.086980:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291909632
00000100:00100000:3.0:1767319304.087034:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291909760
00000100:00100000:3.0:1767319304.087037:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291909760
00000100:00100000:0.0:1767319304.087179:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16855
00000100:00100000:0.0:1767319304.087188:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291909632:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319304.087210:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319304.087297:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291909632:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 108us (1174us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319304.087657:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4164
00000100:00100000:3.0:1767319304.087666:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291909760:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319304.087748:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291909760:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (994us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319304.087755:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4164
00000100:00100000:0.0:1767319304.088075:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16855
00000100:00080000:2.0:1767319304.097959:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319304.664089:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319305.687069:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319306.200256:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319306.202489:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379725184:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319306.202632:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319306.205043:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725184
00000100:00100000:2.0:1767319306.205059:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725184
00000100:00100000:2.0:1767319306.205189:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2234
00000100:00100000:2.0:1767319306.205199:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379725184:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319306.205253:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767319306.205464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319306.205558:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379725184:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319306.205668:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379725184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 470us (3035us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319306.205676:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2234
00010000:00010000:1.0:1767319306.716986:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319307.735120:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319307.737059:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319307.737087:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379725312:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319307.737215:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319307.737497:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725312
00000100:00100000:2.0:1767319307.737506:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725312
00000100:00100000:2.0:1767319307.737598:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235
00000100:00100000:2.0:1767319307.737608:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379725312:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319307.737672:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319307.737722:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379725312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (507us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319307.737730:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235
00000100:00080000:3.0:1767319307.738224:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319307.738273:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379725312:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319308.247119:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319308.247130:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319308.247133:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319308.247136:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319308.247140:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319308.247153:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4205
00000100:00080000:2.0:1767319308.247158:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319308.247167:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319308.247209:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79500 x1853164379725440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319308.247898:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319308.247903:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319308.247905:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319308.247911:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4205
00000100:00080000:2.0:1767319308.247913:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319308.247918:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319308.247937:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79180 x1853164379725568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319308.247986:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319308.247990:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319308.247992:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319308.247996:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4205
00000100:00080000:2.0:1767319308.247999:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319308.248003:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319308.248014:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78380 x1853164379725952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319308.248046:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319308.248050:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319308.248051:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319308.248055:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4205
00000100:00080000:2.0:1767319308.248058:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319308.248080:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319308.248095:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7a680 x1853164379726208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319308.248103:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379725696:0@lo:400:kworker.0
00000100:00100000:2.0:1767319308.248191:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379725824:0@lo:400:kworker.0
00000100:00100000:3.0:1767319308.248200:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319308.248297:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319308.248311:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379726080:0@lo:400:kworker.0
00000100:00100000:1.0:1767319308.251968:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379725440:0@lo:38:kworker.0
00000100:00100000:2.0:1767319308.253594:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319308.253672:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725824
00000100:00100000:2.0:1767319308.253681:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725824
00000100:00100000:3.0:1767319308.253748:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725696
00000100:00100000:3.0:1767319308.253753:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725696
00000100:00100000:2.0:1767319308.253770:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4165
00000100:00100000:2.0:1767319308.253783:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379725824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319308.253854:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379725824:12345-0@lo:400:kworker.0 Request processed in 75us (266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319308.253862:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4165
00000100:00080000:2.0:1767319308.253905:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319308.253910:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319308.253943:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379725824:0@lo:400:kworker.0
00000100:00100000:3.0:1767319308.254227:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471
00000100:00100000:3.0:1767319308.254237:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379725696:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319308.254286:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379725696:12345-0@lo:400:kworker.0 Request processed in 51us (6087us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319308.254292:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471
00000100:00100000:3.0:1767319308.254349:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379725696:0@lo:400:kworker.0
00000100:00100000:0.0:1767319308.255513:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319308.256114:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726080
00000100:00100000:2.0:1767319308.256122:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726080
00000100:00100000:2.0:1767319308.256190:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4166
00000100:00100000:2.0:1767319308.256198:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379726080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319308.256265:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379726080:12345-0@lo:400:kworker.0 Request processed in 68us (755us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319308.256272:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4166
00000100:00080000:3.0:1767319308.256309:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319308.256569:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379726080:0@lo:400:kworker.0
00000100:00100000:1.0:1767319308.258630:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319308.258725:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379725568:0@lo:38:kworker.0
00000100:00100000:1.0:1767319308.258768:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319308.258817:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379725952:0@lo:38:kworker.0
00000100:00100000:1.0:1767319308.258842:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319308.258898:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725568
00000100:00100000:2.0:1767319308.258907:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725568
00000100:00100000:2.0:1767319308.258990:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976
00000100:00100000:2.0:1767319308.258997:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379725568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319308.259020:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319308.259061:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379725568:12345-0@lo:38:kworker.0 Request processed in 63us (292us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319308.259068:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976
00000100:00100000:1.0:1767319308.259189:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379726208:0@lo:38:kworker.0
00000100:00100000:1.0:1767319308.259214:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319308.259275:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725440
00000100:00100000:0.0:1767319308.259281:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725440
00000100:00100000:0.0:1767319308.259323:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379725952
00000100:00100000:0.0:1767319308.259327:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379725952
00000100:00100000:0.0:1767319308.259348:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16856
00000100:00100000:0.0:1767319308.259353:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379725440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319308.259375:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319308.259407:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379725440:12345-0@lo:38:kworker.0 Request processed in 52us (785us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319308.259413:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16856
00000100:00100000:0.0:1767319308.259429:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16857
00000100:00100000:0.0:1767319308.259433:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379725952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319308.259442:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319308.259464:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379725952:12345-0@lo:38:kworker.0 Request processed in 29us (621us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319308.259469:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16857
00000100:00080000:1.0:1767319308.259671:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319308.259678:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319308.259682:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379725440:0@lo:38:kworker.0
00000100:00080000:1.0:1767319308.259692:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319308.259695:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319308.259698:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379725568:0@lo:38:kworker.0
00000100:00080000:1.0:1767319308.259705:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319308.259708:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319308.259710:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379725952:0@lo:38:kworker.0
00000100:00100000:0.0:1767319308.259896:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726208
00000100:00100000:0.0:1767319308.259900:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726208
00000100:00100000:0.0:1767319308.259931:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16858
00000100:00100000:0.0:1767319308.259936:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379726208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319308.259945:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319308.259977:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379726208:12345-0@lo:38:kworker.0 Request processed in 39us (762us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319308.259982:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16858
00000100:00080000:1.0:1767319308.260052:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319308.260056:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319308.260059:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379726208:0@lo:38:kworker.0
00010000:00010000:3.0:1767319308.759272:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319309.199819:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319309.199862:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319309.199987:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291910016
00000100:00100000:3.0:1767319309.199998:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291910016
00000100:00100000:3.0:1767319309.200072:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291909888
00000100:00100000:3.0:1767319309.200076:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291909888
00000100:00100000:3.0:1767319309.200099:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4167
00000100:00100000:3.0:1767319309.200110:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291910016:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319309.200212:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291910016:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (402us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319309.200220:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4167
00000100:00100000:3.0:1767319309.200247:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16859
00000100:00100000:3.0:1767319309.200252:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291909888:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319309.200281:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319309.200309:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291909888:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (446us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319309.200315:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16859
00000100:00080000:0.0:1767319309.200651:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319309.783119:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319310.807111:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319311.319844:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379726336:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319311.319997:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319311.320081:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726336
00000100:00100000:3.0:1767319311.320094:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726336
00000100:00080000:1.0:1767319311.320144:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319311.320181:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236
00000100:00100000:3.0:1767319311.320194:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379726336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319311.320228:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319311.320326:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379726336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319311.320810:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236
00000100:00100000:0.0:1767319311.321974:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379726336:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319311.831107:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319312.857491:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319312.857516:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379726464:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319312.857581:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319312.857690:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726464
00000100:00100000:0.0:1767319312.857697:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726464
00000100:00100000:0.0:1767319312.857777:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237
00000100:00100000:0.0:1767319312.857787:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379726464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319312.857818:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319312.857865:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379726464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (282us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319312.857891:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237
00000100:00100000:0.0:1767319312.857936:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379726464:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319312.858002:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319312.859379:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319313.367106:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319313.367117:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319313.367120:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319313.367124:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319313.367128:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319313.367137:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4210
00000100:00080000:2.0:1767319313.367141:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319313.367149:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319313.367191:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7b480 x1853164379726592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319313.367254:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379726592:0@lo:38:kworker.0
00000100:00100000:1.0:1767319313.367320:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319313.367405:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319313.367409:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319313.367411:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319313.367415:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4210
00000100:00080000:2.0:1767319313.367418:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319313.367422:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319313.367439:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79f80 x1853164379726720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319313.367539:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726592
00000100:00100000:0.0:1767319313.367547:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726592
00000100:00100000:0.0:1767319313.367596:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16860
00000100:00100000:0.0:1767319313.367604:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379726592:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319313.367624:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319313.370611:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379726720:0@lo:38:kworker.0
00000100:00100000:1.0:1767319313.370690:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319313.371828:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726720
00000100:00100000:3.0:1767319313.371839:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726720
00000100:00100000:3.0:1767319313.371916:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977
00000100:00100000:3.0:1767319313.371924:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379726720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319313.371946:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319313.372011:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379726720:12345-0@lo:38:kworker.0 Request processed in 87us (1320us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319313.372018:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977
00000100:00080000:2.0:1767319313.372372:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319313.372376:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319313.372379:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319313.372384:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4210
00000100:00080000:2.0:1767319313.372388:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319313.372393:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319313.372413:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79180 x1853164379727104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319313.372430:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319313.372433:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319313.372434:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319313.372437:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4210
00000100:00080000:2.0:1767319313.372439:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319313.372443:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319313.372454:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7aa00 x1853164379727360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319313.372482:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319313.372494:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379726848:0@lo:400:kworker.0
00000100:00100000:2.0:1767319313.372530:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319313.372573:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379727232:0@lo:400:kworker.0
00000100:00100000:2.0:1767319313.372599:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319313.372617:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319313.372622:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379726976:0@lo:400:kworker.0
00000100:00100000:2.0:1767319313.372644:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319313.373177:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379727232
00000100:00100000:3.0:1767319313.373184:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379727232
00000100:00100000:3.0:1767319313.373235:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726976
00000100:00100000:3.0:1767319313.373238:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726976
00000100:00100000:3.0:1767319313.373263:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4168
00000100:00100000:3.0:1767319313.373271:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379727232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319313.373324:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379727232:12345-0@lo:400:kworker.0 Request processed in 53us (723us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319313.373330:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4168
00000100:00100000:3.0:1767319313.373344:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4169
00000100:00100000:3.0:1767319313.373351:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379726976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319313.373375:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379726976:12345-0@lo:400:kworker.0 Request processed in 25us (731us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319313.373379:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4169
00000100:00100000:3.0:1767319313.373422:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379726976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319313.373433:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379727232:0@lo:400:kworker.0
00000100:00100000:3.0:1767319313.373461:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379726848
00000100:00100000:3.0:1767319313.373465:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379726848
00000100:00100000:3.0:1767319313.373489:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472
00000100:00100000:3.0:1767319313.373494:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379726848:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319313.373524:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379726848:12345-0@lo:400:kworker.0 Request processed in 30us (993us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319313.373529:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472
00000100:00080000:2.0:1767319313.374076:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319313.374083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319313.374115:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379726848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319313.377263:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379726592:12345-0@lo:38:kworker.0 Request processed in 9648us (9932us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319313.377278:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16860
00000100:00080000:1.0:1767319313.378718:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319313.378729:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319313.378735:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379726592:0@lo:38:kworker.0
00000100:00100000:1.0:1767319313.378780:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379727104:0@lo:38:kworker.0
00000100:00100000:1.0:1767319313.379293:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319313.379336:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379727360:0@lo:38:kworker.0
00000100:00100000:1.0:1767319313.379358:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319313.379492:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319313.379497:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319313.379500:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379726720:0@lo:38:kworker.0
00000100:00100000:3.0:1767319313.380474:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379727104
00000100:00100000:3.0:1767319313.380486:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379727104
00000100:00100000:3.0:1767319313.380539:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379727360
00000100:00100000:3.0:1767319313.380543:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379727360
00000100:00100000:3.0:1767319313.380619:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16861
00000100:00100000:3.0:1767319313.380627:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379727104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319313.380649:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319313.380723:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379727104:12345-0@lo:38:kworker.0 Request processed in 84us (1418us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319313.380730:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16861
00000100:00100000:3.0:1767319313.380756:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16862
00000100:00100000:3.0:1767319313.380760:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379727360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319313.380770:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319313.380809:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379727360:12345-0@lo:38:kworker.0 Request processed in 36us (1439us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319313.380815:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16862
00000100:00080000:1.0:1767319313.380931:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319313.380937:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319313.380941:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379727104:0@lo:38:kworker.0
00000100:00080000:1.0:1767319313.380951:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319313.380955:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319313.380958:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379727360:0@lo:38:kworker.0
00010000:00010000:0.0:1767319313.879100:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319314.331783:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291910144 offset 0 length 520: 4
00000100:00100000:3.0:1767319314.331855:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319314.332053:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319314.334355:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291910400
00000100:00100000:0.0:1767319314.334373:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291910400
00000100:00100000:0.0:1767319314.334473:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291910272
00000100:00100000:0.0:1767319314.334477:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291910272
00000100:00100000:0.0:1767319314.334511:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4170
00000100:00100000:0.0:1767319314.334522:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291910400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319314.334608:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291910400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (2754us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319314.334616:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4170
00000100:00100000:0.0:1767319314.334637:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16863
00000100:00100000:0.0:1767319314.334642:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291910272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319314.334662:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319314.334686:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291910272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (2634us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319314.334692:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16863
00000100:00080000:1.0:1767319314.336649:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319314.907864:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319315.927168:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319316.439537:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319316.441595:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379727488:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319316.442500:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319316.443355:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379727488
00000100:00100000:0.0:1767319316.443367:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379727488
00000100:00100000:0.0:1767319316.443490:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238
00000100:00100000:0.0:1767319316.443500:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379727488:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319316.443534:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319316.443765:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379727488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 267us (1267us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319316.443773:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238
00000100:00100000:2.0:1767319316.447250:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379727488:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319316.447431:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319316.951235:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319317.463184:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319292/real 1767319292]  req@ffff8b0e04ed4a80 x1853164379722624/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319317 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319317.463226:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e04ed4a80 x1853164379722624/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319317 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319317.463240:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319317.463258:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319317.463280:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379722624:0@lo:250:kworker.0
00000100:00080000:2.0:1767319317.463287:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319317.463293:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319317.463296:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319317.463301:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4195
00000100:00080000:2.0:1767319317.463306:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319317.463327:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319317.463370:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebe680 x1853164379727616/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319317.463386:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319317.463400:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319317.463403:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319317.463406:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4215
00000100:00080000:2.0:1767319317.463408:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319317.463411:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319317.463420:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379727616:0@lo:250:kworker.0
00000100:00100000:2.0:1767319317.463430:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd500 x1853164379727744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319317.463438:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319317.463441:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319317.463442:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319317.463446:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4215
00000100:00080000:2.0:1767319317.463449:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319317.463452:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000400:00000100:1.0:1767319317.463473:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379727616 offset 0 length 520: 4
00000100:00100000:1.0:1767319317.463520:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379727744:0@lo:38:kworker.0
00000100:00100000:1.0:1767319317.463555:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319317.464324:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164379727872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319317.464404:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379727872:0@lo:38:kworker.0
00000100:00100000:1.0:1767319317.464450:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319317.464547:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379727872
00000100:00100000:0.0:1767319317.464556:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379727872
00000100:00100000:0.0:1767319317.464626:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978
00000100:00100000:0.0:1767319317.464634:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379727872:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319317.464660:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319317.464937:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319317.464941:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319317.464944:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319317.464949:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4215
00000100:00080000:2.0:1767319317.464952:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319317.464957:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319317.464972:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7b80 x1853164379728384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319317.465334:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379728384:0@lo:38:kworker.0
00000100:00100000:1.0:1767319317.465372:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319317.465429:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379727872:12345-0@lo:38:kworker.0 Request processed in 793us (977us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319317.465437:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978
00000100:00100000:0.0:1767319317.465485:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319317.465495:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379728000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319317.465531:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319317.465927:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728000
00000100:00100000:0.0:1767319317.465934:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728000
00000100:00100000:0.0:1767319317.465980:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473
00000100:00100000:0.0:1767319317.465988:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379728000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319317.466036:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379728000:12345-0@lo:400:kworker.0 Request processed in 49us (504us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319317.466042:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473
00000100:00100000:0.0:1767319317.466082:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379728000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319317.466126:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379728128:0@lo:400:kworker.0
00000100:00100000:0.0:1767319317.466152:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319317.466171:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319317.466176:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379728256:0@lo:400:kworker.0
00000100:00100000:0.0:1767319317.466202:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728128
00000100:00100000:0.0:1767319317.466205:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728128
00000100:00100000:0.0:1767319317.466236:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474
00000100:00100000:0.0:1767319317.466242:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379728128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319317.466275:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379728128:12345-0@lo:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319317.466284:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474
00000100:00080000:0.0:1767319317.466325:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319317.470884:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728384
00000100:00100000:3.0:1767319317.470884:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379727744
00000100:00100000:0.0:1767319317.470901:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728384
00000100:00100000:3.0:1767319317.470901:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379727744
00000100:00100000:0.0:1767319317.470952:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16864
00000100:00100000:0.0:1767319317.470960:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379728384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319317.470985:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319317.471026:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319317.471032:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319317.471036:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379727872:0@lo:38:kworker.0
00000100:00100000:0.0:1767319317.471045:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379728384:12345-0@lo:38:kworker.0 Request processed in 86us (5673us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319317.471052:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16864
00000100:00080000:1.0:1767319317.471065:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767319317.471067:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16865
00000100:00080000:1.0:1767319317.471069:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319317.471071:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379727744:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319317.471072:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379728384:0@lo:38:kworker.0
00010000:00020000:0.0:1767319317.471080:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319317.471097:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319317.471105:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379727744:12345-0@lo:38:kworker.0 Request processed in 32us (7551us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319317.471117:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16865
00000100:00100000:1.0:1767319317.471170:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379728128:0@lo:400:kworker.0
00000100:00080000:2.0:1767319317.471193:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319317.471198:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319317.471201:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319317.471205:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4215
00000100:00080000:2.0:1767319317.471212:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319317.471217:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319317.471240:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680a80 x1853164379728640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319317.471276:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379728512:0@lo:400:kworker.0
00000100:00100000:2.0:1767319317.471316:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319317.476308:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728256
00000100:00100000:0.0:1767319317.476330:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728256
00000100:00100000:3.0:1767319317.476551:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4171
00000100:00100000:3.0:1767319317.476569:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379728256:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319317.476683:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379728256:12345-0@lo:400:kworker.0 Request processed in 121us (5584us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319317.476691:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4171
00000100:00100000:3.0:1767319317.476928:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379728640:0@lo:38:kworker.0
00000100:00100000:3.0:1767319317.477010:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379728256:0@lo:400:kworker.0
00000100:00080000:0.0:1767319317.478478:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319317.478956:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319317.480519:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319317.480531:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319317.480537:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379727744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319317.480668:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728512
00000100:00100000:2.0:1767319317.480677:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728512
00000100:00100000:2.0:1767319317.480761:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728640
00000100:00100000:2.0:1767319317.480765:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728640
00000100:00100000:2.0:1767319317.480785:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4172
00000100:00100000:2.0:1767319317.480795:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379728512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319317.480906:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379728512:12345-0@lo:400:kworker.0 Request processed in 112us (9588us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319317.480915:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4172
00000100:00100000:2.0:1767319317.480935:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16866
00000100:00100000:2.0:1767319317.480939:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379728640:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319317.480958:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319317.480995:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379728640:12345-0@lo:38:kworker.0 Request processed in 54us (2042us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319317.481002:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16866
00000100:00080000:2.0:1767319317.481036:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319317.481040:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319317.481044:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379728640:0@lo:38:kworker.0
00000100:00100000:2.0:1767319317.481084:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379728512:0@lo:400:kworker.0
00000100:00080000:3.0:1767319317.481155:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319317.975070:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319317.975216:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319317.975243:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379728768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319317.975326:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319317.975423:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728768
00000100:00100000:0.0:1767319317.975434:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728768
00000100:00100000:0.0:1767319317.975497:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239
00000100:00100000:0.0:1767319317.975508:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379728768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319317.975542:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319317.975612:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379728768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (285us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319317.975620:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239
00000100:00100000:2.0:1767319317.975995:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379728768:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319318.999082:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319319.442364:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319319.442424:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319319.442540:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291910528
00000100:00100000:2.0:1767319319.442541:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291910656
00000100:00100000:2.0:1767319319.442553:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291910656
00000100:00100000:3.0:1767319319.442563:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291910528
00000100:00100000:3.0:1767319319.442628:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4173
00000100:00100000:3.0:1767319319.442642:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291910656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767319319.442665:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319319.442817:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291910656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 178us (391us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319319.442949:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16867
00000100:00100000:2.0:1767319319.442957:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291910528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319319.442981:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319319.443015:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291910528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (667us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319319.443023:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16867
00000100:00100000:3.0:1767319319.443292:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4173
00010000:00010000:1.0:1767319320.023987:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319321.048622:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319321.559214:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319321.567158:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379728896:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319321.567245:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319321.567663:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379728896
00000100:00100000:2.0:1767319321.567680:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379728896
00000100:00100000:2.0:1767319321.567749:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240
00000100:00100000:2.0:1767319321.567758:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379728896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319321.567788:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319321.567850:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379728896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (603us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319321.567860:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240
00000100:00100000:3.0:1767319321.568121:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379728896:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319321.572230:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767319322.071091:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319322.583523:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319322.583540:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319322.583544:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319322.583549:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319322.583556:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319322.583568:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4219
00000100:00080000:1.0:1767319322.583575:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319322.583584:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319322.583651:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164379729024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319322.583714:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319322.583719:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319322.583721:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319322.583727:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4219
00000100:00080000:1.0:1767319322.583730:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319322.583735:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319322.583757:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4a80 x1853164379729152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319322.583853:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319322.583857:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319322.583859:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319322.583863:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4219
00000100:00080000:1.0:1767319322.583866:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319322.583897:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319322.583911:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafe680 x1853164379729664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319322.583933:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319322.583938:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319322.583940:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319322.583946:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4219
00000100:00080000:1.0:1767319322.583951:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767319322.583957:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319322.583974:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164379729920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319322.583974:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379729280:0@lo:400:kworker.0
00000100:00100000:3.0:1767319322.584086:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319322.584170:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319322.584177:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379729792:0@lo:400:kworker.0
00000100:00100000:3.0:1767319322.584203:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319322.584253:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379729536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319322.584284:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319322.584310:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319322.584317:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379729408:0@lo:400:kworker.0
00000100:00100000:3.0:1767319322.584340:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319322.594680:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729792
00000100:00100000:2.0:1767319322.594708:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729792
00000100:00100000:2.0:1767319322.594837:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729536
00000100:00100000:2.0:1767319322.594842:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729536
00000100:00100000:2.0:1767319322.594902:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4174
00000100:00100000:2.0:1767319322.594913:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379729792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319322.595067:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379729792:12345-0@lo:400:kworker.0 Request processed in 155us (10861us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319322.595076:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4174
00000100:00100000:2.0:1767319322.595102:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4175
00000100:00100000:2.0:1767319322.595109:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379729536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319322.595385:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379729536:12345-0@lo:400:kworker.0 Request processed in 275us (11103us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319322.595392:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4175
00000100:00100000:2.0:1767319322.595486:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379729536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319322.595536:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379729024:0@lo:38:kworker.0
00000100:00100000:2.0:1767319322.595587:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319322.595618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379729152:0@lo:38:kworker.0
00000100:00100000:2.0:1767319322.595656:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319322.595699:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379729664:0@lo:38:kworker.0
00000100:00100000:2.0:1767319322.595724:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319322.595747:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379729920:0@lo:38:kworker.0
00000100:00100000:2.0:1767319322.595772:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319322.595820:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729024
00000100:00100000:2.0:1767319322.595826:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729024
00000100:00100000:2.0:1767319322.595851:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729664
00000100:00100000:2.0:1767319322.595854:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729664
00000100:00100000:2.0:1767319322.595862:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729920
00000100:00100000:2.0:1767319322.595865:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729920
00000100:00100000:2.0:1767319322.595919:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16868
00000100:00100000:2.0:1767319322.595926:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379729024:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319322.595931:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729280
00000100:00100000:0.0:1767319322.595954:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729280
00010000:00020000:2.0:1767319322.595957:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319322.596010:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379729024:12345-0@lo:38:kworker.0 Request processed in 81us (421us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319322.596018:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16868
00000100:00100000:2.0:1767319322.596036:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16869
00000100:00100000:2.0:1767319322.596045:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379729664:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319322.596048:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729408
00000100:00100000:0.0:1767319322.596055:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729408
00010000:00020000:2.0:1767319322.596058:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319322.596092:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379729664:12345-0@lo:38:kworker.0 Request processed in 49us (366us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319322.596099:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16869
00000100:00100000:2.0:1767319322.597913:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16870
00000100:00100000:2.0:1767319322.597926:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379729920:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319322.597955:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319322.598068:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379729920:12345-0@lo:38:kworker.0 Request processed in 142us (2293us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319322.598076:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16870
00000100:00100000:2.0:1767319322.598176:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379729792:0@lo:400:kworker.0
00000100:00080000:2.0:1767319322.598227:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319322.598233:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319322.598237:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379729024:0@lo:38:kworker.0
00000100:00080000:2.0:1767319322.598250:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319322.598254:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319322.598257:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379729664:0@lo:38:kworker.0
00000100:00080000:2.0:1767319322.599415:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319322.599426:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319322.599431:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379729920:0@lo:38:kworker.0
00000100:00080000:2.0:1767319322.599551:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319322.599560:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319322.602167:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475
00000100:00100000:0.0:1767319322.602198:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379729280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319322.602318:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379729280:12345-0@lo:400:kworker.0 Request processed in 138us (18235us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319322.602327:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475
00000100:00100000:0.0:1767319322.602407:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379729280:0@lo:400:kworker.0
00000100:00100000:0.0:1767319322.602451:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379729152
00000100:00100000:0.0:1767319322.602458:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379729152
00000100:00100000:0.0:1767319322.602486:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979
00000100:00100000:0.0:1767319322.602491:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379729152:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319322.602730:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476
00000100:00100000:3.0:1767319322.602744:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379729408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319322.602791:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379729408:12345-0@lo:400:kworker.0 Request processed in 53us (18450us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319322.602797:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476
00000100:00100000:3.0:1767319322.602997:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379729408:0@lo:400:kworker.0
00010000:00020000:0.0:1767319322.603382:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319322.603438:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379729152:12345-0@lo:38:kworker.0 Request processed in 945us (7780us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319322.603446:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979
00000100:00080000:3.0:1767319322.604015:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319322.604022:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319322.604026:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379729152:0@lo:38:kworker.0
00000100:00100000:0.0:1767319323.095200:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379730048:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319323.095373:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319323.095384:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319323.095568:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730048
00000100:00100000:2.0:1767319323.095577:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730048
00000100:00100000:2.0:1767319323.095628:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241
00000100:00100000:2.0:1767319323.095649:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379730048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319323.095711:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319323.095760:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379730048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (383us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319323.095767:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241
00000100:00100000:0.0:1767319323.095976:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379730048:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319324.119157:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319324.574862:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319324.574944:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319324.575032:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291910912
00000100:00100000:2.0:1767319324.575042:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291910912
00000100:00100000:2.0:1767319324.575133:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291910784
00000100:00100000:2.0:1767319324.575136:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291910784
00000100:00100000:2.0:1767319324.575162:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4176
00000100:00100000:2.0:1767319324.575172:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291910912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319324.575256:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291910912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (403us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319324.575264:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4176
00000100:00100000:2.0:1767319324.575285:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16871
00000100:00100000:2.0:1767319324.575289:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291910784:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319324.575312:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319324.575341:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291910784:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (398us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319324.575348:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16871
00000100:00080000:0.0:1767319324.575771:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319325.143176:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319326.167055:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319326.679212:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319326.686071:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379730176:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319326.686152:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319326.686318:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730176
00000100:00100000:1.0:1767319326.686328:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730176
00000100:00100000:1.0:1767319326.686407:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242
00000100:00100000:1.0:1767319326.686416:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379730176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319326.686449:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319326.686505:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379730176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (353us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319326.686520:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242
00000100:00080000:2.0:1767319326.686926:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319326.687032:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379730176:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319327.191544:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319327.703016:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319327.703038:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319327.703042:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319327.703046:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319327.703051:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319327.703060:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4224
00000100:00080000:1.0:1767319327.703065:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319327.703072:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319327.703126:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafea00 x1853164379730304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319327.703154:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319327.703158:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319327.703160:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319327.703164:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4224
00000100:00080000:1.0:1767319327.703166:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319327.703170:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319327.703184:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafdc00 x1853164379730432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319327.703226:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379730304:0@lo:38:kworker.0
00000100:00080000:1.0:1767319327.703263:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319327.703267:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319327.703269:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319327.703273:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4224
00000100:00080000:1.0:1767319327.703276:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319327.703280:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319327.703292:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafe680 x1853164379730944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319327.703309:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319327.703312:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319327.703316:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319327.703319:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319327.703323:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4224
00000100:00080000:1.0:1767319327.703327:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:1.0:1767319327.703331:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319327.703344:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc000 x1853164379731200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319327.703383:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379730688:0@lo:400:kworker.0
00000100:00100000:3.0:1767319327.703389:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379730432:0@lo:38:kworker.0
00000100:00100000:1.0:1767319327.703432:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319327.703435:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319327.703512:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379730816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319327.703563:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379730560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319327.708385:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730688
00000100:00100000:1.0:1767319327.708405:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730688
00000100:00100000:1.0:1767319327.708499:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477
00000100:00100000:1.0:1767319327.708510:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379730688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319327.708603:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379730688:12345-0@lo:400:kworker.0 Request processed in 95us (5175us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319327.708611:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477
00000100:00100000:1.0:1767319327.708691:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379730688:0@lo:400:kworker.0
00000100:00100000:1.0:1767319327.708726:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379731072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319327.708765:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319327.708803:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730304
00000100:00100000:1.0:1767319327.708808:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730304
00000100:00100000:1.0:1767319327.708827:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731072
00000100:00100000:1.0:1767319327.708829:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731072
00000100:00100000:1.0:1767319327.708853:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4177
00000100:00100000:1.0:1767319327.708859:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379731072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319327.709666:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379731072:12345-0@lo:400:kworker.0 Request processed in 803us (896us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319327.709679:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4177
00000100:00100000:1.0:1767319327.709705:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16872
00000100:00100000:1.0:1767319327.709710:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379730304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319327.709731:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319327.709761:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379730304:12345-0@lo:38:kworker.0 Request processed in 51us (6455us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319327.709767:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16872
00000100:00100000:1.0:1767319327.709807:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379731072:0@lo:400:kworker.0
00000100:00100000:1.0:1767319327.709848:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730432
00000100:00100000:1.0:1767319327.709853:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730432
00000100:00100000:1.0:1767319327.711832:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980
00000100:00100000:1.0:1767319327.711846:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379730432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319327.711888:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319327.711975:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379730432:12345-0@lo:38:kworker.0 Request processed in 130us (8546us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319327.711993:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980
00000100:00080000:1.0:1767319327.712066:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319327.712073:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319327.712119:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319327.712125:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319327.712130:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379730432:0@lo:38:kworker.0
00000100:00100000:3.0:1767319327.712161:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379730944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319327.712198:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319327.712229:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379731200:0@lo:38:kworker.0
00000100:00100000:3.0:1767319327.712252:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319327.712275:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730944
00000100:00100000:3.0:1767319327.712282:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730944
00000100:00100000:3.0:1767319327.712307:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731200
00000100:00100000:3.0:1767319327.712310:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731200
00000100:00100000:3.0:1767319327.712327:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16873
00000100:00100000:3.0:1767319327.712332:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379730944:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319327.712357:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319327.712386:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379730944:12345-0@lo:38:kworker.0 Request processed in 53us (188us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319327.712392:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16873
00000100:00100000:3.0:1767319327.712405:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16874
00000100:00100000:3.0:1767319327.712409:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379731200:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319327.712815:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319327.712849:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379731200:12345-0@lo:38:kworker.0 Request processed in 438us (596us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319327.712856:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16874
00000100:00080000:3.0:1767319327.712908:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319327.712913:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319327.712916:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379731200:0@lo:38:kworker.0
00000100:00080000:3.0:1767319327.712928:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319327.712931:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319327.712934:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379730304:0@lo:38:kworker.0
00000100:00080000:3.0:1767319327.712958:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319327.712962:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319327.712965:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379730944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319327.713071:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319327.713456:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730816
00000100:00100000:1.0:1767319327.713463:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730816
00000100:00080000:0.0:1767319327.713862:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319327.713968:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4178
00000100:00100000:1.0:1767319327.713978:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379730816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319327.714044:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379730816:12345-0@lo:400:kworker.0 Request processed in 68us (972us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319327.714051:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4178
00000100:00100000:0.0:1767319327.714243:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379730816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319327.717178:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319327.720780:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379730560
00000100:00100000:3.0:1767319327.720799:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379730560
00000100:00100000:3.0:1767319327.720917:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478
00000100:00100000:3.0:1767319327.720928:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379730560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319327.721050:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379730560:12345-0@lo:400:kworker.0 Request processed in 123us (3879us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319327.721058:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478
00000100:00100000:2.0:1767319327.721110:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379730560:0@lo:400:kworker.0
00010000:00010000:1.0:1767319328.216508:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319328.217153:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319328.217176:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379731328:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319328.217267:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319328.217579:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731328
00000100:00100000:3.0:1767319328.217589:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731328
00000100:00100000:3.0:1767319328.217680:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243
00000100:00100000:3.0:1767319328.217690:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379731328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319328.217720:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319328.217782:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379731328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (515us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319328.217789:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243
00000100:00100000:2.0:1767319328.218012:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379731328:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319329.240362:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319329.679840:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319329.679966:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319329.681787:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291911168
00000100:00100000:0.0:1767319329.681805:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291911168
00000100:00100000:0.0:1767319329.681975:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291911040
00000100:00100000:0.0:1767319329.681979:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291911040
00000100:00100000:0.0:1767319329.682019:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4179
00000100:00100000:0.0:1767319329.682031:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291911168:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319329.682367:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291911168:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 337us (2537us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319329.682376:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4179
00000100:00100000:0.0:1767319329.682396:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16875
00000100:00100000:0.0:1767319329.682401:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291911040:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319329.682421:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319329.682450:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291911040:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (2484us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319329.682456:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16875
00000100:00080000:1.0:1767319329.684653:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319330.263663:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319331.287452:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319331.799226:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379731456:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319331.799295:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319331.799373:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731456
00000100:00100000:3.0:1767319331.799382:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731456
00000100:00100000:3.0:1767319331.799456:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244
00000100:00100000:3.0:1767319331.799465:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379731456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319331.799491:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767319331.799565:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319331.802555:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379731456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3079us (3246us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319331.802571:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244
00000100:00100000:1.0:1767319331.803283:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379731456:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319332.314230:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319332.823082:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319332.823094:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319332.823097:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319332.823100:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319332.823105:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319332.823114:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4230
00000100:00080000:0.0:1767319332.823118:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319332.823125:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319332.823164:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379731584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319332.823193:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319332.823197:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319332.823199:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319332.823202:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4230
00000100:00080000:0.0:1767319332.823204:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319332.823208:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319332.823220:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19f80 x1853164379731712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319332.823393:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379731840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319332.823395:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379731584:0@lo:38:kworker.0
00000100:00080000:0.0:1767319332.823496:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319332.823500:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319332.823502:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319332.823506:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4230
00000100:00080000:0.0:1767319332.823509:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319332.823514:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319332.823526:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b800 x1853164379732224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319332.823535:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379731968:0@lo:400:kworker.0
00000100:00080000:0.0:1767319332.823551:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319332.823555:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319332.823557:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319332.823560:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4230
00000100:00080000:0.0:1767319332.823564:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767319332.823580:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319332.823592:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19180 x1853164379732480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319332.823627:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379732096:0@lo:400:kworker.0
00000100:00100000:3.0:1767319332.823776:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319332.826835:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319332.826922:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319332.826937:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379732352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319332.826967:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319332.827011:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731840
00000100:00100000:1.0:1767319332.827019:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731840
00000100:00100000:1.0:1767319332.827067:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479
00000100:00100000:1.0:1767319332.827080:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379731840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319332.827080:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379731712:0@lo:38:kworker.0
00000100:00100000:3.0:1767319332.827165:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319332.827230:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379732224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319332.827283:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319332.827318:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379732480:0@lo:38:kworker.0
00000100:00100000:3.0:1767319332.827368:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319332.827424:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731584
00000100:00100000:3.0:1767319332.827429:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731584
00000100:00100000:3.0:1767319332.827452:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732352
00000100:00100000:3.0:1767319332.827455:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732352
00000100:00100000:3.0:1767319332.827484:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732224
00000100:00100000:3.0:1767319332.827515:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732224
00000100:00100000:3.0:1767319332.827541:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732480
00000100:00100000:3.0:1767319332.827546:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732480
00000100:00100000:3.0:1767319332.827559:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4180
00000100:00100000:0.0:1767319332.827592:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319332.827603:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379732352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319332.827626:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732096
00000100:00100000:0.0:1767319332.827631:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732096
00000100:00100000:3.0:1767319332.827653:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379732352:12345-0@lo:400:kworker.0 Request processed in 62us (683us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319332.827660:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4181
00000100:00100000:3.0:1767319332.827668:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4180
00000100:00100000:0.0:1767319332.827671:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379732096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319332.827694:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16876
00000100:00100000:3.0:1767319332.827700:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379731584:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319332.827713:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379732096:12345-0@lo:400:kworker.0 Request processed in 44us (121us total) trans 0 rc 0/0
00010000:00020000:3.0:1767319332.827720:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319332.827723:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4181
00000100:00100000:0.0:1767319332.827739:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16877
00000100:00100000:0.0:1767319332.827745:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379732224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319332.827756:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319332.827812:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379731584:12345-0@lo:38:kworker.0 Request processed in 111us (4036us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319332.827819:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16876
00000100:00100000:1.0:1767319332.827834:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379731840:12345-0@lo:400:kworker.0 Request processed in 757us (1004us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319332.827843:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479
00000100:00100000:3.0:1767319332.827856:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16878
00000100:00100000:1.0:1767319332.827919:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379732352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319332.827930:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379731840:0@lo:400:kworker.0
00000100:00100000:1.0:1767319332.827982:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379732096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319332.828016:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731712
00000100:00100000:1.0:1767319332.828020:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731712
00000100:00100000:1.0:1767319332.828040:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981
00000100:00100000:1.0:1767319332.828044:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379731712:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319332.828054:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319332.828138:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379732224:12345-0@lo:38:kworker.0 Request processed in 393us (854us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319332.828145:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16877
00000100:00080000:0.0:1767319332.828177:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319332.828224:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319332.828229:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319332.828232:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379732224:0@lo:38:kworker.0
00000100:00080000:0.0:1767319332.828409:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319332.828413:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319332.828416:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379731584:0@lo:38:kworker.0
00000100:00100000:1.0:1767319332.828456:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379731712:12345-0@lo:38:kworker.0 Request processed in 409us (1290us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319332.828475:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981
00000100:00100000:3.0:1767319332.828484:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379732480:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767319332.828622:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319332.828626:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319332.828629:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379731712:0@lo:38:kworker.0
00010000:00020000:3.0:1767319332.828648:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319332.828698:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379732480:12345-0@lo:38:kworker.0 Request processed in 834us (1339us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319332.828704:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16878
00000100:00080000:0.0:1767319332.829053:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319332.829059:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319332.829062:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379732480:0@lo:38:kworker.0
00000100:00100000:2.0:1767319332.829359:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319332.829480:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379731968
00000100:00100000:0.0:1767319332.829485:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379731968
00000100:00100000:0.0:1767319332.829883:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480
00000100:00100000:0.0:1767319332.829894:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379731968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319332.830450:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379731968:12345-0@lo:400:kworker.0 Request processed in 547us (1080us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319332.830458:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480
00000100:00100000:3.0:1767319332.834256:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379731968:0@lo:400:kworker.0
00000100:00080000:2.0:1767319332.835256:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319333.335282:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319333.335307:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379732608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319333.335430:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319333.335682:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732608
00000100:00100000:2.0:1767319333.335691:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732608
00000100:00100000:2.0:1767319333.335754:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245
00000100:00100000:2.0:1767319333.335763:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379732608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319333.335794:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319333.335853:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379732608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (422us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319333.335861:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245
00000100:00100000:1.0:1767319333.336005:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379732608:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319333.336072:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319334.359572:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319334.805113:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319334.805153:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319334.805171:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291911424
00000100:00100000:3.0:1767319334.805184:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291911424
00000100:00100000:2.0:1767319334.805206:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291911296
00000100:00100000:2.0:1767319334.805213:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291911296
00000100:00080000:0.0:1767319334.805247:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319334.805265:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4182
00000100:00100000:2.0:1767319334.805278:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291911424:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319334.805360:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291911424:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (257us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319334.805368:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4182
00000100:00100000:2.0:1767319334.805387:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16879
00000100:00100000:2.0:1767319334.805392:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291911296:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319334.805412:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319334.805453:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291911296:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (299us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319334.805459:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16879
00010000:00010000:1.0:1767319335.384518:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319336.409252:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319336.927911:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379732736:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319336.927985:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319336.928108:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732736
00000100:00100000:1.0:1767319336.928117:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732736
00000100:00100000:1.0:1767319336.928183:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246
00000100:00100000:1.0:1767319336.928192:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379732736:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319336.928222:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767319336.928343:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319336.942077:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379732736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 13875us (14080us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319336.942093:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246
00000100:00100000:3.0:1767319336.944338:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379732736:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319337.432491:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319337.943013:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319337.943023:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319337.943027:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319337.943030:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319337.943034:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319337.943041:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4235
00000100:00080000:0.0:1767319337.943046:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319337.943052:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319337.943091:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379732864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319337.943110:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319337.943113:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319337.943115:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319337.943119:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4235
00000100:00080000:0.0:1767319337.943121:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319337.943124:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319337.943138:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b800 x1853164379732992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319337.943213:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319337.943217:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319337.943219:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319337.943223:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4235
00000100:00080000:0.0:1767319337.943225:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319337.943228:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319337.943239:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18700 x1853164379733504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319337.943255:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319337.943259:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319337.943260:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319337.943263:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4235
00000100:00080000:0.0:1767319337.943266:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319337.943269:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319337.943280:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379733760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319337.943311:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379733376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319337.943362:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379733120:0@lo:400:kworker.0
00000100:00100000:0.0:1767319337.943370:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319337.943398:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319337.943431:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319337.943435:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319337.943437:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379733248:0@lo:400:kworker.0
00000100:00100000:2.0:1767319337.943439:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379733632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319337.943459:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319337.943461:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319337.943490:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379733120
00000100:00100000:2.0:1767319337.943496:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379733376
00000100:00100000:0.0:1767319337.943497:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379733120
00000100:00100000:2.0:1767319337.943499:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379733376
00000100:00100000:0.0:1767319337.943549:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379733248
00000100:00100000:0.0:1767319337.943552:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379733248
00000100:00100000:2.0:1767319337.943559:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379733632
00000100:00100000:2.0:1767319337.943562:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379733632
00000100:00100000:0.0:1767319337.943573:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481
00000100:00100000:0.0:1767319337.943581:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379733120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319337.943581:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4183
00000100:00100000:2.0:1767319337.943585:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379733376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319337.943626:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379733120:12345-0@lo:400:kworker.0 Request processed in 44us (227us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319337.943626:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379733376:12345-0@lo:400:kworker.0 Request processed in 39us (255us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319337.943634:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481
00000100:00100000:2.0:1767319337.943634:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4183
00000100:00100000:0.0:1767319337.943650:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482
00000100:00100000:2.0:1767319337.943650:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4184
00000100:00100000:0.0:1767319337.943656:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379733248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319337.943656:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379733632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319337.943680:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379733248:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319337.943680:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379733632:12345-0@lo:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319337.943687:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482
00000100:00100000:2.0:1767319337.943687:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4184
00000100:00080000:2.0:1767319337.943703:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319337.943708:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319337.943803:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379733248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319337.943814:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379733376:0@lo:400:kworker.0
00000100:00100000:3.0:1767319337.943915:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379732864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319337.943945:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319337.944040:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379733632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319337.944050:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379733120:0@lo:400:kworker.0
00000100:00100000:3.0:1767319337.950324:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379732992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319337.950395:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319337.950427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379733504:0@lo:38:kworker.0
00000100:00100000:3.0:1767319337.950450:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319337.950505:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732992
00000100:00100000:1.0:1767319337.950514:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732992
00000100:00100000:1.0:1767319337.950580:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982
00000100:00100000:1.0:1767319337.950588:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379732992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319337.950773:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319337.950820:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379732992:12345-0@lo:38:kworker.0 Request processed in 231us (424us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319337.950827:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982
00000100:00100000:3.0:1767319337.954792:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379733760:0@lo:38:kworker.0
00000100:00100000:3.0:1767319337.954861:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319337.954971:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379732864
00000100:00100000:0.0:1767319337.954979:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379732864
00000100:00100000:0.0:1767319337.955042:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379733504
00000100:00100000:0.0:1767319337.955045:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379733504
00000100:00100000:0.0:1767319337.955064:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16880
00000100:00100000:0.0:1767319337.955071:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379732864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319337.955092:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319337.955136:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379732864:12345-0@lo:38:kworker.0 Request processed in 64us (11189us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319337.955144:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16880
00000100:00100000:0.0:1767319337.955162:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16881
00000100:00100000:0.0:1767319337.955166:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379733504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319337.955175:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319337.955199:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379733504:12345-0@lo:38:kworker.0 Request processed in 31us (4748us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319337.955205:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16881
00000100:00080000:3.0:1767319337.959740:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319337.959754:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319337.959760:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379732864:0@lo:38:kworker.0
00000100:00080000:3.0:1767319337.959776:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319337.959780:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319337.959783:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379732992:0@lo:38:kworker.0
00000100:00080000:3.0:1767319337.959795:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319337.959798:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319337.959801:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379733504:0@lo:38:kworker.0
00000100:00100000:1.0:1767319337.961382:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379733760
00000100:00100000:1.0:1767319337.961399:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379733760
00000100:00100000:1.0:1767319337.961532:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16882
00000100:00100000:1.0:1767319337.961543:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379733760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319337.961570:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319337.961660:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379733760:12345-0@lo:38:kworker.0 Request processed in 118us (6798us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319337.961668:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16882
00000100:00080000:3.0:1767319337.961760:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319337.961766:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319337.961770:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379733760:0@lo:38:kworker.0
00010000:00010000:0.0:1767319338.455085:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319338.455525:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319338.455631:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379733888:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319338.455702:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319338.461193:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379733888
00000100:00100000:2.0:1767319338.461210:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379733888
00000100:00100000:2.0:1767319338.461308:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247
00000100:00100000:2.0:1767319338.461319:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379733888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319338.461361:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319338.461461:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379733888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (5757us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319338.461468:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247
00000100:00100000:1.0:1767319338.461982:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379733888:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319338.895810:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319338.895960:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291911808
00000100:00100000:1.0:1767319338.895970:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291911808
00000100:00100000:1.0:1767319338.896076:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4185
00000100:00100000:1.0:1767319338.896088:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291911808:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319338.896240:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291911808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 154us (443us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319338.896250:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4185
00000100:00080000:2.0:1767319338.896462:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:1.0:1767319338.904657:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291911552 offset 0 length 520: 4
00000100:00100000:0.0:1767319338.907481:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319338.907947:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291911680
00000100:00100000:3.0:1767319338.907958:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291911680
00000100:00100000:3.0:1767319338.908469:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16883
00000100:00100000:3.0:1767319338.908478:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291911680:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319338.908505:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319338.908607:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291911680:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 128us (1136us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319338.908615:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16883
00010000:00010000:1.0:1767319339.484326:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319340.503910:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319341.527957:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319342.039504:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319317/real 1767319317]  req@ffff8b0e08ebe680 x1853164379727616/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319342.039538:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e08ebe680 x1853164379727616/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319342.039557:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319342.039582:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319342.039586:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379727616:0@lo:250:kworker.0
00000100:00100000:1.0:1767319342.039850:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379734016:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319342.039943:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319342.040127:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379734016
00000100:00100000:2.0:1767319342.040136:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379734016
00000100:00100000:2.0:1767319342.040199:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248
00000100:00100000:2.0:1767319342.040208:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379734016:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319342.040236:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319342.040279:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379734016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (336us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319342.040287:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248
00000100:00080000:1.0:1767319342.040425:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319342.040462:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379734016:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319342.040857:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319342.040863:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319342.040866:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319342.040888:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4219
00000100:00080000:0.0:1767319342.040893:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319342.040897:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319342.040921:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e680 x1853164379734144/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319342.040947:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319342.040951:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319342.040953:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319342.040957:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4240
00000100:00080000:0.0:1767319342.040959:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319342.040962:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319342.040989:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d180 x1853164379734272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319342.040998:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319342.041002:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319342.041004:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319342.041007:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4240
00000100:00080000:0.0:1767319342.041010:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319342.041013:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319342.041024:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379734400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319342.041076:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319342.041079:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319342.041081:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319342.041085:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4240
00000100:00080000:0.0:1767319342.041087:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319342.041090:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319342.041100:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ea00 x1853164379734784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319342.041113:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319342.041115:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319342.041117:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319342.041120:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4240
00000100:00080000:0.0:1767319342.041122:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319342.041125:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319342.041134:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ce00 x1853164379735040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319342.041160:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379734656:0@lo:400:kworker.0
00000100:00100000:0.0:1767319342.041200:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319342.041226:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319342.041232:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379734912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319342.041251:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319342.041332:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379734656
00000100:00100000:1.0:1767319342.041338:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379734656
00000100:00100000:1.0:1767319342.041385:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379734912
00000100:00100000:1.0:1767319342.041388:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379734912
00000100:00100000:1.0:1767319342.041412:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4186
00000100:00100000:1.0:1767319342.041419:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379734656:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319342.041465:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379734656:12345-0@lo:400:kworker.0 Request processed in 47us (265us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319342.041472:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4186
00000100:00100000:1.0:1767319342.041502:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4187
00000100:00100000:1.0:1767319342.041508:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379734912:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319342.041534:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379734912:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319342.041539:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4187
00000100:00100000:1.0:1767319342.041560:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379734528:0@lo:400:kworker.0
00000100:00100000:1.0:1767319342.041585:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319342.041630:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379734528
00000100:00100000:1.0:1767319342.041634:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379734528
00000100:00100000:1.0:1767319342.041660:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483
00000100:00100000:1.0:1767319342.041665:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379734528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319342.041697:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379734528:12345-0@lo:400:kworker.0 Request processed in 32us (111us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319342.041703:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483
00000100:00100000:1.0:1767319342.041730:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379734528:0@lo:400:kworker.0
00000100:00100000:1.0:1767319342.041753:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379734912:0@lo:400:kworker.0
00000100:00100000:1.0:1767319342.041762:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379734656:0@lo:400:kworker.0
00000100:00080000:0.0:1767319342.042154:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319342.042159:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319342.042352:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379734144:0@lo:250:kworker.0
00000400:00000100:3.0:1767319342.042383:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379734144 offset 0 length 520: 4
00000100:00100000:3.0:1767319342.042407:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379734272:0@lo:38:kworker.0
00000100:00100000:3.0:1767319342.042432:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319342.042460:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379734400:0@lo:38:kworker.0
00000100:00100000:3.0:1767319342.042493:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319342.042518:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379734784:0@lo:38:kworker.0
00000100:00100000:3.0:1767319342.042539:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319342.042562:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379735040:0@lo:38:kworker.0
00000100:00100000:3.0:1767319342.042585:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319342.042629:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379734272
00000100:00100000:3.0:1767319342.042634:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379734272
00000100:00100000:3.0:1767319342.042657:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379734784
00000100:00100000:3.0:1767319342.042659:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379734784
00000100:00100000:3.0:1767319342.042670:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735040
00000100:00100000:3.0:1767319342.042672:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735040
00000100:00100000:3.0:1767319342.042685:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16884
00000100:00100000:3.0:1767319342.042690:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379734272:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319342.042707:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319342.042744:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379734272:12345-0@lo:38:kworker.0 Request processed in 53us (310us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319342.042750:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16884
00000100:00100000:3.0:1767319342.042762:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16885
00000100:00100000:3.0:1767319342.042766:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379734784:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319342.042773:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319342.042793:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379734784:12345-0@lo:38:kworker.0 Request processed in 25us (253us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319342.042797:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16885
00000100:00100000:3.0:1767319342.042806:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16886
00000100:00100000:3.0:1767319342.042810:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379735040:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319342.042818:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319342.042852:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379735040:12345-0@lo:38:kworker.0 Request processed in 40us (267us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319342.042857:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16886
00000100:00080000:3.0:1767319342.042914:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319342.042920:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319342.042923:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379734272:0@lo:38:kworker.0
00000100:00080000:3.0:1767319342.042932:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319342.042934:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319342.042937:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379734784:0@lo:38:kworker.0
00000100:00080000:3.0:1767319342.042942:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319342.042945:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319342.042947:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379735040:0@lo:38:kworker.0
00000100:00100000:1.0:1767319342.043742:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379734400
00000100:00100000:1.0:1767319342.043749:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379734400
00000100:00100000:1.0:1767319342.043784:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983
00000100:00100000:1.0:1767319342.043790:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379734400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319342.043803:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319342.043863:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379734400:12345-0@lo:38:kworker.0 Request processed in 72us (1380us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319342.043893:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983
00000100:00080000:3.0:1767319342.044200:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319342.044206:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319342.044211:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379734400:0@lo:38:kworker.0
00010000:00010000:0.0:1767319342.551573:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319343.575342:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379735168:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319343.575430:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319343.575661:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735168
00000100:00100000:2.0:1767319343.575670:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735168
00000100:00100000:2.0:1767319343.575731:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249
00000100:00100000:2.0:1767319343.575745:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379735168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319343.575782:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319343.575842:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379735168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (412us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319343.575851:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249
00000100:00100000:0.0:1767319343.575912:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379735168:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319343.577492:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319344.017088:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319344.017298:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291911936
00000100:00100000:2.0:1767319344.017309:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291911936
00000100:00100000:2.0:1767319344.017378:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16887
00000100:00100000:2.0:1767319344.017388:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291911936:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319344.017415:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319344.017498:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291911936:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 110us (421us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319344.017506:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16887
00000100:00100000:1.0:1767319344.020709:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319344.020855:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291912064
00000100:00100000:0.0:1767319344.020901:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291912064
00000100:00100000:0.0:1767319344.020982:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4188
00000100:00100000:0.0:1767319344.020994:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291912064:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319344.021086:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291912064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 95us (387us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319344.021095:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4188
00000100:00080000:1.0:1767319344.021310:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319344.599115:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319345.623146:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319346.647033:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319347.159432:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319347.159466:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379735296:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319347.159469:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319347.159475:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319347.159479:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319347.159483:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319347.159488:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319347.159495:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4244
00000100:00080000:3.0:1767319347.159498:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319347.159504:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319347.159532:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379735424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319347.159550:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319347.159554:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767319347.159556:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319347.159556:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319347.159560:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4244
00000100:00080000:3.0:1767319347.159562:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319347.159566:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319347.159577:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e0700 x1853164379735552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319347.159605:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319347.159608:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319347.159610:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319347.159614:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4244
00000100:00080000:3.0:1767319347.159616:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319347.159619:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319347.159629:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e0000 x1853164379735936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319347.159630:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735296
00000100:00100000:2.0:1767319347.159637:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735296
00000100:00080000:3.0:1767319347.159647:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319347.159650:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319347.159652:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319347.159656:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4244
00000100:00080000:3.0:1767319347.159658:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319347.159662:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319347.159670:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1880 x1853164379736192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319347.159692:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379735424:0@lo:38:kworker.0
00000100:00100000:2.0:1767319347.159696:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250
00000100:00100000:2.0:1767319347.159705:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379735296:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319347.159725:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:2.0:1767319347.159736:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319347.159751:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379735552:0@lo:38:kworker.0
00000100:00100000:3.0:1767319347.159771:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319347.159774:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379735296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (219us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319347.159782:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250
00000100:00100000:3.0:1767319347.159791:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379735936:0@lo:38:kworker.0
00000100:00100000:2.0:1767319347.159809:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735424
00000100:00100000:2.0:1767319347.159812:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735424
00000100:00100000:3.0:1767319347.159813:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319347.159830:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735936
00000100:00100000:3.0:1767319347.159830:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379736192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319347.159832:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735936
00000100:00100000:2.0:1767319347.159849:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16888
00000100:00100000:3.0:1767319347.159849:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319347.159854:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379735424:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319347.159895:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735552
00010000:00020000:2.0:1767319347.159898:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319347.159899:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735552
00000100:00100000:3.0:1767319347.159922:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984
00000100:00100000:3.0:1767319347.159926:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379735552:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319347.159931:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379735424:12345-0@lo:38:kworker.0 Request processed in 77us (206us total) trans 0 rc -19/-19
00010000:00020000:3.0:1767319347.159936:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319347.159937:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16888
00000100:00100000:2.0:1767319347.159947:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736192
00000100:00100000:2.0:1767319347.159950:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736192
00000100:00100000:3.0:1767319347.159959:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379735552:12345-0@lo:38:kworker.0 Request processed in 32us (187us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319347.159965:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16889
00000100:00100000:3.0:1767319347.159965:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984
00000100:00100000:2.0:1767319347.159969:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379735936:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319347.159978:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319347.159983:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16890
00000100:00100000:3.0:1767319347.159987:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379736192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319347.159997:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319347.159998:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379735936:12345-0@lo:38:kworker.0 Request processed in 28us (185us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319347.160004:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16889
00000100:00100000:3.0:1767319347.160020:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379736192:12345-0@lo:38:kworker.0 Request processed in 31us (170us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319347.160026:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16890
00000100:00100000:2.0:1767319347.160043:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379736064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319347.160064:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319347.160064:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319347.160068:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319347.160072:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379735424:0@lo:38:kworker.0
00000100:00080000:3.0:1767319347.160082:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319347.160085:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319347.160088:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379735552:0@lo:38:kworker.0
00000100:00100000:2.0:1767319347.160090:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379735296:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319347.160095:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319347.160097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319347.160100:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379735936:0@lo:38:kworker.0
00000100:00080000:3.0:1767319347.160106:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319347.160109:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319347.160112:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379736192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319347.160116:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736064
00000100:00100000:2.0:1767319347.160119:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736064
00000100:00100000:2.0:1767319347.160144:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4189
00000100:00100000:2.0:1767319347.160151:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379736064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319347.160494:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379736064:12345-0@lo:400:kworker.0 Request processed in 342us (427us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319347.160501:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4189
00000100:00100000:2.0:1767319347.160530:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379735808:0@lo:400:kworker.0
00000100:00100000:2.0:1767319347.160555:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319347.160573:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319347.160580:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379735680:0@lo:400:kworker.0
00000100:00100000:2.0:1767319347.160602:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319347.160628:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735680
00000100:00100000:2.0:1767319347.160631:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735680
00000100:00100000:2.0:1767319347.160671:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484
00000100:00100000:2.0:1767319347.160678:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379735680:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319347.160742:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379735680:12345-0@lo:400:kworker.0 Request processed in 64us (139us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319347.160747:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484
00000100:00100000:2.0:1767319347.160772:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379735680:0@lo:400:kworker.0
00000100:00100000:2.0:1767319347.160786:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379735808
00000100:00100000:2.0:1767319347.160789:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379735808
00000100:00100000:2.0:1767319347.160811:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4190
00000100:00100000:2.0:1767319347.160817:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379735808:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319347.160847:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379735808:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319347.160853:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4190
00000100:00080000:1.0:1767319347.161055:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319347.161061:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319347.161063:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319347.161212:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379736064:0@lo:400:kworker.0
00000100:00100000:3.0:1767319347.161245:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379735808:0@lo:400:kworker.0
00010000:00010000:1.0:1767319347.671229:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319348.695736:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379736320:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319348.695815:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1767319348.696561:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319348.696683:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736320
00000100:00100000:2.0:1767319348.696694:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736320
00000100:00100000:2.0:1767319348.696757:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251
00000100:00100000:2.0:1767319348.696767:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379736320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319348.696798:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319348.696896:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379736320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (1053us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319348.696905:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251
00000100:00100000:0.0:1767319348.697132:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379736320:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319349.137150:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319349.137261:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291912320
00000100:00100000:2.0:1767319349.137272:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291912320
00000100:00100000:2.0:1767319349.137351:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4191
00000100:00100000:2.0:1767319349.137361:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291912320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319349.137460:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291912320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 100us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319349.137468:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4191
00000100:00080000:1.0:1767319349.137614:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319349.139560:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319349.139691:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291912192
00000100:00100000:0.0:1767319349.139702:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291912192
00000100:00100000:0.0:1767319349.139800:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16891
00000100:00100000:0.0:1767319349.139810:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291912192:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319349.139835:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319349.139943:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291912192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 132us (391us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319349.139951:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16891
00010000:00010000:2.0:1767319349.719987:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319350.743158:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319351.767329:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319352.279238:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379736448:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319352.279288:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319352.279295:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319352.279298:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319352.279302:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319352.279307:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319352.279312:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4249
00000100:00080000:2.0:1767319352.279317:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319352.279324:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319352.279341:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319352.279355:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570380 x1853164379736576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319352.279548:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319352.279552:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319352.279554:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319352.279559:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4249
00000100:00080000:2.0:1767319352.279562:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319352.279567:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319352.279583:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572d80 x1853164379736704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319352.279647:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379736832:0@lo:400:kworker.0
00000100:00100000:0.0:1767319352.279699:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319352.279724:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319352.279727:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319352.279730:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319352.279734:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4249
00000100:00080000:2.0:1767319352.279737:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319352.279740:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319352.279743:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736832
00000100:00100000:0.0:1767319352.279752:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736832
00000100:00100000:2.0:1767319352.279754:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573480 x1853164379737088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319352.279769:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319352.279773:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319352.279774:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319352.279778:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4249
00000100:00080000:2.0:1767319352.279780:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319352.279784:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319352.279793:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573100 x1853164379737344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319352.279819:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485
00000100:00100000:2.0:1767319352.279828:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379737216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319352.279830:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379736832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319352.279887:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319352.279910:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379736832:12345-0@lo:400:kworker.0 Request processed in 82us (210us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319352.279910:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319352.279915:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379736960:0@lo:400:kworker.0
00000100:00100000:0.0:1767319352.279918:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485
00000100:00100000:2.0:1767319352.279937:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319352.279952:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737216
00000100:00100000:0.0:1767319352.279956:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737216
00000100:00100000:2.0:1767319352.279964:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736960
00000100:00100000:2.0:1767319352.279967:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736960
00000100:00100000:0.0:1767319352.279988:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4192
00000100:00100000:2.0:1767319352.279992:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4193
00000100:00100000:2.0:1767319352.279997:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379736960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319352.280008:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379737216:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319352.280035:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379737216:12345-0@lo:400:kworker.0 Request processed in 40us (166us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319352.280035:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379736960:12345-0@lo:400:kworker.0 Request processed in 36us (97us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319352.280042:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4193
00000100:00100000:0.0:1767319352.280045:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4192
00000100:00100000:2.0:1767319352.280089:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379736960:0@lo:400:kworker.0
00000100:00100000:1.0:1767319352.280183:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379736576:0@lo:38:kworker.0
00000100:00100000:3.0:1767319352.280192:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736448
00000100:00100000:3.0:1767319352.280196:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736448
00000100:00100000:3.0:1767319352.280236:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252
00000100:00100000:3.0:1767319352.280244:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379736448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319352.280286:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319352.280313:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379736832:0@lo:400:kworker.0
00000100:00100000:3.0:1767319352.280332:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379736448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (991us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319352.280339:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252
00000100:00100000:0.0:1767319352.280361:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379736448:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319352.280383:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319352.280397:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319352.280400:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319352.282809:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379737216:0@lo:400:kworker.0
00000100:00100000:1.0:1767319352.283550:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319352.283672:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379736704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319352.284893:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319352.284981:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379737088:0@lo:38:kworker.0
00000100:00100000:1.0:1767319352.285032:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319352.285214:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736704
00000100:00100000:3.0:1767319352.285226:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736704
00000100:00100000:3.0:1767319352.285299:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985
00000100:00100000:3.0:1767319352.285310:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379736704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319352.285341:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319352.289588:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379737344:0@lo:38:kworker.0
00000100:00100000:1.0:1767319352.289774:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319352.289864:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379736576
00000100:00100000:0.0:1767319352.289909:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379736576
00000100:00100000:0.0:1767319352.289977:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737088
00000100:00100000:0.0:1767319352.289981:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737088
00000100:00100000:0.0:1767319352.293695:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16892
00000100:00100000:0.0:1767319352.293715:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379736576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319352.293764:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319352.293927:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379736576:12345-0@lo:38:kworker.0 Request processed in 214us (10380us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319352.293936:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16892
00000100:00100000:0.0:1767319352.293962:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16893
00000100:00100000:0.0:1767319352.293967:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379737088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319352.293978:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319352.294007:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379737088:12345-0@lo:38:kworker.0 Request processed in 38us (8974us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319352.294013:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16893
00000100:00080000:1.0:1767319352.294692:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319352.294702:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319352.294707:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379736576:0@lo:38:kworker.0
00000100:00080000:1.0:1767319352.294722:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319352.294726:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319352.294729:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379737088:0@lo:38:kworker.0
00000100:00100000:0.0:1767319352.294996:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737344
00000100:00100000:0.0:1767319352.295005:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737344
00000100:00100000:0.0:1767319352.295053:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16894
00000100:00100000:0.0:1767319352.295058:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379737344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319352.295074:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319352.295119:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379737344:12345-0@lo:38:kworker.0 Request processed in 60us (5347us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319352.295125:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16894
00000100:00080000:1.0:1767319352.295324:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319352.295329:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319352.295333:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379737344:0@lo:38:kworker.0
00000100:00100000:3.0:1767319352.322695:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379736704:12345-0@lo:38:kworker.0 Request processed in 37369us (37792us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319352.322716:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985
00000100:00080000:1.0:1767319352.324939:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319352.324954:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319352.324960:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379736704:0@lo:38:kworker.0
00010000:00010000:3.0:1767319352.796067:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319353.815619:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379737472:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319353.815705:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319353.815823:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737472
00000100:00100000:2.0:1767319353.815832:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737472
00000100:00100000:2.0:1767319353.815895:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253
00000100:00100000:2.0:1767319353.815905:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379737472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319353.815948:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319353.815994:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379737472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (289us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319353.816002:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253
00000100:00100000:0.0:1767319353.817635:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379737472:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319353.817725:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319354.262030:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319354.262093:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319354.262316:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291912448
00000100:00100000:1.0:1767319354.262327:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291912448
00000100:00100000:1.0:1767319354.262379:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291912576
00000100:00100000:1.0:1767319354.262383:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291912576
00000100:00100000:1.0:1767319354.262434:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4194
00000100:00100000:1.0:1767319354.262444:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291912576:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319354.262526:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291912576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (433us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319354.262534:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4194
00000100:00100000:1.0:1767319354.262558:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16895
00000100:00100000:1.0:1767319354.262563:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291912448:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319354.262588:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319354.262615:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291912448:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (600us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319354.262621:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16895
00000100:00080000:3.0:1767319354.262690:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319354.839410:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319355.869127:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319356.888202:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319357.399336:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379737600:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319357.399437:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319357.399606:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737600
00000100:00100000:0.0:1767319357.399617:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737600
00000100:00100000:0.0:1767319357.399681:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254
00000100:00100000:0.0:1767319357.399691:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379737600:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319357.399725:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767319357.399949:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319357.399954:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319357.399957:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319357.399961:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319357.399966:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319357.399972:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4254
00000100:00080000:3.0:1767319357.399976:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767319357.399982:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319357.400010:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e2680 x1853164379737728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319357.400037:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319357.400040:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319357.400042:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319357.400046:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4254
00000100:00080000:3.0:1767319357.400049:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767319357.400052:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319357.400066:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1880 x1853164379737856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319357.400102:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319357.400106:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319357.400107:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319357.400111:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4254
00000100:00080000:3.0:1767319357.400113:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:3.0:1767319357.400117:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319357.400127:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e2300 x1853164379738240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319357.401301:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379737728:0@lo:38:kworker.0
00000100:00100000:2.0:1767319357.401378:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319357.401427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379737856:0@lo:38:kworker.0
00000100:00100000:2.0:1767319357.401453:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319357.401484:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379738240:0@lo:38:kworker.0
00000100:00100000:2.0:1767319357.401506:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319357.401548:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737728
00000100:00100000:2.0:1767319357.401554:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737728
00000100:00100000:2.0:1767319357.401584:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379738240
00000100:00100000:2.0:1767319357.401587:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379738240
00000100:00100000:2.0:1767319357.401608:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16896
00000100:00100000:2.0:1767319357.401614:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379737728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319357.401635:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319357.401672:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379737728:12345-0@lo:38:kworker.0 Request processed in 57us (294us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319357.401679:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16896
00000100:00100000:2.0:1767319357.401696:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16897
00000100:00100000:2.0:1767319357.401700:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379738240:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319357.401711:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319357.401734:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379738240:12345-0@lo:38:kworker.0 Request processed in 32us (227us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319357.401740:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16897
00000100:00080000:2.0:1767319357.401774:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319357.401779:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319357.401782:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379737728:0@lo:38:kworker.0
00000100:00080000:2.0:1767319357.401791:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319357.401795:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319357.401797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379738240:0@lo:38:kworker.0
00000100:00100000:2.0:1767319357.401859:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379738112:0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.401913:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319357.401933:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319357.401939:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379737984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.401964:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319357.401990:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319357.402001:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379738112
00000100:00100000:2.0:1767319357.402004:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379738112
00000100:00100000:2.0:1767319357.402039:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4195
00000100:00100000:2.0:1767319357.402046:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379738112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.402085:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379738112:12345-0@lo:400:kworker.0 Request processed in 40us (171us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319357.402091:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4195
00000100:00080000:2.0:1767319357.402106:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319357.402125:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379738112:0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.402151:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379738368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.402175:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319357.402202:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379738368
00000100:00100000:2.0:1767319357.402206:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379738368
00000100:00100000:2.0:1767319357.402228:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4196
00000100:00100000:2.0:1767319357.402233:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379738368:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.402262:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379738368:12345-0@lo:400:kworker.0 Request processed in 28us (86us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319357.402267:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4196
00000100:00080000:2.0:1767319357.402280:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319357.402294:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379738368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.402322:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737856
00000100:00100000:2.0:1767319357.402325:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737856
00000100:00100000:2.0:1767319357.402363:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986
00000100:00100000:2.0:1767319357.402367:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379737856:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319357.402378:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319357.402409:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379737856:12345-0@lo:38:kworker.0 Request processed in 40us (955us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319357.402415:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986
00000100:00080000:2.0:1767319357.402439:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319357.402443:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319357.402447:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379737856:0@lo:38:kworker.0
00000100:00100000:2.0:1767319357.402478:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379737984
00000100:00100000:2.0:1767319357.402482:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379737984
00000100:00100000:2.0:1767319357.402511:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486
00000100:00100000:2.0:1767319357.402517:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379737984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319357.402548:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379737984:12345-0@lo:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319357.402553:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486
00000100:00080000:2.0:1767319357.402569:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319357.402581:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379737984:0@lo:400:kworker.0
00000100:00100000:0.0:1767319357.410188:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379737600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 10486us (10739us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319357.410206:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254
00000100:00100000:1.0:1767319357.410380:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379737600:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319357.414922:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319357.414932:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319357.414937:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319357.414944:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4254
00000100:00080000:3.0:1767319357.414948:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319357.414964:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319357.415012:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1180 x1853164379738496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319357.415088:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379738496:0@lo:38:kworker.0
00000100:00100000:2.0:1767319357.415178:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319357.415259:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379738496
00000100:00100000:1.0:1767319357.415267:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379738496
00000100:00100000:1.0:1767319357.415311:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16898
00000100:00100000:1.0:1767319357.415319:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379738496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319357.415349:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319357.422070:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379738496:12345-0@lo:38:kworker.0 Request processed in 6735us (6876us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319357.422087:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16898
00000100:00080000:2.0:1767319357.423033:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319357.423042:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319357.423048:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379738496:0@lo:38:kworker.0
00010000:00010000:3.0:1767319357.912203:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319358.936189:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319358.937096:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379738624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319358.937193:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319358.937656:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379738624
00000100:00100000:1.0:1767319358.937666:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379738624
00000100:00100000:1.0:1767319358.937717:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255
00000100:00100000:1.0:1767319358.937727:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379738624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319358.937762:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319358.937833:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379738624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (639us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319358.937841:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255
00000100:00100000:0.0:1767319358.940045:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379738624:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319359.377370:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319359.377417:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319359.377507:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291912832
00000100:00100000:1.0:1767319359.377639:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291912832
00000100:00100000:1.0:1767319359.377771:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291912704
00000100:00100000:1.0:1767319359.377775:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291912704
00000100:00100000:1.0:1767319359.377817:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4197
00000100:00100000:1.0:1767319359.377832:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291912832:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319359.378027:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291912832:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 198us (666us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319359.378036:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4197
00000100:00100000:1.0:1767319359.378069:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16899
00000100:00100000:1.0:1767319359.378076:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291912704:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319359.378105:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319359.378278:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319359.378354:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291912704:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 276us (935us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319359.378363:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16899
00010000:00010000:1.0:1767319359.959281:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319360.983828:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319362.007582:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319362.520517:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379738752:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319362.520633:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319362.521370:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379738752
00000100:00100000:2.0:1767319362.521385:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379738752
00000100:00100000:2.0:1767319362.521483:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256
00000100:00100000:2.0:1767319362.521495:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379738752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319362.521536:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319362.521609:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379738752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (978us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319362.521618:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256
00000100:00100000:2.0:1767319362.521682:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379738752:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319362.521752:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319362.522760:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319362.522769:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319362.522772:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319362.522777:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319362.522782:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319362.522789:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4259
00000100:00080000:0.0:1767319362.522795:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767319362.522802:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319362.522845:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d500 x1853164379738880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319362.522907:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319362.522912:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319362.522914:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319362.522919:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4259
00000100:00080000:0.0:1767319362.522922:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767319362.522926:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319362.522943:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360ad80 x1853164379739008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319362.523006:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319362.523009:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319362.523011:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319362.523014:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4259
00000100:00080000:0.0:1767319362.523017:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767319362.523020:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319362.523029:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628700 x1853164379739392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319362.523045:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319362.523049:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319362.523051:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319362.523054:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4259
00000100:00080000:0.0:1767319362.523056:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319362.523060:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319362.523070:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629880 x1853164379739648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319362.523102:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379739520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319362.523149:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319362.523165:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319362.523168:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379739136:0@lo:400:kworker.0
00000100:00100000:1.0:1767319362.523216:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319362.523217:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319362.523226:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379739264:0@lo:400:kworker.0
00000100:00100000:0.0:1767319362.523272:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319362.523276:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739136
00000100:00100000:1.0:1767319362.523285:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739136
00000100:00100000:0.0:1767319362.523318:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739520
00000100:00100000:0.0:1767319362.523323:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739520
00000100:00100000:1.0:1767319362.523357:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487
00000100:00100000:1.0:1767319362.523367:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379739136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319362.523423:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379739136:12345-0@lo:400:kworker.0 Request processed in 58us (208us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319362.523431:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487
00000100:00100000:1.0:1767319362.523464:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739264
00000100:00100000:1.0:1767319362.523469:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739264
00000100:00100000:1.0:1767319362.523496:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4198
00000100:00100000:1.0:1767319362.523503:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379739264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319362.523747:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4199
00000100:00100000:0.0:1767319362.523760:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379739520:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319362.523766:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379739264:12345-0@lo:400:kworker.0 Request processed in 246us (480us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319362.523789:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4198
00000100:00080000:3.0:1767319362.523802:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319362.523812:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319362.523819:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379739520:12345-0@lo:400:kworker.0 Request processed in 62us (653us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319362.523828:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4199
00000100:00100000:0.0:1767319362.523923:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379739264:0@lo:400:kworker.0
00000100:00100000:3.0:1767319362.523924:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379739136:0@lo:400:kworker.0
00000100:00100000:0.0:1767319362.523945:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379739520:0@lo:400:kworker.0
00000100:00100000:2.0:1767319362.524493:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379738880:0@lo:38:kworker.0
00000100:00100000:2.0:1767319362.524545:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319362.524584:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379739008:0@lo:38:kworker.0
00000100:00100000:2.0:1767319362.524609:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319362.524646:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379739392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319362.524667:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319362.524689:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379739648:0@lo:38:kworker.0
00000100:00100000:2.0:1767319362.524715:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319362.524749:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379738880
00000100:00100000:1.0:1767319362.524763:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379738880
00000100:00100000:2.0:1767319362.524774:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739392
00000100:00100000:2.0:1767319362.524781:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739392
00000100:00100000:1.0:1767319362.524811:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739648
00000100:00100000:1.0:1767319362.524817:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739648
00000100:00100000:3.0:1767319362.524897:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739008
00000100:00100000:3.0:1767319362.524910:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739008
00000100:00100000:3.0:1767319362.524946:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987
00000100:00100000:3.0:1767319362.524953:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379739008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319362.524977:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319362.525036:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379739008:12345-0@lo:38:kworker.0 Request processed in 82us (425us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319362.525042:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987
00000100:00080000:3.0:1767319362.525374:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319362.525381:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319362.525385:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379739008:0@lo:38:kworker.0
00000100:00100000:2.0:1767319362.525488:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16900
00000100:00100000:2.0:1767319362.525496:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379738880:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319362.525509:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319362.525551:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379738880:12345-0@lo:38:kworker.0 Request processed in 53us (1005us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319362.525557:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16900
00000100:00100000:2.0:1767319362.525579:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16901
00000100:00100000:2.0:1767319362.525583:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379739392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319362.525592:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319362.525617:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379739392:12345-0@lo:38:kworker.0 Request processed in 32us (948us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319362.525622:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16901
00000100:00100000:2.0:1767319362.525636:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16902
00000100:00100000:2.0:1767319362.525640:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379739648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319362.525650:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319362.525672:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379739648:12345-0@lo:38:kworker.0 Request processed in 30us (960us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319362.525678:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16902
00000100:00080000:2.0:1767319362.525710:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319362.525715:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319362.525719:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379738880:0@lo:38:kworker.0
00000100:00080000:2.0:1767319362.525728:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319362.525732:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319362.525735:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379739392:0@lo:38:kworker.0
00000100:00080000:2.0:1767319362.525744:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319362.525748:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319362.525751:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379739648:0@lo:38:kworker.0
00010000:00010000:0.0:1767319363.031328:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319363.474392:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319363.475117:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913216
00000100:00100000:3.0:1767319363.475136:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913216
00000100:00080000:1.0:1767319363.475223:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319363.475249:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4200
00000100:00100000:3.0:1767319363.475262:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291913216:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319363.475371:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291913216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 112us (995us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319363.475379:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4200
00000400:00000100:0.0:1767319363.479910:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291912960 offset 0 length 520: 4
00000100:00100000:0.0:1767319363.480452:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319363.483479:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913088
00000100:00100000:2.0:1767319363.483504:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913088
00000100:00100000:2.0:1767319363.483611:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16903
00000100:00100000:2.0:1767319363.483623:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291913088:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319363.483659:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319363.485009:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291913088:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1364us (4537us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319363.485028:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16903
00010000:00010000:1.0:1767319364.055764:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319364.055918:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379739776:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319364.056024:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319364.056166:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739776
00000100:00100000:1.0:1767319364.056176:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739776
00000100:00100000:1.0:1767319364.056294:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257
00000100:00100000:1.0:1767319364.056307:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379739776:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319364.056313:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:1.0:1767319364.056349:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319364.063412:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379739776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7089us (7369us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319364.063433:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257
00000100:00100000:3.0:1767319364.063729:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379739776:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319365.081515:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319366.103497:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319367.127079:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319367.639229:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319367.639261:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379739904:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319367.639355:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319367.639969:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319367.639976:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319367.639980:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319367.639984:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319367.639989:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319367.639996:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4264
00000100:00080000:1.0:1767319367.640002:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:1.0:1767319367.640010:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319367.640045:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafed80 x1853164379740032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319367.640062:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319367.640066:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319367.640068:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319367.640072:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4264
00000100:00080000:1.0:1767319367.640075:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:1.0:1767319367.640079:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319367.640096:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dce00 x1853164379740160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319367.640143:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319367.640146:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319367.640147:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319367.640151:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4264
00000100:00080000:1.0:1767319367.640153:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:1.0:1767319367.640157:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319367.640167:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df800 x1853164379740544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319367.640206:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319367.640210:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319367.640212:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319367.640226:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4264
00000100:00080000:1.0:1767319367.640228:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319367.640232:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319367.640244:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddf80 x1853164379740800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319367.640284:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379740672:0@lo:400:kworker.0
00000100:00100000:1.0:1767319367.640333:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319367.640346:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379739904
00000100:00100000:2.0:1767319367.640359:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379739904
00000100:00100000:1.0:1767319367.640400:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379740672
00000100:00100000:1.0:1767319367.640405:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379740672
00000100:00100000:1.0:1767319367.640457:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4201
00000100:00100000:2.0:1767319367.640457:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258
00000100:00100000:2.0:1767319367.640473:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379739904:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319367.640474:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379740672:12345-0@lo:400:kworker.0
00002000:00000024:2.0:1767319367.640513:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319367.640540:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379740672:12345-0@lo:400:kworker.0 Request processed in 70us (205us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319367.640553:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4201
00000100:00100000:2.0:1767319367.640557:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379739904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1200us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319367.640563:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258
00000100:00080000:2.0:1767319367.640583:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319367.640588:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319367.640616:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379740672:0@lo:400:kworker.0
00000100:00100000:1.0:1767319367.640636:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379739904:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319367.640913:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319342/real 1767319342]  req@ffff8b0f08e9e680 x1853164379734144/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319367 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319367.640931:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f08e9e680 x1853164379734144/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319367 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319367.640942:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379740032:0@lo:38:kworker.0
00000100:00100000:3.0:1767319367.640967:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319367.640989:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379740160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319367.641007:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319367.641027:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379740544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319367.641041:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319367.641052:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379740800:0@lo:38:kworker.0
00000100:00100000:3.0:1767319367.641066:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319367.641078:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767319367.641088:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379740416:0@lo:400:kworker.0
00000100:00080000:3.0:1767319367.641091:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319367.641097:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379734144:0@lo:250:kworker.0
00000100:00100000:3.0:1767319367.641117:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379740032
00000100:00100000:3.0:1767319367.641120:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379740032
00000100:00100000:0.0:1767319367.641135:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319367.641169:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319367.641185:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379740160
00000100:00100000:1.0:1767319367.641189:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379740160
00000100:00100000:0.0:1767319367.641191:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379740288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319367.641209:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988
00000100:00100000:1.0:1767319367.641216:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379740160:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319367.641235:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:1.0:1767319367.641239:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319367.641351:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379740160:12345-0@lo:38:kworker.0 Request processed in 133us (341us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319367.641358:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988
00000100:00100000:3.0:1767319367.641425:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379740544
00000100:00100000:3.0:1767319367.641428:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379740544
00000100:00100000:3.0:1767319367.641444:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379740800
00000100:00100000:3.0:1767319367.641445:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379740800
00000100:00100000:3.0:1767319367.641451:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379740416
00000100:00100000:3.0:1767319367.641452:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379740416
00000100:00100000:3.0:1767319367.641471:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4202
00000100:00100000:3.0:1767319367.641475:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379740416:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319367.641501:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379740416:12345-0@lo:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319367.641506:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4202
00000100:00100000:3.0:1767319367.641514:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16904
00000100:00100000:3.0:1767319367.641517:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379740032:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319367.641524:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319367.641538:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379740032:12345-0@lo:38:kworker.0 Request processed in 20us (570us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319367.641542:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16904
00000100:00100000:3.0:1767319367.641548:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16905
00000100:00100000:3.0:1767319367.641550:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379740544:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319367.641556:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319367.641567:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379740544:12345-0@lo:38:kworker.0 Request processed in 16us (525us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319367.641571:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16905
00000100:00100000:3.0:1767319367.641576:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16906
00000100:00100000:3.0:1767319367.641578:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379740800:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319367.641584:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319367.641597:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379740800:12345-0@lo:38:kworker.0 Request processed in 18us (530us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319367.641600:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16906
00000100:00080000:3.0:1767319367.641615:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319367.641630:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319367.641633:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319367.641635:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379740032:0@lo:38:kworker.0
00000100:00080000:3.0:1767319367.641642:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319367.641644:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319367.641646:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379740160:0@lo:38:kworker.0
00000100:00080000:3.0:1767319367.641651:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319367.641653:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319367.641655:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379740544:0@lo:38:kworker.0
00000100:00080000:3.0:1767319367.641659:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319367.641662:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319367.641665:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379740800:0@lo:38:kworker.0
00000100:00080000:3.0:1767319367.641704:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319367.641708:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319367.641711:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319367.641715:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4244
00000100:00080000:3.0:1767319367.641719:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319367.641724:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319367.641746:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1880 x1853164379740928/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319367.641771:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379740928:0@lo:250:kworker.0
00000400:00000100:3.0:1767319367.641786:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379740928 offset 0 length 520: 4
00000100:00100000:3.0:1767319367.641825:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379740288
00000100:00100000:3.0:1767319367.641827:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379740288
00000100:00100000:3.0:1767319367.641852:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488
00000100:00100000:3.0:1767319367.641855:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379740288:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319367.641903:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379740288:12345-0@lo:400:kworker.0 Request processed in 48us (670us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319367.641908:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488
00000100:00080000:3.0:1767319367.641920:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319367.641949:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379740288:0@lo:400:kworker.0
00000100:00100000:3.0:1767319367.641955:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379740416:0@lo:400:kworker.0
00010000:00010000:1.0:1767319368.157815:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319368.593987:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319368.594041:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319368.594139:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913472
00000100:00100000:1.0:1767319368.594152:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913472
00000100:00100000:1.0:1767319368.594349:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913344
00000100:00100000:1.0:1767319368.594353:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913344
00000100:00100000:1.0:1767319368.594385:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4203
00000100:00100000:1.0:1767319368.594400:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291913472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319368.594513:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291913472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 117us (542us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319368.594522:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4203
00000100:00100000:1.0:1767319368.594547:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16907
00000100:00100000:1.0:1767319368.594552:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291913344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319368.594577:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319368.594605:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291913344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (566us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319368.594611:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16907
00000100:00080000:3.0:1767319368.595796:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319369.175474:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319369.175908:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379741056:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319369.176010:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319369.176159:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741056
00000100:00100000:2.0:1767319369.176171:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741056
00000100:00100000:2.0:1767319369.176420:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259
00000100:00100000:2.0:1767319369.176432:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379741056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319369.176474:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319369.176541:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379741056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (531us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319369.176550:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259
00000100:00100000:2.0:1767319369.176629:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379741056:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319369.176699:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319370.203099:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319371.223097:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319372.247196:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319372.760886:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319372.760901:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319372.760904:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319372.760909:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319372.760914:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319372.760926:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4270
00000100:00080000:3.0:1767319372.760933:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319372.760945:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319372.760986:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e2300 x1853164379741184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319372.761002:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319372.761006:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319372.761008:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767319372.761014:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00080000:3.0:1767319372.761014:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4270
00000100:00080000:3.0:1767319372.761017:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319372.761023:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319372.761033:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379741312:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319372.761130:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319372.761229:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741312
00000100:00100000:1.0:1767319372.761238:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741312
00000100:00100000:3.0:1767319372.761244:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e2680 x1853164379741440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319372.761314:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260
00000100:00100000:1.0:1767319372.761325:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379741312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319372.761360:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319372.761405:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379741312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (275us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319372.761412:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260
00000100:00100000:1.0:1767319372.761460:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319372.761468:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379741568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319372.761497:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319372.761529:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741568
00000100:00100000:1.0:1767319372.761533:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741568
00000100:00100000:1.0:1767319372.761566:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489
00000100:00100000:1.0:1767319372.761572:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379741568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319372.761607:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379741568:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319372.761612:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489
00000100:00100000:1.0:1767319372.761658:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379741568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319372.761699:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379741312:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319372.761728:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319372.761737:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379741696:0@lo:400:kworker.0
00000100:00100000:1.0:1767319372.761767:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319372.762436:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319372.762443:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319372.762447:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319372.762452:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4270
00000100:00080000:3.0:1767319372.762457:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319372.762463:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319372.762509:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360ad80 x1853164379741824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319372.762857:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379741184:0@lo:38:kworker.0
00000100:00100000:0.0:1767319372.762929:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319372.762987:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379741440:0@lo:38:kworker.0
00000100:00100000:1.0:1767319372.763008:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741696
00000100:00100000:0.0:1767319372.763023:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319372.763027:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741696
00000100:00100000:0.0:1767319372.763068:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379741824:0@lo:38:kworker.0
00000100:00100000:1.0:1767319372.763100:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741184
00000100:00100000:0.0:1767319372.763109:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319372.763111:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741184
00000100:00100000:1.0:1767319372.763148:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741824
00000100:00100000:1.0:1767319372.763151:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741824
00000100:00100000:1.0:1767319372.763176:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4204
00000100:00100000:1.0:1767319372.763191:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379741696:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319372.763292:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319372.763300:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319372.763303:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319372.763323:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16908
00000100:00100000:0.0:1767319372.763331:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379741184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319372.763357:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319372.763409:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379741184:12345-0@lo:38:kworker.0 Request processed in 77us (478us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319372.763417:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16908
00000100:00100000:0.0:1767319372.763444:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16909
00000100:00100000:0.0:1767319372.763449:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379741824:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319372.763460:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319372.763484:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379741824:12345-0@lo:38:kworker.0 Request processed in 33us (381us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319372.763490:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16909
00000100:00100000:0.0:1767319372.763511:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741440
00000100:00100000:0.0:1767319372.763517:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741440
00000100:00100000:0.0:1767319372.763556:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989
00000100:00100000:0.0:1767319372.763562:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379741440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319372.763574:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319372.763607:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379741440:12345-0@lo:38:kworker.0 Request processed in 44us (584us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767319372.764141:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319372.764147:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319372.764152:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319372.764158:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4270
00000100:00080000:3.0:1767319372.764162:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319372.764170:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319372.764216:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379742080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319372.764254:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319372.764269:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379741952:0@lo:400:kworker.0
00000100:00100000:3.0:1767319372.764317:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319372.765548:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989
00000100:00100000:0.0:1767319372.765634:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379741952
00000100:00100000:0.0:1767319372.765646:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379741952
00000100:00100000:0.0:1767319372.765719:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4205
00000100:00100000:0.0:1767319372.765729:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379741952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319372.765842:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379741952:12345-0@lo:400:kworker.0 Request processed in 115us (1524us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319372.765850:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4205
00000100:00080000:0.0:1767319372.765910:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319372.766052:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379742080:0@lo:38:kworker.0
00000100:00100000:0.0:1767319372.766100:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319372.766162:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319372.766170:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319372.766175:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379741184:0@lo:38:kworker.0
00000100:00080000:0.0:1767319372.766198:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319372.766214:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379741952:0@lo:400:kworker.0
00000100:00100000:2.0:1767319372.766280:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742080
00000100:00100000:2.0:1767319372.766287:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742080
00000100:00100000:2.0:1767319372.766342:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16910
00000100:00100000:2.0:1767319372.766350:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379742080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319372.766372:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319372.766450:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379742080:12345-0@lo:38:kworker.0 Request processed in 99us (351us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319372.766457:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16910
00000100:00080000:0.0:1767319372.766681:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319372.766688:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379741440:0@lo:38:kworker.0
00000100:00080000:0.0:1767319372.766714:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319372.766719:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319372.766725:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379741824:0@lo:38:kworker.0
00000100:00100000:1.0:1767319372.766730:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379741696:12345-0@lo:400:kworker.0 Request processed in 3538us (4954us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319372.766742:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4204
00000100:00080000:0.0:1767319372.766785:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319372.766793:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319372.766797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379742080:0@lo:38:kworker.0
00000100:00100000:3.0:1767319372.767228:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379741696:0@lo:400:kworker.0
00010000:00010000:3.0:1767319373.271315:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319373.712356:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319373.714549:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319373.715037:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913728
00000100:00100000:1.0:1767319373.715064:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913728
00000100:00100000:1.0:1767319373.715160:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913600
00000100:00100000:1.0:1767319373.715164:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913600
00000100:00080000:0.0:1767319373.715389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319373.715446:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4206
00000100:00100000:1.0:1767319373.715459:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291913728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319373.715519:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16911
00000100:00100000:3.0:1767319373.715532:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291913600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319373.715565:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319373.715601:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291913728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 142us (3257us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319373.715610:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4206
00000100:00100000:3.0:1767319373.715631:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291913600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 96us (1095us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319373.715641:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16911
00000100:00100000:3.0:1767319374.295224:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379742208:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319374.295336:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319374.295581:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742208
00000100:00100000:2.0:1767319374.295594:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742208
00000100:00080000:1.0:1767319374.295756:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319374.295974:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261
00000100:00100000:2.0:1767319374.295987:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379742208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319374.296027:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319374.296218:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379742208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 234us (882us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319374.296228:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261
00000100:00100000:1.0:1767319374.296442:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379742208:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319374.296971:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319375.319137:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319376.343193:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319377.371049:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319377.879105:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319377.879118:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319377.879121:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319377.879125:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319377.879130:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319377.879141:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4275
00000100:00080000:1.0:1767319377.879147:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767319377.881215:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379742336:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319377.881319:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319377.881499:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742336
00000100:00100000:2.0:1767319377.881510:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742336
00000100:00100000:2.0:1767319377.881593:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262
00000100:00100000:2.0:1767319377.881603:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379742336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319377.881639:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319377.881694:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379742336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (375us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319377.881702:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262
00000100:00100000:2.0:1767319377.881769:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379742336:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319377.882035:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319377.882802:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319377.882849:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379742464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319377.884012:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319377.884019:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319377.884023:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319377.884028:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4275
00000100:00080000:1.0:1767319377.884032:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319377.884040:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319377.884066:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379742592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319377.884122:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319377.884125:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319377.884127:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319377.884131:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4275
00000100:00080000:1.0:1767319377.884133:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319377.884138:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319377.884151:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164379742976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319377.884173:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379742848:0@lo:400:kworker.0
00000100:00080000:1.0:1767319377.884208:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319377.884214:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319377.884215:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319377.884220:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4275
00000100:00080000:1.0:1767319377.884224:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319377.884229:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319377.884244:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164379743232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319377.884272:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319377.884299:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379743104:0@lo:400:kworker.0
00000100:00100000:3.0:1767319377.884344:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319377.884356:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379742720:0@lo:400:kworker.0
00000100:00100000:1.0:1767319377.884380:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319377.884430:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379742464:0@lo:38:kworker.0
00000100:00100000:2.0:1767319377.884528:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742848
00000100:00100000:2.0:1767319377.884538:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742848
00000100:00100000:2.0:1767319377.884612:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379743104
00000100:00100000:2.0:1767319377.884617:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379743104
00000100:00100000:2.0:1767319377.884653:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4207
00000100:00100000:2.0:1767319377.884665:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379742848:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319377.887130:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319377.887279:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4208
00000100:00100000:3.0:1767319377.887304:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379743104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319377.887398:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379743104:12345-0@lo:400:kworker.0 Request processed in 107us (3019us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319377.887407:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4208
00000100:00080000:3.0:1767319377.887490:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319377.887545:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742720
00000100:00100000:3.0:1767319377.887554:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742720
00000100:00100000:3.0:1767319377.887625:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490
00000100:00100000:3.0:1767319377.887633:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379742720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319377.887676:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379742720:12345-0@lo:400:kworker.0 Request processed in 45us (555us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319377.887683:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490
00000100:00080000:3.0:1767319377.887700:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319377.887740:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379742720:0@lo:400:kworker.0
00000100:00100000:1.0:1767319377.889024:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379743104:0@lo:400:kworker.0
00000100:00100000:0.0:1767319377.893125:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319377.893221:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379742592:0@lo:38:kworker.0
00000100:00100000:0.0:1767319377.893279:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319377.893335:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379742976:0@lo:38:kworker.0
00000100:00100000:0.0:1767319377.893363:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319377.893393:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379743232:0@lo:38:kworker.0
00000100:00100000:0.0:1767319377.893415:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319377.893644:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742464
00000100:00100000:3.0:1767319377.893656:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742464
00000100:00100000:3.0:1767319377.893705:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742976
00000100:00100000:3.0:1767319377.893708:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742976
00000100:00100000:3.0:1767319377.893722:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379743232
00000100:00100000:3.0:1767319377.893725:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379743232
00000100:00100000:3.0:1767319377.893741:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16912
00000100:00100000:3.0:1767319377.894072:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379742464:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319377.894101:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319377.894190:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379742464:12345-0@lo:38:kworker.0 Request processed in 439us (1075us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319377.894198:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16912
00000100:00100000:3.0:1767319377.894223:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16913
00000100:00100000:3.0:1767319377.894228:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379742976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319377.894239:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319377.894267:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379742976:12345-0@lo:38:kworker.0 Request processed in 37us (903us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319377.894273:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16913
00000100:00100000:3.0:1767319377.894285:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16914
00000100:00100000:3.0:1767319377.894290:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379743232:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319377.894300:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319377.894325:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379743232:12345-0@lo:38:kworker.0 Request processed in 34us (908us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319377.894331:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16914
00000100:00100000:1.0:1767319377.895319:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379742592
00000100:00100000:1.0:1767319377.895332:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379742592
00000100:00100000:1.0:1767319377.895385:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990
00000100:00100000:1.0:1767319377.895392:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379742592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319377.895410:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319377.895575:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379742592:12345-0@lo:38:kworker.0 Request processed in 183us (2295us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319377.895582:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990
00000100:00080000:1.0:1767319377.895662:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319377.895669:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319377.895673:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379742976:0@lo:38:kworker.0
00000100:00080000:1.0:1767319377.895689:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319377.895692:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319377.895695:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379743232:0@lo:38:kworker.0
00000100:00080000:1.0:1767319377.895707:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319377.895710:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319377.895713:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379742464:0@lo:38:kworker.0
00000100:00080000:1.0:1767319377.895724:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319377.895727:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319377.895730:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379742592:0@lo:38:kworker.0
00000100:00100000:2.0:1767319377.896022:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379742848:12345-0@lo:400:kworker.0 Request processed in 11358us (11750us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319377.896033:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4207
00000100:00100000:2.0:1767319377.896086:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379742848:0@lo:400:kworker.0
00010000:00010000:3.0:1767319378.391294:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319378.830993:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319378.831248:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913984
00000100:00100000:3.0:1767319378.831260:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913984
00000100:00100000:3.0:1767319378.831393:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4209
00000100:00100000:3.0:1767319378.831405:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291913984:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319378.831515:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291913984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (538us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319378.831523:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4209
00000100:00100000:2.0:1767319378.837831:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319378.839824:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291913856
00000100:00100000:3.0:1767319378.839845:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291913856
00000100:00100000:3.0:1767319378.839979:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16915
00000100:00100000:3.0:1767319378.839992:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291913856:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319378.840025:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319378.840137:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291913856:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 144us (2321us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319378.840166:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16915
00000100:00080000:0.0:1767319378.842004:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319379.415114:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319379.415678:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379743360:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319379.415774:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319379.415980:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379743360
00000100:00100000:0.0:1767319379.415991:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379743360
00000100:00100000:0.0:1767319379.416073:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263
00000100:00100000:0.0:1767319379.416084:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379743360:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319379.416134:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319379.416197:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379743360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (422us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319379.416205:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263
00000100:00100000:3.0:1767319379.416486:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379743360:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319379.416516:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319380.443182:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319381.463985:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319382.487612:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319382.999283:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319382.999296:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319382.999299:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319382.999302:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319382.999308:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319382.999318:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4280
00000100:00080000:2.0:1767319382.999323:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319382.999330:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319382.999375:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379743488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319382.999437:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379743488:0@lo:38:kworker.0
00000100:00100000:0.0:1767319382.999550:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319382.999683:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379743488
00000100:00100000:3.0:1767319382.999699:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379743488
00000100:00100000:1.0:1767319382.999721:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319382.999736:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379743616:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319382.999776:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16916
00000100:00100000:1.0:1767319382.999777:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319382.999793:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379743488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319382.999828:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319382.999841:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379743616
00000100:00100000:1.0:1767319382.999851:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379743616
00000100:00100000:1.0:1767319383.000068:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264
00000100:00100000:1.0:1767319383.000077:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379743616:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319383.000094:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319383.000098:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319383.000100:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319383.000105:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4280
00000100:00080000:2.0:1767319383.000116:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00002000:00000024:1.0:1767319383.000117:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767319383.000121:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319383.000137:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e680 x1853164379743744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319383.000164:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379743616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (391us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319383.000171:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264
00000100:00100000:1.0:1767319383.000219:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379743616:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319383.000273:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319383.004831:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379743744:0@lo:38:kworker.0
00000100:00100000:0.0:1767319383.004930:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319383.005214:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379743744
00000100:00100000:1.0:1767319383.005223:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379743744
00000100:00100000:1.0:1767319383.005265:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991
00000100:00100000:1.0:1767319383.005272:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379743744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319383.005294:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319383.005337:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379743744:12345-0@lo:38:kworker.0 Request processed in 64us (407us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319383.005344:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991
00000100:00100000:3.0:1767319383.011075:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379743488:12345-0@lo:38:kworker.0 Request processed in 11270us (11510us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319383.011095:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16916
00000100:00080000:2.0:1767319383.014335:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319383.014342:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319383.014345:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319383.014353:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4280
00000100:00080000:2.0:1767319383.014357:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319383.014364:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319383.014387:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23800 x1853164379744128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319383.014406:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319383.014410:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319383.014412:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319383.014415:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4280
00000100:00080000:2.0:1767319383.014418:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319383.014422:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319383.014432:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21f80 x1853164379744384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319383.014564:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319383.014583:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379743872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319383.014652:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319383.014709:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379744000:0@lo:400:kworker.0
00000100:00100000:1.0:1767319383.014734:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319383.014755:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319383.014761:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379744256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319383.014782:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319383.014812:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744000
00000100:00100000:1.0:1767319383.014819:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744000
00000100:00100000:1.0:1767319383.014891:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744256
00000100:00100000:1.0:1767319383.014894:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744256
00000100:00100000:1.0:1767319383.014919:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4210
00000100:00100000:1.0:1767319383.014927:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379744000:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319383.014975:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379744000:12345-0@lo:400:kworker.0 Request processed in 48us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319383.015776:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4210
00000100:00100000:1.0:1767319383.015806:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4211
00000100:00100000:1.0:1767319383.015816:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379744256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319383.015859:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379744256:12345-0@lo:400:kworker.0 Request processed in 46us (1076us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319383.015865:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4211
00000100:00080000:1.0:1767319383.015916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319383.015950:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379744256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319383.015962:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379744000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319383.016064:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379743872
00000100:00100000:2.0:1767319383.016070:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379743872
00000100:00100000:2.0:1767319383.016126:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491
00000100:00100000:2.0:1767319383.016133:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379743872:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319383.016172:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379743872:12345-0@lo:400:kworker.0 Request processed in 39us (1520us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319383.016178:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491
00000100:00080000:1.0:1767319383.018171:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319383.018238:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379743872:0@lo:400:kworker.0
00000100:00080000:0.0:1767319383.020842:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319383.020856:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319383.020861:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379743488:0@lo:38:kworker.0
00000100:00100000:0.0:1767319383.020915:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379744128:0@lo:38:kworker.0
00000100:00100000:0.0:1767319383.021266:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319383.021383:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379744384:0@lo:38:kworker.0
00000100:00100000:0.0:1767319383.021408:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319383.028393:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319383.028407:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319383.028418:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379743744:0@lo:38:kworker.0
00000100:00100000:3.0:1767319383.034293:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744128
00000100:00100000:3.0:1767319383.034307:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744128
00000100:00100000:3.0:1767319383.034424:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744384
00000100:00100000:3.0:1767319383.034429:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744384
00000100:00100000:1.0:1767319383.034495:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16917
00000100:00100000:1.0:1767319383.034506:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379744128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319383.034528:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319383.034617:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379744128:12345-0@lo:38:kworker.0 Request processed in 110us (13349us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319383.034623:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16917
00000100:00100000:1.0:1767319383.034642:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16918
00000100:00100000:1.0:1767319383.034647:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379744384:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319383.034656:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319383.034680:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379744384:12345-0@lo:38:kworker.0 Request processed in 33us (13272us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319383.034685:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16918
00000100:00080000:0.0:1767319383.034767:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319383.034773:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319383.034778:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379744128:0@lo:38:kworker.0
00000100:00080000:0.0:1767319383.034789:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319383.034793:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319383.034796:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379744384:0@lo:38:kworker.0
00010000:00010000:0.0:1767319383.511085:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319383.951723:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319383.951855:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291914240
00000100:00100000:2.0:1767319383.951908:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291914240
00000100:00100000:2.0:1767319383.952013:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4212
00000100:00100000:2.0:1767319383.952024:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291914240:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319383.952127:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291914240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 105us (418us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319383.952136:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4212
00000100:00080000:0.0:1767319383.953045:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319383.957390:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319383.957579:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291914112
00000100:00100000:0.0:1767319383.957599:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291914112
00000100:00100000:0.0:1767319383.957666:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16919
00000100:00100000:0.0:1767319383.957678:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291914112:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319383.957710:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319383.957793:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291914112:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 116us (416us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319383.957800:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16919
00010000:00010000:1.0:1767319384.535255:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319384.535503:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379744512:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319384.535618:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319384.535955:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744512
00000100:00100000:2.0:1767319384.535966:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744512
00000100:00100000:2.0:1767319384.536038:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265
00000100:00100000:2.0:1767319384.536050:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379744512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319384.536107:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319384.536174:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379744512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (556us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319384.536183:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265
00000100:00100000:3.0:1767319384.536508:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379744512:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319385.559312:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319386.586046:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319387.607160:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319388.120120:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319388.120136:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319388.120140:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319388.120146:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319388.120153:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319388.120166:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4285
00000100:00080000:3.0:1767319388.120173:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319388.120184:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319388.120244:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164379744640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319388.120283:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319388.120288:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319388.120290:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319388.120294:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4285
00000100:00080000:3.0:1767319388.120297:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319388.120301:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319388.120317:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe300 x1853164379744768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319388.120384:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319388.120388:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319388.120390:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319388.120395:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4285
00000100:00080000:3.0:1767319388.120398:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319388.120402:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319388.120417:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379745280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319388.120434:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319388.120438:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319388.120440:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319388.120443:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4285
00000100:00080000:3.0:1767319388.120446:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319388.120450:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319388.120464:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858380 x1853164379745536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319388.120507:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379745408:0@lo:400:kworker.0
00000100:00100000:3.0:1767319388.120601:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319388.120688:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319388.120695:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379744896:0@lo:400:kworker.0
00000100:00100000:3.0:1767319388.120724:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319388.120779:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379745152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319388.120807:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319388.120827:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319388.120831:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379745024:0@lo:400:kworker.0
00000100:00100000:3.0:1767319388.120854:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319388.120929:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744896
00000100:00100000:3.0:1767319388.120939:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744896
00000100:00100000:3.0:1767319388.121018:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379745024
00000100:00100000:3.0:1767319388.121022:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379745024
00000100:00100000:3.0:1767319388.121048:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492
00000100:00100000:3.0:1767319388.121058:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379744896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319388.121135:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379744896:12345-0@lo:400:kworker.0 Request processed in 79us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319388.121145:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492
00000100:00100000:3.0:1767319388.121164:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493
00000100:00100000:3.0:1767319388.121171:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379745024:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319388.121203:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379745024:12345-0@lo:400:kworker.0 Request processed in 33us (348us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319388.121209:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493
00000100:00100000:3.0:1767319388.121266:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379745024:0@lo:400:kworker.0
00000100:00100000:3.0:1767319388.121299:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379744896:0@lo:400:kworker.0
00000100:00100000:0.0:1767319388.121417:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379745408
00000100:00100000:0.0:1767319388.121423:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379745408
00000100:00100000:0.0:1767319388.121467:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379745152
00000100:00100000:0.0:1767319388.121470:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379745152
00000100:00100000:0.0:1767319388.121495:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4213
00000100:00100000:0.0:1767319388.121504:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379745408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319388.121555:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379745408:12345-0@lo:400:kworker.0 Request processed in 53us (954us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319388.121561:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4213
00000100:00100000:0.0:1767319388.121578:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4214
00000100:00100000:0.0:1767319388.121585:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379745152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319388.121614:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379745152:12345-0@lo:400:kworker.0 Request processed in 30us (807us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319388.121620:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4214
00000100:00080000:0.0:1767319388.121639:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319388.121645:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319388.121647:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319388.121673:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379745408:0@lo:400:kworker.0
00000100:00100000:2.0:1767319388.125107:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379744640:0@lo:38:kworker.0
00000100:00100000:2.0:1767319388.125246:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319388.125299:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379744768:0@lo:38:kworker.0
00000100:00100000:2.0:1767319388.125329:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319388.125364:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379745280:0@lo:38:kworker.0
00000100:00100000:2.0:1767319388.125391:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319388.125408:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379745536:0@lo:38:kworker.0
00000100:00100000:2.0:1767319388.125433:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319388.125482:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744640
00000100:00100000:2.0:1767319388.125494:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744640
00000100:00100000:2.0:1767319388.125535:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379745280
00000100:00100000:2.0:1767319388.125538:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379745280
00000100:00100000:2.0:1767319388.125550:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379745536
00000100:00100000:2.0:1767319388.125552:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379745536
00000100:00100000:2.0:1767319388.125566:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16920
00000100:00100000:2.0:1767319388.125575:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379744640:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319388.125603:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319388.125657:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379744640:12345-0@lo:38:kworker.0 Request processed in 81us (411us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319388.125665:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16920
00000100:00100000:2.0:1767319388.125689:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16921
00000100:00100000:2.0:1767319388.125693:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379745280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319388.125702:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319388.125730:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379745280:12345-0@lo:38:kworker.0 Request processed in 36us (338us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319388.125737:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16921
00000100:00100000:2.0:1767319388.125748:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16922
00000100:00100000:2.0:1767319388.125753:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379745536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319388.125762:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319388.125786:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379745536:12345-0@lo:38:kworker.0 Request processed in 31us (351us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319388.125792:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16922
00000100:00080000:2.0:1767319388.125835:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319388.125842:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319388.125846:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379744640:0@lo:38:kworker.0
00000100:00080000:2.0:1767319388.125857:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767319388.128187:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379745664:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319388.128291:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319388.128582:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319388.128590:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379745280:0@lo:38:kworker.0
00000100:00080000:2.0:1767319388.128634:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319388.128638:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319388.128641:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379745536:0@lo:38:kworker.0
00000100:00100000:1.0:1767319388.129237:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379744768
00000100:00100000:1.0:1767319388.129248:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379744768
00000100:00100000:1.0:1767319388.129303:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992
00000100:00100000:1.0:1767319388.129313:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379744768:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319388.129343:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319388.129431:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379744768:12345-0@lo:38:kworker.0 Request processed in 118us (4100us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319388.129438:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992
00000100:00100000:1.0:1767319388.129478:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379745664
00000100:00100000:1.0:1767319388.129482:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379745664
00000100:00100000:1.0:1767319388.129521:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266
00000100:00100000:1.0:1767319388.129528:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379745664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319388.129564:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319388.129609:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379745664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1320us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319388.129616:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266
00000100:00100000:1.0:1767319388.129682:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379745664:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319388.129925:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319388.129932:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319388.129936:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379744768:0@lo:38:kworker.0
00000100:00100000:3.0:1767319388.131328:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379745152:0@lo:400:kworker.0
00010000:00010000:1.0:1767319388.631214:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319389.079339:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319389.079477:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319389.083283:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291914496
00000100:00100000:3.0:1767319389.083311:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291914496
00000100:00100000:3.0:1767319389.083657:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291914368
00000100:00100000:3.0:1767319389.083662:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291914368
00000100:00100000:3.0:1767319389.083695:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4215
00000100:00100000:3.0:1767319389.083709:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291914496:12345-192.168.202.33@tcp:400:kworker.0
00000400:00000100:2.0:1767319389.084127:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291914624 offset 0 length 520: 4
00000100:00100000:2.0:1767319389.084197:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16923
00000100:00100000:2.0:1767319389.084206:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291914368:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319389.084247:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319389.084344:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291914368:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 138us (4867us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319389.084352:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16923
00000100:00100000:3.0:1767319389.085398:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291914496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1345us (5729us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319389.085414:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4215
00000100:00080000:1.0:1767319389.085523:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319389.655391:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319389.655825:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319389.655855:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379745792:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319389.655975:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319389.656168:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379745792
00000100:00100000:2.0:1767319389.656180:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379745792
00000100:00100000:2.0:1767319389.656258:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267
00000100:00100000:2.0:1767319389.656274:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379745792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319389.656312:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319389.656375:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379745792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (400us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319389.656383:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267
00000100:00100000:0.0:1767319389.656484:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379745792:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319390.679171:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319391.705860:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319392.215545:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319367/real 1767319367]  req@ffff8b0f336e1880 x1853164379740928/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319392 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319392.215600:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f336e1880 x1853164379740928/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319392 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319392.215622:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319392.215739:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319392.215743:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379740928:0@lo:250:kworker.0
00000100:00080000:0.0:1767319392.217315:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319392.217328:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319392.217333:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319392.217341:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4270
00000100:00080000:0.0:1767319392.217347:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319392.217357:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319392.217411:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04700 x1853164379745920/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319392.217454:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319392.217460:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319392.217461:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319392.217465:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4290
00000100:00080000:0.0:1767319392.217468:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319392.217472:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319392.217494:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379746048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319392.217504:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319392.217507:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319392.217509:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319392.217514:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4290
00000100:00080000:0.0:1767319392.217517:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319392.217521:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319392.217534:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05c00 x1853164379746176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319392.217662:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379746304:0@lo:400:kworker.0
00000100:00100000:3.0:1767319392.217790:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319392.217967:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746304
00000100:00100000:1.0:1767319392.217985:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746304
00000100:00100000:1.0:1767319392.218090:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494
00000100:00100000:1.0:1767319392.218101:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379746304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.218618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379745920:0@lo:250:kworker.0
00000400:00000100:2.0:1767319392.218660:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379745920 offset 0 length 520: 4
00000100:00100000:2.0:1767319392.218701:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379746048:0@lo:38:kworker.0
00000100:00100000:2.0:1767319392.218745:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319392.218771:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379746176:0@lo:38:kworker.0
00000100:00100000:2.0:1767319392.218796:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319392.218855:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746048
00000100:00100000:2.0:1767319392.218863:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746048
00000100:00100000:2.0:1767319392.218934:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16924
00000100:00100000:2.0:1767319392.218942:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379746048:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319392.218968:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319392.219012:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379746048:12345-0@lo:38:kworker.0 Request processed in 69us (265us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319392.219020:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16924
00000100:00100000:2.0:1767319392.219057:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746176
00000100:00100000:2.0:1767319392.219061:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746176
00000100:00100000:2.0:1767319392.219086:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993
00000100:00100000:2.0:1767319392.219091:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379746176:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767319392.219638:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319392.219643:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319392.219646:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319392.219652:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4290
00000100:00080000:0.0:1767319392.219657:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319392.219662:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319392.219686:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05180 x1853164379746688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00020000:2.0:1767319392.219742:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319392.219781:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379746176:12345-0@lo:38:kworker.0 Request processed in 687us (984us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319392.219791:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993
00000100:00100000:2.0:1767319392.219828:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379746688:0@lo:38:kworker.0
00000100:00100000:2.0:1767319392.219891:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319392.219943:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319392.219948:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319392.219952:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379746048:0@lo:38:kworker.0
00000100:00080000:2.0:1767319392.219965:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319392.219969:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319392.219971:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379746176:0@lo:38:kworker.0
00000100:00100000:2.0:1767319392.220009:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746688
00000100:00100000:2.0:1767319392.220013:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746688
00000100:00100000:2.0:1767319392.220046:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16925
00000100:00100000:2.0:1767319392.220051:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379746688:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319392.220061:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319392.220086:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379746688:12345-0@lo:38:kworker.0 Request processed in 35us (195us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319392.220092:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16925
00000100:00080000:2.0:1767319392.220913:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319392.220922:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319392.220938:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379746688:0@lo:38:kworker.0
00000100:00100000:2.0:1767319392.221014:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379746432:0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.221069:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319392.221307:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319392.221315:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379746560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.221341:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319392.221372:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746432
00000100:00100000:2.0:1767319392.221379:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746432
00000100:00100000:2.0:1767319392.221434:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495
00000100:00100000:2.0:1767319392.221442:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379746432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.221492:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379746432:12345-0@lo:400:kworker.0 Request processed in 50us (422us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319392.221499:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495
00000100:00100000:2.0:1767319392.221519:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746560
00000100:00100000:2.0:1767319392.221522:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746560
00000100:00100000:2.0:1767319392.221550:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4216
00000100:00100000:2.0:1767319392.221556:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379746560:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.221585:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379746560:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319392.221591:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4216
00000100:00100000:2.0:1767319392.221612:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379746816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.221639:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319392.221667:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746816
00000100:00100000:2.0:1767319392.221670:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746816
00000100:00100000:2.0:1767319392.222005:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4217
00000100:00100000:2.0:1767319392.222015:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379746816:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.222066:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379746816:12345-0@lo:400:kworker.0 Request processed in 53us (425us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319392.222082:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4217
00000100:00100000:2.0:1767319392.222547:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379746560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.222561:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379746432:0@lo:400:kworker.0
00000100:00100000:2.0:1767319392.222598:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379746816:0@lo:400:kworker.0
00000100:00080000:2.0:1767319392.222683:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319392.222702:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319392.222705:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319392.225855:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379746304:12345-0@lo:400:kworker.0 Request processed in 7744us (8052us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319392.226165:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494
00000100:00080000:0.0:1767319392.230431:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319392.230448:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319392.230453:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319392.230462:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4290
00000100:00080000:0.0:1767319392.230467:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319392.230477:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319392.231007:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379746304:0@lo:400:kworker.0
00000100:00100000:0.0:1767319392.231421:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04e00 x1853164379746944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319392.231637:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379746944:0@lo:38:kworker.0
00000100:00100000:2.0:1767319392.232454:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319392.236411:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379746944
00000100:00100000:1.0:1767319392.236435:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379746944
00000100:00100000:1.0:1767319392.237447:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16926
00000100:00100000:1.0:1767319392.237461:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379746944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319392.237492:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319392.237637:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379746944:12345-0@lo:38:kworker.0 Request processed in 176us (5186us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319392.237645:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16926
00000100:00080000:3.0:1767319392.237777:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319392.237783:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319392.237787:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379746944:0@lo:38:kworker.0
00010000:00010000:2.0:1767319392.729981:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319393.239368:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319393.242933:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379747072:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319393.243062:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319393.247012:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747072
00000100:00100000:3.0:1767319393.247049:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747072
00000100:00100000:3.0:1767319393.247422:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268
00000100:00100000:3.0:1767319393.247438:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379747072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319393.247494:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319393.247635:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379747072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 201us (4571us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319393.247643:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268
00000100:00100000:0.0:1767319393.247758:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379747072:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319393.751900:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319394.200841:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319394.200932:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319394.201059:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291914752
00000100:00100000:1.0:1767319394.201069:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291914752
00000100:00100000:1.0:1767319394.201104:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291914880
00000100:00100000:1.0:1767319394.201105:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291914880
00000100:00100000:1.0:1767319394.201147:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4218
00000100:00100000:1.0:1767319394.201155:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291914880:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319394.201216:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291914880:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 63us (286us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319394.201230:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4218
00000100:00100000:1.0:1767319394.201256:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16927
00000100:00100000:1.0:1767319394.201261:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291914752:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319394.201283:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319394.201306:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291914752:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (480us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319394.201311:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16927
00000100:00080000:0.0:1767319394.201980:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319394.776452:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379747200:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319394.776530:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1767319394.776753:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319394.776801:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747200
00000100:00100000:2.0:1767319394.776811:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747200
00000100:00100000:2.0:1767319394.776900:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269
00000100:00100000:2.0:1767319394.776909:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379747200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319394.776943:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319394.777010:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379747200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (471us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319394.777017:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269
00000100:00100000:3.0:1767319394.777141:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379747200:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319394.777202:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767319395.800431:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319396.823117:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319397.335002:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319397.335016:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319397.335020:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319397.335025:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319397.335030:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319397.335038:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4294
00000100:00080000:0.0:1767319397.335044:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319397.335062:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319397.335108:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04e00 x1853164379747328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319397.335148:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319397.335152:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319397.335154:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319397.335158:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4294
00000100:00080000:0.0:1767319397.335161:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319397.335166:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319397.335180:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379747456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319397.335263:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319397.335267:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319397.335268:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319397.335273:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4294
00000100:00080000:0.0:1767319397.335276:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319397.335280:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319397.335290:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05180 x1853164379747968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319397.335305:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319397.335309:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319397.335311:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319397.335314:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4294
00000100:00080000:0.0:1767319397.335316:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319397.335320:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319397.335330:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379748224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319397.335380:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379747712:0@lo:400:kworker.0
00000100:00100000:1.0:1767319397.335665:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379747584:0@lo:400:kworker.0
00000100:00100000:1.0:1767319397.335716:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379747840:0@lo:400:kworker.0
00000100:00100000:1.0:1767319397.335746:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319397.335933:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319397.336142:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319397.336175:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319397.336182:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379748096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319397.336209:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319397.336240:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747712
00000100:00100000:1.0:1767319397.336249:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747712
00000100:00100000:1.0:1767319397.336313:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747584
00000100:00100000:1.0:1767319397.336316:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747584
00000100:00100000:1.0:1767319397.336338:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496
00000100:00100000:1.0:1767319397.336347:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379747712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319397.336418:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379747712:12345-0@lo:400:kworker.0 Request processed in 71us (950us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319397.336426:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496
00000100:00100000:1.0:1767319397.336450:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497
00000100:00100000:1.0:1767319397.336455:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379747584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319397.336497:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379747584:12345-0@lo:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319397.336503:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497
00000100:00080000:1.0:1767319397.336522:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319397.336527:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319397.336562:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379747584:0@lo:400:kworker.0
00000100:00100000:3.0:1767319397.336849:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747840
00000100:00100000:3.0:1767319397.336854:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747840
00000100:00100000:3.0:1767319397.336915:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748096
00000100:00100000:3.0:1767319397.336919:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748096
00000100:00100000:3.0:1767319397.336940:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4219
00000100:00100000:3.0:1767319397.336946:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379747840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319397.336999:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379747840:12345-0@lo:400:kworker.0 Request processed in 53us (1253us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319397.337007:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4219
00000100:00100000:3.0:1767319397.337019:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4220
00000100:00100000:3.0:1767319397.337026:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379748096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319397.337070:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379748096:12345-0@lo:400:kworker.0 Request processed in 45us (860us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319397.337076:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4220
00000100:00100000:3.0:1767319397.337102:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379747328:0@lo:38:kworker.0
00000100:00100000:3.0:1767319397.337145:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319397.337166:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379747456:0@lo:38:kworker.0
00000100:00100000:3.0:1767319397.337191:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319397.337216:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379747968:0@lo:38:kworker.0
00000100:00100000:3.0:1767319397.337238:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319397.337252:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379748224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319397.337269:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319397.337303:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747456
00000100:00100000:3.0:1767319397.337307:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747456
00000100:00100000:3.0:1767319397.337329:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994
00000100:00100000:3.0:1767319397.337334:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379747456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319397.337353:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319397.337695:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379747456:12345-0@lo:38:kworker.0 Request processed in 358us (501us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319397.337702:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994
00000100:00100000:3.0:1767319397.337721:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747328
00000100:00100000:3.0:1767319397.337725:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747328
00000100:00100000:3.0:1767319397.337739:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379747968
00000100:00100000:3.0:1767319397.337742:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379747968
00000100:00100000:3.0:1767319397.337748:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748224
00000100:00100000:3.0:1767319397.337750:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748224
00000100:00100000:3.0:1767319397.337758:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16928
00000100:00100000:3.0:1767319397.337763:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379747328:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319397.337773:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319397.337799:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379747328:12345-0@lo:38:kworker.0 Request processed in 35us (655us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319397.337805:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16928
00000100:00100000:3.0:1767319397.337815:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16929
00000100:00100000:3.0:1767319397.337818:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379747968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319397.337827:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319397.337847:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379747968:12345-0@lo:38:kworker.0 Request processed in 27us (607us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319397.337852:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16929
00000100:00100000:3.0:1767319397.337861:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16930
00000100:00100000:3.0:1767319397.337865:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379748224:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319397.337900:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319397.337923:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379748224:12345-0@lo:38:kworker.0 Request processed in 56us (652us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319397.337928:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16930
00000100:00100000:3.0:1767319397.337968:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379748096:0@lo:400:kworker.0
00000100:00080000:3.0:1767319397.338011:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319397.338017:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319397.338021:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379747328:0@lo:38:kworker.0
00000100:00080000:3.0:1767319397.338028:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319397.338032:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319397.338035:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379747456:0@lo:38:kworker.0
00000100:00080000:3.0:1767319397.338042:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319397.338045:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319397.338182:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379747712:0@lo:400:kworker.0
00000100:00080000:1.0:1767319397.338356:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319397.338396:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379747840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319397.339600:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379747968:0@lo:38:kworker.0
00000100:00080000:3.0:1767319397.339645:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319397.339650:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319397.339653:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379748224:0@lo:38:kworker.0
00010000:00010000:3.0:1767319397.847270:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319398.361417:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319398.361459:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379748352:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319398.361539:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319398.361602:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748352
00000100:00100000:2.0:1767319398.361611:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748352
00000100:00100000:2.0:1767319398.361661:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270
00000100:00100000:2.0:1767319398.361671:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379748352:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319398.361699:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319398.361768:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379748352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (228us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319398.361775:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270
00000100:00100000:1.0:1767319398.362177:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379748352:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319398.877189:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319399.315158:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319399.315212:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319399.315323:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291915008
00000100:00100000:0.0:1767319399.315333:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291915008
00000100:00100000:0.0:1767319399.315393:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291915136
00000100:00100000:0.0:1767319399.315397:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291915136
00000100:00100000:0.0:1767319399.315446:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4221
00000100:00100000:0.0:1767319399.315460:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291915136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319399.315552:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291915136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 94us (338us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319399.315562:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4221
00000100:00100000:0.0:1767319399.315587:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16931
00000100:00100000:0.0:1767319399.315593:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291915008:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319399.315618:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319399.315650:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291915008:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (511us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319399.315656:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16931
00000100:00080000:0.0:1767319399.315676:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319399.895231:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319399.896706:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379748480:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319399.896931:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319399.897144:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748480
00000100:00100000:2.0:1767319399.897154:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748480
00000100:00100000:2.0:1767319399.897224:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271
00000100:00100000:2.0:1767319399.897233:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379748480:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319399.897262:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319399.897303:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379748480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (374us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319399.897310:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271
00000100:00080000:3.0:1767319399.900188:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319399.904044:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379748480:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319400.919403:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319401.943733:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319402.457484:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319402.457494:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319402.457497:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319402.457501:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319402.457505:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319402.457512:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4299
00000100:00080000:1.0:1767319402.457516:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319402.457522:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319402.457559:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dce00 x1853164379748608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319402.457587:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319402.457590:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319402.457592:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319402.457596:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4299
00000100:00080000:1.0:1767319402.457598:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319402.457601:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319402.457612:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dfb80 x1853164379748736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319402.457698:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319402.457701:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319402.457703:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319402.457706:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4299
00000100:00080000:1.0:1767319402.457708:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319402.457712:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319402.457721:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1880 x1853164379749248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319402.457734:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319402.457737:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319402.457739:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319402.457742:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4299
00000100:00080000:1.0:1767319402.457744:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319402.457747:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319402.457754:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e2300 x1853164379749504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319402.457778:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379748992:0@lo:400:kworker.0
00000100:00100000:1.0:1767319402.457851:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319402.457941:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319402.457947:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379749120:0@lo:400:kworker.0
00000100:00100000:1.0:1767319402.457980:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319402.458432:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748992
00000100:00100000:2.0:1767319402.458441:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748992
00000100:00100000:2.0:1767319402.458516:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498
00000100:00100000:2.0:1767319402.458524:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379748992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319402.458577:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379748992:12345-0@lo:400:kworker.0 Request processed in 53us (725us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319402.458584:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498
00000100:00080000:2.0:1767319402.458607:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319402.458625:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379748608:0@lo:38:kworker.0
00000100:00100000:2.0:1767319402.458707:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319402.458724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379748736:0@lo:38:kworker.0
00000100:00100000:2.0:1767319402.458770:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319402.458798:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379749248:0@lo:38:kworker.0
00000100:00100000:2.0:1767319402.459168:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319402.459188:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379749504:0@lo:38:kworker.0
00000100:00100000:2.0:1767319402.459206:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319402.459235:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748608
00000100:00100000:2.0:1767319402.459239:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748608
00000100:00100000:2.0:1767319402.459432:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379749248
00000100:00100000:2.0:1767319402.459436:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379749248
00000100:00100000:2.0:1767319402.459449:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379749504
00000100:00100000:2.0:1767319402.459451:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379749504
00000100:00100000:2.0:1767319402.459463:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16932
00000100:00100000:0.0:1767319402.459575:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16933
00000100:00100000:0.0:1767319402.459581:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379749248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319402.459604:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319402.459646:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379749248:12345-0@lo:38:kworker.0 Request processed in 63us (477us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319402.459651:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16933
00000100:00100000:0.0:1767319402.459666:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16934
00000100:00100000:0.0:1767319402.459670:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379749504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319402.459678:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319402.459712:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379749504:12345-0@lo:38:kworker.0 Request processed in 41us (505us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319402.459717:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16934
00000100:00080000:0.0:1767319402.459749:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319402.459755:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319402.459758:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379749248:0@lo:38:kworker.0
00000100:00080000:0.0:1767319402.459767:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319402.459769:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319402.459772:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379749504:0@lo:38:kworker.0
00000100:00100000:0.0:1767319402.459943:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379748992:0@lo:400:kworker.0
00000100:00100000:2.0:1767319402.460734:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379748608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319402.460752:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319402.460814:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379748608:12345-0@lo:38:kworker.0 Request processed in 1344us (2106us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319402.460824:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16932
00000100:00100000:2.0:1767319402.460856:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379749376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319402.460906:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319402.460943:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319402.460950:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379748864:0@lo:400:kworker.0
00000100:00100000:2.0:1767319402.460973:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319402.461000:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748864
00000100:00100000:2.0:1767319402.461005:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748864
00000100:00100000:3.0:1767319402.461457:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379749376
00000100:00100000:3.0:1767319402.461462:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379749376
00000100:00100000:3.0:1767319402.461527:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4222
00000100:00100000:3.0:1767319402.461537:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379749376:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319402.461597:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379749376:12345-0@lo:400:kworker.0 Request processed in 63us (690us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319402.461604:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4222
00000100:00100000:3.0:1767319402.461628:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379748736
00000100:00100000:3.0:1767319402.461633:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379748736
00000100:00100000:3.0:1767319402.461657:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995
00000100:00100000:3.0:1767319402.461661:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379748736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319402.461672:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319402.461715:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379748736:12345-0@lo:38:kworker.0 Request processed in 51us (2946us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319402.461721:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995
00000100:00080000:3.0:1767319402.461748:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319402.461813:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379749376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319402.462623:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379749120
00000100:00100000:1.0:1767319402.462633:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379749120
00000100:00100000:1.0:1767319402.463383:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4223
00000100:00100000:1.0:1767319402.463396:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379749120:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319402.466075:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319402.466097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319402.466103:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379748608:0@lo:38:kworker.0
00000100:00080000:0.0:1767319402.466118:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319402.466122:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319402.466125:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379748736:0@lo:38:kworker.0
00000100:00100000:2.0:1767319402.466458:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499
00000100:00100000:1.0:1767319402.466598:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379749120:12345-0@lo:400:kworker.0 Request processed in 3205us (8615us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319402.466609:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4223
00000100:00100000:2.0:1767319402.468911:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379748864:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319402.469064:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379748864:12345-0@lo:400:kworker.0 Request processed in 2596us (8088us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319402.469079:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499
00000100:00080000:3.0:1767319402.469219:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319402.469227:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319402.469993:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379749120:0@lo:400:kworker.0
00000100:00100000:1.0:1767319402.470710:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379748864:0@lo:400:kworker.0
00010000:00010000:2.0:1767319402.969122:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319403.479587:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319403.479603:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379749632:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319403.479675:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319403.479890:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379749632
00000100:00100000:0.0:1767319403.479898:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379749632
00000100:00100000:0.0:1767319403.479958:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272
00000100:00100000:0.0:1767319403.479967:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379749632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319403.479996:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319403.480046:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379749632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319403.480053:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272
00000100:00100000:1.0:1767319403.481572:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379749632:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319403.991462:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319404.430807:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319404.430991:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319404.431147:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291915392
00000100:00100000:0.0:1767319404.431157:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291915392
00000100:00100000:0.0:1767319404.431230:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291915264
00000100:00100000:0.0:1767319404.431233:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291915264
00000100:00100000:0.0:1767319404.431253:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4224
00000100:00100000:0.0:1767319404.431263:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291915392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319404.431344:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291915392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (550us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319404.431352:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4224
00000100:00100000:0.0:1767319404.431372:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16935
00000100:00100000:0.0:1767319404.431377:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291915264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319404.431396:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319404.431583:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291915264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 203us (591us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319404.431590:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16935
00000100:00080000:3.0:1767319404.431756:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319405.015470:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319405.015523:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379749760:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319405.015610:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319405.015758:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379749760
00000100:00100000:2.0:1767319405.015767:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379749760
00000100:00100000:2.0:1767319405.015833:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273
00000100:00100000:2.0:1767319405.015843:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379749760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319405.015895:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319405.015972:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379749760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (360us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319405.015979:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273
00000100:00100000:2.0:1767319405.016028:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379749760:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319405.016364:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319406.039265:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319407.063819:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319407.575227:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319407.575242:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319407.575245:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319407.575250:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319407.575255:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319407.575266:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4304
00000100:00080000:0.0:1767319407.575274:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319407.575284:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319407.575345:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379749888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319407.575384:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319407.575389:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319407.575391:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319407.575395:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4304
00000100:00080000:0.0:1767319407.575397:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319407.575400:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319407.575416:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04e00 x1853164379750016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319407.575493:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319407.575496:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319407.575498:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319407.575502:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4304
00000100:00080000:0.0:1767319407.575504:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319407.575508:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319407.575521:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379750528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319407.575538:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319407.575541:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319407.575544:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319407.575547:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4304
00000100:00080000:0.0:1767319407.575549:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319407.575553:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319407.575564:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dfb80 x1853164379750784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319407.575591:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379750272:0@lo:400:kworker.0
00000100:00100000:0.0:1767319407.575676:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319407.575741:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319407.575748:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379750400:0@lo:400:kworker.0
00000100:00100000:0.0:1767319407.575773:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319407.575989:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379750656:0@lo:400:kworker.0
00000100:00100000:1.0:1767319407.576018:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319407.576048:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319407.576055:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379750144:0@lo:400:kworker.0
00000100:00100000:1.0:1767319407.576075:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319407.576124:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750272
00000100:00100000:1.0:1767319407.576130:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750272
00000100:00100000:1.0:1767319407.576182:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750144
00000100:00100000:1.0:1767319407.576184:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750144
00000100:00100000:1.0:1767319407.576206:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500
00000100:00100000:1.0:1767319407.576214:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379750272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319407.576263:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379750272:12345-0@lo:400:kworker.0 Request processed in 49us (586us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319407.576271:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500
00000100:00100000:1.0:1767319407.576290:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501
00000100:00100000:1.0:1767319407.576296:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379750144:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319407.576326:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379750144:12345-0@lo:400:kworker.0 Request processed in 30us (251us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319407.576332:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501
00000100:00100000:1.0:1767319407.576382:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379750144:0@lo:400:kworker.0
00000100:00100000:2.0:1767319407.576687:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379749888:0@lo:38:kworker.0
00000100:00100000:2.0:1767319407.576721:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319407.576739:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379750016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319407.576762:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319407.576784:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379750528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319407.576805:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319407.576822:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379750784:0@lo:38:kworker.0
00000100:00100000:2.0:1767319407.576842:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319407.576899:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750400
00000100:00100000:2.0:1767319407.576904:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750400
00000100:00100000:2.0:1767319407.576935:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750656
00000100:00100000:2.0:1767319407.576938:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750656
00000100:00100000:2.0:1767319407.576953:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379749888
00000100:00100000:2.0:1767319407.576956:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379749888
00000100:00100000:2.0:1767319407.576965:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750528
00000100:00100000:2.0:1767319407.576967:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750528
00000100:00100000:2.0:1767319407.576973:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750784
00000100:00100000:2.0:1767319407.576975:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750784
00000100:00100000:2.0:1767319407.576983:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225
00000100:00100000:2.0:1767319407.576990:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379750400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319407.577022:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379750400:12345-0@lo:400:kworker.0 Request processed in 33us (1248us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319407.577028:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225
00000100:00100000:2.0:1767319407.577041:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4226
00000100:00100000:2.0:1767319407.577048:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379750656:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319407.577077:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379750656:12345-0@lo:400:kworker.0 Request processed in 30us (1057us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319407.577138:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4226
00000100:00100000:2.0:1767319407.577152:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16936
00000100:00100000:2.0:1767319407.577156:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379749888:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319407.577179:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319407.577211:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379749888:12345-0@lo:38:kworker.0 Request processed in 54us (489us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319407.577218:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16936
00000100:00100000:2.0:1767319407.577229:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16937
00000100:00100000:2.0:1767319407.577233:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379750528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319407.577243:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319407.577265:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379750528:12345-0@lo:38:kworker.0 Request processed in 30us (459us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319407.577271:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16937
00000100:00100000:2.0:1767319407.577281:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16938
00000100:00100000:2.0:1767319407.577284:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379750784:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319407.577294:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319407.577316:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379750784:12345-0@lo:38:kworker.0 Request processed in 29us (472us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319407.577321:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16938
00000100:00080000:2.0:1767319407.577350:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319407.577505:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750016
00000100:00100000:3.0:1767319407.577511:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750016
00000100:00100000:3.0:1767319407.577540:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996
00000100:00100000:3.0:1767319407.577545:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379750016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319407.577556:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319407.577594:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379750016:12345-0@lo:38:kworker.0 Request processed in 48us (831us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319407.577601:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996
00000100:00080000:2.0:1767319407.578004:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319407.578009:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379749888:0@lo:38:kworker.0
00000100:00080000:2.0:1767319407.578025:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319407.578028:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319407.578031:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379750016:0@lo:38:kworker.0
00000100:00080000:2.0:1767319407.578042:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319407.578045:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319407.578048:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379750528:0@lo:38:kworker.0
00000100:00080000:2.0:1767319407.578055:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319407.578058:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319407.578062:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379750784:0@lo:38:kworker.0
00000100:00100000:1.0:1767319407.578306:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379750656:0@lo:400:kworker.0
00000100:00080000:0.0:1767319407.578703:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319407.578710:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319407.578713:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319407.578746:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379750400:0@lo:400:kworker.0
00000100:00100000:0.0:1767319407.578761:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379750272:0@lo:400:kworker.0
00010000:00010000:0.0:1767319408.087191:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319408.599706:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379750912:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319408.599781:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319408.600603:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379750912
00000100:00100000:0.0:1767319408.600614:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379750912
00000100:00100000:0.0:1767319408.600666:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274
00000100:00100000:0.0:1767319408.600675:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379750912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319408.600707:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319408.600766:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379750912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (984us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319408.600773:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274
00000100:00100000:1.0:1767319408.601475:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379750912:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319409.111157:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319409.551817:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319409.551984:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319409.552180:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291915648
00000100:00100000:1.0:1767319409.552195:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291915648
00000100:00100000:1.0:1767319409.552292:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291915520
00000100:00100000:1.0:1767319409.552296:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291915520
00000100:00100000:1.0:1767319409.552315:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4227
00000100:00100000:1.0:1767319409.552327:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291915648:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319409.552703:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291915648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 377us (901us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319409.552713:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4227
00000100:00100000:1.0:1767319409.552743:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16939
00000100:00100000:1.0:1767319409.552749:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291915520:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319409.552777:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319409.552807:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291915520:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (823us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319409.552813:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16939
00000100:00080000:3.0:1767319409.553424:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319410.136305:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319410.136343:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379751040:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319410.136466:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319410.136669:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751040
00000100:00100000:1.0:1767319410.136684:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751040
00000100:00080000:3.0:1767319410.136760:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319410.136785:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275
00000100:00100000:1.0:1767319410.136798:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379751040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319410.136843:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319410.136952:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379751040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (485us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319410.136960:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275
00010000:00010000:1.0:1767319410.137196:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319410.137460:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379751040:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319411.159347:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319412.183124:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319412.695228:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319412.695247:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319412.695251:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319412.695256:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319412.695264:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319412.695277:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4309
00000100:00080000:3.0:1767319412.695284:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319412.695296:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319412.695361:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164379751168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319412.695383:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319412.695387:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319412.695389:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319412.695394:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4309
00000100:00080000:3.0:1767319412.695396:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319412.695400:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319412.695416:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efce00 x1853164379751296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319412.695542:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319412.695546:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319412.695548:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319412.695552:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4309
00000100:00080000:3.0:1767319412.695555:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319412.695559:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319412.695570:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fce00 x1853164379751808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319412.695586:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319412.695590:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319412.695592:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319412.695595:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4309
00000100:00080000:3.0:1767319412.695597:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319412.695600:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379751936:0@lo:400:kworker.0
00000100:00080000:3.0:1767319412.695601:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319412.695610:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd500 x1853164379752064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319412.695638:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379751552:0@lo:400:kworker.0
00000100:00100000:0.0:1767319412.695711:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379751424:0@lo:400:kworker.0
00000100:00100000:3.0:1767319412.695772:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319412.695862:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319412.695908:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379751680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319412.695936:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319412.695985:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751680
00000100:00100000:3.0:1767319412.695997:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751680
00000100:00100000:3.0:1767319412.696075:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4228
00000100:00100000:3.0:1767319412.696089:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379751680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319412.696156:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379751680:12345-0@lo:400:kworker.0 Request processed in 71us (217us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319412.696165:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4228
00000100:00080000:3.0:1767319412.696194:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319412.696238:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379751680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319412.696283:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751552
00000100:00100000:3.0:1767319412.696287:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751552
00000100:00100000:3.0:1767319412.696328:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502
00000100:00100000:3.0:1767319412.696335:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379751552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319412.696377:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379751552:12345-0@lo:400:kworker.0 Request processed in 42us (606us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319412.696383:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502
00000100:00080000:3.0:1767319412.696404:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319412.696420:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379751552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319412.698379:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319412.698603:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379751168:0@lo:38:kworker.0
00000100:00100000:2.0:1767319412.698692:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319412.698737:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379751296:0@lo:38:kworker.0
00000100:00100000:2.0:1767319412.699461:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319412.699676:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751296
00000100:00100000:1.0:1767319412.699690:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751296
00000100:00100000:1.0:1767319412.699749:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997
00000100:00100000:1.0:1767319412.699758:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379751296:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319412.699789:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319412.699910:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379751296:12345-0@lo:38:kworker.0 Request processed in 150us (447us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319412.699918:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997
00000100:00100000:2.0:1767319412.700723:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379751808:0@lo:38:kworker.0
00000100:00100000:2.0:1767319412.700791:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319412.700830:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379752064:0@lo:38:kworker.0
00000100:00100000:1.0:1767319412.700940:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751936
00000100:00100000:1.0:1767319412.700951:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751936
00000100:00100000:2.0:1767319412.700958:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319412.701023:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319412.701032:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319412.701036:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751168
00000100:00100000:2.0:1767319412.701041:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379751296:0@lo:38:kworker.0
00000100:00100000:1.0:1767319412.701044:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751168
00000100:00100000:1.0:1767319412.701081:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751808
00000100:00100000:1.0:1767319412.701087:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751808
00000100:00100000:1.0:1767319412.701111:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379752064
00000100:00100000:1.0:1767319412.701115:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379752064
00000100:00100000:2.0:1767319412.701122:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4229
00000100:00100000:2.0:1767319412.701139:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379751936:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319412.701193:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379751936:12345-0@lo:400:kworker.0 Request processed in 61us (2820us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319412.701200:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4229
00000100:00100000:1.0:1767319412.701230:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16940
00000100:00100000:1.0:1767319412.701247:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379751168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319412.701270:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319412.701626:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379751168:12345-0@lo:38:kworker.0 Request processed in 385us (2934us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319412.701659:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16941
00000100:00100000:2.0:1767319412.701667:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379751808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319412.701687:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319412.701726:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379751808:12345-0@lo:38:kworker.0 Request processed in 59us (935us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319412.701732:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16941
00000100:00100000:2.0:1767319412.701758:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16942
00000100:00100000:2.0:1767319412.701762:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379752064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319412.701771:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319412.701791:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379752064:12345-0@lo:38:kworker.0 Request processed in 28us (836us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319412.701796:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16942
00000100:00100000:2.0:1767319412.701853:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379751936:0@lo:400:kworker.0
00000100:00080000:2.0:1767319412.701920:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319412.701924:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319412.701927:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379751168:0@lo:38:kworker.0
00000100:00080000:2.0:1767319412.701933:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319412.701936:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319412.701939:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379751808:0@lo:38:kworker.0
00000100:00080000:2.0:1767319412.701945:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319412.701948:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319412.701950:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379752064:0@lo:38:kworker.0
00000100:00080000:2.0:1767319412.701992:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319412.705035:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319412.705465:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379751424
00000100:00100000:2.0:1767319412.705479:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379751424
00000100:00100000:2.0:1767319412.705585:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503
00000100:00100000:2.0:1767319412.705598:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379751424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319412.705680:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379751424:12345-0@lo:400:kworker.0 Request processed in 86us (656us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319412.705688:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503
00000100:00080000:0.0:1767319412.710599:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319412.710698:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379751424:0@lo:400:kworker.0
00000100:00100000:1.0:1767319412.714664:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16940
00010000:00010000:1.0:1767319413.207213:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319413.647960:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319413.647997:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291915776 offset 0 length 520: 4
00000100:00100000:3.0:1767319413.648029:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319413.648142:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916032
00000100:00100000:0.0:1767319413.648161:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916032
00000100:00100000:0.0:1767319413.648284:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291915904
00000100:00100000:0.0:1767319413.648288:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291915904
00000100:00100000:0.0:1767319413.648318:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4230
00000100:00100000:0.0:1767319413.648334:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291916032:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319413.648456:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291916032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 126us (505us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319413.648464:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4230
00000100:00100000:0.0:1767319413.648492:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16943
00000100:00100000:0.0:1767319413.648498:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291915904:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319413.648526:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319413.648562:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291915904:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 62us (531us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319413.648570:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16943
00000100:00080000:3.0:1767319413.649206:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319413.719276:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319413.719302:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379752192:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319413.719422:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319413.719659:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379752192
00000100:00100000:1.0:1767319413.719671:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379752192
00000100:00100000:1.0:1767319413.719738:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276
00000100:00100000:1.0:1767319413.719749:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379752192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319413.719790:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319413.719914:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379752192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (491us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319413.719924:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276
00000100:00100000:3.0:1767319413.719991:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379752192:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319414.231228:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319415.255485:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319415.255520:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379752320:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319415.255533:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319415.255607:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319415.255667:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379752320
00000100:00100000:2.0:1767319415.255682:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379752320
00000100:00080000:3.0:1767319415.255750:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319415.255795:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277
00000100:00100000:2.0:1767319415.255810:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379752320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319415.255862:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319415.255996:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379752320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (388us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319415.256005:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277
00000100:00100000:3.0:1767319415.256966:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379752320:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319416.279125:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319417.303373:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319417.815072:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319392/real 1767319392]  req@ffff8b0e0be04700 x1853164379745920/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319417.815121:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0be04700 x1853164379745920/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319417.815149:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319417.815187:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319417.815193:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379745920:0@lo:250:kworker.0
00000100:00080000:0.0:1767319417.816456:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319417.816467:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319417.816472:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319417.816480:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4294
00000100:00080000:0.0:1767319417.816486:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319417.816495:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319417.816547:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ce00 x1853164379752448/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319417.816583:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319417.816587:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319417.816589:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319417.816593:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4315
00000100:00080000:0.0:1767319417.816595:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319417.816599:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319417.816615:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ca80 x1853164379752576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319417.816625:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319417.816629:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319417.816630:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319417.816635:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4315
00000100:00080000:0.0:1767319417.816638:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319417.816642:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319417.816655:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c380 x1853164379752704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319417.816739:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319417.816743:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319417.816745:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319417.816748:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4315
00000100:00080000:0.0:1767319417.816751:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319417.816755:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319417.816764:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e1880 x1853164379753216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319417.816781:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319417.816784:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319417.816786:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319417.816789:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4315
00000100:00080000:0.0:1767319417.816806:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319417.816811:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319417.816823:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff800 x1853164379753472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319417.816914:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379752960:0@lo:400:kworker.0
00000100:00100000:0.0:1767319417.817014:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319417.817038:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379753344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319417.817096:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319417.817106:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379753088:0@lo:400:kworker.0
00000100:00100000:0.0:1767319417.817153:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319417.817185:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319417.817251:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753088
00000100:00100000:0.0:1767319417.817263:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753088
00000100:00100000:0.0:1767319417.817341:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753344
00000100:00100000:0.0:1767319417.817346:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753344
00000100:00100000:0.0:1767319417.817378:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4231
00000100:00100000:0.0:1767319417.817389:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379753088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319417.817496:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379752960
00000100:00100000:2.0:1767319417.817500:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379752960
00000100:00100000:1.0:1767319417.817518:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319417.817535:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379752832:0@lo:400:kworker.0
00000100:00100000:2.0:1767319417.817554:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504
00000100:00100000:2.0:1767319417.817591:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379752960:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319417.817923:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319417.817930:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319417.818087:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4232
00000100:00100000:3.0:1767319417.818100:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379753344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319417.818338:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319417.818354:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379753088:12345-0@lo:400:kworker.0 Request processed in 964us (1197us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319417.818368:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4231
00000100:00100000:1.0:1767319417.818415:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379752832
00000100:00100000:1.0:1767319417.818424:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379752832
00000100:00100000:0.0:1767319417.818477:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379753088:0@lo:400:kworker.0
00000100:00100000:1.0:1767319417.818494:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505
00000100:00100000:1.0:1767319417.818506:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379752832:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319417.818559:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379752832:12345-0@lo:400:kworker.0 Request processed in 58us (226us total) trans 0 rc 0/0
00000100:00080000:0.0:1767319417.818571:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319417.818573:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505
00000100:00100000:0.0:1767319417.818599:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379752448:0@lo:250:kworker.0
00000100:00100000:1.0:1767319417.818639:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379752832:0@lo:400:kworker.0
00000400:00000100:0.0:1767319417.818771:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379752448 offset 0 length 520: 4
00000100:00100000:0.0:1767319417.818814:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379752576:0@lo:38:kworker.0
00000100:00100000:0.0:1767319417.818845:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319417.818906:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379752704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319417.818924:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379752576
00000100:00100000:1.0:1767319417.818931:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379752576
00000100:00100000:0.0:1767319417.818937:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319417.818966:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379753216:0@lo:38:kworker.0
00000100:00100000:1.0:1767319417.818972:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16944
00000100:00100000:1.0:1767319417.818979:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379752576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319417.818998:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319417.819002:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319417.819151:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379752576:12345-0@lo:38:kworker.0 Request processed in 172us (305us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319417.819157:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16944
00000100:00100000:1.0:1767319417.819166:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753216
00000100:00100000:1.0:1767319417.819169:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753216
00000100:00100000:1.0:1767319417.819183:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16945
00000100:00100000:1.0:1767319417.819186:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379753216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319417.819193:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319417.819210:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379753216:12345-0@lo:38:kworker.0 Request processed in 23us (216us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319417.819213:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16945
00000100:00100000:1.0:1767319417.819229:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379752704
00000100:00100000:1.0:1767319417.819231:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379752704
00000100:00100000:1.0:1767319417.819244:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998
00000100:00100000:1.0:1767319417.819319:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379752704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319417.819328:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319417.819349:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379752704:12345-0@lo:38:kworker.0 Request processed in 31us (414us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319417.819353:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998
00000100:00080000:0.0:1767319417.819510:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319417.819520:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319417.819524:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379753216:0@lo:38:kworker.0
00000100:00100000:0.0:1767319417.819533:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379753472:0@lo:38:kworker.0
00000100:00100000:0.0:1767319417.819569:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319417.819627:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319417.819629:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753472
00000100:00080000:0.0:1767319417.819634:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319417.819640:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753472
00000100:00100000:0.0:1767319417.819642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379752576:0@lo:38:kworker.0
00000100:00080000:0.0:1767319417.819667:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319417.819673:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319417.819679:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379752704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319417.819690:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16946
00000100:00100000:1.0:1767319417.819702:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379753472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319417.819715:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319417.819768:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379753472:12345-0@lo:38:kworker.0 Request processed in 70us (197us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319417.819777:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16946
00000100:00080000:0.0:1767319417.819814:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319417.819822:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319417.819826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379753472:0@lo:38:kworker.0
00000100:00100000:2.0:1767319417.820402:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379752960:12345-0@lo:400:kworker.0 Request processed in 2834us (3383us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319417.820415:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504
00000100:00100000:0.0:1767319417.820618:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379752960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319417.820753:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379753344:12345-0@lo:400:kworker.0 Request processed in 2655us (3572us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319417.820764:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4232
00000100:00100000:1.0:1767319417.820836:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379753344:0@lo:400:kworker.0
00010000:00010000:3.0:1767319418.327333:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319418.766681:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319418.766734:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319418.766936:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916160
00000100:00100000:0.0:1767319418.766946:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916160
00000100:00100000:0.0:1767319418.766991:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916288
00000100:00100000:0.0:1767319418.766994:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916288
00000100:00100000:0.0:1767319418.767038:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4233
00000100:00100000:0.0:1767319418.767048:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291916288:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319418.767128:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291916288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (393us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319418.767137:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4233
00000100:00100000:0.0:1767319418.767162:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16947
00000100:00100000:0.0:1767319418.767167:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291916160:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319418.767188:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319418.767216:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291916160:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (544us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319418.767223:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16947
00000100:00080000:2.0:1767319418.767238:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319418.839618:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319418.839649:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379753600:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319418.839723:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319418.839933:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753600
00000100:00100000:1.0:1767319418.839943:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753600
00000100:00100000:1.0:1767319418.839996:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278
00000100:00100000:1.0:1767319418.840008:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379753600:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319418.840043:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319418.840097:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379753600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319418.840107:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278
00000100:00100000:2.0:1767319418.840130:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379753600:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319419.351168:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319420.375223:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319420.375269:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379753728:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319420.375378:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319420.375521:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753728
00000100:00100000:3.0:1767319420.375532:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753728
00000100:00100000:3.0:1767319420.375612:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279
00000100:00100000:3.0:1767319420.375624:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379753728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319420.375663:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319420.375723:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379753728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (345us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319420.375732:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279
00000100:00080000:2.0:1767319420.375820:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319420.375913:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379753728:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319420.376052:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319421.399181:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319422.423190:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319422.935329:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319422.935341:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319422.935344:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319422.935348:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319422.935354:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319422.935364:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4320
00000100:00080000:2.0:1767319422.935369:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319422.935377:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319422.935423:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198000 x1853164379753856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319422.935449:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319422.935452:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319422.935454:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319422.935458:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4320
00000100:00080000:2.0:1767319422.935460:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319422.935464:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319422.935477:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efdf80 x1853164379753984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319422.935544:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319422.935548:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319422.935549:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319422.935554:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4320
00000100:00080000:2.0:1767319422.935556:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319422.935561:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319422.935574:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379754496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319422.935607:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319422.935610:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319422.935612:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319422.935615:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4320
00000100:00080000:2.0:1767319422.935618:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319422.935622:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319422.935632:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164379754752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319422.935665:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379754240:0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.935856:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379754112:0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.935952:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319422.936014:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319422.936020:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379754624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.936046:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319422.936080:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379754624
00000100:00100000:1.0:1767319422.936088:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379754624
00000100:00100000:1.0:1767319422.936152:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4234
00000100:00100000:1.0:1767319422.936161:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379754624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.936211:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379754624:12345-0@lo:400:kworker.0 Request processed in 52us (163us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319422.936218:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4234
00000100:00080000:1.0:1767319422.936247:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319422.936289:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379754624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.936332:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379754112
00000100:00100000:1.0:1767319422.936336:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379754112
00000100:00100000:1.0:1767319422.936367:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506
00000100:00100000:1.0:1767319422.936373:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379754112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.936409:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379754112:12345-0@lo:400:kworker.0 Request processed in 36us (457us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319422.936414:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506
00000100:00080000:1.0:1767319422.936433:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319422.936449:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379754112:0@lo:400:kworker.0
00000100:00100000:0.0:1767319422.936838:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379753856:0@lo:38:kworker.0
00000100:00100000:0.0:1767319422.936897:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319422.936926:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379753984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319422.936950:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319422.936981:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379754496:0@lo:38:kworker.0
00000100:00100000:0.0:1767319422.937004:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319422.937021:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379754752:0@lo:38:kworker.0
00000100:00100000:0.0:1767319422.937040:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319422.937070:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753984
00000100:00100000:0.0:1767319422.937075:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753984
00000100:00100000:0.0:1767319422.937097:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999
00000100:00100000:0.0:1767319422.937103:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379753984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319422.937123:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319422.937155:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379753984:12345-0@lo:38:kworker.0 Request processed in 52us (204us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319422.937161:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999
00000100:00100000:0.0:1767319422.937180:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379753856
00000100:00100000:0.0:1767319422.937183:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379753856
00000100:00100000:0.0:1767319422.937198:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379754496
00000100:00100000:0.0:1767319422.937201:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379754496
00000100:00100000:0.0:1767319422.937210:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379754752
00000100:00100000:0.0:1767319422.937212:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379754752
00000100:00100000:0.0:1767319422.937225:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16948
00000100:00100000:0.0:1767319422.937230:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379753856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319422.937239:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319422.937263:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379753856:12345-0@lo:38:kworker.0 Request processed in 33us (367us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319422.937270:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16948
00000100:00100000:0.0:1767319422.937279:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16949
00000100:00100000:0.0:1767319422.937283:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379754496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319422.937290:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319422.937310:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379754496:12345-0@lo:38:kworker.0 Request processed in 25us (305us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319422.937315:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16949
00000100:00100000:0.0:1767319422.937328:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16950
00000100:00100000:0.0:1767319422.937332:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379754752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319422.937340:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319422.937364:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379754752:12345-0@lo:38:kworker.0 Request processed in 31us (323us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319422.937369:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16950
00000100:00080000:0.0:1767319422.937401:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319422.937406:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319422.937409:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379753856:0@lo:38:kworker.0
00000100:00080000:0.0:1767319422.937417:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319422.937421:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319422.937423:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379753984:0@lo:38:kworker.0
00000100:00080000:0.0:1767319422.937430:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319422.937432:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319422.937435:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379754496:0@lo:38:kworker.0
00000100:00080000:0.0:1767319422.937441:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319422.937444:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319422.937447:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379754752:0@lo:38:kworker.0
00000100:00100000:2.0:1767319422.937767:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319422.937791:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319422.937800:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379754368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319422.937820:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319422.938419:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379754368
00000100:00100000:1.0:1767319422.938427:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379754368
00000100:00100000:1.0:1767319422.938494:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4235
00000100:00100000:1.0:1767319422.938501:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379754368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.938551:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379754368:12345-0@lo:400:kworker.0 Request processed in 50us (729us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319422.938557:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4235
00000100:00100000:1.0:1767319422.938596:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379754240
00000100:00100000:1.0:1767319422.938600:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379754240
00000100:00100000:1.0:1767319422.938623:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507
00000100:00100000:1.0:1767319422.938629:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379754240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319422.938659:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379754240:12345-0@lo:400:kworker.0 Request processed in 31us (894us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319422.938665:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507
00000100:00080000:2.0:1767319422.939712:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319422.939718:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319422.939773:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379754368:0@lo:400:kworker.0
00000100:00100000:2.0:1767319422.939789:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379754240:0@lo:400:kworker.0
00010000:00010000:2.0:1767319423.447198:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319423.889555:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319423.889816:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916416
00000100:00100000:2.0:1767319423.889829:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916416
00000100:00100000:2.0:1767319423.889914:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16951
00000100:00100000:2.0:1767319423.889923:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291916416:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319423.889948:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319423.890021:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291916416:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 98us (478us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319423.890028:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16951
00000100:00100000:0.0:1767319423.893088:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319423.894810:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916544
00000100:00100000:1.0:1767319423.894829:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916544
00000100:00100000:1.0:1767319423.894976:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4236
00000100:00100000:1.0:1767319423.894986:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291916544:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319423.895095:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291916544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (2019us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319423.895104:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4236
00000100:00080000:2.0:1767319423.895511:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319423.960619:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319423.960638:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379754880:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319423.960730:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319423.962543:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379754880
00000100:00100000:0.0:1767319423.962557:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379754880
00000100:00100000:0.0:1767319423.962679:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280
00000100:00100000:0.0:1767319423.962690:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379754880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319423.962754:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319423.962839:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379754880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (2108us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319423.962847:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280
00000100:00100000:2.0:1767319423.962948:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379754880:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319424.471491:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319425.495626:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319425.496115:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379755008:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319425.496193:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319425.496391:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755008
00000100:00100000:3.0:1767319425.496400:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755008
00000100:00100000:3.0:1767319425.496470:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281
00000100:00100000:3.0:1767319425.496481:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379755008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319425.496520:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319425.496584:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379755008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (391us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319425.496591:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281
00000100:00100000:3.0:1767319425.496662:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379755008:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319425.497451:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319426.519135:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319427.543153:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319428.056272:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319428.056287:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319428.056291:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319428.056294:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319428.056298:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319428.056307:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4325
00000100:00080000:2.0:1767319428.056312:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319428.056320:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319428.056523:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379755136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319428.056583:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379755136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319428.056660:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319428.056754:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755136
00000100:00100000:1.0:1767319428.056763:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755136
00000100:00080000:2.0:1767319428.056764:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319428.056769:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319428.056772:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319428.056777:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4325
00000100:00080000:2.0:1767319428.056780:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319428.056785:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319428.056804:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efdf80 x1853164379755264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319428.056813:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16952
00000100:00100000:1.0:1767319428.056926:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379755136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319428.056952:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319428.063976:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379755264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319428.064080:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319428.064343:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319428.064348:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319428.064352:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319428.064357:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4325
00000100:00080000:2.0:1767319428.064362:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319428.064368:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319428.064390:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164379755776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319428.064411:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319428.064415:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319428.064416:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319428.064420:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4325
00000100:00080000:2.0:1767319428.064422:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319428.064426:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319428.064439:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93100 x1853164379756032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319428.064489:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379755392:0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.064525:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319428.064550:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319428.064556:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379755904:0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.064583:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319428.064617:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755392
00000100:00100000:2.0:1767319428.064626:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755392
00000100:00100000:2.0:1767319428.064692:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508
00000100:00100000:2.0:1767319428.064733:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379755392:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.064790:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379755392:12345-0@lo:400:kworker.0 Request processed in 59us (264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319428.064797:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508
00000100:00080000:2.0:1767319428.064824:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319428.064865:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379755392:0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.064923:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379755520:0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.064950:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319428.064972:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319428.064977:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379755648:0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.065536:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319428.065577:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755904
00000100:00100000:2.0:1767319428.065583:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755904
00000100:00100000:2.0:1767319428.065622:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755648
00000100:00100000:2.0:1767319428.065625:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755648
00000100:00100000:2.0:1767319428.065647:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4237
00000100:00100000:2.0:1767319428.065655:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379755904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.065710:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379755904:12345-0@lo:400:kworker.0 Request processed in 44us (1114us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319428.065717:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4237
00000100:00100000:2.0:1767319428.065731:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4238
00000100:00100000:2.0:1767319428.065736:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379755648:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.065767:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379755648:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319428.065772:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4238
00000100:00080000:2.0:1767319428.065787:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319428.065797:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755520
00000100:00100000:2.0:1767319428.065800:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755520
00000100:00100000:2.0:1767319428.065829:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509
00000100:00100000:2.0:1767319428.065835:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379755520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.065903:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379755520:12345-0@lo:400:kworker.0 Request processed in 68us (953us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319428.065910:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509
00000100:00080000:2.0:1767319428.065924:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319428.065955:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379755904:0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.066008:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379755648:0@lo:400:kworker.0
00000100:00100000:2.0:1767319428.066019:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379755520:0@lo:400:kworker.0
00000100:00100000:3.0:1767319428.066819:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755264
00000100:00100000:3.0:1767319428.066829:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755264
00000100:00100000:3.0:1767319428.066895:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000
00000100:00100000:3.0:1767319428.066902:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379755264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319428.066923:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319428.066985:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379755264:12345-0@lo:38:kworker.0 Request processed in 82us (2904us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319428.066992:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000
00000100:00100000:1.0:1767319428.072426:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379755136:12345-0@lo:38:kworker.0 Request processed in 15589us (15753us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319428.072442:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16952
00000100:00080000:0.0:1767319428.072738:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319428.072745:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319428.072750:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379755136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319428.072788:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379755776:0@lo:38:kworker.0
00000100:00100000:0.0:1767319428.072905:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319428.072932:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379756032:0@lo:38:kworker.0
00000100:00100000:0.0:1767319428.072973:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319428.073015:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319428.073021:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319428.073025:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379755264:0@lo:38:kworker.0
00000100:00100000:1.0:1767319428.073064:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379755776
00000100:00100000:1.0:1767319428.073071:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379755776
00000100:00100000:1.0:1767319428.073098:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756032
00000100:00100000:1.0:1767319428.073101:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756032
00000100:00100000:1.0:1767319428.073134:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16953
00000100:00100000:1.0:1767319428.073145:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379755776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319428.073169:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319428.073183:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16954
00000100:00100000:3.0:1767319428.073191:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379756032:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319428.073204:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319428.073216:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379755776:12345-0@lo:38:kworker.0 Request processed in 73us (310us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319428.073223:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16953
00000100:00100000:3.0:1767319428.073250:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379756032:12345-0@lo:38:kworker.0 Request processed in 57us (287us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319428.073258:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16954
00000100:00080000:0.0:1767319428.073370:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319428.073374:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319428.073377:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379755776:0@lo:38:kworker.0
00000100:00080000:0.0:1767319428.073385:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319428.073387:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319428.073390:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379756032:0@lo:38:kworker.0
00010000:00010000:0.0:1767319428.567155:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319429.007799:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319429.008097:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319429.008282:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916800
00000100:00100000:2.0:1767319429.008294:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916800
00000100:00100000:2.0:1767319429.008383:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916672
00000100:00100000:2.0:1767319429.008387:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916672
00000100:00100000:2.0:1767319429.008409:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4239
00000100:00100000:2.0:1767319429.008421:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291916800:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319429.008517:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291916800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (728us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319429.008525:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4239
00000100:00100000:2.0:1767319429.008549:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16955
00000100:00100000:2.0:1767319429.008553:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291916672:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319429.008576:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319429.008605:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291916672:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (508us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319429.008612:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16955
00000100:00080000:3.0:1767319429.008992:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319429.080370:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319429.080390:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379756160:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319429.080470:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319429.080650:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756160
00000100:00100000:1.0:1767319429.080658:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756160
00000100:00100000:1.0:1767319429.080775:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282
00000100:00100000:1.0:1767319429.080786:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379756160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319429.080818:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319429.080912:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379756160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (440us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319429.080921:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282
00000100:00100000:2.0:1767319429.081013:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379756160:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319429.591234:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319430.615686:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319430.615847:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379756288:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319430.615962:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319430.616116:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756288
00000100:00100000:1.0:1767319430.616131:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756288
00000100:00100000:1.0:1767319430.616199:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283
00000100:00100000:1.0:1767319430.616209:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379756288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319430.616241:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319430.616289:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379756288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (327us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319430.616297:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283
00000100:00100000:0.0:1767319430.616521:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379756288:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319430.616687:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319431.639216:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319432.663237:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319433.175064:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319433.175075:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319433.175079:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319433.175082:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319433.175086:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319433.175093:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4330
00000100:00080000:3.0:1767319433.175098:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319433.175105:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319433.175145:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe300 x1853164379756416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319433.175174:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319433.175178:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319433.175180:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319433.175184:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4330
00000100:00080000:3.0:1767319433.175186:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319433.175189:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319433.175204:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ff480 x1853164379756544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319433.175218:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379756416:0@lo:38:kworker.0
00000100:00080000:3.0:1767319433.175287:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767319433.175294:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319433.175294:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319433.175297:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319433.175302:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4330
00000100:00080000:3.0:1767319433.175304:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319433.175308:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319433.175320:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd500 x1853164379757056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319433.175337:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319433.175340:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319433.175342:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767319433.175347:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379756672:0@lo:400:kworker.0
00000100:00080000:3.0:1767319433.175348:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4330
00000100:00080000:3.0:1767319433.175354:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319433.175359:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319433.175380:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379756544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319433.175386:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fca80 x1853164379757312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319433.175392:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319433.175420:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319433.175428:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319433.175437:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379757184:0@lo:400:kworker.0
00000100:00100000:0.0:1767319433.175459:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379757056:0@lo:38:kworker.0
00000100:00100000:1.0:1767319433.175469:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319433.175472:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379756800:0@lo:400:kworker.0
00000100:00100000:0.0:1767319433.175494:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319433.175517:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319433.175526:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756416
00000100:00100000:0.0:1767319433.175527:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379757312:0@lo:38:kworker.0
00000100:00100000:1.0:1767319433.175535:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756416
00000100:00100000:3.0:1767319433.175552:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319433.175563:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379756928:0@lo:400:kworker.0
00000100:00100000:0.0:1767319433.175564:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319433.175824:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319433.176592:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756672
00000100:00100000:2.0:1767319433.176600:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756672
00000100:00100000:2.0:1767319433.176670:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756800
00000100:00100000:2.0:1767319433.176674:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756800
00000100:00100000:2.0:1767319433.176702:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510
00000100:00100000:2.0:1767319433.176711:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379756672:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319433.176797:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379756672:12345-0@lo:400:kworker.0 Request processed in 87us (1406us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319433.176805:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510
00000100:00100000:2.0:1767319433.176825:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511
00000100:00100000:2.0:1767319433.176843:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379756800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319433.176899:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379756800:12345-0@lo:400:kworker.0 Request processed in 68us (1382us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319433.176906:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511
00000100:00080000:2.0:1767319433.176924:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319433.176927:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319433.176963:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379756672:0@lo:400:kworker.0
00000100:00100000:1.0:1767319433.181206:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757184
00000100:00100000:1.0:1767319433.181225:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757184
00000100:00100000:1.0:1767319433.181432:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757056
00000100:00100000:1.0:1767319433.181438:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757056
00000100:00100000:1.0:1767319433.181452:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757312
00000100:00100000:1.0:1767319433.181455:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757312
00000100:00100000:1.0:1767319433.181482:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4240
00000100:00100000:1.0:1767319433.181496:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379757184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319433.181607:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379757184:12345-0@lo:400:kworker.0 Request processed in 115us (6137us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319433.181614:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4240
00000100:00100000:1.0:1767319433.181636:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16956
00000100:00100000:1.0:1767319433.181640:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379756416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319433.181672:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319433.181710:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379756416:12345-0@lo:38:kworker.0 Request processed in 67us (6419us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319433.181716:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16956
00000100:00100000:1.0:1767319433.181729:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16957
00000100:00100000:1.0:1767319433.181733:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379757056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319433.181743:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319433.181766:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379757056:12345-0@lo:38:kworker.0 Request processed in 31us (6273us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319433.181771:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16957
00000100:00100000:1.0:1767319433.181782:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16958
00000100:00100000:1.0:1767319433.181786:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379757312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319433.181795:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319433.181816:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379757312:12345-0@lo:38:kworker.0 Request processed in 29us (6257us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319433.181822:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16958
00000100:00080000:1.0:1767319433.181854:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319433.181908:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379757184:0@lo:400:kworker.0
00000100:00080000:1.0:1767319433.181946:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319433.181952:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319433.181955:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379757312:0@lo:38:kworker.0
00000100:00080000:1.0:1767319433.181965:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319433.181969:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319433.181971:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379757056:0@lo:38:kworker.0
00000100:00080000:1.0:1767319433.181979:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319433.181982:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319433.181985:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379756416:0@lo:38:kworker.0
00000100:00100000:1.0:1767319433.182038:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756544
00000100:00100000:1.0:1767319433.182042:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756544
00000100:00100000:1.0:1767319433.182063:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001
00000100:00100000:1.0:1767319433.182067:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379756544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319433.182078:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319433.182108:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379756544:12345-0@lo:38:kworker.0 Request processed in 39us (6691us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319433.182114:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001
00000100:00080000:1.0:1767319433.182137:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319433.182141:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319433.182143:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379756544:0@lo:38:kworker.0
00000100:00100000:3.0:1767319433.182622:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379756800:0@lo:400:kworker.0
00000100:00100000:0.0:1767319433.182703:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379756928
00000100:00100000:0.0:1767319433.182708:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379756928
00000100:00080000:1.0:1767319433.182762:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319433.182766:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4241
00000100:00100000:0.0:1767319433.182777:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379756928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319433.182830:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379756928:12345-0@lo:400:kworker.0 Request processed in 56us (7006us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319433.182837:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4241
00000100:00100000:1.0:1767319433.182865:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379756928:0@lo:400:kworker.0
00010000:00010000:2.0:1767319433.687636:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319434.128230:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319434.128290:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319434.128468:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291916928
00000100:00100000:0.0:1767319434.128480:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291916928
00000100:00100000:0.0:1767319434.128537:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291917056
00000100:00100000:0.0:1767319434.128541:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291917056
00000100:00100000:1.0:1767319434.128570:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16959
00000100:00100000:1.0:1767319434.128582:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291916928:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:0.0:1767319434.128601:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4242
00010000:00020000:1.0:1767319434.128608:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319434.128615:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291917056:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319434.128712:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291917056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (420us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319434.128720:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4242
00000100:00100000:1.0:1767319434.128810:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291916928:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 228us (607us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319434.128817:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16959
00000100:00080000:1.0:1767319434.128864:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319434.200438:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319434.200464:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379757440:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319434.200538:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319434.200687:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757440
00000100:00100000:1.0:1767319434.200698:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757440
00000100:00100000:1.0:1767319434.200761:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284
00000100:00100000:1.0:1767319434.200771:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379757440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319434.200808:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319434.200898:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379757440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (358us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319434.200908:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284
00000100:00100000:2.0:1767319434.200985:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379757440:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319434.711136:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319435.737078:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319435.737117:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379757568:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319435.737220:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319435.737315:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757568
00000100:00100000:1.0:1767319435.737325:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757568
00000100:00100000:1.0:1767319435.737395:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285
00000100:00100000:1.0:1767319435.737405:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379757568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319435.737442:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319435.737486:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379757568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (265us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319435.737494:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285
00000100:00080000:1.0:1767319435.737522:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319435.737568:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379757568:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319435.739393:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319436.759091:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319437.784136:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319438.298557:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319438.298570:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319438.298573:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319438.298578:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319438.298583:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319438.298593:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4335
00000100:00080000:2.0:1767319438.298599:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319438.298616:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319438.298675:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379757696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319438.298705:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319438.298709:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319438.298711:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319438.298714:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4335
00000100:00080000:2.0:1767319438.298717:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319438.298720:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319438.298732:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc700 x1853164379757824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319438.298806:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379757952:0@lo:400:kworker.0
00000100:00100000:0.0:1767319438.298916:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319438.299056:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757952
00000100:00100000:1.0:1767319438.299066:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757952
00000100:00100000:1.0:1767319438.299155:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512
00000100:00100000:1.0:1767319438.299165:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379757952:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319438.299276:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319438.299280:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319438.299282:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319438.299286:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4335
00000100:00080000:2.0:1767319438.299290:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319438.299294:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319438.299305:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe300 x1853164379758336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319438.304846:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379758080:0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.304986:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319438.305081:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319438.305090:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379758208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.305122:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319438.305175:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379758080
00000100:00100000:3.0:1767319438.305186:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379758080
00000100:00100000:3.0:1767319438.305271:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513
00000100:00100000:3.0:1767319438.305283:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379758080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.305349:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379758080:12345-0@lo:400:kworker.0 Request processed in 68us (362us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319438.305358:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513
00000100:00100000:3.0:1767319438.305414:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379758080:0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.305443:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379758464:0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.305469:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319438.305554:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319438.305559:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319438.305573:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379757696:0@lo:38:kworker.0
00000100:00100000:3.0:1767319438.305614:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319438.305635:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379757824:0@lo:38:kworker.0
00000100:00100000:3.0:1767319438.305668:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319438.305695:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379758336:0@lo:38:kworker.0
00000100:00100000:3.0:1767319438.305719:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319438.305758:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379758208
00000100:00100000:3.0:1767319438.305763:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379758208
00000100:00100000:3.0:1767319438.305799:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379758464
00000100:00100000:3.0:1767319438.305803:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379758464
00000100:00100000:3.0:1767319438.305823:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757696
00000100:00100000:3.0:1767319438.305825:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757696
00000100:00100000:3.0:1767319438.305835:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379758336
00000100:00100000:3.0:1767319438.305837:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379758336
00000100:00100000:3.0:1767319438.305846:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4243
00000100:00100000:3.0:1767319438.305853:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379758208:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.305924:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379758208:12345-0@lo:400:kworker.0 Request processed in 71us (801us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319438.305930:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4243
00000100:00100000:3.0:1767319438.305942:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4244
00000100:00100000:3.0:1767319438.305948:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379758464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.305978:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379758464:12345-0@lo:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319438.305984:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4244
00000100:00100000:3.0:1767319438.305995:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16960
00000100:00100000:3.0:1767319438.305999:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379757696:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319438.306024:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319438.306060:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379757696:12345-0@lo:38:kworker.0 Request processed in 59us (457us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319438.306066:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16960
00000100:00100000:3.0:1767319438.306078:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16961
00000100:00100000:3.0:1767319438.306081:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379758336:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319438.306090:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319438.306111:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379758336:12345-0@lo:38:kworker.0 Request processed in 28us (391us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319438.306116:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16961
00000100:00100000:3.0:1767319438.306141:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379758208:0@lo:400:kworker.0
00000100:00080000:3.0:1767319438.306155:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319438.306170:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319438.306175:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319438.306178:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379757696:0@lo:38:kworker.0
00000100:00080000:3.0:1767319438.306186:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319438.306190:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319438.306192:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379758336:0@lo:38:kworker.0
00000100:00100000:3.0:1767319438.306213:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379758464:0@lo:400:kworker.0
00000100:00100000:3.0:1767319438.306250:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379757824
00000100:00100000:3.0:1767319438.306254:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379757824
00000100:00100000:3.0:1767319438.306276:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002
00000100:00100000:3.0:1767319438.306281:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379757824:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319438.306291:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319438.306319:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379757824:12345-0@lo:38:kworker.0 Request processed in 37us (650us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319438.306325:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002
00000100:00080000:3.0:1767319438.306345:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319438.306349:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319438.306351:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379757824:0@lo:38:kworker.0
00000100:00100000:1.0:1767319438.307354:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379757952:12345-0@lo:400:kworker.0 Request processed in 8184us (8430us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319438.307368:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512
00000100:00080000:2.0:1767319438.307799:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319438.307805:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319438.307809:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319438.307816:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4335
00000100:00080000:2.0:1767319438.307821:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319438.307828:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319438.307921:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fca80 x1853164379758592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319438.308203:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379758592:0@lo:38:kworker.0
00000100:00100000:3.0:1767319438.308276:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319438.308732:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379758592
00000100:00100000:2.0:1767319438.308744:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379758592
00000100:00100000:2.0:1767319438.308797:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16962
00000100:00100000:2.0:1767319438.308807:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379758592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319438.308833:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319438.308925:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379758592:12345-0@lo:38:kworker.0 Request processed in 118us (648us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319438.308932:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16962
00000100:00080000:1.0:1767319438.309483:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319438.309490:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319438.309495:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379758592:0@lo:38:kworker.0
00000100:00100000:0.0:1767319438.309966:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379757952:0@lo:400:kworker.0
00010000:00010000:3.0:1767319438.807934:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319439.247623:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319439.247675:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319439.247781:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291917440 offset 0 length 520: 4
00000100:00100000:0.0:1767319439.249296:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291917312
00000100:00100000:2.0:1767319439.249296:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291917184
00000100:00100000:0.0:1767319439.249318:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291917312
00000100:00100000:0.0:1767319439.249446:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4245
00000100:00100000:0.0:1767319439.249459:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291917312:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319439.249537:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291917184
00000100:00100000:2.0:1767319439.249849:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16963
00000100:00100000:2.0:1767319439.249857:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291917184:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319439.249904:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319439.253337:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319439.253525:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291917184:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 3652us (5926us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319439.253526:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291917312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4053us (5833us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319439.253639:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16963
00000100:00100000:0.0:1767319439.254255:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4245
00000100:00100000:0.0:1767319439.319446:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379758720:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319439.319559:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319439.320462:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379758720
00000100:00100000:2.0:1767319439.320479:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379758720
00000100:00100000:2.0:1767319439.320567:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286
00000100:00100000:2.0:1767319439.320581:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379758720:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319439.320634:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319439.320715:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379758720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 137us (1154us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319439.320724:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286
00000100:00100000:0.0:1767319439.320779:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379758720:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319439.834254:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319440.855621:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319440.855671:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379758848:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319440.855717:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319440.855788:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319440.856255:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379758848
00000100:00100000:1.0:1767319440.856268:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379758848
00000100:00100000:1.0:1767319440.856346:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287
00000100:00100000:1.0:1767319440.856359:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379758848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319440.856403:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319440.856489:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379758848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (700us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319440.856498:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287
00000100:00100000:2.0:1767319440.856754:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379758848:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319440.856959:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319441.879013:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319442.391180:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319417/real 1767319417]  req@ffff8b0f08e9ce00 x1853164379752448/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319442 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319442.391217:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f08e9ce00 x1853164379752448/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319442 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319442.391245:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319442.391274:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319442.391278:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379752448:0@lo:250:kworker.0
00000100:00080000:0.0:1767319442.391364:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319442.391370:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319442.391374:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319442.391379:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4320
00000100:00080000:0.0:1767319442.391383:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319442.391390:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319442.391428:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164379758976/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319442.391458:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319442.391462:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319442.391463:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319442.391467:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4340
00000100:00080000:0.0:1767319442.391470:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319442.391474:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319442.391490:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4a80 x1853164379759104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319442.391499:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319442.391502:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319442.391504:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319442.391508:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4340
00000100:00080000:0.0:1767319442.391510:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319442.391513:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319442.391544:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85bb80 x1853164379759232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319442.391634:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319442.391638:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319442.391640:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319442.391644:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4340
00000100:00080000:0.0:1767319442.391647:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319442.391650:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319442.391662:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dfb80 x1853164379759744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319442.391677:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319442.391680:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319442.391682:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319442.391685:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4340
00000100:00080000:0.0:1767319442.391688:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319442.391691:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319442.391701:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21f80 x1853164379760000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319442.391725:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379759616:0@lo:400:kworker.0
00000100:00100000:0.0:1767319442.391786:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319442.391839:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319442.391845:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379759488:0@lo:400:kworker.0
00000100:00100000:0.0:1767319442.391893:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319442.391928:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379759616
00000100:00100000:0.0:1767319442.391936:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379759616
00000100:00100000:0.0:1767319442.391988:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4246
00000100:00100000:0.0:1767319442.391996:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379759616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319442.392043:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379759616:12345-0@lo:400:kworker.0 Request processed in 48us (256us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319442.392050:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4246
00000100:00100000:0.0:1767319442.392075:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379759872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319442.392097:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319442.392115:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319442.392120:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379759360:0@lo:400:kworker.0
00000100:00100000:0.0:1767319442.392139:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319442.392162:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379759872
00000100:00100000:0.0:1767319442.392165:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379759872
00000100:00100000:0.0:1767319442.392187:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4247
00000100:00100000:0.0:1767319442.392193:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379759872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319442.392222:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379759872:12345-0@lo:400:kworker.0 Request processed in 28us (123us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319442.392227:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4247
00000100:00100000:0.0:1767319442.392258:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379759872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319442.392283:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379759616:0@lo:400:kworker.0
00000100:00100000:1.0:1767319442.392746:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379759488
00000100:00100000:1.0:1767319442.392752:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379759488
00000100:00100000:1.0:1767319442.392795:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379759360
00000100:00100000:1.0:1767319442.392799:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379759360
00000100:00100000:1.0:1767319442.392821:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514
00000100:00100000:1.0:1767319442.392828:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379759488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319442.392899:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379759488:12345-0@lo:400:kworker.0 Request processed in 71us (1004us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319442.392905:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514
00000100:00100000:1.0:1767319442.392923:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515
00000100:00100000:1.0:1767319442.392928:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379759360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319442.392960:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379759360:12345-0@lo:400:kworker.0 Request processed in 32us (820us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319442.392966:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515
00000100:00100000:1.0:1767319442.392998:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379759360:0@lo:400:kworker.0
00000100:00100000:1.0:1767319442.393023:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379759488:0@lo:400:kworker.0
00000100:00080000:3.0:1767319442.393112:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319442.393118:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319442.393121:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319442.393142:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379758976:0@lo:250:kworker.0
00000400:00000100:3.0:1767319442.393169:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379758976 offset 0 length 520: 4
00000100:00100000:3.0:1767319442.393197:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379759104:0@lo:38:kworker.0
00000100:00100000:3.0:1767319442.393221:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319442.393245:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379759232:0@lo:38:kworker.0
00000100:00100000:3.0:1767319442.393267:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319442.393283:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379759744:0@lo:38:kworker.0
00000100:00100000:3.0:1767319442.393303:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319442.393321:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379760000:0@lo:38:kworker.0
00000100:00100000:3.0:1767319442.393341:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319442.393366:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379759104
00000100:00100000:3.0:1767319442.393370:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379759104
00000100:00100000:3.0:1767319442.393388:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379759744
00000100:00100000:3.0:1767319442.393391:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379759744
00000100:00100000:3.0:1767319442.393401:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760000
00000100:00100000:3.0:1767319442.393403:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760000
00000100:00100000:3.0:1767319442.393417:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16964
00000100:00100000:3.0:1767319442.393422:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379759104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319442.393439:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319442.393472:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379759104:12345-0@lo:38:kworker.0 Request processed in 49us (249us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319442.393477:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16964
00000100:00100000:3.0:1767319442.393489:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16965
00000100:00100000:3.0:1767319442.393493:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379759744:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319442.393504:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319442.393539:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379759744:12345-0@lo:38:kworker.0 Request processed in 32us (223us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319442.393544:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16965
00000100:00100000:1.0:1767319442.393973:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379759232
00000100:00100000:1.0:1767319442.393978:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379759232
00000100:00100000:1.0:1767319442.394004:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003
00000100:00100000:1.0:1767319442.394008:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379759232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319442.394020:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319442.394050:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379759232:12345-0@lo:38:kworker.0 Request processed in 40us (781us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319442.394055:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003
00000100:00100000:1.0:1767319442.394079:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16966
00000100:00100000:1.0:1767319442.394084:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379760000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319442.394093:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319442.394115:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379760000:12345-0@lo:38:kworker.0 Request processed in 31us (774us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319442.394120:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16966
00000100:00080000:1.0:1767319442.394198:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319442.394204:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319442.394207:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379759104:0@lo:38:kworker.0
00000100:00080000:1.0:1767319442.394217:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319442.394221:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319442.394224:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379759232:0@lo:38:kworker.0
00000100:00080000:1.0:1767319442.394232:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319442.394235:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319442.394238:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379759744:0@lo:38:kworker.0
00000100:00080000:1.0:1767319442.394246:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319442.394249:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319442.394251:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379760000:0@lo:38:kworker.0
00010000:00010000:3.0:1767319442.909038:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319443.928008:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319444.372271:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319444.372361:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319444.372434:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291917696
00000100:00100000:1.0:1767319444.372446:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291917696
00000100:00100000:1.0:1767319444.372537:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291917568
00000100:00100000:1.0:1767319444.372541:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291917568
00000100:00080000:0.0:1767319444.372542:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319444.372577:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4248
00000100:00100000:1.0:1767319444.372588:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291917696:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319444.372674:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291917696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (414us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319444.372682:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4248
00000100:00100000:1.0:1767319444.372708:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16967
00000100:00100000:1.0:1767319444.372713:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291917568:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319444.372735:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319444.372764:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291917568:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 50us (404us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319444.372772:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16967
00000100:00100000:2.0:1767319444.441536:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379760128:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319444.441628:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319444.441682:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760128
00000100:00100000:3.0:1767319444.441693:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760128
00000100:00080000:1.0:1767319444.441737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319444.441759:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288
00000100:00100000:3.0:1767319444.441770:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379760128:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319444.441799:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319444.441935:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379760128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (307us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319444.441943:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288
00000100:00100000:2.0:1767319444.443286:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379760128:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319444.951032:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319445.978010:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319445.978035:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379760256:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319445.978087:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319445.978110:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319445.978239:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760256
00000100:00100000:1.0:1767319445.978247:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760256
00000100:00100000:1.0:1767319445.978313:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289
00000100:00100000:1.0:1767319445.978323:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379760256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319445.978353:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319445.978409:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379760256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319445.978417:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289
00000100:00100000:2.0:1767319445.978464:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379760256:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319445.978476:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319447.001050:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319447.510992:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319447.511004:0:52952:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319447.511007:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319447.511011:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319447.511015:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319447.511023:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4344
00000100:00080000:0.0:1767319447.511028:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319447.511035:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319447.511079:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05c00 x1853164379760384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319447.511157:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379760384:0@lo:38:kworker.0
00000100:00100000:1.0:1767319447.511230:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319447.511356:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760384
00000100:00100000:3.0:1767319447.511365:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760384
00000100:00100000:3.0:1767319447.511405:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968
00000100:00100000:3.0:1767319447.511424:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379760384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319447.511453:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319447.511504:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319447.511507:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319447.511510:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319447.511514:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4344
00000100:00080000:0.0:1767319447.511517:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319447.511533:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319447.511550:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164379760512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319447.511944:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379760512:0@lo:38:kworker.0
00000100:00100000:1.0:1767319447.511979:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319447.512053:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760512
00000100:00100000:2.0:1767319447.512058:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760512
00000100:00100000:2.0:1767319447.512085:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004
00000100:00100000:2.0:1767319447.512090:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379760512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319447.512102:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319447.512147:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379760512:12345-0@lo:38:kworker.0 Request processed in 56us (167us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319447.512154:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004
00000100:00100000:3.0:1767319447.512313:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379760384:12345-0@lo:38:kworker.0 Request processed in 899us (1081us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319447.512320:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968
00000100:00100000:2.0:1767319447.512604:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379760640:0@lo:400:kworker.0
00000100:00100000:2.0:1767319447.512640:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319447.512717:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319447.512721:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319447.512724:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319447.512728:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4344
00000100:00080000:0.0:1767319447.512732:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319447.512736:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319447.512751:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05880 x1853164379761024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319447.512809:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760640
00000100:00100000:3.0:1767319447.512814:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760640
00000100:00100000:3.0:1767319447.512861:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516
00000100:00100000:3.0:1767319447.512883:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379760640:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319447.512996:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319447.513002:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319447.513005:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379760384:0@lo:38:kworker.0
00000100:00100000:1.0:1767319447.513030:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379761024:0@lo:38:kworker.0
00000100:00100000:1.0:1767319447.513058:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319447.513085:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319447.513089:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319447.513092:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379760512:0@lo:38:kworker.0
00000100:00080000:1.0:1767319447.513162:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319447.513174:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379761152:0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.513199:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319447.513238:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379760896:0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.513262:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319447.513282:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319447.513287:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379760768:0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.513311:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319447.513332:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760768
00000100:00100000:1.0:1767319447.513336:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760768
00000100:00100000:1.0:1767319447.513369:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517
00000100:00100000:1.0:1767319447.513375:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379760768:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.513408:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379760768:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319447.513427:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517
00000100:00100000:1.0:1767319447.513726:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761024
00000100:00100000:1.0:1767319447.513732:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761024
00000100:00100000:1.0:1767319447.513753:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761152
00000100:00100000:1.0:1767319447.513755:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761152
00000100:00100000:1.0:1767319447.513775:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379760896
00000100:00100000:1.0:1767319447.513778:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379760896
00000100:00100000:1.0:1767319447.513797:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4249
00000100:00100000:1.0:1767319447.513803:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379761152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.513839:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379761152:12345-0@lo:400:kworker.0 Request processed in 36us (640us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319447.513846:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4249
00000100:00100000:1.0:1767319447.513857:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4250
00000100:00100000:1.0:1767319447.513863:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379760896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.513921:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379760896:12345-0@lo:400:kworker.0 Request processed in 58us (658us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319447.513927:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4250
00000100:00100000:1.0:1767319447.513939:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969
00000100:00100000:1.0:1767319447.513943:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379761024:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319447.513962:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319447.513993:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379761024:12345-0@lo:38:kworker.0 Request processed in 48us (933us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319447.513999:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969
00000100:00080000:1.0:1767319447.514016:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319447.514019:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319447.514055:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379761152:0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.514086:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379760768:0@lo:400:kworker.0
00000100:00100000:1.0:1767319447.514096:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379760896:0@lo:400:kworker.0
00000100:00080000:1.0:1767319447.514139:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319447.514143:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319447.514146:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379761024:0@lo:38:kworker.0
00000100:00080000:0.0:1767319447.514366:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319447.514370:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319447.514373:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319447.514378:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4344
00000100:00080000:0.0:1767319447.514382:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319447.514387:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319447.514425:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379761280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319447.514625:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379760640:12345-0@lo:400:kworker.0 Request processed in 1757us (1983us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319447.514634:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516
00000100:00100000:1.0:1767319447.515052:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379761280:0@lo:38:kworker.0
00000100:00100000:1.0:1767319447.515094:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319447.515325:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379760640:0@lo:400:kworker.0
00000100:00100000:0.0:1767319447.515378:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761280
00000100:00100000:0.0:1767319447.515385:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761280
00000100:00100000:0.0:1767319447.515622:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16970
00000100:00100000:0.0:1767319447.515630:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379761280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319447.515654:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319447.515723:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379761280:12345-0@lo:38:kworker.0 Request processed in 93us (629us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319447.515730:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16970
00000100:00080000:2.0:1767319447.515795:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319447.515800:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319447.515803:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379761280:0@lo:38:kworker.0
00010000:00010000:2.0:1767319448.027834:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319449.047026:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319449.488520:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319449.488568:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319449.489603:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291917952
00000100:00100000:0.0:1767319449.489616:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291917952
00000100:00100000:0.0:1767319449.489714:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291917824
00000100:00100000:0.0:1767319449.489718:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291917824
00000100:00100000:0.0:1767319449.489738:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4251
00000100:00100000:0.0:1767319449.489749:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291917952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319449.489838:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291917952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (1341us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319449.489848:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4251
00000100:00100000:0.0:1767319449.489910:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16971
00000100:00100000:0.0:1767319449.489914:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291917824:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319449.489934:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319449.489956:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291917824:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (1388us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319449.489962:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16971
00000100:00080000:1.0:1767319449.491443:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319449.561800:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379761408:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319449.561904:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319449.562028:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761408
00000100:00100000:1.0:1767319449.562036:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761408
00000100:00100000:1.0:1767319449.562101:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290
00000100:00100000:1.0:1767319449.562111:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379761408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319449.562136:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319449.562246:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379761408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319449.562254:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290
00000100:00100000:1.0:1767319449.562302:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379761408:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319449.562610:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319450.071757:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319451.095588:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319451.096326:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319451.096352:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379761536:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319451.096438:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319451.096771:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761536
00000100:00100000:0.0:1767319451.096780:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761536
00000100:00100000:0.0:1767319451.096861:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291
00000100:00100000:0.0:1767319451.096891:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379761536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319451.096922:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319451.096984:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379761536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (533us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319451.096992:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291
00000100:00080000:1.0:1767319451.097346:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319451.097518:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379761536:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319452.123427:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319452.631288:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319452.631299:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319452.631302:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319452.631305:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319452.631310:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319452.631318:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4349
00000100:00080000:3.0:1767319452.631322:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319452.631329:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319452.631370:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebed80 x1853164379761664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319452.631398:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319452.631401:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319452.631403:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319452.631406:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4349
00000100:00080000:3.0:1767319452.631409:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319452.631413:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319452.631426:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682d80 x1853164379761792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319452.631516:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379761920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319452.631586:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319452.631700:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761920
00000100:00100000:1.0:1767319452.631708:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761920
00000100:00100000:1.0:1767319452.631764:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518
00000100:00100000:1.0:1767319452.631774:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379761920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.631854:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379761664:0@lo:38:kworker.0
00000100:00100000:2.0:1767319452.631906:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319452.631927:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379761792:0@lo:38:kworker.0
00000100:00100000:2.0:1767319452.631949:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319452.631985:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761664
00000100:00100000:2.0:1767319452.631989:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761664
00000100:00100000:2.0:1767319452.632013:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16972
00000100:00100000:2.0:1767319452.632018:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379761664:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319452.632036:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319452.632070:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379761664:12345-0@lo:38:kworker.0 Request processed in 51us (163us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319452.632076:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16972
00000100:00080000:2.0:1767319452.632115:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319452.632120:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319452.632123:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379761664:0@lo:38:kworker.0
00000100:00080000:2.0:1767319452.632172:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319452.632190:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379761792
00000100:00100000:2.0:1767319452.632193:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379761792
00000100:00100000:2.0:1767319452.632214:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005
00000100:00100000:2.0:1767319452.632217:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379761792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319452.632227:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319452.632255:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379761792:12345-0@lo:38:kworker.0 Request processed in 36us (305us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319452.632261:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005
00000100:00080000:2.0:1767319452.632286:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319452.632290:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319452.632292:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379761792:0@lo:38:kworker.0
00000100:00080000:3.0:1767319452.632605:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319452.632608:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319452.632611:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319452.632615:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4349
00000100:00080000:3.0:1767319452.632618:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319452.632633:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319452.632648:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4a80 x1853164379762304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319452.632707:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379762432:0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.632736:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319452.632767:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762432
00000100:00100000:2.0:1767319452.632771:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762432
00000100:00100000:2.0:1767319452.632803:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4252
00000100:00100000:2.0:1767319452.632809:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379762432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.632848:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379762432:12345-0@lo:400:kworker.0 Request processed in 39us (111us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319452.632855:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4252
00000100:00080000:2.0:1767319452.632900:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319452.632920:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379762432:0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.632939:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379762304:0@lo:38:kworker.0
00000100:00100000:2.0:1767319452.632964:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319452.632987:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762304
00000100:00100000:2.0:1767319452.632990:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762304
00000100:00100000:2.0:1767319452.633008:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16973
00000100:00100000:2.0:1767319452.633012:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379762304:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319452.633023:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319452.633051:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379762304:12345-0@lo:38:kworker.0 Request processed in 37us (86us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319452.633056:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16973
00000100:00080000:2.0:1767319452.633078:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319452.633082:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319452.633085:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379762304:0@lo:38:kworker.0
00000100:00100000:2.0:1767319452.633112:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379762048:0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.633137:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319452.633158:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319452.633163:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379762176:0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.633182:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319452.633204:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762048
00000100:00100000:2.0:1767319452.633207:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762048
00000100:00100000:2.0:1767319452.633233:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519
00000100:00100000:2.0:1767319452.633240:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379762048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.633272:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379762048:12345-0@lo:400:kworker.0 Request processed in 32us (134us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319452.633278:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519
00000100:00100000:2.0:1767319452.633301:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379762048:0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.633316:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762176
00000100:00100000:2.0:1767319452.633319:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762176
00000100:00100000:2.0:1767319452.633344:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4253
00000100:00100000:2.0:1767319452.633350:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379762176:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319452.633380:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379762176:12345-0@lo:400:kworker.0 Request processed in 30us (196us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319452.633386:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4253
00000100:00080000:2.0:1767319452.633401:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319452.633418:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379762176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319452.638098:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379761920:12345-0@lo:400:kworker.0 Request processed in 6311us (6497us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319452.638113:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518
00000100:00080000:3.0:1767319452.639782:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319452.639792:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319452.639796:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319452.639802:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4349
00000100:00080000:3.0:1767319452.639807:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319452.639814:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319452.639854:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5c00 x1853164379762560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319452.640101:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379762560:0@lo:38:kworker.0
00000100:00100000:2.0:1767319452.640170:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319452.640751:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762560
00000100:00100000:3.0:1767319452.640760:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762560
00000100:00100000:3.0:1767319452.640807:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16974
00000100:00100000:3.0:1767319452.640814:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379762560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319452.640836:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319452.641016:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379762560:12345-0@lo:38:kworker.0 Request processed in 200us (845us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319452.641024:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16974
00000100:00080000:2.0:1767319452.641095:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319452.641100:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319452.641104:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379762560:0@lo:38:kworker.0
00000100:00100000:0.0:1767319452.641394:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379761920:0@lo:400:kworker.0
00010000:00010000:0.0:1767319453.143576:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319454.168202:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319454.608937:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319454.608987:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319454.611478:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291918208
00000100:00100000:2.0:1767319454.611494:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291918208
00000100:00080000:0.0:1767319454.611646:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319454.611704:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291918080
00000100:00100000:2.0:1767319454.611708:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291918080
00000100:00100000:1.0:1767319454.612027:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4254
00000100:00100000:1.0:1767319454.612041:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291918208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319454.612137:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291918208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 100us (3210us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319454.612144:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4254
00000100:00100000:1.0:1767319454.612168:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16975
00000100:00100000:1.0:1767319454.612174:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291918080:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319454.612194:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319454.612290:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291918080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 114us (3302us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319454.612297:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16975
00000100:00100000:0.0:1767319454.679981:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379762688:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319454.680061:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319454.680530:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762688
00000100:00100000:3.0:1767319454.680539:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762688
00000100:00100000:3.0:1767319454.680621:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292
00000100:00100000:3.0:1767319454.680632:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379762688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319454.680661:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319454.680715:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379762688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (653us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319454.680723:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292
00000100:00080000:0.0:1767319454.680786:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319454.680828:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379762688:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319455.193311:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319456.215188:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319456.215492:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379762816:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319456.215570:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319456.215711:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762816
00000100:00100000:1.0:1767319456.215720:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762816
00000100:00100000:1.0:1767319456.215784:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293
00000100:00100000:1.0:1767319456.215793:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379762816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319456.215819:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319456.215894:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379762816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (324us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319456.215901:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293
00000100:00080000:3.0:1767319456.216156:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319456.216196:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379762816:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319457.239575:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319457.751136:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319457.751148:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319457.751151:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319457.751155:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319457.751160:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319457.751169:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4355
00000100:00080000:1.0:1767319457.751174:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319457.751181:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319457.751222:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859500 x1853164379762944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319457.751251:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319457.751254:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319457.751256:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319457.751259:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4355
00000100:00080000:1.0:1767319457.751262:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319457.751265:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319457.751280:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859c00 x1853164379763072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319457.752034:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319457.752038:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319457.752041:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319457.752045:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4355
00000100:00080000:1.0:1767319457.752049:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319457.752053:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319457.752066:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07480 x1853164379763584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319457.752082:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319457.752085:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319457.752087:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319457.752090:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4355
00000100:00080000:1.0:1767319457.752093:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319457.752097:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319457.752472:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379763328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319457.752544:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319457.752614:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319457.752620:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379763456:0@lo:400:kworker.0
00000100:00100000:2.0:1767319457.752644:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319457.752678:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763456
00000100:00100000:2.0:1767319457.752685:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763456
00000100:00100000:2.0:1767319457.752743:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4255
00000100:00100000:2.0:1767319457.752753:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379763456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319457.752804:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379763456:12345-0@lo:400:kworker.0 Request processed in 53us (159us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319457.752812:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4255
00000100:00100000:2.0:1767319457.752857:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379763456:0@lo:400:kworker.0
00000100:00100000:2.0:1767319457.753000:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763328
00000100:00100000:2.0:1767319457.753004:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763328
00000100:00100000:2.0:1767319457.753031:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520
00000100:00100000:2.0:1767319457.753037:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379763328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319457.753072:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379763328:12345-0@lo:400:kworker.0 Request processed in 35us (527us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319457.753077:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520
00000100:00100000:2.0:1767319457.753106:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379763328:0@lo:400:kworker.0
00000100:00100000:0.0:1767319457.753612:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379763200:0@lo:400:kworker.0
00000100:00100000:0.0:1767319457.753654:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319457.753706:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319457.753712:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379763712:0@lo:400:kworker.0
00000100:00100000:0.0:1767319457.753734:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319457.753763:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763712
00000100:00100000:0.0:1767319457.753767:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763712
00000100:00100000:0.0:1767319457.753798:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4256
00000100:00100000:0.0:1767319457.753804:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379763712:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319457.753851:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379763712:12345-0@lo:400:kworker.0 Request processed in 47us (115us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319457.753857:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4256
00000100:00100000:0.0:1767319457.753940:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379763712:0@lo:400:kworker.0
00000100:00080000:3.0:1767319457.754153:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319457.754170:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379762944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319457.754203:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319457.754231:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379763072:0@lo:38:kworker.0
00000100:00100000:3.0:1767319457.754255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319457.754280:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379763584:0@lo:38:kworker.0
00000100:00100000:3.0:1767319457.754299:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319457.754442:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379763840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319457.754503:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763072
00000100:00100000:1.0:1767319457.754508:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763072
00000100:00100000:1.0:1767319457.754532:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006
00000100:00100000:1.0:1767319457.754538:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379763072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319457.754558:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319457.754594:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379763072:12345-0@lo:38:kworker.0 Request processed in 55us (337us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319457.754600:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006
00000100:00100000:2.0:1767319457.754716:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763200
00000100:00100000:2.0:1767319457.754721:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763200
00000100:00100000:3.0:1767319457.754743:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379763840:0@lo:38:kworker.0
00000100:00100000:2.0:1767319457.754776:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521
00000100:00100000:3.0:1767319457.754777:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319457.754789:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379763200:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767319457.754813:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319457.754819:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319457.754823:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379763072:0@lo:38:kworker.0
00000100:00100000:2.0:1767319457.754843:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379763200:12345-0@lo:400:kworker.0 Request processed in 56us (1187us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319457.754851:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521
00000100:00100000:3.0:1767319457.754855:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379762944
00000100:00100000:3.0:1767319457.754860:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379762944
00000100:00100000:3.0:1767319457.754906:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763584
00000100:00100000:3.0:1767319457.754910:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763584
00000100:00100000:2.0:1767319457.754912:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763840
00000100:00100000:2.0:1767319457.754919:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763840
00000100:00100000:3.0:1767319457.754932:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16976
00000100:00100000:3.0:1767319457.754938:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379762944:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319457.754948:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16977
00010000:00020000:3.0:1767319457.754952:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319457.754958:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379763584:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319457.754971:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319457.754995:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379762944:12345-0@lo:38:kworker.0 Request processed in 54us (789us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319457.755003:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16976
00000100:00100000:2.0:1767319457.755009:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379763584:12345-0@lo:38:kworker.0 Request processed in 51us (707us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319457.755017:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16977
00000100:00080000:1.0:1767319457.755521:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319457.756397:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16978
00000100:00100000:3.0:1767319457.756406:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379763840:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319457.756434:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319457.758544:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379763840:12345-0@lo:38:kworker.0 Request processed in 2127us (3758us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319457.758561:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16978
00000100:00080000:3.0:1767319457.758646:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319457.758653:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319457.758658:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379763840:0@lo:38:kworker.0
00000100:00080000:3.0:1767319457.758674:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319457.758679:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319457.758682:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379762944:0@lo:38:kworker.0
00000100:00080000:3.0:1767319457.758692:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319457.758695:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319457.758698:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379763584:0@lo:38:kworker.0
00000100:00100000:3.0:1767319457.758820:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379763200:0@lo:400:kworker.0
00010000:00010000:2.0:1767319458.264884:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319459.288268:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319459.726584:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319459.726633:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319459.726791:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291918464
00000100:00100000:2.0:1767319459.726801:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291918464
00000100:00100000:2.0:1767319459.726898:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291918336
00000100:00100000:2.0:1767319459.726903:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291918336
00000100:00100000:2.0:1767319459.726922:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4257
00000100:00100000:2.0:1767319459.726932:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291918464:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319459.726981:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16979
00000100:00100000:1.0:1767319459.726990:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291918336:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319459.727016:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319459.727017:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291918464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (439us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319459.727028:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4257
00000100:00100000:1.0:1767319459.727047:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291918336:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (413us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319459.727054:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16979
00000100:00080000:3.0:1767319459.727198:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319459.799451:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379763968:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319459.799527:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319459.799661:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379763968
00000100:00100000:0.0:1767319459.799671:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379763968
00000100:00080000:1.0:1767319459.799714:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319459.799741:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294
00000100:00100000:0.0:1767319459.799752:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379763968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319459.799785:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319459.800426:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379763968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 673us (896us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319459.800435:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294
00000100:00100000:3.0:1767319459.800596:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379763968:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319460.313632:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319461.338843:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319461.339694:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379764096:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319461.339789:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319461.340455:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764096
00000100:00100000:0.0:1767319461.340465:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764096
00000100:00100000:0.0:1767319461.340540:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295
00000100:00100000:0.0:1767319461.340550:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379764096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319461.340579:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319461.340643:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379764096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (860us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319461.340650:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295
00000100:00080000:1.0:1767319461.340714:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319461.340935:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379764096:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319462.359220:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319462.870998:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319462.871011:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319462.871015:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319462.871018:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319462.871023:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319462.871031:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4360
00000100:00080000:1.0:1767319462.871036:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319462.871043:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319462.871084:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379764224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319462.871114:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319462.871118:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319462.871120:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319462.871124:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4360
00000100:00080000:1.0:1767319462.871126:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319462.871130:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319462.871142:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07480 x1853164379764352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319462.871146:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379764224:0@lo:38:kworker.0
00000100:00100000:0.0:1767319462.871215:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319462.871217:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:1.0:1767319462.871268:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319462.871272:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319462.871273:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319462.871278:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4360
00000100:00080000:1.0:1767319462.871281:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319462.871284:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319462.871295:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07800 x1853164379764864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319462.871416:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379764736:0@lo:400:kworker.0
00000100:00100000:2.0:1767319462.871447:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319462.871482:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764224
00000100:00100000:2.0:1767319462.871490:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764224
00000100:00100000:2.0:1767319462.871519:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764736
00000100:00100000:2.0:1767319462.871522:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764736
00000100:00100000:2.0:1767319462.871556:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4258
00000100:00100000:2.0:1767319462.871565:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379764736:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319462.871608:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379764736:12345-0@lo:400:kworker.0 Request processed in 44us (159us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319462.871615:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4258
00000100:00100000:2.0:1767319462.871630:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16980
00000100:00100000:2.0:1767319462.871634:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379764224:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319462.871651:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319462.871676:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379764224:12345-0@lo:38:kworker.0 Request processed in 40us (461us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319462.871682:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16980
00000100:00100000:2.0:1767319462.871698:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379764608:0@lo:400:kworker.0
00000100:00100000:2.0:1767319462.871722:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319462.871744:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764608
00000100:00100000:2.0:1767319462.871748:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764608
00000100:00100000:2.0:1767319462.871786:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522
00000100:00100000:2.0:1767319462.871792:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379764608:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319462.871825:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379764608:12345-0@lo:400:kworker.0 Request processed in 32us (100us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319462.871830:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522
00000100:00080000:2.0:1767319462.871895:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319462.874711:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319462.874723:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319462.874728:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379764224:0@lo:38:kworker.0
00000100:00100000:0.0:1767319462.874759:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379764352:0@lo:38:kworker.0
00000100:00100000:0.0:1767319462.874812:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319462.874857:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764352
00000100:00100000:0.0:1767319462.874862:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764352
00000100:00100000:0.0:1767319462.874931:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007
00000100:00100000:0.0:1767319462.874938:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379764352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319462.874959:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319462.874998:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379764352:12345-0@lo:38:kworker.0 Request processed in 59us (184us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319462.875005:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007
00000100:00100000:2.0:1767319462.875678:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379764736:0@lo:400:kworker.0
00000100:00100000:0.0:1767319462.876512:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379764608:0@lo:400:kworker.0
00000100:00080000:2.0:1767319462.876591:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319462.876596:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319462.876599:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379764352:0@lo:38:kworker.0
00000100:00100000:2.0:1767319462.876609:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379764864:0@lo:38:kworker.0
00000100:00100000:2.0:1767319462.876660:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319462.876888:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764864
00000100:00100000:0.0:1767319462.876895:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764864
00000100:00100000:0.0:1767319462.876944:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16981
00000100:00100000:0.0:1767319462.876951:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379764864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319462.876972:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319462.877030:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379764864:12345-0@lo:38:kworker.0 Request processed in 77us (369us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319462.877037:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16981
00000100:00080000:0.0:1767319462.877068:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319462.877072:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319462.877075:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379764864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319462.880910:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379764992:0@lo:400:kworker.0
00000100:00100000:3.0:1767319462.881005:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319462.881054:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379764480:0@lo:400:kworker.0
00000100:00100000:2.0:1767319462.881075:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764992
00000100:00100000:3.0:1767319462.881078:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319462.881083:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764992
00000100:00080000:3.0:1767319462.881137:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319462.881142:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4259
00000100:00100000:2.0:1767319462.881151:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379764992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319462.881292:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379764480
00000100:00100000:0.0:1767319462.881305:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379764480
00000100:00100000:0.0:1767319462.881345:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523
00000100:00100000:0.0:1767319462.881351:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379764480:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319462.881421:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379764992:12345-0@lo:400:kworker.0 Request processed in 270us (414us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319462.881430:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4259
00000100:00080000:2.0:1767319462.881464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319462.885309:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319462.885320:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319462.885324:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319462.885332:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4360
00000100:00080000:1.0:1767319462.885337:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319462.885344:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319462.885402:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07800 x1853164379765120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319462.885502:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379765120:0@lo:38:kworker.0
00000100:00100000:1.0:1767319462.885567:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319462.885621:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379765120
00000100:00100000:1.0:1767319462.885628:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379765120
00000100:00100000:1.0:1767319462.885664:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16982
00000100:00100000:1.0:1767319462.885671:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379765120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319462.885692:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319462.885728:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379765120:12345-0@lo:38:kworker.0 Request processed in 56us (160us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319462.885735:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16982
00000100:00080000:1.0:1767319462.885862:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319462.885884:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319462.885888:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379765120:0@lo:38:kworker.0
00000100:00100000:0.0:1767319462.886594:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379764480:12345-0@lo:400:kworker.0 Request processed in 5239us (5511us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319462.886605:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523
00000100:00100000:3.0:1767319462.886728:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379764992:0@lo:400:kworker.0
00000100:00100000:2.0:1767319462.886909:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379764480:0@lo:400:kworker.0
00010000:00010000:3.0:1767319463.383143:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319463.829426:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291918592 offset 0 length 520: 4
00000100:00100000:3.0:1767319463.829490:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319463.829807:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291918720
00000100:00100000:2.0:1767319463.829820:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291918720
00000100:00100000:2.0:1767319463.829923:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16983
00000100:00100000:2.0:1767319463.829933:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291918720:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319463.829961:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319463.830039:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291918720:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 105us (547us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319463.830049:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16983
00000100:00100000:2.0:1767319463.835700:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319463.835900:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291918848
00000100:00100000:1.0:1767319463.835922:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291918848
00000100:00100000:1.0:1767319463.836003:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4260
00000100:00100000:1.0:1767319463.836015:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291918848:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319463.836100:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291918848:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (410us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319463.836109:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4260
00000100:00080000:2.0:1767319463.836251:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319464.409598:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319464.919268:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319464.925403:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379765248:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319464.925486:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319464.925813:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379765248
00000100:00100000:0.0:1767319464.925822:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379765248
00000100:00100000:0.0:1767319464.925920:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296
00000100:00100000:0.0:1767319464.925932:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379765248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319464.925971:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319464.926016:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379765248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (528us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319464.926023:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296
00000100:00100000:3.0:1767319464.926247:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379765248:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319464.928160:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319465.431028:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319466.455164:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319466.455293:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379765376:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319466.455374:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319466.455519:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379765376
00000100:00100000:1.0:1767319466.455528:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379765376
00000100:00100000:1.0:1767319466.455589:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297
00000100:00100000:1.0:1767319466.455598:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379765376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319466.455627:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319466.455673:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379765376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319466.455680:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297
00000100:00080000:2.0:1767319466.455694:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319466.455789:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379765376:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319467.479123:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319467.991020:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319442/real 1767319442]  req@ffff8b0e04ed5c00 x1853164379758976/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319467 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319467.991061:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e04ed5c00 x1853164379758976/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319467 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319467.991077:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319467.991087:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319467.991091:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379758976:0@lo:250:kworker.0
00000100:00080000:0.0:1767319467.991102:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319467.991108:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319467.991111:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319467.991115:0:52952:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4344
00000100:00080000:0.0:1767319467.991118:0:52952:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319467.991130:0:52952:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319467.991160:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e4a80 x1853164379765504/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319467.991180:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319467.991184:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319467.991186:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319467.991189:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4365
00000100:00080000:0.0:1767319467.991191:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319467.991195:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319467.991220:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f336e6680 x1853164379765632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319467.991229:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319467.991233:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319467.991235:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319467.991238:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4365
00000100:00080000:0.0:1767319467.991240:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319467.991244:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319467.991255:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91f80 x1853164379765760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319467.991330:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379765888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319467.991363:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379765504:0@lo:250:kworker.0
00000100:00080000:0.0:1767319467.991460:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319467.991463:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319467.991465:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319467.991469:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4365
00000100:00080000:0.0:1767319467.991471:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319467.991475:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319467.991485:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92300 x1853164379766272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319467.991500:0:52952:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319467.991503:0:52952:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319467.991504:0:52952:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319467.991507:0:52952:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4365
00000100:00080000:0.0:1767319467.991509:0:52952:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319467.991526:0:52952:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319467.991537:0:52952:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b100 x1853164379766528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319467.991560:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379766016:0@lo:400:kworker.0
00000400:00000100:2.0:1767319467.991574:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379765504 offset 0 length 520: 4
00000100:00100000:3.0:1767319467.991622:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379766400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319467.991623:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f336e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379765632:0@lo:38:kworker.0
00000100:00100000:2.0:1767319467.991672:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319467.991704:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379766144:0@lo:400:kworker.0
00000100:00100000:2.0:1767319467.991706:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379765760:0@lo:38:kworker.0
00000100:00100000:3.0:1767319467.991745:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319467.991750:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319467.991787:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379765632
00000100:00100000:3.0:1767319467.991794:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379765632
00000100:00100000:3.0:1767319467.991822:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766144
00000100:00100000:3.0:1767319467.991825:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766144
00000100:00100000:3.0:1767319467.991862:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4261
00000100:00100000:3.0:1767319467.991891:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379766144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319467.991930:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379766144:12345-0@lo:400:kworker.0 Request processed in 62us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319467.991935:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4261
00000100:00100000:3.0:1767319467.991947:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16984
00000100:00100000:3.0:1767319467.991950:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379765632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319467.991964:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319467.991981:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379765632:12345-0@lo:38:kworker.0 Request processed in 30us (311us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319467.991985:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16984
00000100:00100000:3.0:1767319467.992006:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379766144:0@lo:400:kworker.0
00000100:00100000:3.0:1767319467.992018:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319467.992034:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766400
00000100:00100000:3.0:1767319467.992037:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766400
00000100:00100000:3.0:1767319467.992051:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4262
00000100:00100000:3.0:1767319467.992054:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379766400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319467.992074:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379766400:12345-0@lo:400:kworker.0 Request processed in 19us (55us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319467.992077:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4262
00000100:00100000:3.0:1767319467.992093:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379766400:0@lo:400:kworker.0
00000100:00080000:3.0:1767319467.992108:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319467.992132:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379765760
00000100:00100000:3.0:1767319467.992135:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379765760
00000100:00100000:2.0:1767319467.992139:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379766272:0@lo:38:kworker.0
00000100:00100000:3.0:1767319467.992151:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008
00000100:00100000:3.0:1767319467.992154:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379765760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319467.992161:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319467.992180:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379765760:12345-0@lo:38:kworker.0 Request processed in 24us (433us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319467.992186:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008
00000100:00100000:2.0:1767319467.992736:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319467.992766:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379766528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319467.992790:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319467.992815:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319467.992820:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319467.992823:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379765632:0@lo:38:kworker.0
00000100:00080000:2.0:1767319467.992831:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319467.992834:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319467.992837:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379765760:0@lo:38:kworker.0
00000100:00100000:2.0:1767319467.992867:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766272
00000100:00100000:2.0:1767319467.992888:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766272
00000100:00100000:2.0:1767319467.992908:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766528
00000100:00100000:2.0:1767319467.992911:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766528
00000100:00100000:2.0:1767319467.992925:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16985
00000100:00100000:2.0:1767319467.992930:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379766272:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319467.992941:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319467.992973:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379766272:12345-0@lo:38:kworker.0 Request processed in 42us (238us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319467.992980:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16985
00000100:00100000:2.0:1767319467.992995:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16986
00000100:00100000:1.0:1767319467.993000:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319467.993005:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379766528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319467.993015:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319467.993036:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379766528:12345-0@lo:38:kworker.0 Request processed in 34us (245us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319467.993042:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16986
00000100:00080000:2.0:1767319467.993066:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319467.993071:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319467.993076:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379766272:0@lo:38:kworker.0
00000100:00080000:2.0:1767319467.993088:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319467.993092:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319467.993096:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379766528:0@lo:38:kworker.0
00000100:00100000:1.0:1767319467.993103:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379765888
00000100:00100000:1.0:1767319467.993107:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379765888
00000100:00080000:2.0:1767319467.993130:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319467.993286:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524
00000100:00100000:1.0:1767319467.993294:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379765888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319467.993451:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379765888:12345-0@lo:400:kworker.0 Request processed in 159us (453us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319467.993456:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524
00000100:00100000:0.0:1767319467.993522:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319467.993576:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766016
00000100:00100000:1.0:1767319467.993579:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766016
00000100:00100000:1.0:1767319467.993601:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525
00000100:00100000:1.0:1767319467.993605:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379766016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319467.993630:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379766016:12345-0@lo:400:kworker.0 Request processed in 24us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319467.993634:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525
00000100:00100000:1.0:1767319467.993651:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379766016:0@lo:400:kworker.0
00000100:00100000:3.0:1767319467.993917:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379765888:0@lo:400:kworker.0
00010000:00010000:2.0:1767319468.503064:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319468.954608:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319468.954655:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319468.954724:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291919104
00000100:00100000:3.0:1767319468.954733:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291919104
00000100:00100000:3.0:1767319468.954797:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291918976
00000100:00100000:3.0:1767319468.954799:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291918976
00000100:00100000:3.0:1767319468.954814:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4263
00000100:00100000:3.0:1767319468.954821:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291919104:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319468.955532:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16987
00000100:00100000:1.0:1767319468.955539:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291918976:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319468.955560:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319468.956017:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291919104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1194us (1418us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319468.956024:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4263
00000100:00080000:0.0:1767319468.956152:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319468.959052:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291918976:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 3498us (4382us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319468.959067:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16987
00010000:00010000:2.0:1767319469.527185:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319470.039386:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379766656:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319470.039463:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319470.039595:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766656
00000100:00100000:0.0:1767319470.039605:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766656
00000100:00100000:0.0:1767319470.039666:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298
00000100:00100000:0.0:1767319470.039675:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379766656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319470.039704:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319470.039758:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379766656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (297us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319470.039766:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298
00000100:00100000:3.0:1767319470.039903:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379766656:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319470.039966:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319470.551250:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319471.575263:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319471.575512:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319471.575536:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379766784:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319471.575612:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319471.575675:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766784
00000100:00100000:1.0:1767319471.575684:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766784
00000100:00100000:1.0:1767319471.575743:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299
00000100:00100000:1.0:1767319471.575752:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379766784:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319471.575779:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767319471.575829:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319471.575836:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379766784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (223us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319471.575845:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299
00000100:00100000:3.0:1767319471.576000:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379766784:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319472.599320:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319473.111241:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319473.111248:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319473.111250:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319473.111253:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319473.111257:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319473.111264:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4370
00000100:00080000:1.0:1767319473.111268:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319473.111276:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319473.111337:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05880 x1853164379766912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319473.111365:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319473.111380:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319473.111383:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319473.111387:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4370
00000100:00080000:1.0:1767319473.111390:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319473.111394:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319473.111408:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07800 x1853164379767040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319473.111435:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379766912:0@lo:38:kworker.0
00000100:00080000:1.0:1767319473.111456:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319473.111459:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319473.111460:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319473.111464:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4370
00000100:00080000:1.0:1767319473.111466:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319473.111469:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319473.111480:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164379767552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319473.111492:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319473.111495:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319473.111496:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319473.111498:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4370
00000100:00080000:1.0:1767319473.111500:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319473.111502:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319473.111507:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319473.111510:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4a80 x1853164379767808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319473.111528:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379767168:0@lo:400:kworker.0
00000100:00100000:1.0:1767319473.111557:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319473.111721:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379767424:0@lo:400:kworker.0
00000100:00100000:3.0:1767319473.111911:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319473.112385:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379767040:0@lo:38:kworker.0
00000100:00100000:0.0:1767319473.112416:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319473.118065:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379766912
00000100:00100000:2.0:1767319473.118084:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379766912
00000100:00100000:2.0:1767319473.118146:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767424
00000100:00100000:2.0:1767319473.118539:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767424
00000100:00100000:2.0:1767319473.118590:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4264
00000100:00100000:2.0:1767319473.118603:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379767424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319473.118686:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379767424:12345-0@lo:400:kworker.0 Request processed in 88us (6776us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319473.118693:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4264
00000100:00100000:2.0:1767319473.118711:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16988
00000100:00100000:2.0:1767319473.118715:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379766912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319473.118734:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319473.119119:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379766912:12345-0@lo:38:kworker.0 Request processed in 401us (7612us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319473.119126:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16988
00000100:00100000:2.0:1767319473.119189:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379767296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319473.119230:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319473.120443:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767168
00000100:00100000:0.0:1767319473.120453:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767168
00000100:00100000:0.0:1767319473.120497:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767296
00000100:00100000:0.0:1767319473.120499:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767296
00000100:00100000:0.0:1767319473.120519:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526
00000100:00100000:0.0:1767319473.120526:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379767168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319473.120581:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379767168:12345-0@lo:400:kworker.0 Request processed in 56us (9022us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319473.120588:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526
00000100:00100000:0.0:1767319473.120603:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527
00000100:00100000:0.0:1767319473.120609:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379767296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319473.120633:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379767296:12345-0@lo:400:kworker.0 Request processed in 24us (1403us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319473.120638:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527
00000100:00100000:0.0:1767319473.120667:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767040
00000100:00100000:0.0:1767319473.120670:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767040
00000100:00100000:0.0:1767319473.120690:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009
00000100:00100000:0.0:1767319473.120695:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379767040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319473.120713:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319473.120737:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379767040:12345-0@lo:38:kworker.0 Request processed in 41us (8321us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319473.120743:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009
00000100:00080000:0.0:1767319473.120788:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319473.120793:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319473.120797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379767040:0@lo:38:kworker.0
00000100:00100000:0.0:1767319473.120820:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379767552:0@lo:38:kworker.0
00000100:00100000:0.0:1767319473.120846:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319473.121210:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379767808:0@lo:38:kworker.0
00000100:00100000:0.0:1767319473.121231:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319473.121251:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767552
00000100:00100000:0.0:1767319473.121254:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767552
00000100:00100000:0.0:1767319473.121270:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767808
00000100:00100000:0.0:1767319473.121271:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767808
00000100:00100000:0.0:1767319473.121280:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16989
00000100:00100000:0.0:1767319473.121284:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379767552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319473.121306:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319473.121332:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379767552:12345-0@lo:38:kworker.0 Request processed in 47us (485us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319473.121338:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16989
00000100:00100000:0.0:1767319473.121350:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16990
00000100:00100000:0.0:1767319473.121353:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379767808:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319473.121361:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319473.121380:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379767808:12345-0@lo:38:kworker.0 Request processed in 26us (148us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319473.121385:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16990
00000100:00080000:0.0:1767319473.121411:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319473.121416:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319473.121419:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379767808:0@lo:38:kworker.0
00000100:00080000:0.0:1767319473.121428:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319473.121431:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319473.121433:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379766912:0@lo:38:kworker.0
00000100:00080000:0.0:1767319473.121451:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319473.121454:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319473.121457:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379767552:0@lo:38:kworker.0
00000100:00100000:0.0:1767319473.121505:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379767680:0@lo:400:kworker.0
00000100:00100000:0.0:1767319473.121529:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319473.121553:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767680
00000100:00100000:0.0:1767319473.121556:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767680
00000100:00100000:0.0:1767319473.121579:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4265
00000100:00100000:0.0:1767319473.121584:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379767680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319473.121613:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379767680:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319473.121619:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4265
00000100:00100000:0.0:1767319473.121642:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379767680:0@lo:400:kworker.0
00000100:00080000:0.0:1767319473.121676:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319473.121680:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319473.121682:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319473.124595:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379767168:0@lo:400:kworker.0
00000100:00100000:3.0:1767319473.131513:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379767424:0@lo:400:kworker.0
00000100:00100000:2.0:1767319473.131538:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379767296:0@lo:400:kworker.0
00010000:00010000:2.0:1767319473.623852:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319474.064980:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319474.065629:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291919360
00000100:00100000:0.0:1767319474.065639:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291919360
00000100:00100000:0.0:1767319474.065740:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4266
00000100:00100000:0.0:1767319474.065752:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291919360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767319474.065778:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319474.065835:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291919360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (877us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319474.065844:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4266
00000100:00100000:2.0:1767319474.066000:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319474.066055:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291919232
00000100:00100000:0.0:1767319474.066060:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291919232
00000100:00100000:0.0:1767319474.066097:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16991
00000100:00100000:0.0:1767319474.066102:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291919232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319474.066123:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319474.066155:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291919232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (155us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319474.066161:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16991
00010000:00010000:2.0:1767319474.647259:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319475.159378:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379767936:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319475.159461:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319475.159730:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379767936
00000100:00100000:1.0:1767319475.159741:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379767936
00000100:00100000:1.0:1767319475.159811:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300
00000100:00100000:1.0:1767319475.159822:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379767936:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319475.159860:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319475.159958:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379767936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (496us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319475.159967:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300
00000100:00100000:1.0:1767319475.160019:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379767936:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319475.163945:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319475.671372:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319476.696379:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319476.696653:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379768064:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319476.696805:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319476.697150:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768064
00000100:00100000:1.0:1767319476.697160:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768064
00000100:00100000:1.0:1767319476.698373:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301
00000100:00100000:1.0:1767319476.698387:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379768064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319476.698418:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319476.698496:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379768064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1691us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319476.698504:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301
00000100:00080000:2.0:1767319476.698617:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319476.699022:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379768064:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319477.719746:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319478.231490:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319478.231501:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319478.231504:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319478.231508:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319478.231513:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319478.231520:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4375
00000100:00080000:0.0:1767319478.231525:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319478.231533:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319478.231586:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6d80 x1853164379768192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319478.231607:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319478.231611:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319478.231613:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319478.231617:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4375
00000100:00080000:0.0:1767319478.231620:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319478.231624:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319478.231637:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164379768320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319478.231729:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319478.231854:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379768192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319478.231943:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319478.232014:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379768320:0@lo:38:kworker.0
00000100:00100000:2.0:1767319478.232059:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319478.232100:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768320
00000100:00100000:2.0:1767319478.232108:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768320
00000100:00100000:2.0:1767319478.232145:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010
00000100:00100000:2.0:1767319478.232153:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379768320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319478.232174:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319478.232212:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379768320:12345-0@lo:38:kworker.0 Request processed in 57us (152us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319478.232217:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010
00000100:00080000:2.0:1767319478.232266:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319478.232271:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319478.232274:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379768320:0@lo:38:kworker.0
00000100:00100000:2.0:1767319478.232310:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768192
00000100:00100000:2.0:1767319478.232314:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768192
00000100:00100000:2.0:1767319478.232333:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16992
00000100:00100000:2.0:1767319478.232337:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379768192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319478.232347:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319478.232376:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379768192:12345-0@lo:38:kworker.0 Request processed in 37us (434us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319478.232382:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16992
00000100:00080000:2.0:1767319478.232405:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319478.232408:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319478.232411:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379768192:0@lo:38:kworker.0
00000100:00080000:0.0:1767319478.232632:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319478.232636:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319478.232639:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319478.232643:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4375
00000100:00080000:0.0:1767319478.232645:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319478.232650:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319478.232664:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04e00 x1853164379768832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319478.232726:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379768576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319478.232757:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319478.232777:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319478.232781:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379768704:0@lo:400:kworker.0
00000100:00100000:2.0:1767319478.232796:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319478.232811:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768704
00000100:00100000:2.0:1767319478.232814:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768704
00000100:00100000:2.0:1767319478.232840:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4267
00000100:00100000:2.0:1767319478.232844:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379768704:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319478.232893:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379768704:12345-0@lo:400:kworker.0 Request processed in 48us (94us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319478.232900:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4267
00000100:00080000:2.0:1767319478.232917:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319478.232934:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379768704:0@lo:400:kworker.0
00000100:00100000:2.0:1767319478.232946:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379768832:0@lo:38:kworker.0
00000100:00100000:2.0:1767319478.232962:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319478.232977:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768832
00000100:00100000:2.0:1767319478.232979:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768832
00000100:00100000:3.0:1767319478.233113:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319478.233121:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379768960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319478.233142:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319478.233163:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768960
00000100:00100000:3.0:1767319478.233165:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768960
00000100:00100000:3.0:1767319478.233189:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4268
00000100:00100000:3.0:1767319478.233193:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379768960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319478.233215:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379768960:12345-0@lo:400:kworker.0 Request processed in 22us (72us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319478.233221:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4268
00000100:00080000:3.0:1767319478.233233:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319478.233258:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379768960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319478.233389:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768576
00000100:00100000:3.0:1767319478.233392:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768576
00000100:00100000:3.0:1767319478.233426:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528
00000100:00100000:3.0:1767319478.233431:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379768576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319478.233468:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379768576:12345-0@lo:400:kworker.0 Request processed in 37us (710us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319478.233475:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528
00000100:00080000:3.0:1767319478.233492:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319478.233509:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379768576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319478.233602:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16993
00000100:00100000:2.0:1767319478.233607:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379768832:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319478.233620:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319478.233653:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379768832:12345-0@lo:38:kworker.0 Request processed in 45us (689us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319478.233659:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16993
00000100:00080000:2.0:1767319478.233683:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319478.233688:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319478.233690:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379768832:0@lo:38:kworker.0
00000100:00100000:1.0:1767319478.234026:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379768448:0@lo:400:kworker.0
00000100:00100000:1.0:1767319478.234066:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319478.234207:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379768448
00000100:00100000:2.0:1767319478.234212:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379768448
00000100:00100000:2.0:1767319478.234272:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529
00000100:00100000:2.0:1767319478.234279:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379768448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319478.234315:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379768448:12345-0@lo:400:kworker.0 Request processed in 37us (248us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319478.234321:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529
00000100:00080000:1.0:1767319478.234426:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319478.234449:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379768448:0@lo:400:kworker.0
00000100:00080000:0.0:1767319478.234606:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319478.234611:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319478.234614:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319478.234618:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4375
00000100:00080000:0.0:1767319478.234621:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319478.234625:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319478.234648:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379769088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319478.234722:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379769088:0@lo:38:kworker.0
00000100:00100000:2.0:1767319478.234753:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319478.234948:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769088
00000100:00100000:3.0:1767319478.234954:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769088
00000100:00100000:3.0:1767319478.235091:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16994
00000100:00100000:3.0:1767319478.235098:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379769088:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319478.235114:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319478.235166:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379769088:12345-0@lo:38:kworker.0 Request processed in 67us (411us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319478.235173:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16994
00000100:00080000:0.0:1767319478.235219:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319478.235222:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319478.235224:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379769088:0@lo:38:kworker.0
00010000:00010000:2.0:1767319478.743804:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319479.187565:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319479.187671:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291919616
00000100:00100000:0.0:1767319479.187683:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291919616
00000100:00100000:0.0:1767319479.187804:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4269
00000100:00100000:0.0:1767319479.187816:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291919616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767319479.187821:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319479.187921:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291919616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319479.187930:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4269
00000100:00100000:3.0:1767319479.188669:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319479.188703:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291919488
00000100:00100000:2.0:1767319479.188712:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291919488
00000100:00100000:2.0:1767319479.188838:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16995
00000100:00100000:2.0:1767319479.188846:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291919488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319479.188866:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319479.188938:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291919488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 92us (277us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319479.188945:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16995
00010000:00010000:3.0:1767319479.767188:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319480.280026:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379769216:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319480.280097:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319480.280427:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769216
00000100:00100000:0.0:1767319480.280436:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769216
00000100:00100000:0.0:1767319480.280501:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302
00000100:00100000:0.0:1767319480.280510:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379769216:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319480.280540:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319480.280598:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379769216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (501us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319480.280606:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302
00000100:00100000:2.0:1767319480.280674:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379769216:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319480.280956:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319480.793299:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319481.815167:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379769344:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319481.815294:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319481.815546:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769344
00000100:00100000:2.0:1767319481.815555:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769344
00000100:00100000:2.0:1767319481.815629:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303
00000100:00100000:2.0:1767319481.815637:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379769344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319481.815674:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319481.815732:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379769344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (439us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319481.815738:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303
00000100:00100000:2.0:1767319481.815789:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379769344:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319481.815845:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319481.816145:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319482.840424:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319483.351104:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319483.351118:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319483.351122:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319483.351127:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319483.351132:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319483.351143:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4380
00000100:00080000:2.0:1767319483.351149:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319483.351159:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319483.351231:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380adf80 x1853164379769472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319483.351262:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319483.351266:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319483.351269:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319483.351273:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4380
00000100:00080000:2.0:1767319483.351277:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319483.351281:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319483.351295:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ac000 x1853164379769600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319483.351359:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:2.0:1767319483.351374:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319483.351377:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379769728:0@lo:400:kworker.0
00000100:00080000:2.0:1767319483.351379:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319483.351383:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319483.351389:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4380
00000100:00080000:2.0:1767319483.351392:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319483.351396:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319483.351409:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380af480 x1853164379770112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319483.351429:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319483.351433:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319483.351436:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319483.351439:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4380
00000100:00080000:2.0:1767319483.351442:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319483.351446:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319483.351458:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae680 x1853164379770368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319483.351479:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319483.351485:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379769984:0@lo:400:kworker.0
00000100:00100000:3.0:1767319483.351583:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379770240:0@lo:400:kworker.0
00000100:00100000:0.0:1767319483.351886:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379769856:0@lo:400:kworker.0
00000100:00100000:1.0:1767319483.352031:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379769472:0@lo:38:kworker.0
00000100:00100000:2.0:1767319483.353495:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319483.353699:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319483.353794:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769728
00000100:00100000:3.0:1767319483.353809:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769728
00000100:00100000:1.0:1767319483.354132:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319483.354238:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769984
00000100:00100000:2.0:1767319483.354244:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769984
00000100:00100000:2.0:1767319483.354290:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379770240
00000100:00100000:2.0:1767319483.354293:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379770240
00000100:00100000:2.0:1767319483.354317:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769472
00000100:00100000:1.0:1767319483.354319:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379769600:0@lo:38:kworker.0
00000100:00100000:2.0:1767319483.354321:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769472
00000100:00100000:2.0:1767319483.354345:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4270
00000100:00100000:2.0:1767319483.354358:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379769984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319483.354368:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319483.354432:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379769984:12345-0@lo:400:kworker.0 Request processed in 77us (943us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319483.354440:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4270
00000100:00100000:2.0:1767319483.354462:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4271
00000100:00100000:2.0:1767319483.354469:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379770240:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319483.354509:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379770240:12345-0@lo:400:kworker.0 Request processed in 40us (809us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319483.354516:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4271
00000100:00100000:2.0:1767319483.354534:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16996
00000100:00100000:2.0:1767319483.354538:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379769472:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319483.354544:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379770112:0@lo:38:kworker.0
00010000:00020000:2.0:1767319483.354565:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319483.354579:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319483.354598:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379770368:0@lo:38:kworker.0
00000100:00100000:2.0:1767319483.354609:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379769472:12345-0@lo:38:kworker.0 Request processed in 68us (476us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319483.354617:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16996
00000100:00100000:1.0:1767319483.354629:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319483.354630:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379770112
00000100:00100000:2.0:1767319483.354634:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379770112
00000100:00100000:2.0:1767319483.354645:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379770368
00000100:00100000:2.0:1767319483.354648:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379770368
00000100:00100000:2.0:1767319483.354660:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16997
00000100:00100000:2.0:1767319483.354664:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379770112:12345-0@lo:38:kworker.0
00000100:00080000:1.0:1767319483.354674:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00010000:00020000:2.0:1767319483.354675:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319483.354685:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319483.354690:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379769472:0@lo:38:kworker.0
00000100:00080000:1.0:1767319483.354708:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319483.354710:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379770112:12345-0@lo:38:kworker.0 Request processed in 44us (131us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319483.354714:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319483.354723:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379770112:0@lo:38:kworker.0
00000100:00100000:2.0:1767319483.354724:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16997
00000100:00100000:2.0:1767319483.354742:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16998
00000100:00100000:2.0:1767319483.354747:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379770368:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319483.354758:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319483.354771:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319483.354779:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319483.354791:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379770368:12345-0@lo:38:kworker.0 Request processed in 43us (164us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319483.354798:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16998
00000100:00100000:2.0:1767319483.354831:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769600
00000100:00100000:2.0:1767319483.354834:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769600
00000100:00100000:2.0:1767319483.354858:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011
00000100:00080000:1.0:1767319483.354864:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319483.354864:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379769600:12345-0@lo:38:kworker.0
00000100:00080000:1.0:1767319483.354893:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00010000:00020000:2.0:1767319483.354898:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319483.354924:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379769600:12345-0@lo:38:kworker.0 Request processed in 60us (558us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319483.354931:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011
00000100:00100000:2.0:1767319483.354967:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379769984:0@lo:400:kworker.0
00000100:00100000:2.0:1767319483.355009:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379770240:0@lo:400:kworker.0
00000100:00100000:1.0:1767319483.355306:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379770368:0@lo:38:kworker.0
00000100:00080000:1.0:1767319483.355327:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319483.355331:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319483.355334:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379769600:0@lo:38:kworker.0
00000100:00100000:3.0:1767319483.355657:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530
00000100:00100000:3.0:1767319483.355673:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379769728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319483.355752:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379769728:12345-0@lo:400:kworker.0 Request processed in 86us (4274us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319483.355761:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530
00000100:00100000:1.0:1767319483.356033:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379769728:0@lo:400:kworker.0
00000100:00100000:0.0:1767319483.357965:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319483.358393:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379769856
00000100:00100000:3.0:1767319483.358405:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379769856
00000100:00080000:1.0:1767319483.358568:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319483.358694:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531
00000100:00100000:3.0:1767319483.358707:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379769856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319483.358806:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379769856:12345-0@lo:400:kworker.0 Request processed in 102us (851us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319483.358814:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531
00000100:00100000:0.0:1767319483.358925:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379769856:0@lo:400:kworker.0
00010000:00010000:3.0:1767319483.863550:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319484.305771:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319484.305952:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291919872
00000100:00100000:0.0:1767319484.305964:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291919872
00000100:00100000:0.0:1767319484.306102:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4272
00000100:00100000:0.0:1767319484.306115:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291919872:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319484.306241:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291919872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 129us (486us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319484.306251:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4272
00000100:00080000:1.0:1767319484.306495:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319484.306501:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319484.306537:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291919744
00000100:00100000:2.0:1767319484.306755:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291919744
00000100:00100000:2.0:1767319484.306786:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 16999
00000100:00100000:2.0:1767319484.306793:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291919744:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319484.306823:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319484.306894:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291919744:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 75us (368us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319484.306902:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 16999
00010000:00010000:2.0:1767319484.887458:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319485.401907:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379770496:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319485.402017:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319485.402213:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379770496
00000100:00100000:1.0:1767319485.402225:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379770496
00000100:00100000:1.0:1767319485.402307:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304
00000100:00100000:1.0:1767319485.402319:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379770496:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319485.402363:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319485.402421:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379770496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (404us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319485.402429:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304
00000100:00080000:2.0:1767319485.402916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319485.402976:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379770496:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319485.911159:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319486.935376:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319486.935411:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379770624:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319486.935508:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319486.935652:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379770624
00000100:00100000:3.0:1767319486.935663:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379770624
00000100:00100000:3.0:1767319486.935746:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305
00000100:00100000:3.0:1767319486.935757:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379770624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319486.935795:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319486.935855:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379770624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (349us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319486.935862:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305
00000100:00100000:3.0:1767319486.935932:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379770624:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319486.936020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319486.940841:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319487.959923:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319488.399995:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291920000 offset 0 length 520: 4
00000100:00100000:3.0:1767319488.406529:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319488.406580:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319488.407576:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291920128
00000100:00100000:2.0:1767319488.407588:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291920128
00000100:00100000:2.0:1767319488.407645:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291920256
00000100:00100000:2.0:1767319488.407649:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291920256
00000100:00100000:2.0:1767319488.407706:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4273
00000100:00100000:2.0:1767319488.407716:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291920256:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319488.407793:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291920256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (1212us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319488.407801:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4273
00000100:00100000:2.0:1767319488.407835:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17000
00000100:00100000:2.0:1767319488.407840:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291920128:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319488.407861:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319488.407906:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291920128:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 64us (1388us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319488.407912:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17000
00000100:00080000:3.0:1767319488.408019:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319488.471033:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319488.471043:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319488.471046:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319488.471049:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319488.471055:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319488.471064:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4385
00000100:00080000:1.0:1767319488.471070:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319488.471077:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319488.471120:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44700 x1853164379770752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319488.471160:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319488.471164:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319488.471165:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319488.471169:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4385
00000100:00080000:1.0:1767319488.471172:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319488.471176:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319488.471191:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164379770880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319488.471264:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319488.471292:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379771008:0@lo:400:kworker.0
00000100:00080000:1.0:1767319488.471292:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319488.471307:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319488.471309:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319488.471313:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4385
00000100:00080000:1.0:1767319488.471317:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319488.471322:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319488.471337:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b97b80 x1853164379771392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319488.471357:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319488.471361:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319488.471363:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319488.471366:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4385
00000100:00080000:1.0:1767319488.471368:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319488.471373:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319488.471384:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b94380 x1853164379771648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319488.471402:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.471418:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379771264:0@lo:400:kworker.0
00000100:00100000:0.0:1767319488.471499:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379771520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319488.471501:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.471552:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319488.471560:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379771136:0@lo:400:kworker.0
00000100:00100000:3.0:1767319488.471630:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771008
00000100:00100000:3.0:1767319488.471649:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771008
00000100:00100000:3.0:1767319488.471707:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532
00000100:00100000:3.0:1767319488.471717:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379771008:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319488.471898:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379770752:0@lo:38:kworker.0
00000100:00100000:1.0:1767319488.473294:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.473387:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771264
00000100:00100000:1.0:1767319488.473395:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771264
00000100:00100000:1.0:1767319488.473446:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4274
00000100:00100000:1.0:1767319488.473456:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379771264:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319488.473615:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379771264:12345-0@lo:400:kworker.0 Request processed in 160us (2120us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319488.473623:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4274
00000100:00100000:1.0:1767319488.473687:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379771264:0@lo:400:kworker.0
00000100:00100000:1.0:1767319488.473727:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771136
00000100:00100000:1.0:1767319488.473731:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771136
00000100:00100000:1.0:1767319488.473761:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533
00000100:00100000:1.0:1767319488.473768:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379771136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319488.473803:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379771136:12345-0@lo:400:kworker.0 Request processed in 37us (513us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319488.473810:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533
00000100:00100000:1.0:1767319488.473839:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379771136:0@lo:400:kworker.0
00000100:00080000:1.0:1767319488.473888:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319488.473893:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319488.473895:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319488.476586:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379771008:12345-0@lo:400:kworker.0 Request processed in 4861us (5175us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319488.476600:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532
00000100:00100000:2.0:1767319488.479188:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.479828:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379770752
00000100:00100000:1.0:1767319488.479838:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379770752
00000100:00100000:1.0:1767319488.479915:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17001
00000100:00100000:1.0:1767319488.479925:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379770752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319488.479953:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319488.480008:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379770752:12345-0@lo:38:kworker.0 Request processed in 83us (860us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319488.480016:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17001
00000100:00080000:2.0:1767319488.480387:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319488.480394:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319488.480403:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379770752:0@lo:38:kworker.0
00000100:00100000:2.0:1767319488.480414:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379770880:0@lo:38:kworker.0
00000100:00100000:0.0:1767319488.489445:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.489603:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771520
00000100:00100000:1.0:1767319488.489622:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771520
00000100:00100000:2.0:1767319488.489666:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.489705:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4275
00000100:00100000:1.0:1767319488.489714:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379771520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319488.489718:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379771392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319488.489749:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.489766:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379771520:12345-0@lo:400:kworker.0 Request processed in 53us (338us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319488.489767:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379771648:0@lo:38:kworker.0
00000100:00100000:1.0:1767319488.489774:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4275
00000100:00100000:2.0:1767319488.489787:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319488.489794:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771392
00000100:00100000:1.0:1767319488.489797:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771392
00000100:00100000:1.0:1767319488.489814:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771648
00000100:00100000:1.0:1767319488.489816:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771648
00000100:00100000:1.0:1767319488.489831:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17002
00000100:00100000:2.0:1767319488.489831:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379770880
00000100:00100000:2.0:1767319488.489834:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379770880
00000100:00100000:1.0:1767319488.489835:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379771392:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319488.489853:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012
00010000:00020000:1.0:1767319488.489886:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319488.489887:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379770880:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319488.489897:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319488.489955:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319488.489970:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17003
00000100:00100000:3.0:1767319488.489976:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379771648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319488.489986:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319488.490021:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379771392:12345-0@lo:38:kworker.0 Request processed in 182us (269us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319488.490027:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17002
00000100:00100000:1.0:1767319488.490084:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379771520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319488.490099:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379771008:0@lo:400:kworker.0
00000100:00100000:3.0:1767319488.490716:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379771648:12345-0@lo:38:kworker.0 Request processed in 736us (924us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319488.490722:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379770880:12345-0@lo:38:kworker.0 Request processed in 862us (1058us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319488.490724:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17003
00000100:00100000:2.0:1767319488.490728:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012
00000100:00080000:2.0:1767319488.490764:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319488.490769:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319488.490772:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379770880:0@lo:38:kworker.0
00000100:00080000:2.0:1767319488.490781:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319488.490784:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319488.490785:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379771392:0@lo:38:kworker.0
00000100:00080000:2.0:1767319488.490790:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319488.490792:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319488.490794:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379771648:0@lo:38:kworker.0
00010000:00010000:2.0:1767319488.983972:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319490.007103:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319490.519402:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319490.519420:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379771776:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319490.519488:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319490.519534:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771776
00000100:00100000:2.0:1767319490.519543:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771776
00000100:00080000:1.0:1767319490.519581:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319490.519602:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306
00000100:00100000:2.0:1767319490.519611:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379771776:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319490.519642:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319490.519740:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379771776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (250us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319490.519749:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306
00000100:00100000:1.0:1767319490.519834:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379771776:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319491.031357:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319492.058411:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319492.058560:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319492.059167:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379771904:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319492.059238:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319492.059727:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379771904
00000100:00100000:1.0:1767319492.059735:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379771904
00000100:00100000:1.0:1767319492.059821:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307
00000100:00100000:1.0:1767319492.059829:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379771904:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319492.059846:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:1.0:1767319492.059863:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319492.059924:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379771904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (686us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319492.059929:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307
00000100:00100000:3.0:1767319492.059990:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379771904:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319492.567013:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319467/real 1767319467]  req@ffff8b0f336e4a80 x1853164379765504/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319492 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319492.567047:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f336e4a80 x1853164379765504/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319492 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319492.567072:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319492.567099:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319492.567103:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f336e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379765504:0@lo:250:kworker.0
00000100:00080000:3.0:1767319492.567310:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319492.567316:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319492.567320:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319492.567325:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4370
00000100:00080000:3.0:1767319492.567328:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319492.567334:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319492.567368:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907b80 x1853164379772032/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319492.567398:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319492.567402:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319492.567403:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319492.567407:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4390
00000100:00080000:3.0:1767319492.567410:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319492.567413:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319492.567428:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906680 x1853164379772160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319492.567437:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319492.567440:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319492.567442:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319492.567446:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4390
00000100:00080000:3.0:1767319492.567448:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319492.567451:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319492.567462:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904380 x1853164379772288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319492.567535:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319492.567538:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319492.567540:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319492.567543:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4390
00000100:00080000:3.0:1767319492.567545:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319492.567549:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319492.567560:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379772672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319492.567575:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319492.567578:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319492.567580:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319492.567582:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4390
00000100:00080000:3.0:1767319492.567584:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319492.567588:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319492.567597:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905c00 x1853164379772928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319492.567623:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379772800:0@lo:400:kworker.0
00000100:00100000:3.0:1767319492.567685:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319492.567749:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319492.567756:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379772544:0@lo:400:kworker.0
00000100:00100000:3.0:1767319492.567778:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319492.567806:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379772800
00000100:00100000:3.0:1767319492.567814:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379772800
00000100:00100000:0.0:1767319492.567977:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379772416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319492.568012:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319492.568051:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379772416
00000100:00100000:0.0:1767319492.568055:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379772416
00000100:00100000:0.0:1767319492.568091:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534
00000100:00100000:0.0:1767319492.568100:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379772416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319492.568163:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379772416:12345-0@lo:400:kworker.0 Request processed in 63us (148us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319492.568170:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534
00000100:00100000:0.0:1767319492.568214:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379772416:0@lo:400:kworker.0
00000100:00080000:0.0:1767319492.568251:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319492.568256:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319492.568564:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379772032:0@lo:250:kworker.0
00000400:00000100:2.0:1767319492.568592:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379772032 offset 0 length 520: 4
00000100:00100000:2.0:1767319492.568612:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379772160:0@lo:38:kworker.0
00000100:00100000:2.0:1767319492.568634:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319492.568661:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379772288:0@lo:38:kworker.0
00000100:00100000:2.0:1767319492.568683:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319492.568700:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379772672:0@lo:38:kworker.0
00000100:00100000:2.0:1767319492.568719:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319492.568733:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379772928:0@lo:38:kworker.0
00000100:00100000:2.0:1767319492.568754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319492.568783:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379772288
00000100:00100000:2.0:1767319492.568787:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379772288
00000100:00100000:2.0:1767319492.568809:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013
00000100:00100000:2.0:1767319492.568815:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379772288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319492.568834:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319492.568983:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379772544
00000100:00100000:0.0:1767319492.568988:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379772544
00000100:00100000:0.0:1767319492.569017:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379772160
00000100:00100000:0.0:1767319492.569020:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379772160
00000100:00100000:0.0:1767319492.569028:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379772672
00000100:00100000:0.0:1767319492.569031:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379772672
00000100:00100000:0.0:1767319492.569037:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379772928
00000100:00100000:0.0:1767319492.569040:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379772928
00000100:00100000:0.0:1767319492.569049:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4276
00000100:00100000:0.0:1767319492.569056:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379772800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319492.569134:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379772288:12345-0@lo:38:kworker.0 Request processed in 317us (448us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319492.569140:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013
00000100:00100000:3.0:1767319492.569216:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4277
00000100:00100000:3.0:1767319492.569225:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379772544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319492.569303:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17004
00000100:00100000:1.0:1767319492.569309:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379772160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319492.569319:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319492.569554:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379772800:12345-0@lo:400:kworker.0 Request processed in 498us (1868us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319492.569560:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4276
00000100:00100000:0.0:1767319492.569576:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17005
00000100:00100000:0.0:1767319492.569581:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379772672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319492.569590:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319492.569627:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379772672:12345-0@lo:38:kworker.0 Request processed in 44us (906us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319492.569632:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17005
00000100:00100000:0.0:1767319492.569646:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17006
00000100:00100000:0.0:1767319492.569650:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379772928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319492.569659:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319492.569681:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379772928:12345-0@lo:38:kworker.0 Request processed in 30us (926us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319492.569686:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17006
00000100:00080000:0.0:1767319492.569704:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319492.569804:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379772800:0@lo:400:kworker.0
00000100:00080000:2.0:1767319492.570434:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319492.570441:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319492.570445:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379772288:0@lo:38:kworker.0
00000100:00080000:2.0:1767319492.570454:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319492.570457:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319492.570460:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379772672:0@lo:38:kworker.0
00000100:00080000:2.0:1767319492.570469:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319492.570472:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319492.570475:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379772928:0@lo:38:kworker.0
00000100:00100000:3.0:1767319492.570589:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379772544:12345-0@lo:400:kworker.0 Request processed in 1365us (2809us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319492.570597:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4277
00000100:00100000:0.0:1767319492.570677:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379772544:0@lo:400:kworker.0
00000100:00100000:1.0:1767319492.570752:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379772160:12345-0@lo:38:kworker.0 Request processed in 1435us (2110us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319492.570759:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17004
00000100:00080000:2.0:1767319492.570792:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319492.570798:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319492.570802:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379772160:0@lo:38:kworker.0
00010000:00010000:2.0:1767319493.085193:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319493.519657:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319493.519739:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319493.521562:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291920512
00000100:00100000:1.0:1767319493.521575:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291920512
00000100:00100000:1.0:1767319493.521698:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291920384
00000100:00100000:1.0:1767319493.521702:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291920384
00000100:00100000:0.0:1767319493.521736:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4278
00000100:00100000:0.0:1767319493.521748:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291920512:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319493.521851:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291920512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (2200us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319493.521865:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4278
00000100:00100000:0.0:1767319493.521907:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17007
00000100:00100000:0.0:1767319493.521912:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291920384:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319493.521932:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319493.521956:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291920384:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 42us (2216us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319493.521962:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17007
00000100:00080000:2.0:1767319493.522017:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319494.103248:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319495.127424:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319495.639293:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379773056:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319495.639366:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319495.639660:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773056
00000100:00100000:1.0:1767319495.639670:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773056
00000100:00100000:1.0:1767319495.639761:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308
00000100:00100000:1.0:1767319495.639774:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f336e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379773056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319495.639815:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319495.639895:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f336e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379773056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (528us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319495.639904:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308
00000100:00100000:1.0:1767319495.639962:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379773056:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319495.640042:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319496.151199:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319497.175133:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319497.175422:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319497.175447:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379773184:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319497.175548:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319497.175857:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773184
00000100:00100000:3.0:1767319497.175867:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773184
00000100:00100000:3.0:1767319497.175955:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309
00000100:00100000:3.0:1767319497.175975:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379773184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319497.176007:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319497.176082:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379773184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (533us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319497.176091:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309
00000100:00100000:3.0:1767319497.176139:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379773184:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319497.176646:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319497.690725:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319497.690735:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319497.690738:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319497.690742:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319497.690746:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319497.690754:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4394
00000100:00080000:3.0:1767319497.690759:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319497.690766:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319497.690805:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905f80 x1853164379773312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319497.690838:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319497.690841:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319497.690843:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319497.690847:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4394
00000100:00080000:3.0:1767319497.690849:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319497.690863:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319497.690906:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904000 x1853164379773440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319497.690968:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319497.690972:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319497.690973:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319497.690977:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4394
00000100:00080000:3.0:1767319497.690979:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319497.690983:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319497.690994:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379773952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319497.691011:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319497.691014:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319497.691016:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319497.691019:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4394
00000100:00080000:3.0:1767319497.691021:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319497.691026:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319497.691036:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905500 x1853164379774208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319497.691055:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379773312:0@lo:38:kworker.0
00000100:00100000:3.0:1767319497.691073:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379773824:0@lo:400:kworker.0
00000100:00100000:1.0:1767319497.691138:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379773568:0@lo:400:kworker.0
00000100:00100000:0.0:1767319497.692020:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379774080:0@lo:400:kworker.0
00000100:00100000:3.0:1767319497.692130:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319497.692228:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379773696:0@lo:400:kworker.0
00000100:00100000:3.0:1767319497.692281:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319497.692325:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773696
00000100:00100000:3.0:1767319497.692332:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773696
00000100:00100000:3.0:1767319497.692381:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535
00000100:00100000:3.0:1767319497.692390:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379773696:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319497.692443:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379773696:12345-0@lo:400:kworker.0 Request processed in 54us (162us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319497.692717:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535
00000100:00100000:3.0:1767319497.692768:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379773696:0@lo:400:kworker.0
00000100:00100000:3.0:1767319497.692804:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773824
00000100:00100000:3.0:1767319497.692808:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773824
00000100:00100000:3.0:1767319497.692845:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4279
00000100:00100000:3.0:1767319497.692866:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379773824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319497.692924:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379773824:12345-0@lo:400:kworker.0 Request processed in 73us (794us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319497.692931:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4279
00000100:00100000:3.0:1767319497.692960:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379773824:0@lo:400:kworker.0
00000100:00080000:3.0:1767319497.692985:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319497.694338:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319497.694379:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379773440:0@lo:38:kworker.0
00000100:00100000:2.0:1767319497.694416:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319497.694450:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379773952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319497.694475:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319497.694489:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379774208:0@lo:38:kworker.0
00000100:00100000:2.0:1767319497.694509:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319497.694565:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773440
00000100:00100000:2.0:1767319497.694572:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773440
00000100:00100000:2.0:1767319497.694604:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014
00000100:00100000:2.0:1767319497.694610:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379773440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319497.694633:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319497.694671:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379773440:12345-0@lo:38:kworker.0 Request processed in 59us (254us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319497.694678:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014
00000100:00080000:2.0:1767319497.694719:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319497.694725:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319497.694728:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379773440:0@lo:38:kworker.0
00000100:00100000:2.0:1767319497.694764:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773312
00000100:00100000:2.0:1767319497.694769:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773312
00000100:00100000:2.0:1767319497.694787:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773952
00000100:00100000:2.0:1767319497.694790:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773952
00000100:00100000:2.0:1767319497.694803:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774208
00000100:00100000:2.0:1767319497.694806:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774208
00000100:00100000:2.0:1767319497.694820:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17008
00000100:00100000:2.0:1767319497.694825:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379773312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319497.694835:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319497.694866:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379773312:12345-0@lo:38:kworker.0 Request processed in 40us (944us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319497.694905:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17008
00000100:00100000:2.0:1767319497.694917:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17009
00000100:00100000:2.0:1767319497.694921:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379773952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319497.695122:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319497.695151:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379773952:12345-0@lo:38:kworker.0 Request processed in 228us (675us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319497.695157:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17009
00000100:00100000:2.0:1767319497.695170:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17010
00000100:00100000:2.0:1767319497.695174:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379774208:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319497.695183:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319497.695205:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379774208:12345-0@lo:38:kworker.0 Request processed in 29us (695us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319497.695211:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17010
00000100:00080000:2.0:1767319497.695244:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319497.695248:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319497.695252:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379773312:0@lo:38:kworker.0
00000100:00080000:2.0:1767319497.695273:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319497.695277:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319497.695280:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379773952:0@lo:38:kworker.0
00000100:00080000:2.0:1767319497.695289:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319497.695293:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319497.695296:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379774208:0@lo:38:kworker.0
00000100:00100000:1.0:1767319497.700569:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319497.700702:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379773568
00000100:00100000:3.0:1767319497.700714:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379773568
00000100:00100000:3.0:1767319497.700792:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536
00000100:00100000:3.0:1767319497.700803:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379773568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319497.700900:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379773568:12345-0@lo:400:kworker.0 Request processed in 99us (337us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319497.700907:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536
00000100:00080000:2.0:1767319497.701039:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319497.701159:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379773568:0@lo:400:kworker.0
00000100:00100000:0.0:1767319497.705249:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319497.706918:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774080
00000100:00100000:3.0:1767319497.706936:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774080
00000100:00100000:3.0:1767319497.707024:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4280
00000100:00100000:3.0:1767319497.707035:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379774080:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319497.707143:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379774080:12345-0@lo:400:kworker.0 Request processed in 110us (1902us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319497.707150:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4280
00000100:00100000:1.0:1767319497.707244:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379774080:0@lo:400:kworker.0
00000100:00080000:2.0:1767319497.707338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319498.199819:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319498.641125:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319498.641230:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319498.641323:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291920768
00000100:00100000:1.0:1767319498.641333:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291920768
00000100:00100000:1.0:1767319498.641396:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291920640
00000100:00100000:1.0:1767319498.641399:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291920640
00000100:00100000:1.0:1767319498.641416:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4281
00000100:00100000:1.0:1767319498.641424:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291920768:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319498.641493:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291920768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319498.641501:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4281
00000100:00100000:1.0:1767319498.641522:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17011
00000100:00100000:1.0:1767319498.641527:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291920640:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319498.641558:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319498.641579:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291920640:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (350us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319498.641585:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17011
00000100:00080000:2.0:1767319498.641894:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319499.223095:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319500.247093:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319500.761826:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319500.761848:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379774336:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319500.762180:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319500.762288:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774336
00000100:00100000:1.0:1767319500.762297:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774336
00000100:00100000:1.0:1767319500.762372:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310
00000100:00100000:1.0:1767319500.762385:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379774336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319500.762429:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319500.762489:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379774336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (309us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319500.762496:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310
00000100:00100000:0.0:1767319500.762572:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379774336:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319500.762635:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319501.272684:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319502.295152:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319502.295650:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319502.295672:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379774464:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319502.295739:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319502.296215:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774464
00000100:00100000:3.0:1767319502.296225:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774464
00000100:00100000:3.0:1767319502.296299:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311
00000100:00100000:3.0:1767319502.296320:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379774464:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319502.296343:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:3.0:1767319502.296359:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319502.296441:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379774464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (700us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319502.296449:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311
00000100:00100000:2.0:1767319502.296521:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379774464:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319502.807317:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319502.807328:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319502.807332:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319502.807337:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319502.807344:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319502.807353:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4400
00000100:00080000:1.0:1767319502.807359:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319502.807366:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319502.807421:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b97800 x1853164379774592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319502.807450:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319502.807454:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319502.807456:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319502.807461:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4400
00000100:00080000:1.0:1767319502.807464:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319502.807468:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319502.807484:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b94700 x1853164379774720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319502.807558:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319502.807563:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319502.807565:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319502.807569:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4400
00000100:00080000:1.0:1767319502.807571:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319502.807575:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319502.807587:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b95180 x1853164379775232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319502.807601:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319502.807604:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319502.807606:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319502.807609:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4400
00000100:00080000:1.0:1767319502.807611:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319502.807615:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319502.807625:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b95c00 x1853164379775488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319502.807649:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379775104:0@lo:400:kworker.0
00000100:00100000:1.0:1767319502.807719:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319502.807798:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319502.807804:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379775360:0@lo:400:kworker.0
00000100:00100000:1.0:1767319502.807827:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319502.807857:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379775104
00000100:00100000:1.0:1767319502.807863:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379775104
00000100:00100000:1.0:1767319502.807952:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379775360
00000100:00100000:1.0:1767319502.807956:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379775360
00000100:00100000:1.0:1767319502.807998:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4282
00000100:00100000:1.0:1767319502.808008:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379775104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319502.808065:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379775104:12345-0@lo:400:kworker.0 Request processed in 59us (346us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319502.808073:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4282
00000100:00100000:1.0:1767319502.808103:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4283
00000100:00100000:1.0:1767319502.808109:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379775360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319502.808133:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379775360:12345-0@lo:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319502.808138:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4283
00000100:00080000:1.0:1767319502.808155:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319502.808209:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379775360:0@lo:400:kworker.0
00000100:00100000:1.0:1767319502.808220:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379775104:0@lo:400:kworker.0
00000100:00100000:0.0:1767319502.808311:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379774976:0@lo:400:kworker.0
00000100:00100000:0.0:1767319502.808346:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319502.808383:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319502.808389:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379774848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319502.808410:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319502.808918:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774976
00000100:00100000:1.0:1767319502.808924:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774976
00000100:00100000:1.0:1767319502.808962:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774848
00000100:00100000:1.0:1767319502.808966:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774848
00000100:00100000:1.0:1767319502.809005:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537
00000100:00100000:1.0:1767319502.809012:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379774976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319502.809062:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379774976:12345-0@lo:400:kworker.0 Request processed in 50us (715us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319502.809068:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537
00000100:00100000:1.0:1767319502.809093:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538
00000100:00100000:1.0:1767319502.809099:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379774848:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319502.809127:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379774848:12345-0@lo:400:kworker.0 Request processed in 28us (716us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319502.809132:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538
00000100:00080000:1.0:1767319502.809153:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319502.809292:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379774848:0@lo:400:kworker.0
00000100:00100000:0.0:1767319502.809302:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379774976:0@lo:400:kworker.0
00000100:00100000:2.0:1767319502.809772:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379774592:0@lo:38:kworker.0
00000100:00100000:2.0:1767319502.809814:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319502.809848:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379774720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319502.809898:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319502.809944:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379775232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319502.809974:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319502.810002:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379775488:0@lo:38:kworker.0
00000100:00100000:2.0:1767319502.810033:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319502.810067:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774592
00000100:00100000:2.0:1767319502.810072:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774592
00000100:00100000:2.0:1767319502.810107:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379775232
00000100:00100000:2.0:1767319502.810110:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379775232
00000100:00100000:2.0:1767319502.810121:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379775488
00000100:00100000:2.0:1767319502.810123:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379775488
00000100:00100000:2.0:1767319502.810135:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17012
00000100:00100000:2.0:1767319502.810140:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379774592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319502.810160:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319502.810195:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379774592:12345-0@lo:38:kworker.0 Request processed in 53us (379us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319502.810201:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17012
00000100:00100000:2.0:1767319502.810216:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17013
00000100:00100000:2.0:1767319502.810221:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379775232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319502.810230:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319502.810268:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379775232:12345-0@lo:38:kworker.0 Request processed in 45us (301us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319502.810273:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17013
00000100:00100000:2.0:1767319502.810284:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17014
00000100:00100000:2.0:1767319502.810288:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379775488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319502.810297:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319502.810320:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379775488:12345-0@lo:38:kworker.0 Request processed in 30us (286us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319502.810325:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17014
00000100:00080000:2.0:1767319502.810365:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319502.810370:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319502.810374:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379774592:0@lo:38:kworker.0
00000100:00080000:2.0:1767319502.810383:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319502.810386:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319502.810389:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379775232:0@lo:38:kworker.0
00000100:00080000:2.0:1767319502.810396:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319502.810399:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319502.810402:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379775488:0@lo:38:kworker.0
00000100:00100000:0.0:1767319502.811245:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379774720
00000100:00100000:0.0:1767319502.811252:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379774720
00000100:00100000:0.0:1767319502.811288:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015
00000100:00100000:0.0:1767319502.811294:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379774720:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319502.811307:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319502.811355:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379774720:12345-0@lo:38:kworker.0 Request processed in 60us (1456us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319502.811362:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015
00000100:00080000:0.0:1767319502.811396:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319502.811401:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319502.811415:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379774720:0@lo:38:kworker.0
00010000:00010000:2.0:1767319503.319204:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319503.761072:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319503.761123:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319503.761218:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291921024
00000100:00100000:3.0:1767319503.761238:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291921024
00000100:00100000:3.0:1767319503.761322:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291920896
00000100:00100000:3.0:1767319503.761326:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291920896
00000100:00100000:3.0:1767319503.761351:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4284
00000100:00100000:3.0:1767319503.761362:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291921024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319503.761446:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291921024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (385us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319503.761454:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4284
00000100:00100000:3.0:1767319503.761472:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17015
00000100:00100000:3.0:1767319503.761477:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291920896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319503.761498:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319503.761522:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291920896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319503.761529:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17015
00000100:00080000:2.0:1767319503.762360:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319504.343260:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319505.368906:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319505.880276:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319505.880295:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379775616:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319505.880366:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319505.886190:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379775616
00000100:00100000:1.0:1767319505.886209:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379775616
00000100:00100000:1.0:1767319505.886436:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2312
00000100:00100000:1.0:1767319505.886449:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379775616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319505.887121:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319505.887213:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379775616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 766us (6845us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319505.887222:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2312
00000100:00100000:0.0:1767319505.887415:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379775616:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319505.890502:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767319506.391940:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319507.415205:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379775744:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319507.415300:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319507.415639:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379775744
00000100:00100000:1.0:1767319507.415649:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379775744
00010000:00010000:2.0:1767319507.415708:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319507.415727:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313
00000100:00100000:1.0:1767319507.415737:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379775744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319507.415770:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319507.415843:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379775744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (542us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319507.415853:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313
00000100:00100000:2.0:1767319507.415987:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379775744:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319507.416111:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319507.929069:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319507.929080:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319507.929084:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319507.929098:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319507.929103:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319507.929112:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4405
00000100:00080000:0.0:1767319507.929117:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319507.929124:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319507.929554:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28c380 x1853164379775872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319507.929663:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379775872:0@lo:38:kworker.0
00000100:00100000:2.0:1767319507.929744:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319507.929835:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319507.929839:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319507.929841:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319507.929845:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4405
00000100:00080000:0.0:1767319507.929848:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319507.929853:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319507.929891:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ed80 x1853164379776000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319507.930140:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379775872
00000100:00100000:3.0:1767319507.930148:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379775872
00000100:00100000:3.0:1767319507.930233:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17016
00000100:00100000:3.0:1767319507.930243:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379775872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319507.930266:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319507.932799:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379776000:0@lo:38:kworker.0
00000100:00080000:0.0:1767319507.933865:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319507.933888:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319507.933892:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319507.933897:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4405
00000100:00080000:0.0:1767319507.933901:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319507.933907:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319507.933929:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28dc00 x1853164379776512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319507.933949:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319507.933952:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319507.933954:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319507.933958:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4405
00000100:00080000:0.0:1767319507.933961:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319507.933965:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319507.933986:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f800 x1853164379776768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319507.934026:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379776256:0@lo:400:kworker.0
00000100:00100000:0.0:1767319507.934061:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319507.934907:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379776128:0@lo:400:kworker.0
00000100:00100000:2.0:1767319507.934977:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319507.935190:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776256
00000100:00100000:0.0:1767319507.935200:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776256
00000100:00100000:0.0:1767319507.935271:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539
00000100:00100000:0.0:1767319507.935281:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379776256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319507.940354:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319507.940524:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776128
00000100:00100000:1.0:1767319507.940535:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776128
00000100:00100000:1.0:1767319507.940606:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540
00000100:00100000:1.0:1767319507.940618:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379776128:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319507.940783:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319507.940790:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319507.940796:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379775872:0@lo:38:kworker.0
00000100:00100000:2.0:1767319507.940827:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379776512:0@lo:38:kworker.0
00000100:00100000:1.0:1767319507.944152:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379776128:12345-0@lo:400:kworker.0 Request processed in 3525us (3796us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319507.944170:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540
00000100:00100000:1.0:1767319507.944272:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379776128:0@lo:400:kworker.0
00000100:00080000:1.0:1767319507.944306:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319507.944358:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776000
00000100:00100000:1.0:1767319507.944365:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776000
00000100:00100000:1.0:1767319507.944395:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016
00000100:00100000:1.0:1767319507.944401:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379776000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319507.944424:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319507.944468:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379776000:12345-0@lo:38:kworker.0 Request processed in 66us (10794us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319507.944475:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016
00000100:00100000:1.0:1767319507.944501:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379776640:0@lo:400:kworker.0
00000100:00100000:1.0:1767319507.944541:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319507.944567:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319507.944573:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379776384:0@lo:400:kworker.0
00000100:00100000:1.0:1767319507.944593:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319507.944618:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776640
00000100:00100000:1.0:1767319507.944621:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776640
00000100:00080000:1.0:1767319507.944640:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319507.944668:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776384
00000100:00100000:1.0:1767319507.944671:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776384
00000100:00080000:1.0:1767319507.944682:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319507.944699:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4285
00000100:00100000:1.0:1767319507.944705:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379776640:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319507.944745:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379776640:12345-0@lo:400:kworker.0 Request processed in 40us (204us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319507.944751:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4285
00000100:00100000:2.0:1767319507.945842:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319507.945900:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379776768:0@lo:38:kworker.0
00000100:00100000:2.0:1767319507.945929:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319507.945959:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319507.945964:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319507.945967:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379776000:0@lo:38:kworker.0
00000100:00100000:3.0:1767319507.946018:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379775872:12345-0@lo:38:kworker.0 Request processed in 15774us (16272us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319507.946022:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776512
00000100:00100000:2.0:1767319507.946027:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776512
00000100:00100000:1.0:1767319507.946111:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379776640:0@lo:400:kworker.0
00000100:00100000:1.0:1767319507.946128:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776768
00000100:00100000:1.0:1767319507.946131:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776768
00000100:00100000:0.0:1767319507.946337:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379776256:12345-0@lo:400:kworker.0 Request processed in 11055us (12273us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319507.946348:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539
00000100:00100000:3.0:1767319507.949432:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17016
00000100:00100000:3.0:1767319507.949535:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4286
00000100:00100000:3.0:1767319507.949561:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379776384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319507.949709:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379776384:12345-0@lo:400:kworker.0 Request processed in 162us (5114us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319507.949717:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4286
00000100:00100000:3.0:1767319507.949783:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379776384:0@lo:400:kworker.0
00000100:00100000:2.0:1767319507.949894:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17017
00000100:00100000:2.0:1767319507.949901:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379776512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319507.949929:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319507.949989:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379776512:12345-0@lo:38:kworker.0 Request processed in 87us (4307us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319507.949997:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17017
00000100:00080000:3.0:1767319507.951650:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319507.951660:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319507.951664:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379776512:0@lo:38:kworker.0
00000100:00100000:1.0:1767319507.954203:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17018
00000100:00100000:1.0:1767319507.954220:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379776768:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319507.954252:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319507.954382:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379776768:12345-0@lo:38:kworker.0 Request processed in 164us (8451us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319507.954390:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17018
00000100:00100000:1.0:1767319507.954466:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379776256:0@lo:400:kworker.0
00000100:00080000:2.0:1767319507.954591:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319507.954597:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319507.954601:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379776768:0@lo:38:kworker.0
00010000:00010000:3.0:1767319508.439819:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319508.881089:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319508.881144:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319508.881343:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291921280
00000100:00100000:2.0:1767319508.881353:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291921280
00000100:00100000:3.0:1767319508.881408:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291921152
00000100:00100000:3.0:1767319508.881414:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291921152
00000100:00100000:2.0:1767319508.881440:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4287
00000100:00100000:3.0:1767319508.881451:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17019
00000100:00100000:2.0:1767319508.881454:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291921280:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319508.881463:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291921152:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319508.881486:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319508.881538:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291921280:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (457us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319508.881545:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4287
00000100:00080000:1.0:1767319508.881616:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319508.881973:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291921152:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 502us (817us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319508.881981:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17019
00010000:00010000:2.0:1767319509.463190:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319510.487135:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319511.002151:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319511.007169:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379776896:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319511.007234:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319511.007557:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379776896
00000100:00100000:3.0:1767319511.007567:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379776896
00000100:00100000:3.0:1767319511.007691:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314
00000100:00100000:3.0:1767319511.007702:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379776896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319511.007733:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319511.007784:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379776896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (548us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319511.007790:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314
00000100:00100000:0.0:1767319511.008034:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379776896:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319511.008099:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319511.511042:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319512.535757:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319512.536779:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319512.536799:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379777024:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319512.536865:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319512.537571:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777024
00000100:00100000:1.0:1767319512.537581:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777024
00000100:00100000:1.0:1767319512.537652:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315
00000100:00100000:1.0:1767319512.537662:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379777024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319512.537694:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319512.537758:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379777024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (891us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319512.537765:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315
00000100:00100000:3.0:1767319512.537920:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379777024:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319512.537993:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319513.047900:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319513.047912:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319513.047916:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319513.047919:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319513.047932:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319513.047941:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4410
00000100:00080000:0.0:1767319513.047947:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319513.047955:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319513.047999:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28df80 x1853164379777152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319513.048029:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319513.048033:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319513.048035:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319513.048039:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4410
00000100:00080000:0.0:1767319513.048042:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319513.048047:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319513.048058:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28c000 x1853164379777280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319513.048081:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379777152:0@lo:38:kworker.0
00000100:00100000:1.0:1767319513.048140:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379777408:0@lo:400:kworker.0
00000100:00100000:1.0:1767319513.048183:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319513.048278:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319513.048308:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379777280:0@lo:38:kworker.0
00000100:00100000:2.0:1767319513.048320:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777408
00000100:00100000:2.0:1767319513.048330:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777408
00000100:00100000:3.0:1767319513.048337:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319513.048380:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777152
00000100:00100000:3.0:1767319513.048385:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777152
00000100:00100000:2.0:1767319513.048409:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541
00000100:00100000:3.0:1767319513.048417:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17020
00000100:00100000:3.0:1767319513.048426:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379777152:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319513.048432:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379777408:12345-0@lo:400:kworker.0
00010000:00020000:3.0:1767319513.048451:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319513.048485:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379777152:12345-0@lo:38:kworker.0 Request processed in 59us (326us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319513.048493:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17020
00000100:00100000:3.0:1767319513.048514:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777280
00000100:00100000:3.0:1767319513.048517:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777280
00000100:00100000:3.0:1767319513.048532:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017
00000100:00100000:3.0:1767319513.048536:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379777280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319513.048545:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319513.048564:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379777280:12345-0@lo:38:kworker.0 Request processed in 27us (229us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319513.048570:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017
00000100:00080000:3.0:1767319513.048599:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319513.048603:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319513.048607:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379777152:0@lo:38:kworker.0
00000100:00080000:3.0:1767319513.048614:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319513.048617:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319513.048619:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379777280:0@lo:38:kworker.0
00000100:00080000:3.0:1767319513.048651:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319513.048996:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379777536:0@lo:400:kworker.0
00000100:00100000:3.0:1767319513.049023:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319513.049050:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777536
00000100:00100000:3.0:1767319513.049054:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777536
00000100:00100000:3.0:1767319513.049077:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542
00000100:00100000:3.0:1767319513.049082:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379777536:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319513.049122:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379777536:12345-0@lo:400:kworker.0 Request processed in 40us (98us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319513.049129:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542
00000100:00100000:3.0:1767319513.049261:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379777536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319513.054689:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379777408:12345-0@lo:400:kworker.0 Request processed in 6251us (6494us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319513.054706:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541
00000100:00100000:1.0:1767319513.054885:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379777408:0@lo:400:kworker.0
00000100:00080000:0.0:1767319513.055912:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319513.055918:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319513.055931:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319513.055937:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4410
00000100:00080000:0.0:1767319513.055941:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319513.055946:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319513.055969:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f480 x1853164379777792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319513.055978:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379777664:0@lo:400:kworker.0
00000100:00080000:0.0:1767319513.056003:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319513.056007:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319513.056009:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319513.056013:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4410
00000100:00080000:0.0:1767319513.056015:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319513.056020:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319513.056033:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28d180 x1853164379778048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319513.056051:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319513.056067:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379777920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319513.056103:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319513.056125:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777664
00000100:00100000:3.0:1767319513.056134:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777664
00000100:00100000:0.0:1767319513.056144:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777920
00000100:00100000:0.0:1767319513.056150:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777920
00000100:00100000:3.0:1767319513.056196:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4288
00000100:00100000:3.0:1767319513.056205:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379777664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319513.056248:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379777664:12345-0@lo:400:kworker.0 Request processed in 45us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319513.056254:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4288
00000100:00100000:3.0:1767319513.056266:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4289
00000100:00100000:3.0:1767319513.056272:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379777920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319513.056303:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379777920:12345-0@lo:400:kworker.0 Request processed in 30us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319513.056309:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4289
00000100:00080000:2.0:1767319513.056618:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319513.056655:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379777664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319513.056693:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379777920:0@lo:400:kworker.0
00000100:00100000:2.0:1767319513.057300:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379777792:0@lo:38:kworker.0
00000100:00100000:2.0:1767319513.057342:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319513.060704:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379778048:0@lo:38:kworker.0
00000100:00100000:2.0:1767319513.060780:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319513.061146:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379778048
00000100:00100000:3.0:1767319513.061155:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379778048
00000100:00100000:3.0:1767319513.061198:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17021
00000100:00100000:3.0:1767319513.061208:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379778048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319513.061236:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319513.061291:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379778048:12345-0@lo:38:kworker.0 Request processed in 83us (510us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319513.061298:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17021
00000100:00080000:2.0:1767319513.061421:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319513.061429:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319513.061433:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379778048:0@lo:38:kworker.0
00000100:00100000:0.0:1767319513.063055:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379777792
00000100:00100000:0.0:1767319513.063070:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379777792
00000100:00100000:0.0:1767319513.063138:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17022
00000100:00100000:0.0:1767319513.063146:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379777792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319513.063167:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319513.063267:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379777792:12345-0@lo:38:kworker.0 Request processed in 121us (5923us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319513.063274:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17022
00000100:00080000:1.0:1767319513.063484:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319513.063490:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319513.063494:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379777792:0@lo:38:kworker.0
00010000:00010000:2.0:1767319513.559348:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319514.002433:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767319514.002473:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291921408 offset 0 length 520: 4
00000100:00100000:2.0:1767319514.002579:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319514.002660:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291921664
00000100:00100000:0.0:1767319514.002671:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291921664
00000100:00100000:0.0:1767319514.002753:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291921536
00000100:00100000:0.0:1767319514.002757:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291921536
00000100:00100000:0.0:1767319514.002784:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4290
00000100:00100000:0.0:1767319514.002796:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291921664:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319514.002922:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17023
00000100:00100000:1.0:1767319514.002930:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291921536:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:0.0:1767319514.002935:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291921664:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 139us (511us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319514.002944:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4290
00010000:00020000:1.0:1767319514.002956:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319514.002992:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291921536:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 60us (412us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319514.003000:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17023
00000100:00080000:2.0:1767319514.003383:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319514.583107:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319515.608681:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319516.120161:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319516.123727:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379778176:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319516.123821:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319516.124754:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379778176
00000100:00100000:1.0:1767319516.124765:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379778176
00000100:00100000:1.0:1767319516.124914:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316
00000100:00100000:1.0:1767319516.124926:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379778176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319516.124960:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319516.125030:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379778176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (1208us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319516.125037:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316
00000100:00100000:0.0:1767319516.125134:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379778176:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319516.127091:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319516.633587:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319517.146573:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319492/real 1767319492]  req@ffff8b0f10907b80 x1853164379772032/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319517.146601:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f10907b80 x1853164379772032/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319517 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319517.146616:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319517.146639:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319517.146641:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379772032:0@lo:250:kworker.0
00000100:00080000:3.0:1767319517.146713:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319517.146718:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319517.146720:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319517.146724:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4394
00000100:00080000:3.0:1767319517.146727:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319517.146732:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319517.146759:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a7100 x1853164379778304/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319517.146779:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319517.146782:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319517.146783:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319517.146785:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4415
00000100:00080000:3.0:1767319517.146787:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319517.146789:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319517.146802:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a6300 x1853164379778432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319517.146807:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319517.146810:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319517.146811:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319517.146814:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4415
00000100:00080000:3.0:1767319517.146816:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319517.146818:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319517.146825:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a7480 x1853164379778560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319517.146931:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319517.146934:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319517.146936:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319517.146940:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4415
00000100:00080000:3.0:1767319517.146942:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319517.146946:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319517.146956:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a6d80 x1853164379779072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319517.146971:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319517.146974:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319517.146976:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319517.146979:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4415
00000100:00080000:3.0:1767319517.146981:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319517.146985:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319517.146997:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a4a80 x1853164379779328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319517.147028:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379778816:0@lo:400:kworker.0
00000100:00100000:3.0:1767319517.147086:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319517.147150:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319517.147156:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379778944:0@lo:400:kworker.0
00000100:00100000:3.0:1767319517.147182:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319517.147213:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379778816
00000100:00100000:3.0:1767319517.147221:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379778816
00000100:00100000:2.0:1767319517.147260:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379779200:0@lo:400:kworker.0
00000100:00100000:3.0:1767319517.147272:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543
00000100:00100000:3.0:1767319517.147281:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379778816:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319517.147287:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319517.147307:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319517.147312:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379778688:0@lo:400:kworker.0
00000100:00100000:3.0:1767319517.147329:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379778816:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319517.147332:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319517.147336:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543
00000100:00100000:3.0:1767319517.147350:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379778688
00000100:00100000:3.0:1767319517.147353:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379778688
00000100:00100000:3.0:1767319517.147374:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544
00000100:00080000:2.0:1767319517.147375:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319517.147380:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379778688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319517.147387:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379778944
00000100:00100000:2.0:1767319517.147390:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379778944
00000100:00100000:3.0:1767319517.147410:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379778688:12345-0@lo:400:kworker.0 Request processed in 31us (77us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319517.147417:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544
00000100:00100000:2.0:1767319517.147419:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779200
00000100:00100000:2.0:1767319517.147422:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779200
00000100:00100000:2.0:1767319517.147442:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4291
00000100:00100000:2.0:1767319517.147447:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379778944:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319517.147450:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379778816:0@lo:400:kworker.0
00000100:00080000:3.0:1767319517.147473:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319517.147480:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379778944:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319517.147487:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4291
00000100:00100000:3.0:1767319517.147493:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379778688:0@lo:400:kworker.0
00000100:00100000:2.0:1767319517.147499:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4292
00000100:00100000:2.0:1767319517.147506:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379779200:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319517.147519:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379778944:0@lo:400:kworker.0
00000100:00100000:2.0:1767319517.147534:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379779200:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319517.147540:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4292
00000100:00100000:3.0:1767319517.147541:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379779200:0@lo:400:kworker.0
00000100:00100000:1.0:1767319517.148088:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379778304:0@lo:250:kworker.0
00000400:00000100:1.0:1767319517.148111:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379778304 offset 0 length 520: 4
00000100:00100000:1.0:1767319517.148129:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379778432:0@lo:38:kworker.0
00000100:00100000:1.0:1767319517.148143:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319517.148161:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379778560:0@lo:38:kworker.0
00000100:00100000:1.0:1767319517.148174:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319517.148189:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379779072:0@lo:38:kworker.0
00000100:00100000:1.0:1767319517.148201:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319517.148218:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379779328:0@lo:38:kworker.0
00000100:00100000:1.0:1767319517.148237:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319517.148252:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379778432
00000100:00100000:2.0:1767319517.148256:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379778432
00000100:00100000:2.0:1767319517.148277:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779072
00000100:00100000:3.0:1767319517.148279:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379778560
00000100:00100000:2.0:1767319517.148280:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779072
00000100:00100000:3.0:1767319517.148282:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379778560
00000100:00100000:2.0:1767319517.148291:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779328
00000100:00100000:2.0:1767319517.148294:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779328
00000100:00100000:3.0:1767319517.148300:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018
00000100:00100000:2.0:1767319517.148302:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17024
00000100:00100000:3.0:1767319517.148304:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379778560:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319517.148306:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379778432:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319517.148323:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319517.148385:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379778432:12345-0@lo:38:kworker.0 Request processed in 77us (240us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319517.148390:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319517.148405:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319517.148408:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379778432:0@lo:38:kworker.0
00000100:00100000:0.0:1767319517.148431:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17025
00000100:00100000:2.0:1767319517.148436:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17024
00000100:00100000:0.0:1767319517.148437:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379779072:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319517.148448:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17026
00000100:00100000:2.0:1767319517.148452:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379779328:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319517.153846:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319517.153978:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379778560:12345-0@lo:38:kworker.0 Request processed in 5669us (5798us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319517.153992:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018
00000100:00080000:1.0:1767319517.154150:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319517.154158:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319517.154162:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379778560:0@lo:38:kworker.0
00010000:00020000:0.0:1767319517.155668:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319517.155803:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379779072:12345-0@lo:38:kworker.0 Request processed in 7362us (7596us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319517.155814:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17025
00000100:00080000:1.0:1767319517.157037:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319517.157046:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319517.157050:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379779072:0@lo:38:kworker.0
00010000:00020000:2.0:1767319517.157298:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319517.157371:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379779328:12345-0@lo:38:kworker.0 Request processed in 8915us (9131us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319517.157383:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17026
00000100:00080000:1.0:1767319517.158237:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319517.158243:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319517.158247:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379779328:0@lo:38:kworker.0
00010000:00010000:3.0:1767319517.655232:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319517.655390:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319517.655412:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379779456:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319517.655484:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319517.655577:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779456
00000100:00100000:1.0:1767319517.655586:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779456
00000100:00100000:1.0:1767319517.655641:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317
00000100:00100000:1.0:1767319517.655650:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379779456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319517.655678:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319517.655731:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379779456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (247us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319517.655739:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317
00000100:00100000:2.0:1767319517.657465:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379779456:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319518.679684:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319519.122327:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319519.122382:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319519.122499:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291921920
00000100:00100000:0.0:1767319519.122510:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291921920
00000100:00100000:0.0:1767319519.122583:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291921792
00000100:00100000:0.0:1767319519.122587:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291921792
00000100:00100000:0.0:1767319519.122605:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4293
00000100:00100000:0.0:1767319519.122615:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291921920:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319519.122694:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291921920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319519.122702:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4293
00000100:00100000:0.0:1767319519.122721:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17027
00000100:00100000:0.0:1767319519.122726:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291921792:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319519.122747:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319519.122772:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291921792:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (389us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319519.122778:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17027
00000100:00080000:2.0:1767319519.123013:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319519.703125:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319520.727110:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319521.241409:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379779584:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319521.241483:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319521.241651:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779584
00000100:00100000:0.0:1767319521.241660:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779584
00000100:00100000:0.0:1767319521.241728:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2318
00000100:00100000:0.0:1767319521.241738:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379779584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319521.241766:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319521.241814:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379779584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319521.241821:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2318
00000100:00100000:0.0:1767319521.241922:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379779584:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319521.242538:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319521.752044:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319522.263332:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319522.263343:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319522.263346:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319522.263350:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319522.263354:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319522.263361:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4419
00000100:00080000:1.0:1767319522.263366:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319522.263373:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319522.263416:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b94700 x1853164379779712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319522.263443:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319522.263446:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319522.263448:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319522.263452:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4419
00000100:00080000:1.0:1767319522.263454:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319522.263458:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319522.263496:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cdc00 x1853164379779840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319522.263568:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319522.263573:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319522.263575:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319522.263578:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4419
00000100:00080000:1.0:1767319522.263582:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319522.263585:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319522.263596:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cd880 x1853164379780352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319522.263610:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319522.263613:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319522.263615:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319522.263618:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4419
00000100:00080000:1.0:1767319522.263620:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319522.263624:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319522.263632:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cc000 x1853164379780608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319522.263661:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379780224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319522.263737:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319522.263804:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319522.263823:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379780096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319522.263863:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319522.263978:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379779968:0@lo:400:kworker.0
00000100:00100000:2.0:1767319522.264013:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319522.264041:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319522.264046:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379780480:0@lo:400:kworker.0
00000100:00100000:2.0:1767319522.264066:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319522.264103:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780224
00000100:00100000:2.0:1767319522.264110:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780224
00000100:00100000:2.0:1767319522.264159:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780480
00000100:00100000:2.0:1767319522.264162:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780480
00000100:00100000:2.0:1767319522.264183:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4294
00000100:00100000:2.0:1767319522.264190:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379780224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319522.264240:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379780224:12345-0@lo:400:kworker.0 Request processed in 49us (502us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319522.264248:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4294
00000100:00100000:2.0:1767319522.264266:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4295
00000100:00100000:2.0:1767319522.264272:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379780480:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319522.264301:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379780480:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319522.264307:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4295
00000100:00080000:2.0:1767319522.264324:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319522.264365:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379780480:0@lo:400:kworker.0
00000100:00100000:2.0:1767319522.264397:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379780224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319522.264801:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780096
00000100:00100000:1.0:1767319522.264816:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780096
00000100:00100000:1.0:1767319522.264893:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779968
00000100:00100000:1.0:1767319522.264897:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779968
00000100:00100000:1.0:1767319522.264918:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545
00000100:00100000:1.0:1767319522.264924:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379780096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319522.264962:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379780096:12345-0@lo:400:kworker.0 Request processed in 38us (1099us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319522.264968:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545
00000100:00100000:1.0:1767319522.264983:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546
00000100:00100000:1.0:1767319522.264989:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379779968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319522.265014:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379779968:12345-0@lo:400:kworker.0 Request processed in 26us (1000us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319522.265019:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546
00000100:00100000:3.0:1767319522.265198:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379779712:0@lo:38:kworker.0
00000100:00100000:3.0:1767319522.265233:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319522.265265:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379779840:0@lo:38:kworker.0
00000100:00100000:3.0:1767319522.265286:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319522.265315:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379780352:0@lo:38:kworker.0
00000100:00100000:3.0:1767319522.265335:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319522.265351:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379780608:0@lo:38:kworker.0
00000100:00100000:3.0:1767319522.265372:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319522.265439:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779712
00000100:00100000:0.0:1767319522.265444:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779712
00000100:00100000:0.0:1767319522.265471:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780352
00000100:00100000:0.0:1767319522.265474:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780352
00000100:00100000:0.0:1767319522.265487:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780608
00000100:00100000:0.0:1767319522.265489:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780608
00000100:00100000:0.0:1767319522.265504:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17028
00000100:00100000:0.0:1767319522.265509:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379779712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319522.265528:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319522.265565:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379779712:12345-0@lo:38:kworker.0 Request processed in 55us (331us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319522.265571:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17028
00000100:00100000:0.0:1767319522.265585:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17029
00000100:00100000:0.0:1767319522.265589:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379780352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319522.265598:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319522.265617:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379780352:12345-0@lo:38:kworker.0 Request processed in 27us (281us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319522.265622:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17029
00000100:00100000:0.0:1767319522.265631:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17030
00000100:00100000:0.0:1767319522.265635:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379780608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319522.265644:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319522.265661:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379780608:12345-0@lo:38:kworker.0 Request processed in 25us (289us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319522.265666:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17030
00000100:00080000:0.0:1767319522.265702:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319522.265707:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319522.265710:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379779712:0@lo:38:kworker.0
00000100:00080000:0.0:1767319522.265719:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319522.265723:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319522.265726:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379780352:0@lo:38:kworker.0
00000100:00080000:0.0:1767319522.265733:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319522.265736:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319522.265738:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379780608:0@lo:38:kworker.0
00000100:00080000:2.0:1767319522.265832:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319522.265903:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379779968:0@lo:400:kworker.0
00000100:00100000:2.0:1767319522.265934:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379780096:0@lo:400:kworker.0
00000100:00100000:1.0:1767319522.266835:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379779840
00000100:00100000:1.0:1767319522.266855:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379779840
00000100:00100000:1.0:1767319522.266924:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019
00000100:00100000:1.0:1767319522.266932:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379779840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319522.266951:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319522.267021:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379779840:12345-0@lo:38:kworker.0 Request processed in 89us (1733us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319522.267028:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019
00000100:00080000:0.0:1767319522.267152:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319522.267157:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319522.267161:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379779840:0@lo:38:kworker.0
00010000:00010000:0.0:1767319522.775280:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319522.775585:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379780736:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319522.775657:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319522.776095:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780736
00000100:00100000:1.0:1767319522.776103:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780736
00000100:00100000:1.0:1767319522.776155:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319
00000100:00100000:1.0:1767319522.776164:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379780736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319522.776195:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319522.776249:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379780736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (591us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319522.776256:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319
00000100:00100000:2.0:1767319522.776452:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379780736:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319523.800406:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319524.244112:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319524.244355:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291922176
00000100:00100000:3.0:1767319524.244366:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291922176
00000100:00100000:3.0:1767319524.244460:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4296
00000100:00100000:3.0:1767319524.244472:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291922176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767319524.244571:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319524.244785:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291922176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 315us (684us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319524.244792:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4296
00000100:00100000:2.0:1767319524.245326:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319524.245454:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291922048
00000100:00100000:3.0:1767319524.245460:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291922048
00000100:00100000:3.0:1767319524.245493:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17031
00000100:00100000:3.0:1767319524.245499:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291922048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319524.245521:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319524.245570:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291922048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 70us (245us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319524.245578:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17031
00010000:00010000:3.0:1767319524.823155:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319525.849150:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319526.359202:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379780864:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319526.359272:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319526.362702:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780864
00000100:00100000:0.0:1767319526.362719:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780864
00000100:00080000:2.0:1767319526.362822:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319526.362843:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320
00000100:00100000:0.0:1767319526.362854:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379780864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319526.362962:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319526.363053:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379780864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 200us (3779us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319526.363061:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320
00000100:00100000:2.0:1767319526.363244:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379780864:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319526.871052:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319527.383088:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319527.383100:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319527.383104:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319527.383108:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319527.383113:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319527.383123:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4424
00000100:00080000:1.0:1767319527.383129:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319527.383138:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319527.383191:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cfb80 x1853164379780992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319527.383219:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319527.383223:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319527.383224:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319527.383228:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4424
00000100:00080000:1.0:1767319527.383231:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319527.383234:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319527.383247:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046ce680 x1853164379781120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319527.383310:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319527.383313:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319527.383315:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319527.383318:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4424
00000100:00080000:1.0:1767319527.383321:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319527.383324:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319527.383333:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cca80 x1853164379781632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319527.383347:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319527.383350:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319527.383352:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319527.383356:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4424
00000100:00080000:1.0:1767319527.383358:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319527.383361:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319527.383370:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cf480 x1853164379781888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319527.383397:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379781376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319527.383461:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319527.383486:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379781248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319527.383529:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319527.383536:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319527.383539:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379781504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319527.383567:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319527.383574:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379781760:0@lo:400:kworker.0
00000100:00100000:0.0:1767319527.383634:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379780992:0@lo:38:kworker.0
00000100:00100000:2.0:1767319527.383661:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379781376
00000100:00100000:2.0:1767319527.383669:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379781376
00000100:00100000:2.0:1767319527.383715:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379781248
00000100:00100000:2.0:1767319527.383718:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379781248
00000100:00100000:2.0:1767319527.383737:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547
00000100:00100000:2.0:1767319527.383746:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379781376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319527.384571:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319527.384617:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548
00000100:00100000:1.0:1767319527.384629:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379781248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319527.384666:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379781248:12345-0@lo:400:kworker.0 Request processed in 41us (1132us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319527.384674:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548
00000100:00100000:1.0:1767319527.384707:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379781504
00000100:00100000:1.0:1767319527.384711:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379781504
00000100:00100000:1.0:1767319527.384744:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4297
00000100:00100000:1.0:1767319527.384749:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379781504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319527.384785:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379781504:12345-0@lo:400:kworker.0 Request processed in 35us (215us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319527.384799:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4297
00000100:00100000:1.0:1767319527.384842:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379781504:0@lo:400:kworker.0
00000100:00080000:1.0:1767319527.384893:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319527.384899:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319527.388073:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319527.388152:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379781248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319527.388362:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379781760
00000100:00100000:1.0:1767319527.388369:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379781760
00000100:00100000:1.0:1767319527.388443:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4298
00000100:00100000:1.0:1767319527.388451:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379781760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319527.388527:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379781760:12345-0@lo:400:kworker.0 Request processed in 76us (463us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319527.388535:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4298
00000100:00080000:3.0:1767319527.388752:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319527.388780:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379781760:0@lo:400:kworker.0
00000100:00100000:0.0:1767319527.390153:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319527.390294:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379781120:0@lo:38:kworker.0
00000100:00100000:0.0:1767319527.390342:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319527.390387:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379781632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319527.390411:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319527.390486:0:15854:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379781120
00000100:00100000:3.0:1767319527.390494:0:15854:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379781120
00000100:00100000:3.0:1767319527.390532:0:15854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020
00000100:00100000:3.0:1767319527.390539:0:15854:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379781120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319527.390560:0:15854:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319527.394928:0:15854:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:7016:x1853164379781120:12345-0@lo:38:kworker.0 Request processed in 4373us (4581us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319527.400840:0:15854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020
00000100:00100000:3.0:1767319527.401006:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379781376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319527.404223:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379781376:12345-0@lo:400:kworker.0 Request processed in 20462us (20745us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319527.404241:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547
00000100:00100000:0.0:1767319527.412945:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379781888:0@lo:38:kworker.0
00000100:00100000:1.0:1767319527.413022:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379780992
00000100:00100000:1.0:1767319527.413030:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379780992
00000100:00100000:3.0:1767319527.413051:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379781632
00000100:00100000:3.0:1767319527.413059:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379781632
00000100:00100000:1.0:1767319527.413074:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17032
00000100:00100000:1.0:1767319527.413083:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379780992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319527.413105:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319527.413166:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379780992:12345-0@lo:38:kworker.0 Request processed in 82us (23018us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319527.413544:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17033
00000100:00100000:3.0:1767319527.413550:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379781632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319527.413562:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319527.413605:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379781632:12345-0@lo:38:kworker.0 Request processed in 54us (23193us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319527.413820:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17033
00000100:00100000:1.0:1767319527.419172:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17032
00000100:00100000:0.0:1767319527.419421:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319527.419493:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319527.419500:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319527.419512:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379780992:0@lo:38:kworker.0
00000100:00080000:0.0:1767319527.419525:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319527.419529:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319527.419532:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379781120:0@lo:38:kworker.0
00000100:00080000:0.0:1767319527.419552:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319527.419555:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319527.419558:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379781632:0@lo:38:kworker.0
00000100:00100000:1.0:1767319527.423576:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379781888
00000100:00100000:1.0:1767319527.423593:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379781888
00000100:00100000:1.0:1767319527.423659:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17034
00000100:00100000:1.0:1767319527.423669:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379781888:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319527.423699:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319527.423817:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379781888:12345-0@lo:38:kworker.0 Request processed in 148us (4395us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319527.423827:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17034
00000100:00080000:0.0:1767319527.425005:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319527.425017:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319527.425023:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379781888:0@lo:38:kworker.0
00010000:00010000:3.0:1767319527.895082:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319527.895238:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379782016:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319527.895305:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319527.895415:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782016
00000100:00100000:2.0:1767319527.895423:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782016
00000100:00100000:2.0:1767319527.895476:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321
00000100:00100000:2.0:1767319527.895485:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379782016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319527.895514:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319527.895846:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379782016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 361us (540us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319527.895855:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321
00000100:00100000:3.0:1767319527.895997:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379782016:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319528.921314:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319529.358939:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319529.358975:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319529.359069:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291922432
00000100:00100000:1.0:1767319529.359080:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291922432
00000100:00100000:1.0:1767319529.359169:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291922304
00000100:00100000:1.0:1767319529.359173:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291922304
00000100:00100000:1.0:1767319529.359200:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4299
00000100:00100000:1.0:1767319529.359210:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291922432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319529.359297:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291922432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319529.359306:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4299
00000100:00100000:1.0:1767319529.359329:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17035
00000100:00100000:1.0:1767319529.359334:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291922304:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319529.359369:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319529.359396:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291922304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 60us (420us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319529.359403:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17035
00000100:00080000:3.0:1767319529.359611:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319529.943351:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319530.967055:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319531.479149:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379782144:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319531.479365:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319531.483662:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782144
00000100:00100000:0.0:1767319531.483679:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782144
00000100:00100000:0.0:1767319531.485567:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322
00000100:00100000:0.0:1767319531.485585:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379782144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319531.485623:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319531.485715:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379782144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (6351us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319531.485724:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322
00000100:00100000:2.0:1767319531.486930:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379782144:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319531.489462:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319531.991147:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319532.503062:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319532.503073:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319532.503076:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319532.503080:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319532.503084:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319532.503092:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4429
00000100:00080000:3.0:1767319532.503096:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319532.503102:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319532.503153:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907b80 x1853164379782272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319532.503186:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319532.503190:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319532.503192:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319532.503196:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4429
00000100:00080000:3.0:1767319532.503198:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319532.503202:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319532.503216:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904380 x1853164379782400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319532.503353:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379782528:0@lo:400:kworker.0
00000100:00100000:2.0:1767319532.503418:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319532.503487:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782528
00000100:00100000:2.0:1767319532.503494:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782528
00000100:00100000:2.0:1767319532.503536:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549
00000100:00100000:2.0:1767319532.503554:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379782528:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319532.503602:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379782528:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319532.503609:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549
00000100:00100000:2.0:1767319532.503651:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379782528:0@lo:400:kworker.0
00000100:00100000:1.0:1767319532.505944:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379782784:0@lo:400:kworker.0
00000100:00100000:1.0:1767319532.506020:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319532.506088:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319532.506098:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379782656:0@lo:400:kworker.0
00000100:00100000:1.0:1767319532.506133:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319532.506181:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782784
00000100:00100000:1.0:1767319532.506189:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782784
00000100:00100000:1.0:1767319532.506261:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4300
00000100:00100000:1.0:1767319532.506272:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379782784:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319532.506348:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379782784:12345-0@lo:400:kworker.0 Request processed in 77us (328us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319532.506357:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4300
00000100:00100000:1.0:1767319532.506393:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782656
00000100:00100000:1.0:1767319532.506399:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782656
00000100:00100000:1.0:1767319532.506443:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550
00000100:00100000:1.0:1767319532.506452:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379782656:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319532.506491:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379782656:12345-0@lo:400:kworker.0 Request processed in 41us (359us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319532.506499:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550
00000100:00080000:1.0:1767319532.506524:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319532.506530:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319532.506566:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379782656:0@lo:400:kworker.0
00000100:00100000:1.0:1767319532.506584:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379782784:0@lo:400:kworker.0
00000100:00100000:1.0:1767319532.506648:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379782272:0@lo:38:kworker.0
00000100:00100000:1.0:1767319532.506682:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319532.506708:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379782400:0@lo:38:kworker.0
00000100:00100000:1.0:1767319532.506754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319532.507963:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782272
00000100:00100000:0.0:1767319532.507983:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782272
00000100:00100000:0.0:1767319532.508135:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17036
00000100:00100000:0.0:1767319532.508142:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379782272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319532.508162:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319532.508218:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379782272:12345-0@lo:38:kworker.0 Request processed in 75us (1537us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319532.508225:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17036
00000100:00100000:0.0:1767319532.510172:0:15483:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782400
00000100:00100000:0.0:1767319532.510188:0:15483:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782400
00000100:00100000:0.0:1767319532.510239:0:15483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021
00000100:00100000:0.0:1767319532.510247:0:15483:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0912e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379782400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319532.510267:0:15483:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319532.510336:0:15483:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0912e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:7016:x1853164379782400:12345-0@lo:38:kworker.0 Request processed in 88us (3593us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319532.510347:0:15483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021
00000100:00080000:1.0:1767319532.511089:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319532.511098:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319532.511104:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379782400:0@lo:38:kworker.0
00000100:00080000:1.0:1767319532.511140:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319532.511144:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319532.511148:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379782272:0@lo:38:kworker.0
00000100:00080000:3.0:1767319532.517768:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319532.517781:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319532.517785:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319532.517793:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4429
00000100:00080000:3.0:1767319532.517798:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319532.517805:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319532.518000:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06238a80 x1853164379782912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319532.518047:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319532.518050:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319532.518051:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319532.518054:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4429
00000100:00080000:2.0:1767319532.518055:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319532.518060:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319532.518068:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239c00 x1853164379783168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319532.518138:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379782912:0@lo:38:kworker.0
00000100:00100000:1.0:1767319532.518209:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319532.518247:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379783168:0@lo:38:kworker.0
00000100:00100000:1.0:1767319532.518263:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319532.518322:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319532.518334:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379783040:0@lo:400:kworker.0
00000100:00100000:0.0:1767319532.518366:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319532.518404:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379782912
00000100:00100000:0.0:1767319532.518411:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379782912
00000100:00100000:0.0:1767319532.518436:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783168
00000100:00100000:0.0:1767319532.518438:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783168
00000100:00100000:0.0:1767319532.518445:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783040
00000100:00100000:0.0:1767319532.518447:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783040
00000100:00100000:0.0:1767319532.518475:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4301
00000100:00100000:0.0:1767319532.518481:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379783040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319532.518518:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379783040:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319532.518524:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4301
00000100:00100000:0.0:1767319532.518536:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17037
00000100:00100000:0.0:1767319532.518539:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379782912:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319532.518563:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319532.518590:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379782912:12345-0@lo:38:kworker.0 Request processed in 49us (381us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319532.518597:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17037
00000100:00100000:0.0:1767319532.518607:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17038
00000100:00100000:0.0:1767319532.518611:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379783168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319532.518633:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319532.518663:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379783168:12345-0@lo:38:kworker.0 Request processed in 50us (398us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319532.518669:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17038
00000100:00080000:1.0:1767319532.518811:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319532.518817:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319532.518820:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379782912:0@lo:38:kworker.0
00000100:00080000:1.0:1767319532.518835:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319532.518838:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319532.518840:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379783168:0@lo:38:kworker.0
00000100:00080000:3.0:1767319532.521078:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319532.522515:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379783040:0@lo:400:kworker.0
00000100:00100000:1.0:1767319533.015187:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379783296:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319533.015269:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319533.015424:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783296
00000100:00100000:0.0:1767319533.015432:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783296
00000100:00100000:0.0:1767319533.015490:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323
00000100:00100000:0.0:1767319533.015500:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379783296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319533.015531:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319533.015578:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379783296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (309us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319533.015586:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323
00000100:00100000:1.0:1767319533.017912:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379783296:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319533.018005:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319534.039080:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319534.483400:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319534.483682:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291922560
00000100:00100000:0.0:1767319534.483693:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291922560
00000100:00100000:0.0:1767319534.483751:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17039
00000100:00100000:0.0:1767319534.483759:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291922560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319534.483781:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319534.484069:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291922560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 308us (679us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319534.484077:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17039
00000100:00100000:2.0:1767319534.494095:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319534.494309:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291922688
00000100:00100000:0.0:1767319534.494323:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291922688
00000100:00100000:0.0:1767319534.494481:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4302
00000100:00100000:0.0:1767319534.494494:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291922688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319534.494592:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291922688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (512us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319534.494603:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4302
00000100:00080000:3.0:1767319534.495844:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319535.064785:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319536.089159:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319536.599330:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379783424:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319536.602535:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319536.602836:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783424
00000100:00100000:1.0:1767319536.602851:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783424
00000100:00100000:1.0:1767319536.602971:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324
00000100:00100000:1.0:1767319536.602984:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379783424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319536.603033:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319536.603125:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379783424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (607us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319536.603134:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324
00000100:00080000:2.0:1767319536.603221:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319536.603458:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379783424:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319537.111812:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319537.623056:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319537.623083:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319537.623087:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319537.623092:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319537.623098:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319537.623109:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319537.623115:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319537.623126:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319537.623184:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623aa00 x1853164379783552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319537.623231:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319537.623236:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319537.623238:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319537.623243:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319537.623246:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319537.623250:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319537.623269:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623b800 x1853164379783680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319537.623350:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319537.623354:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319537.623356:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319537.623360:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319537.623362:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319537.623365:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319537.623372:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379783808:0@lo:400:kworker.0
00000100:00100000:2.0:1767319537.623376:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06238000 x1853164379784192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319537.623391:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319537.623395:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319537.623397:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319537.623401:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4434
00000100:00080000:2.0:1767319537.623403:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319537.623407:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319537.623417:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623b100 x1853164379784448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319537.623488:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379783936:0@lo:400:kworker.0
00000100:00100000:0.0:1767319537.623862:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379784320:0@lo:400:kworker.0
00000100:00100000:2.0:1767319537.624041:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319537.624130:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319537.624138:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379784064:0@lo:400:kworker.0
00000100:00100000:3.0:1767319537.624143:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319537.624307:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319537.624677:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783936
00000100:00100000:2.0:1767319537.624688:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783936
00000100:00100000:2.0:1767319537.624775:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783808
00000100:00100000:2.0:1767319537.624780:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783808
00000100:00100000:2.0:1767319537.624806:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551
00000100:00100000:2.0:1767319537.624816:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379783936:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319537.625062:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319537.625302:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379783552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319537.625363:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1767319537.625372:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379783808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319537.625433:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379783808:12345-0@lo:400:kworker.0 Request processed in 62us (1287us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319537.625441:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1767319537.625554:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379783808:0@lo:400:kworker.0
00000100:00080000:3.0:1767319537.626090:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319537.626471:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379783936:12345-0@lo:400:kworker.0 Request processed in 1651us (2426us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319537.626484:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551
00000100:00100000:0.0:1767319537.626728:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319537.626988:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379783936:0@lo:400:kworker.0
00000100:00100000:0.0:1767319537.628174:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379783680:0@lo:38:kworker.0
00000100:00100000:0.0:1767319537.628277:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319537.628317:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379784192:0@lo:38:kworker.0
00000100:00100000:0.0:1767319537.628341:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319537.631676:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784064
00000100:00100000:1.0:1767319537.631711:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784064
00000100:00100000:1.0:1767319537.631852:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784320
00000100:00100000:1.0:1767319537.631856:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784320
00000100:00100000:1.0:1767319537.631901:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783552
00000100:00100000:1.0:1767319537.631905:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783552
00000100:00100000:1.0:1767319537.631932:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4303
00000100:00100000:1.0:1767319537.631945:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379784064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319537.632155:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379784064:12345-0@lo:400:kworker.0 Request processed in 212us (7846us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319537.632164:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4303
00000100:00100000:1.0:1767319537.632190:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4304
00000100:00100000:1.0:1767319537.632196:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379784320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319537.632241:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379784320:12345-0@lo:400:kworker.0 Request processed in 46us (7181us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319537.632248:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4304
00000100:00100000:1.0:1767319537.632262:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17040
00000100:00100000:1.0:1767319537.632267:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379783552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319537.632292:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319537.632326:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379783552:12345-0@lo:38:kworker.0 Request processed in 57us (5598us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319537.632332:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17040
00000100:00080000:1.0:1767319537.632370:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319537.632420:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379784064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319537.632464:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379784320:0@lo:400:kworker.0
00000100:00100000:1.0:1767319537.632545:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379783680
00000100:00100000:1.0:1767319537.632552:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379783680
00000100:00100000:1.0:1767319537.632584:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0
00000100:00100000:1.0:1767319537.632590:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379783680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319537.632603:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319537.632637:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379783680:12345-0@lo:38:kworker.0 Request processed in 46us (4361us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319537.632644:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0
00000100:00100000:0.0:1767319537.638852:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379784448:0@lo:38:kworker.0
00000100:00100000:0.0:1767319537.639006:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319537.639726:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319537.639736:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319537.639741:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379783552:0@lo:38:kworker.0
00000100:00080000:0.0:1767319537.639758:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319537.639762:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319537.639764:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379783680:0@lo:38:kworker.0
00000100:00100000:3.0:1767319537.640301:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784192
00000100:00100000:3.0:1767319537.640313:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784192
00000100:00100000:2.0:1767319537.640443:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784448
00000100:00100000:2.0:1767319537.640448:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784448
00000100:00100000:2.0:1767319537.640502:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17041
00000100:00100000:2.0:1767319537.640511:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379784192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319537.640542:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319537.640638:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379784192:12345-0@lo:38:kworker.0 Request processed in 126us (12294us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319537.640646:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17041
00000100:00100000:2.0:1767319537.640666:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17042
00000100:00100000:2.0:1767319537.640671:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379784448:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319537.640681:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319537.640770:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319537.640785:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319537.640789:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379784192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319537.641440:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379784448:12345-0@lo:38:kworker.0 Request processed in 763us (2431us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319537.641450:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17042
00000100:00080000:1.0:1767319537.641494:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319537.641499:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319537.641503:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379784448:0@lo:38:kworker.0
00000100:00100000:2.0:1767319538.135281:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319538.135318:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379784576:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319538.135328:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319538.135435:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319538.135591:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784576
00000100:00100000:0.0:1767319538.135602:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784576
00000100:00100000:0.0:1767319538.135662:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325
00000100:00100000:0.0:1767319538.135673:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379784576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319538.135746:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319538.135818:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379784576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (383us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319538.135828:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325
00000100:00100000:2.0:1767319538.135908:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379784576:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319538.577040:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319538.577452:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923072
00000100:00100000:1.0:1767319538.577464:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923072
00000100:00100000:1.0:1767319538.577577:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4305
00000100:00100000:1.0:1767319538.577588:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291923072:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319538.577700:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291923072:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (673us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319538.577710:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4305
00000400:00000100:0.0:1767319538.577860:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291922816 offset 0 length 520: 4
00000100:00080000:3.0:1767319538.577999:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319538.578092:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319538.578285:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291922944
00000100:00100000:1.0:1767319538.578292:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291922944
00000100:00100000:1.0:1767319538.578330:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17043
00000100:00100000:1.0:1767319538.578335:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291922944:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319538.578356:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319538.578826:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291922944:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 486us (732us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319538.578835:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17043
00010000:00010000:0.0:1767319539.160367:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319540.183455:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319541.207128:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319541.719219:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319541.719249:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379784704:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319541.719329:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319541.719456:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784704
00000100:00100000:0.0:1767319541.719464:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784704
00000100:00100000:0.0:1767319541.719536:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326
00000100:00100000:0.0:1767319541.719547:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379784704:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319541.719577:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319541.719623:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379784704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319541.719651:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326
00000100:00080000:3.0:1767319541.719898:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319541.720210:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379784704:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319542.231781:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319542.743152:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319542.743172:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319542.743175:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319542.743180:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319542.743187:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319542.743199:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4440
00000100:00080000:3.0:1767319542.743204:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319542.743213:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319542.743259:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904e00 x1853164379784832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319542.743291:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319542.743295:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319542.743297:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319542.743302:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4440
00000100:00080000:3.0:1767319542.743304:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319542.743307:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319542.743322:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905c00 x1853164379784960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319542.743393:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319542.743396:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319542.743398:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319542.743410:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4440
00000100:00080000:3.0:1767319542.743413:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319542.743417:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319542.743427:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907480 x1853164379785472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319542.743443:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319542.743446:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319542.743448:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319542.743451:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4440
00000100:00080000:3.0:1767319542.743453:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319542.743456:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319542.743464:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379785728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319542.743492:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379785344:0@lo:400:kworker.0
00000100:00100000:3.0:1767319542.743562:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319542.743628:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319542.743647:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379785216:0@lo:400:kworker.0
00000100:00100000:3.0:1767319542.743684:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319542.743894:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379785600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319542.743925:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319542.743959:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319542.743966:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379785088:0@lo:400:kworker.0
00000100:00100000:1.0:1767319542.743987:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319542.744023:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379785344
00000100:00100000:1.0:1767319542.744031:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379785344
00000100:00100000:1.0:1767319542.744086:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379785600
00000100:00100000:1.0:1767319542.744089:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379785600
00000100:00100000:1.0:1767319542.744115:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4306
00000100:00100000:1.0:1767319542.744125:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379785344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319542.744193:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379785344:12345-0@lo:400:kworker.0 Request processed in 69us (631us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319542.744201:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4306
00000100:00100000:1.0:1767319542.744225:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4307
00000100:00100000:1.0:1767319542.744230:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379785600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319542.744262:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379785600:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319542.744268:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4307
00000100:00100000:0.0:1767319542.744284:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319517/real 1767319517]  req@ffff8b0f092a7100 x1853164379778304/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319542 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319542.744290:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379785216
00000100:00100000:1.0:1767319542.744293:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379785216
00000100:00100000:0.0:1767319542.744312:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f092a7100 x1853164379778304/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319542 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319542.744320:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379785088
00000100:00100000:1.0:1767319542.744322:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379785088
00000100:00100000:0.0:1767319542.744327:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379784832:0@lo:38:kworker.0
00000100:00100000:1.0:1767319542.744338:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553
00000100:00100000:1.0:1767319542.744345:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379785216:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319542.744354:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319542.744373:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379784960:0@lo:38:kworker.0
00000100:00100000:1.0:1767319542.744373:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379785216:12345-0@lo:400:kworker.0 Request processed in 28us (687us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319542.744379:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553
00000100:00100000:0.0:1767319542.744395:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319542.744405:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554
00000100:00100000:1.0:1767319542.744411:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379785088:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319542.744428:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379785472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319542.744436:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379785088:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319542.744442:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554
00000100:00100000:0.0:1767319542.744448:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319542.744459:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319542.744464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319542.744465:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379785728:0@lo:38:kworker.0
00000100:00100000:1.0:1767319542.744473:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784832
00000100:00100000:1.0:1767319542.744477:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784832
00000100:00100000:0.0:1767319542.744485:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319542.744495:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379785472
00000100:00100000:1.0:1767319542.744497:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379785472
00000100:00080000:0.0:1767319542.744499:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319542.744504:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379785728
00000100:00100000:1.0:1767319542.744506:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379785728
00000100:00080000:0.0:1767319542.744514:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319542.744515:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17044
00000100:00100000:0.0:1767319542.744518:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379778304:0@lo:250:kworker.0
00000100:00100000:1.0:1767319542.744519:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379784832:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319542.744539:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319542.744547:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319542.744550:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319542.744552:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319542.744555:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4419
00000100:00080000:0.0:1767319542.744559:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319542.744563:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319542.744585:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28d180 x1853164379785856/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319542.744586:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379784832:12345-0@lo:38:kworker.0 Request processed in 64us (231us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319542.744592:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17044
00000100:00100000:1.0:1767319542.744604:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17045
00000100:00100000:1.0:1767319542.744607:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379785472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319542.744616:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319542.744638:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379785472:12345-0@lo:38:kworker.0 Request processed in 29us (189us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319542.744645:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17045
00000100:00100000:1.0:1767319542.744667:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17046
00000100:00100000:1.0:1767319542.744671:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379785728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319542.744680:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319542.744702:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379785728:12345-0@lo:38:kworker.0 Request processed in 29us (216us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319542.744708:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17046
00000100:00100000:1.0:1767319542.744728:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379784960
00000100:00100000:1.0:1767319542.744731:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379784960
00000100:00100000:1.0:1767319542.744749:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1
00000100:00100000:1.0:1767319542.744754:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379784960:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319542.744763:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319542.744788:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379784960:12345-0@lo:38:kworker.0 Request processed in 33us (392us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319542.744794:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1
00000100:00100000:1.0:1767319542.744824:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379785856:0@lo:250:kworker.0
00000400:00000100:1.0:1767319542.744844:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379785856 offset 0 length 520: 4
00000100:00080000:1.0:1767319542.744866:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319542.744897:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319542.744900:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379784832:0@lo:38:kworker.0
00000100:00080000:1.0:1767319542.744912:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319542.744916:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319542.744918:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379784960:0@lo:38:kworker.0
00000100:00100000:0.0:1767319542.744922:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379785088:0@lo:400:kworker.0
00000100:00080000:1.0:1767319542.744926:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319542.744930:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319542.744932:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379785472:0@lo:38:kworker.0
00000100:00100000:0.0:1767319542.744937:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379785600:0@lo:400:kworker.0
00000100:00080000:1.0:1767319542.744938:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319542.744941:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319542.744943:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379785728:0@lo:38:kworker.0
00000100:00100000:0.0:1767319542.744968:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379785216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319542.744980:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379785344:0@lo:400:kworker.0
00010000:00010000:0.0:1767319543.255060:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319543.255230:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319543.255338:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379785984:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319543.255498:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319543.260157:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379785984
00000100:00100000:2.0:1767319543.260171:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379785984
00000100:00100000:2.0:1767319543.260232:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327
00000100:00100000:2.0:1767319543.260242:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379785984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319543.260276:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319543.260350:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379785984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (4851us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319543.260357:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327
00000100:00100000:0.0:1767319543.260401:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379785984:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319543.695485:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319543.695538:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319543.695655:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923328
00000100:00100000:3.0:1767319543.695667:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923328
00000100:00100000:3.0:1767319543.695765:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923200
00000100:00100000:3.0:1767319543.695769:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923200
00000100:00100000:3.0:1767319543.695789:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4308
00000100:00100000:3.0:1767319543.695800:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291923328:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319543.695919:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291923328:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 121us (446us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319543.695928:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4308
00000100:00100000:3.0:1767319543.695949:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17047
00000100:00100000:3.0:1767319543.695954:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291923200:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319543.695976:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319543.696003:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291923200:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (464us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319543.696011:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17047
00000100:00080000:0.0:1767319543.696075:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319544.279667:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319545.307144:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319546.327668:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319546.842136:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379786112:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319546.842220:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319546.842389:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379786112
00000100:00100000:1.0:1767319546.842398:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379786112
00000100:00100000:1.0:1767319546.842469:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328
00000100:00100000:1.0:1767319546.842479:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379786112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319546.842511:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319546.842560:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379786112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (339us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319546.842568:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328
00000100:00080000:2.0:1767319546.842640:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319546.842676:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379786112:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319547.352107:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319547.863313:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319547.863324:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319547.863328:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319547.863332:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319547.863336:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319547.863346:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4445
00000100:00080000:2.0:1767319547.863352:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319547.863359:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319547.863823:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239180 x1853164379786240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319547.863855:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319547.863860:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319547.863862:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319547.863867:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4445
00000100:00080000:2.0:1767319547.863895:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319547.863900:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319547.863921:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239f80 x1853164379786368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319547.863994:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379786496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319547.864071:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319547.864211:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379786496
00000100:00100000:3.0:1767319547.864219:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379786496
00000100:00100000:3.0:1767319547.864266:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555
00000100:00100000:3.0:1767319547.864274:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379786496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.864349:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379786240:0@lo:38:kworker.0
00000100:00100000:1.0:1767319547.864392:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319547.864411:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379786368:0@lo:38:kworker.0
00000100:00100000:1.0:1767319547.864438:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319547.864469:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379786368
00000100:00100000:1.0:1767319547.864473:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379786368
00000100:00100000:1.0:1767319547.864491:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2
00000100:00100000:1.0:1767319547.864496:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379786368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319547.864515:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319547.864543:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379786368:12345-0@lo:38:kworker.0 Request processed in 46us (103us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319547.864553:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2
00000100:00080000:1.0:1767319547.864591:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319547.864596:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319547.864599:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379786368:0@lo:38:kworker.0
00000100:00100000:1.0:1767319547.864674:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379786240
00000100:00100000:1.0:1767319547.864678:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379786240
00000100:00100000:1.0:1767319547.864698:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17048
00000100:00100000:1.0:1767319547.864703:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379786240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319547.864712:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319547.864751:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379786240:12345-0@lo:38:kworker.0 Request processed in 47us (358us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319547.864757:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17048
00000100:00080000:1.0:1767319547.864786:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319547.864790:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319547.864792:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379786240:0@lo:38:kworker.0
00000100:00080000:2.0:1767319547.865108:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319547.865112:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319547.865114:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319547.865118:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4445
00000100:00080000:2.0:1767319547.865121:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319547.865125:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319547.865138:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239f80 x1853164379786880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319547.866167:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379787008:0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.866219:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319547.866277:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787008
00000100:00100000:1.0:1767319547.866282:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787008
00000100:00100000:1.0:1767319547.866329:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4309
00000100:00100000:1.0:1767319547.866336:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379787008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.866400:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379787008:12345-0@lo:400:kworker.0 Request processed in 65us (181us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319547.866407:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4309
00000100:00100000:1.0:1767319547.866461:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379787008:0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.866484:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379786880:0@lo:38:kworker.0
00000100:00100000:1.0:1767319547.866507:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319547.866531:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379786880
00000100:00100000:1.0:1767319547.866535:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379786880
00000100:00100000:1.0:1767319547.866553:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17049
00000100:00100000:1.0:1767319547.866558:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379786880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319547.866573:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319547.866603:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379786880:12345-0@lo:38:kworker.0 Request processed in 43us (95us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319547.866619:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17049
00000100:00080000:1.0:1767319547.866644:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319547.866649:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319547.866652:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379786880:0@lo:38:kworker.0
00000100:00100000:1.0:1767319547.866688:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379786624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.866715:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319547.867118:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319547.867127:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379786752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.867152:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319547.867178:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379786624
00000100:00100000:1.0:1767319547.867182:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379786624
00000100:00100000:1.0:1767319547.867219:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556
00000100:00100000:1.0:1767319547.867227:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379786624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.867267:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379786624:12345-0@lo:400:kworker.0 Request processed in 41us (551us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319547.867273:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556
00000100:00100000:1.0:1767319547.867303:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379786624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.867322:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379786752
00000100:00100000:1.0:1767319547.867325:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379786752
00000100:00100000:1.0:1767319547.867349:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4310
00000100:00100000:1.0:1767319547.867355:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379786752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319547.867529:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379786752:12345-0@lo:400:kworker.0 Request processed in 174us (376us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319547.867535:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4310
00000100:00100000:1.0:1767319547.867563:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379786752:0@lo:400:kworker.0
00000100:00080000:1.0:1767319547.867622:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319547.867627:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319547.870847:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379786496:12345-0@lo:400:kworker.0 Request processed in 6560us (6761us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319547.870865:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555
00000100:00080000:2.0:1767319547.871126:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319547.871133:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319547.871137:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319547.871143:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4445
00000100:00080000:2.0:1767319547.871148:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319547.871155:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319547.871200:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92a00 x1853164379787136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319547.872935:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379787136:0@lo:38:kworker.0
00000100:00100000:1.0:1767319547.873028:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319547.873236:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787136
00000100:00100000:2.0:1767319547.873244:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787136
00000100:00100000:2.0:1767319547.873290:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17050
00000100:00100000:2.0:1767319547.873298:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379787136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319547.873322:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319547.873392:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379787136:12345-0@lo:38:kworker.0 Request processed in 93us (362us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319547.873399:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17050
00000100:00080000:3.0:1767319547.874124:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319547.874131:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319547.874136:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379787136:0@lo:38:kworker.0
00000100:00100000:0.0:1767319547.874665:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379786496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319548.375260:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379787264:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319548.375326:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319548.375444:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787264
00000100:00100000:1.0:1767319548.375452:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787264
00000100:00100000:1.0:1767319548.375501:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329
00000100:00100000:1.0:1767319548.375509:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379787264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319548.375540:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319548.375593:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379787264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (266us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319548.375612:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329
00000100:00100000:1.0:1767319548.375657:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379787264:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319548.380964:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319548.816673:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319548.816727:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319548.817184:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923584
00000100:00100000:3.0:1767319548.817196:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923584
00000100:00100000:3.0:1767319548.817280:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923456
00000100:00100000:3.0:1767319548.817285:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923456
00000100:00100000:3.0:1767319548.817308:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4311
00000100:00100000:3.0:1767319548.817318:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291923584:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319548.817409:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291923584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (745us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319548.817418:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4311
00000100:00100000:3.0:1767319548.817437:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17051
00000100:00100000:3.0:1767319548.817442:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291923456:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319548.817464:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319548.817825:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319548.818089:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291923456:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 500us (1215us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319548.818099:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17051
00010000:00010000:1.0:1767319549.400828:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319550.423349:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319551.447064:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319551.962129:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379787392:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319551.962210:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319551.962344:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787392
00000100:00100000:2.0:1767319551.962353:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787392
00000100:00100000:2.0:1767319551.962422:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330
00000100:00100000:2.0:1767319551.962432:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379787392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319551.962463:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319551.962508:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379787392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319551.962515:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330
00000100:00080000:1.0:1767319551.962752:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319551.962790:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379787392:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319552.471245:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319552.983165:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319552.983176:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319552.983179:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319552.983183:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319552.983187:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319552.983195:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4450
00000100:00080000:0.0:1767319552.983198:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319552.983204:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319552.983254:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef800 x1853164379787520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319552.983280:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319552.983284:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319552.983286:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319552.983290:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4450
00000100:00080000:0.0:1767319552.983292:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319552.983295:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319552.983307:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef480 x1853164379787648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319552.983372:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319552.983375:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319552.983377:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319552.983380:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4450
00000100:00080000:0.0:1767319552.983383:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319552.983386:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319552.983396:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eca80 x1853164379788160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319552.983409:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319552.983413:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319552.983414:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319552.983417:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4450
00000100:00080000:0.0:1767319552.983419:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319552.983423:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319552.983433:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2efb80 x1853164379788416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319552.983600:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379787776:0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.983668:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319552.983736:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319552.983742:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379788288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.983764:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319552.983786:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379788032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.983804:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319552.983820:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319552.983824:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379787904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.983842:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319552.983899:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788288
00000100:00100000:1.0:1767319552.983906:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788288
00000100:00100000:1.0:1767319552.983952:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788032
00000100:00100000:1.0:1767319552.983955:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788032
00000100:00100000:1.0:1767319552.983978:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4312
00000100:00100000:1.0:1767319552.983985:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379788288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.984033:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379788288:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319552.984041:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4312
00000100:00100000:1.0:1767319552.984061:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4313
00000100:00100000:1.0:1767319552.984068:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379788032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.984098:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379788032:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319552.984104:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4313
00000100:00100000:1.0:1767319552.984123:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787776
00000100:00100000:1.0:1767319552.984127:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787776
00000100:00100000:1.0:1767319552.984149:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787904
00000100:00100000:1.0:1767319552.984152:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787904
00000100:00100000:1.0:1767319552.984171:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557
00000100:00100000:1.0:1767319552.984176:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379787776:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.984203:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379787776:12345-0@lo:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319552.984209:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557
00000100:00100000:1.0:1767319552.984235:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558
00000100:00100000:1.0:1767319552.984241:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379787904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.984268:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379787904:12345-0@lo:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319552.984273:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558
00000100:00080000:1.0:1767319552.984289:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319552.984293:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319552.984332:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379787904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.984342:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379788032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.984370:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379788288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319552.984378:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379787776:0@lo:400:kworker.0
00000100:00100000:2.0:1767319552.984589:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379787520:0@lo:38:kworker.0
00000100:00100000:2.0:1767319552.984623:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319552.984651:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379787648:0@lo:38:kworker.0
00000100:00100000:2.0:1767319552.984674:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319552.984704:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379788160:0@lo:38:kworker.0
00000100:00100000:2.0:1767319552.984725:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319552.984742:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379788416:0@lo:38:kworker.0
00000100:00100000:2.0:1767319552.984763:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319552.984790:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787520
00000100:00100000:2.0:1767319552.984794:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787520
00000100:00100000:2.0:1767319552.984812:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788160
00000100:00100000:2.0:1767319552.984814:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788160
00000100:00100000:2.0:1767319552.984822:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788416
00000100:00100000:2.0:1767319552.984825:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788416
00000100:00100000:2.0:1767319552.984835:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17052
00000100:00100000:2.0:1767319552.984840:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379787520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319552.984856:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319552.984910:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379787520:12345-0@lo:38:kworker.0 Request processed in 69us (286us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319552.984916:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17052
00000100:00100000:2.0:1767319552.984930:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17053
00000100:00100000:2.0:1767319552.984934:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379788160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319552.984942:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319552.984962:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379788160:12345-0@lo:38:kworker.0 Request processed in 27us (237us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319552.984968:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17053
00000100:00100000:2.0:1767319552.984976:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17054
00000100:00100000:2.0:1767319552.984980:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379788416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319552.984988:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319552.985004:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379788416:12345-0@lo:38:kworker.0 Request processed in 23us (240us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319552.985009:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17054
00000100:00080000:2.0:1767319552.985035:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319552.985040:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319552.985043:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379787520:0@lo:38:kworker.0
00000100:00080000:2.0:1767319552.985050:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319552.985053:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319552.985055:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379788160:0@lo:38:kworker.0
00000100:00080000:2.0:1767319552.985061:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319552.985064:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319552.985066:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379788416:0@lo:38:kworker.0
00000100:00100000:1.0:1767319552.985342:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379787648
00000100:00100000:1.0:1767319552.985347:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379787648
00000100:00100000:1.0:1767319552.985374:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3
00000100:00100000:1.0:1767319552.985379:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379787648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319552.985388:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319552.985427:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379787648:12345-0@lo:38:kworker.0 Request processed in 46us (752us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319552.985432:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3
00000100:00080000:3.0:1767319552.985502:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319552.985506:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319552.985510:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379787648:0@lo:38:kworker.0
00000100:00100000:0.0:1767319553.495151:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319553.495177:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379788544:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319553.495252:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319553.495434:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788544
00000100:00100000:1.0:1767319553.495444:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788544
00000100:00100000:1.0:1767319553.495505:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331
00000100:00100000:1.0:1767319553.495518:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379788544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319553.495567:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319553.495651:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379788544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (388us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319553.495660:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331
00000100:00100000:1.0:1767319553.495748:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379788544:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319553.496616:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319553.935074:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319553.935116:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319553.935176:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923840
00000100:00100000:0.0:1767319553.935187:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923840
00000100:00100000:1.0:1767319553.935217:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923712
00000100:00100000:1.0:1767319553.935226:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923712
00000100:00100000:1.0:1767319553.935271:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17055
00000100:00100000:1.0:1767319553.935279:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291923712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319553.935305:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319553.935306:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4314
00000100:00100000:3.0:1767319553.935322:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291923840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319553.935369:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291923712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 89us (251us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319553.935377:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17055
00000100:00100000:3.0:1767319553.935386:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291923840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 68us (319us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319553.935397:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4314
00000100:00080000:2.0:1767319553.935520:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319554.521208:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319555.543928:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319556.567066:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319557.079375:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379788672:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319557.079464:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319557.082029:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788672
00000100:00100000:2.0:1767319557.082044:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788672
00000100:00100000:2.0:1767319557.082130:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332
00000100:00100000:2.0:1767319557.082141:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379788672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319557.082176:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319557.082300:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379788672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (2835us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319557.082307:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332
00000100:00080000:1.0:1767319557.082377:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319557.082390:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379788672:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319557.591110:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319558.103334:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319558.103344:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319558.103349:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319558.103353:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319558.103357:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319558.103364:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4455
00000100:00080000:0.0:1767319558.103370:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319558.103376:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319558.103418:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec700 x1853164379788800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319558.103445:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319558.103449:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319558.103451:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319558.103455:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4455
00000100:00080000:0.0:1767319558.103457:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319558.103460:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319558.103476:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef480 x1853164379788928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319558.103556:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319558.103560:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319558.103562:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319558.103565:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4455
00000100:00080000:0.0:1767319558.103568:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319558.103571:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319558.103580:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ece00 x1853164379789440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319558.103599:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319558.103601:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319558.103603:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319558.103606:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4455
00000100:00080000:0.0:1767319558.103608:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319558.103610:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319558.103618:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eea00 x1853164379789696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319558.103745:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379788800:0@lo:38:kworker.0
00000100:00100000:2.0:1767319558.103833:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319558.103914:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379788928:0@lo:38:kworker.0
00000100:00100000:2.0:1767319558.103940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319558.103965:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379789440:0@lo:38:kworker.0
00000100:00100000:2.0:1767319558.103983:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319558.103996:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379789696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319558.104013:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319558.104049:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788928
00000100:00100000:2.0:1767319558.104056:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788928
00000100:00100000:2.0:1767319558.104090:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4
00000100:00100000:2.0:1767319558.104097:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379788928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319558.104128:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319558.104168:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379788928:12345-0@lo:38:kworker.0 Request processed in 70us (226us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319558.104175:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4
00000100:00100000:2.0:1767319558.104197:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379788800
00000100:00100000:2.0:1767319558.104200:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379788800
00000100:00100000:2.0:1767319558.104217:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789440
00000100:00100000:2.0:1767319558.104220:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789440
00000100:00100000:2.0:1767319558.104232:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789696
00000100:00100000:2.0:1767319558.104234:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789696
00000100:00100000:2.0:1767319558.104246:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17056
00000100:00100000:2.0:1767319558.104250:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379788800:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319558.104260:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319558.104282:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379788800:12345-0@lo:38:kworker.0 Request processed in 31us (449us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319558.104287:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17056
00000100:00100000:2.0:1767319558.104298:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17057
00000100:00100000:2.0:1767319558.104301:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379789440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319558.104309:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319558.104326:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379789440:12345-0@lo:38:kworker.0 Request processed in 23us (342us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319558.104334:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17057
00000100:00100000:2.0:1767319558.104345:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17058
00000100:00100000:2.0:1767319558.104349:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379789696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319558.104358:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319558.104376:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379789696:12345-0@lo:38:kworker.0 Request processed in 26us (362us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319558.104381:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17058
00000100:00080000:2.0:1767319558.104420:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319558.104424:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319558.104427:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379788800:0@lo:38:kworker.0
00000100:00080000:2.0:1767319558.104436:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319558.104439:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319558.104441:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379788928:0@lo:38:kworker.0
00000100:00080000:2.0:1767319558.104447:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319558.104450:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319558.104452:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379789440:0@lo:38:kworker.0
00000100:00080000:2.0:1767319558.104459:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319558.104462:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319558.104464:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379789696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319558.104759:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379789056:0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.104803:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319558.104833:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319558.104838:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379789568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.104859:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319558.104913:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379789184:0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.104935:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319558.104954:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319558.104959:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379789312:0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.104981:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319558.105003:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789568
00000100:00100000:1.0:1767319558.105007:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789568
00000100:00100000:1.0:1767319558.105044:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789312
00000100:00100000:1.0:1767319558.105047:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789312
00000100:00100000:1.0:1767319558.105065:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4315
00000100:00100000:1.0:1767319558.105070:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379789568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.105123:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379789568:12345-0@lo:400:kworker.0 Request processed in 52us (262us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319558.105129:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4315
00000100:00100000:1.0:1767319558.105146:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4316
00000100:00100000:1.0:1767319558.105152:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379789312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.105183:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379789312:12345-0@lo:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319558.105188:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4316
00000100:00100000:1.0:1767319558.105214:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789056
00000100:00100000:1.0:1767319558.105217:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789056
00000100:00100000:1.0:1767319558.105238:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789184
00000100:00100000:1.0:1767319558.105241:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789184
00000100:00100000:1.0:1767319558.105257:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559
00000100:00100000:1.0:1767319558.105262:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379789056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.105291:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379789056:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319558.105296:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559
00000100:00100000:1.0:1767319558.105306:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560
00000100:00100000:1.0:1767319558.105310:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379789184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.105335:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379789184:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319558.105339:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560
00000100:00080000:1.0:1767319558.105353:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319558.105357:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319558.105381:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379789312:0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.105389:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379789184:0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.105410:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379789568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319558.105418:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379789056:0@lo:400:kworker.0
00000100:00100000:3.0:1767319558.615697:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379789824:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319558.615763:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319558.615925:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789824
00000100:00100000:2.0:1767319558.615932:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789824
00000100:00100000:2.0:1767319558.615973:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333
00000100:00100000:2.0:1767319558.615979:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379789824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319558.616009:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319558.616063:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379789824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319558.616068:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333
00000100:00100000:1.0:1767319558.616138:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379789824:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319558.616780:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319559.062361:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319559.062487:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319559.063246:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291924096
00000100:00100000:0.0:1767319559.063256:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291924096
00000100:00100000:0.0:1767319559.063335:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291923968
00000100:00100000:0.0:1767319559.063339:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291923968
00000100:00100000:0.0:1767319559.063359:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4317
00000100:00100000:0.0:1767319559.063369:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291924096:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319559.063444:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291924096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 76us (1092us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319559.063453:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4317
00000100:00100000:0.0:1767319559.063484:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17059
00000100:00100000:0.0:1767319559.063489:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291923968:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319559.063517:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319559.063542:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291923968:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (1056us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319559.063548:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17059
00000100:00080000:1.0:1767319559.064226:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319559.639784:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319560.663195:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319561.687434:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319562.199443:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319562.199461:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379789952:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319562.199555:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319562.200326:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379789952
00000100:00100000:3.0:1767319562.200334:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379789952
00000100:00100000:3.0:1767319562.200411:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334
00000100:00100000:3.0:1767319562.200421:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379789952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319562.200449:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319562.200514:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379789952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (959us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319562.200522:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334
00000100:00100000:3.0:1767319562.200569:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379789952:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319562.201630:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319562.711546:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319563.224803:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319563.224814:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319563.224818:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319563.224823:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319563.224827:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319563.224835:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4460
00000100:00080000:3.0:1767319563.224849:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319563.224856:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319563.224922:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904380 x1853164379790080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319563.224949:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319563.224952:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319563.224966:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319563.224971:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4460
00000100:00080000:3.0:1767319563.224973:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319563.224977:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319563.224989:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379790208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319563.225060:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319563.225063:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319563.225065:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767319563.225067:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:3.0:1767319563.225069:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4460
00000100:00080000:3.0:1767319563.225072:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319563.225076:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319563.225082:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379790336:0@lo:400:kworker.0
00000100:00100000:3.0:1767319563.225087:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905880 x1853164379790720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319563.225101:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319563.225104:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319563.225106:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319563.225109:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4460
00000100:00080000:3.0:1767319563.225111:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319563.225115:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319563.225125:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905180 x1853164379790976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319563.225146:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379790464:0@lo:400:kworker.0
00000100:00100000:1.0:1767319563.225159:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319563.225199:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319563.225225:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379790848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319563.225462:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319563.225480:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379790592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319563.225574:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790336
00000100:00100000:0.0:1767319563.225581:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790336
00000100:00100000:0.0:1767319563.225619:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790464
00000100:00100000:0.0:1767319563.225622:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790464
00000100:00100000:0.0:1767319563.225653:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561
00000100:00100000:0.0:1767319563.225662:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379790336:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319563.225765:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319563.225782:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379790080:0@lo:38:kworker.0
00000100:00100000:1.0:1767319563.231206:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319563.231318:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562
00000100:00100000:1.0:1767319563.231338:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379790464:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319563.231540:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379790464:12345-0@lo:400:kworker.0 Request processed in 210us (6338us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319563.231550:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562
00000100:00100000:1.0:1767319563.231612:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790848
00000100:00100000:1.0:1767319563.231620:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790848
00000100:00100000:1.0:1767319563.231676:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4318
00000100:00100000:1.0:1767319563.231682:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379790848:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319563.231717:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379790848:12345-0@lo:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319563.231723:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4318
00000100:00100000:1.0:1767319563.231770:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379790848:0@lo:400:kworker.0
00000100:00080000:1.0:1767319563.231953:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319563.232808:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319563.232890:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790592
00000100:00100000:1.0:1767319563.232898:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790592
00000100:00100000:1.0:1767319563.232938:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4319
00000100:00100000:1.0:1767319563.232946:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379790592:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319563.234767:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379790336:12345-0@lo:400:kworker.0 Request processed in 9100us (9601us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319563.234781:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561
00000100:00080000:0.0:1767319563.234845:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319563.234910:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379790336:0@lo:400:kworker.0
00000100:00100000:3.0:1767319563.242407:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379790464:0@lo:400:kworker.0
00000100:00100000:2.0:1767319563.242485:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319563.242517:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379790208:0@lo:38:kworker.0
00000100:00100000:2.0:1767319563.242567:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319563.242600:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379790720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319563.242625:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319563.242665:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790080
00000100:00100000:0.0:1767319563.242673:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790080
00000100:00100000:0.0:1767319563.242710:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790720
00000100:00100000:0.0:1767319563.242712:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790720
00000100:00100000:0.0:1767319563.242737:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17060
00000100:00100000:0.0:1767319563.242745:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379790080:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319563.242745:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17061
00000100:00100000:2.0:1767319563.242749:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379790720:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319563.242765:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319563.242797:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790208
00000100:00100000:3.0:1767319563.242801:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790208
00000100:00100000:3.0:1767319563.242823:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5
00000100:00100000:3.0:1767319563.242827:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379790208:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319563.242916:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379790720:12345-0@lo:38:kworker.0 Request processed in 164us (289us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319563.242924:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17061
00000100:00080000:2.0:1767319563.242957:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319563.242962:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319563.242965:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379790720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319563.242974:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379790976:0@lo:38:kworker.0
00000100:00100000:2.0:1767319563.242997:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319563.243015:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379790976
00000100:00100000:2.0:1767319563.243018:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379790976
00000100:00100000:2.0:1767319563.243035:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17062
00000100:00100000:2.0:1767319563.243039:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379790976:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319563.249653:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379790592:12345-0@lo:400:kworker.0 Request processed in 16698us (16837us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319563.249668:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4319
00000100:00100000:1.0:1767319563.249791:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379790592:0@lo:400:kworker.0
00010000:00020000:0.0:1767319563.251733:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319563.251813:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379790080:12345-0@lo:38:kworker.0 Request processed in 9067us (9327us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319563.251823:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17060
00010000:00020000:3.0:1767319563.252488:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319563.252536:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379790208:12345-0@lo:38:kworker.0 Request processed in 9705us (9966us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319563.252545:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5
00000100:00080000:3.0:1767319563.252638:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319563.252644:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319563.252649:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379790080:0@lo:38:kworker.0
00000100:00080000:3.0:1767319563.252660:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319563.252663:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319563.252666:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379790208:0@lo:38:kworker.0
00010000:00020000:2.0:1767319563.256669:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319563.256970:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319563.256977:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319563.256982:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379790976:0@lo:38:kworker.0
00000100:00100000:2.0:1767319563.257437:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379790976:12345-0@lo:38:kworker.0 Request processed in 13732us (13775us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319563.257448:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17062
00000100:00100000:2.0:1767319563.735485:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319563.735514:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379791104:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319563.735774:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:0.0:1767319563.737497:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319563.751151:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379791104
00000100:00100000:3.0:1767319563.751167:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379791104
00000100:00100000:3.0:1767319563.751249:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335
00000100:00100000:3.0:1767319563.751260:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379791104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319563.751295:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319563.751411:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379791104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (15636us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319563.751418:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335
00000100:00100000:0.0:1767319563.751496:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379791104:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319564.176008:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319564.176187:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291924480
00000100:00100000:2.0:1767319564.176198:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291924480
00000100:00100000:2.0:1767319564.176298:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4320
00000100:00100000:2.0:1767319564.176307:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291924480:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319564.176391:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291924480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (392us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319564.176400:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4320
00000100:00080000:0.0:1767319564.177065:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767319564.177909:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291924224 offset 0 length 520: 4
00000100:00100000:2.0:1767319564.177943:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319564.178091:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291924352
00000100:00100000:1.0:1767319564.178099:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291924352
00000100:00100000:1.0:1767319564.178137:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17063
00000100:00100000:1.0:1767319564.178144:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291924352:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319564.178164:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319564.178231:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291924352:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 86us (288us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319564.178239:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17063
00010000:00010000:3.0:1767319564.759106:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319565.787953:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319566.807724:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319567.319033:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379791232:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319567.319101:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319567.319472:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379791232
00000100:00100000:3.0:1767319567.319480:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379791232
00000100:00100000:3.0:1767319567.319547:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336
00000100:00100000:3.0:1767319567.319556:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379791232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319567.319584:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319567.319637:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379791232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (534us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319567.319645:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336
00000100:00100000:2.0:1767319567.319684:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379791232:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319567.319812:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319567.383160:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319542/real 1767319542]  req@ffff8b0f2f28d180 x1853164379785856/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319567 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319567.383196:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f28d180 x1853164379785856/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319567 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319567.383216:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319567.383302:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319567.383307:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379785856:0@lo:250:kworker.0
00000100:00080000:2.0:1767319567.384778:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319567.384786:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319567.384789:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319567.384795:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4445
00000100:00080000:2.0:1767319567.384799:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319567.384805:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319567.384838:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164379791360/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319567.384865:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319567.384883:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319567.384885:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319567.384889:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4465
00000100:00080000:2.0:1767319567.384891:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319567.384895:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319567.384910:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21500 x1853164379791488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319567.384920:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319567.384923:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319567.384924:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319567.384928:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4465
00000100:00080000:2.0:1767319567.384930:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319567.384934:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319567.384945:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20700 x1853164379791616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319567.385032:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379791744:0@lo:400:kworker.0
00000100:00100000:3.0:1767319567.385053:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379791360:0@lo:250:kworker.0
00000400:00000100:3.0:1767319567.385088:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379791360 offset 0 length 520: 4
00000100:00100000:0.0:1767319567.385101:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319567.385134:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379791488:0@lo:38:kworker.0
00000100:00100000:3.0:1767319567.385159:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319567.385180:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379791616:0@lo:38:kworker.0
00000100:00080000:2.0:1767319567.385198:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319567.385204:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1767319567.385206:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319567.385208:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319567.385214:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4465
00000100:00080000:2.0:1767319567.385217:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319567.385222:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319567.385236:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21c00 x1853164379792000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319567.385243:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379791616
00000100:00100000:3.0:1767319567.385250:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379791616
00000100:00080000:2.0:1767319567.385259:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319567.385262:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319567.385264:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319567.385268:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4465
00000100:00080000:2.0:1767319567.385270:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319567.385275:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319567.385283:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6
00000100:00100000:2.0:1767319567.385288:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20000 x1853164379792256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319567.385293:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379791616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319567.385315:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319567.385329:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379791488
00000100:00100000:2.0:1767319567.385346:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379791488
00000100:00100000:3.0:1767319567.385350:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379791616:12345-0@lo:38:kworker.0 Request processed in 58us (144us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319567.385358:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6
00000100:00100000:2.0:1767319567.385380:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17064
00000100:00100000:2.0:1767319567.385386:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379791488:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319567.385397:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319567.385399:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379792128:0@lo:400:kworker.0
00000100:00100000:1.0:1767319567.385482:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379791744
00000100:00100000:1.0:1767319567.385487:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379791744
00000100:00100000:1.0:1767319567.385528:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563
00000100:00100000:1.0:1767319567.385535:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379791744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319567.385600:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379791488:12345-0@lo:38:kworker.0 Request processed in 212us (439us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319567.385608:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17064
00000100:00100000:2.0:1767319567.385631:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379792000:0@lo:38:kworker.0
00000100:00100000:2.0:1767319567.385655:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319567.385670:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379792256:0@lo:38:kworker.0
00000100:00100000:2.0:1767319567.385708:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319567.385737:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319567.385741:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319567.385744:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379791488:0@lo:38:kworker.0
00000100:00080000:2.0:1767319567.385753:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319567.385756:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319567.385759:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379791616:0@lo:38:kworker.0
00000100:00100000:2.0:1767319567.385784:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792000
00000100:00100000:2.0:1767319567.385788:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792000
00000100:00100000:2.0:1767319567.385802:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792256
00000100:00100000:2.0:1767319567.385805:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792256
00000100:00100000:2.0:1767319567.385818:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17065
00000100:00100000:2.0:1767319567.385822:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379792000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319567.385833:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319567.385862:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379792000:12345-0@lo:38:kworker.0 Request processed in 38us (206us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319567.385888:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17065
00000100:00100000:2.0:1767319567.385902:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17066
00000100:00100000:2.0:1767319567.385906:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379792256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319567.385915:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319567.385937:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379792256:12345-0@lo:38:kworker.0 Request processed in 29us (228us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319567.385942:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17066
00000100:00080000:2.0:1767319567.385963:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319567.385966:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319567.385970:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379792000:0@lo:38:kworker.0
00000100:00080000:2.0:1767319567.385977:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319567.385979:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319567.385982:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379792256:0@lo:38:kworker.0
00000100:00080000:2.0:1767319567.386035:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319567.386066:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379791872:0@lo:400:kworker.0
00000100:00100000:2.0:1767319567.386089:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319567.386114:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379791872
00000100:00100000:2.0:1767319567.386117:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379791872
00000100:00100000:2.0:1767319567.386158:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4321
00000100:00100000:2.0:1767319567.386163:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379791872:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319567.386195:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379791872:12345-0@lo:400:kworker.0 Request processed in 31us (105us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319567.386201:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4321
00000100:00080000:2.0:1767319567.386216:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319567.386232:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379791872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319567.392396:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379791744:12345-0@lo:400:kworker.0 Request processed in 6852us (7287us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319567.392411:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563
00000100:00100000:3.0:1767319567.392648:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319567.392893:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379791744:0@lo:400:kworker.0
00000100:00100000:2.0:1767319567.393161:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792128
00000100:00100000:2.0:1767319567.393168:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792128
00000100:00080000:0.0:1767319567.393228:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319567.393275:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4322
00000100:00100000:2.0:1767319567.393284:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379792128:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319567.393349:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379792128:12345-0@lo:400:kworker.0 Request processed in 67us (702us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319567.393356:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4322
00000100:00100000:0.0:1767319567.393399:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379792128:0@lo:400:kworker.0
00010000:00010000:0.0:1767319567.831085:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319568.855531:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379792384:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319568.855601:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1767319568.855743:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319568.857349:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792384
00000100:00100000:1.0:1767319568.857362:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792384
00000100:00100000:1.0:1767319568.857430:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337
00000100:00100000:1.0:1767319568.857440:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379792384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319568.857472:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319568.857549:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379792384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1946us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319568.857556:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337
00000100:00100000:0.0:1767319568.857827:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379792384:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319569.295227:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319569.295275:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319569.295528:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291924736
00000100:00100000:0.0:1767319569.295538:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291924736
00000100:00100000:0.0:1767319569.295627:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291924608
00000100:00100000:0.0:1767319569.295631:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291924608
00000100:00100000:0.0:1767319569.295655:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4323
00000100:00100000:0.0:1767319569.295664:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291924736:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319569.295737:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291924736:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (520us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319569.295744:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4323
00000100:00100000:0.0:1767319569.295764:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17067
00000100:00100000:0.0:1767319569.295769:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291924608:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319569.295790:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319569.295819:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291924608:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 48us (543us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319569.295827:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17067
00000100:00080000:1.0:1767319569.296033:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319569.879319:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319570.903136:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319571.927063:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319572.440780:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319572.440800:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379792512:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319572.440900:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319572.441205:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792512
00000100:00100000:1.0:1767319572.441215:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792512
00000100:00100000:1.0:1767319572.441283:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338
00000100:00100000:1.0:1767319572.441292:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379792512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319572.441320:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319572.441378:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379792512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (478us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319572.441394:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338
00000100:00100000:1.0:1767319572.441446:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379792512:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319572.441631:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319572.442470:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319572.442476:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319572.442478:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319572.442482:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319572.442486:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319572.442491:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4469
00000100:00080000:3.0:1767319572.442494:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319572.442511:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319572.442540:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904e00 x1853164379792640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319572.442566:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319572.442569:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319572.442571:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319572.442575:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4469
00000100:00080000:3.0:1767319572.442578:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319572.442580:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319572.442593:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906300 x1853164379792768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319572.442650:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319572.442653:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319572.442656:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319572.442659:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4469
00000100:00080000:3.0:1767319572.442662:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319572.442665:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319572.442678:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906d80 x1853164379793152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319572.442702:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319572.442705:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319572.442707:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319572.442710:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4469
00000100:00080000:3.0:1767319572.442712:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319572.442716:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319572.442727:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907100 x1853164379793408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319572.442750:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319572.442763:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379793280:0@lo:400:kworker.0
00000100:00100000:3.0:1767319572.442807:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319572.442851:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793280
00000100:00100000:3.0:1767319572.442858:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793280
00000100:00100000:3.0:1767319572.442940:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4324
00000100:00100000:3.0:1767319572.442948:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379793280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319572.442991:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379793280:12345-0@lo:400:kworker.0 Request processed in 44us (183us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319572.442999:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4324
00000100:00080000:3.0:1767319572.443020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319572.443045:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379793280:0@lo:400:kworker.0
00000100:00100000:1.0:1767319572.443209:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379793024:0@lo:400:kworker.0
00000100:00100000:1.0:1767319572.443240:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319572.443268:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319572.443274:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379792896:0@lo:400:kworker.0
00000100:00100000:1.0:1767319572.443301:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319572.443346:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792896
00000100:00100000:1.0:1767319572.443351:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792896
00000100:00100000:1.0:1767319572.443389:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564
00000100:00100000:1.0:1767319572.443396:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379792896:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319572.443431:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379792896:12345-0@lo:400:kworker.0 Request processed in 36us (130us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319572.443437:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564
00000100:00100000:1.0:1767319572.443465:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379792896:0@lo:400:kworker.0
00000100:00100000:2.0:1767319572.443539:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379792640:0@lo:38:kworker.0
00000100:00100000:2.0:1767319572.443568:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319572.443594:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379792768:0@lo:38:kworker.0
00000100:00100000:2.0:1767319572.443618:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319572.443639:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379793152:0@lo:38:kworker.0
00000100:00100000:2.0:1767319572.443702:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319572.443717:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379793408:0@lo:38:kworker.0
00000100:00100000:2.0:1767319572.443735:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319572.443768:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792768
00000100:00100000:2.0:1767319572.443772:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792768
00000100:00100000:2.0:1767319572.443793:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7
00000100:00100000:2.0:1767319572.443798:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379792768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319572.443813:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319572.443844:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379792768:12345-0@lo:38:kworker.0 Request processed in 45us (225us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319572.443850:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7
00000100:00080000:2.0:1767319572.443896:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319572.443901:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319572.443904:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379792768:0@lo:38:kworker.0
00000100:00100000:0.0:1767319572.444039:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793024
00000100:00100000:0.0:1767319572.444044:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793024
00000100:00100000:0.0:1767319572.444083:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379792640
00000100:00100000:0.0:1767319572.444086:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379792640
00000100:00100000:0.0:1767319572.444101:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793152
00000100:00100000:0.0:1767319572.444104:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793152
00000100:00100000:0.0:1767319572.444113:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793408
00000100:00100000:0.0:1767319572.444115:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793408
00000100:00100000:0.0:1767319572.444123:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4325
00000100:00100000:0.0:1767319572.444131:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379793024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319572.444172:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379793024:12345-0@lo:400:kworker.0 Request processed in 42us (931us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319572.444178:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4325
00000100:00100000:0.0:1767319572.444193:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17068
00000100:00100000:0.0:1767319572.444197:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379792640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319572.444208:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319572.444236:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379792640:12345-0@lo:38:kworker.0 Request processed in 37us (667us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319572.444242:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17068
00000100:00100000:0.0:1767319572.444254:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17069
00000100:00100000:0.0:1767319572.444257:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379793152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319572.444266:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319572.444292:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379793152:12345-0@lo:38:kworker.0 Request processed in 33us (589us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319572.444300:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17069
00000100:00100000:0.0:1767319572.444311:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17070
00000100:00100000:0.0:1767319572.444314:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379793408:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319572.444322:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319572.444344:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379793408:12345-0@lo:38:kworker.0 Request processed in 28us (608us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319572.444349:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17070
00000100:00100000:0.0:1767319572.444395:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379793024:0@lo:400:kworker.0
00000100:00080000:0.0:1767319572.444420:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319572.444424:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319572.444427:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379792640:0@lo:38:kworker.0
00000100:00080000:0.0:1767319572.444435:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319572.444437:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319572.444440:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379793152:0@lo:38:kworker.0
00000100:00080000:0.0:1767319572.444446:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319572.444449:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319572.444451:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379793408:0@lo:38:kworker.0
00000100:00080000:3.0:1767319572.445612:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319572.445621:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319572.951172:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319573.980410:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379793536:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319573.980490:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319573.981084:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793536
00000100:00100000:1.0:1767319573.981093:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793536
00000100:00100000:1.0:1767319573.981150:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339
00000100:00100000:1.0:1767319573.981160:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379793536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319573.981193:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319573.981294:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379793536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (803us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319573.981302:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339
00000100:00100000:0.0:1767319573.981516:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379793536:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319573.981805:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319574.418045:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319574.418145:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319574.421031:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291924992
00000100:00100000:2.0:1767319574.421050:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291924992
00000100:00100000:2.0:1767319574.421151:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291924864
00000100:00100000:2.0:1767319574.421156:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291924864
00000100:00100000:2.0:1767319574.421185:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4326
00000100:00100000:2.0:1767319574.421195:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291924992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319574.421404:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17071
00000100:00100000:1.0:1767319574.421413:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291924864:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319574.421453:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319574.421542:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291924992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 347us (3506us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319574.421550:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4326
00000100:00080000:0.0:1767319574.421732:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319574.422654:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291924864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1235us (4503us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319574.422664:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17071
00010000:00010000:3.0:1767319574.999492:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319576.023719:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319577.049356:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319577.559390:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319577.559409:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379793664:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319577.559478:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319577.559734:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793664
00000100:00100000:1.0:1767319577.559742:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793664
00000100:00100000:1.0:1767319577.559845:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340
00000100:00100000:1.0:1767319577.559855:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379793664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319577.559905:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319577.559972:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379793664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (492us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319577.559979:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340
00000100:00100000:3.0:1767319577.560382:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379793664:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319577.562330:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319577.562349:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319577.562352:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319577.562356:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319577.562359:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319577.562366:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319577.562370:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319577.562376:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319577.562413:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379793792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319577.562448:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319577.562452:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319577.562454:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319577.562458:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319577.562460:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319577.562464:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319577.562477:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19500 x1853164379793920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319577.562528:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319577.562531:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319577.562533:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319577.562537:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319577.562539:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319577.562543:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319577.562553:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18700 x1853164379794304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319577.562569:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319577.562572:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319577.562573:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319577.562576:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4474
00000100:00080000:1.0:1767319577.562579:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319577.562582:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319577.562587:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379793792:0@lo:38:kworker.0
00000100:00100000:1.0:1767319577.562590:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19f80 x1853164379794560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319577.562614:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379794432:0@lo:400:kworker.0
00000100:00100000:1.0:1767319577.562643:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319577.562647:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379794048:0@lo:400:kworker.0
00000100:00100000:3.0:1767319577.562671:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319577.562679:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319577.562685:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379794176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319577.562705:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319577.562733:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319577.562736:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794432
00000100:00100000:1.0:1767319577.562742:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794432
00000100:00100000:3.0:1767319577.562751:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379793920:0@lo:38:kworker.0
00000100:00100000:3.0:1767319577.562772:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319577.562792:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379794304:0@lo:38:kworker.0
00000100:00100000:2.0:1767319577.562811:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794048
00000100:00100000:3.0:1767319577.562813:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319577.562816:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794048
00000100:00100000:3.0:1767319577.562832:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379794560:0@lo:38:kworker.0
00000100:00100000:3.0:1767319577.562852:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319577.562903:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794176
00000100:00100000:3.0:1767319577.562907:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794176
00000100:00080000:0.0:1767319577.565552:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319577.565563:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319577.565566:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319577.565618:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793792
00000100:00100000:0.0:1767319577.565628:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793792
00000100:00100000:0.0:1767319577.565674:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794304
00000100:00100000:0.0:1767319577.565677:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794304
00000100:00100000:0.0:1767319577.565689:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794560
00000100:00100000:0.0:1767319577.565691:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794560
00000100:00100000:0.0:1767319577.565706:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17072
00000100:00100000:0.0:1767319577.565715:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379793792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319577.565738:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319577.565814:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379793792:12345-0@lo:38:kworker.0 Request processed in 99us (3079us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319577.565821:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17072
00000100:00100000:0.0:1767319577.565840:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17073
00000100:00100000:0.0:1767319577.565844:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379794304:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319577.565855:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319577.565894:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379794304:12345-0@lo:38:kworker.0 Request processed in 48us (3080us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319577.565899:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17073
00000100:00100000:0.0:1767319577.565910:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17074
00000100:00100000:0.0:1767319577.565914:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379794560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319577.566046:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319577.566074:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379794560:12345-0@lo:38:kworker.0 Request processed in 158us (3220us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319577.566082:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17074
00000100:00100000:0.0:1767319577.566125:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379793920
00000100:00100000:0.0:1767319577.566129:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379793920
00000100:00100000:0.0:1767319577.567105:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8
00000100:00100000:0.0:1767319577.567112:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379793920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319577.567125:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319577.567787:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379793920:12345-0@lo:38:kworker.0 Request processed in 672us (5011us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319577.567795:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8
00000100:00080000:0.0:1767319577.567919:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319577.568088:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4327
00000100:00100000:1.0:1767319577.568098:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379794432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319577.568481:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565
00000100:00100000:2.0:1767319577.568490:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379794048:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319577.568527:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319577.568531:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379794560:0@lo:38:kworker.0
00000100:00080000:0.0:1767319577.568549:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319577.568552:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319577.568555:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379793792:0@lo:38:kworker.0
00000100:00080000:0.0:1767319577.568565:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319577.568569:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319577.568572:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379793920:0@lo:38:kworker.0
00000100:00080000:0.0:1767319577.568580:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319577.568583:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319577.568585:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379794304:0@lo:38:kworker.0
00000100:00100000:0.0:1767319577.569216:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379794432:0@lo:400:kworker.0
00000100:00100000:2.0:1767319577.573916:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379794048:12345-0@lo:400:kworker.0 Request processed in 5416us (11232us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319577.573943:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565
00000100:00100000:0.0:1767319577.574228:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379794048:0@lo:400:kworker.0
00000100:00100000:3.0:1767319577.580014:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4328
00000100:00100000:3.0:1767319577.580032:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379794176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319577.580275:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379794176:12345-0@lo:400:kworker.0 Request processed in 248us (17567us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319577.580284:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4328
00000100:00100000:0.0:1767319577.580539:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379794176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319577.580676:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379794432:12345-0@lo:400:kworker.0 Request processed in 12578us (18029us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319577.580684:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4327
00010000:00010000:3.0:1767319578.076335:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319579.096691:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319579.096719:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379794688:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319579.096804:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319579.096912:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794688
00000100:00100000:1.0:1767319579.096923:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794688
00000100:00100000:1.0:1767319579.097266:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341
00000100:00100000:1.0:1767319579.097278:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379794688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319579.097308:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319579.097363:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379794688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (563us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319579.097371:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341
00000100:00100000:1.0:1767319579.097428:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379794688:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319579.097563:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319579.099748:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319579.537075:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319579.537181:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319579.537389:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291925248
00000100:00100000:0.0:1767319579.537399:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291925248
00000100:00100000:0.0:1767319579.537480:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291925120
00000100:00100000:0.0:1767319579.537484:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291925120
00000100:00100000:0.0:1767319579.537508:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4329
00000100:00100000:0.0:1767319579.537518:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291925248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319579.537596:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291925248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (532us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319579.537604:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4329
00000100:00100000:0.0:1767319579.537625:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17075
00000100:00100000:0.0:1767319579.537643:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291925120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319579.537664:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319579.537689:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291925120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (509us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319579.537695:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17075
00000100:00080000:2.0:1767319579.538423:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319580.119051:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319581.146398:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319582.173253:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319582.679241:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319582.679251:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319582.679254:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319582.679259:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319582.679264:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319582.679274:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319582.679283:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319582.679303:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319582.679337:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef480 x1853164379794944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319582.679352:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379794816:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319582.679371:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319582.679376:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319582.679378:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319582.679384:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319582.679388:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319582.679392:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319582.679413:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec700 x1853164379795072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319582.679416:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379794944:0@lo:38:kworker.0
00000100:00100000:2.0:1767319582.679464:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319582.679484:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319582.679489:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319582.679492:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319582.679499:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319582.679503:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319582.679507:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319582.679524:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319582.679531:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18700 x1853164379795584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319582.679570:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:0.0:1767319582.679574:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319582.679580:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379795072:0@lo:38:kworker.0
00000100:00080000:0.0:1767319582.679582:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767319582.679589:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379795712:0@lo:400:kworker.0
00000100:00080000:0.0:1767319582.679591:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319582.679607:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4479
00000100:00080000:0.0:1767319582.679613:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319582.679619:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319582.679638:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379795840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319582.679651:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319582.679661:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319582.679742:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794944
00000100:00100000:3.0:1767319582.679754:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794944
00000100:00100000:3.0:1767319582.679812:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795712
00000100:00100000:3.0:1767319582.679816:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795712
00000100:00100000:3.0:1767319582.679865:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4330
00000100:00100000:3.0:1767319582.679896:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379795712:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319582.680226:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379795328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.681917:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379795456:0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.681989:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319582.682095:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319582.682115:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795456
00000100:00100000:2.0:1767319582.682122:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795456
00000100:00100000:2.0:1767319582.682181:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4331
00000100:00100000:2.0:1767319582.682190:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379795456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.682250:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379795456:12345-0@lo:400:kworker.0 Request processed in 61us (261us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319582.682257:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4331
00000100:00100000:2.0:1767319582.682278:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17076
00000100:00100000:2.0:1767319582.682284:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379794944:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319582.682316:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319582.682351:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379794944:12345-0@lo:38:kworker.0 Request processed in 66us (2837us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319582.682358:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17076
00000100:00080000:2.0:1767319582.682911:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319582.682950:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379795456:0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.683917:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379795200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.683981:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319582.684069:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795200
00000100:00100000:2.0:1767319582.684077:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795200
00000100:00100000:2.0:1767319582.684320:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566
00000100:00100000:2.0:1767319582.684328:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379795200:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.684473:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379795200:12345-0@lo:400:kworker.0 Request processed in 145us (493us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319582.684481:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566
00000100:00080000:2.0:1767319582.684508:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319582.684535:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379795200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.684581:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379794816
00000100:00100000:2.0:1767319582.684586:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379794816
00000100:00100000:2.0:1767319582.684619:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342
00000100:00100000:2.0:1767319582.684625:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379794816:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319582.684652:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319582.684690:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379794816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (5230us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319582.684697:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342
00000100:00100000:2.0:1767319582.684732:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379794816:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319582.684760:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795072
00000100:00100000:2.0:1767319582.684764:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795072
00000100:00100000:2.0:1767319582.684788:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9
00000100:00100000:2.0:1767319582.684792:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379795072:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319582.684812:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319582.684842:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379795072:12345-0@lo:38:kworker.0 Request processed in 48us (5195us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319582.684848:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9
00000100:00080000:1.0:1767319582.690188:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319582.690208:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319582.690215:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379795072:0@lo:38:kworker.0
00000100:00100000:1.0:1767319582.690234:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379795584:0@lo:38:kworker.0
00000100:00100000:1.0:1767319582.690325:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319582.690351:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379795712:12345-0@lo:400:kworker.0 Request processed in 10455us (10693us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319582.690369:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4330
00000100:00100000:1.0:1767319582.690384:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795584
00000100:00100000:1.0:1767319582.690394:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795584
00000100:00100000:1.0:1767319582.690441:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17077
00000100:00100000:1.0:1767319582.690451:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379795584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319582.690491:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319582.690506:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319582.690732:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795328
00000100:00100000:3.0:1767319582.690736:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795328
00000100:00100000:3.0:1767319582.691062:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567
00000100:00100000:3.0:1767319582.691072:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379795328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319582.691309:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379795712:0@lo:400:kworker.0
00000100:00080000:2.0:1767319582.691360:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319582.691527:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379795328:12345-0@lo:400:kworker.0 Request processed in 457us (1022us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319582.691640:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567
00000100:00100000:0.0:1767319582.692262:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379795328:0@lo:400:kworker.0
00000100:00080000:0.0:1767319582.692352:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319582.692361:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319582.692365:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379794944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319582.692404:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379795840:0@lo:38:kworker.0
00000100:00100000:1.0:1767319582.692416:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379795584:12345-0@lo:38:kworker.0 Request processed in 1963us (2089us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319582.692429:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17077
00000100:00100000:0.0:1767319582.692451:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319582.692530:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319582.692544:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319582.692547:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379795584:0@lo:38:kworker.0
00000100:00100000:1.0:1767319582.693329:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795840
00000100:00100000:1.0:1767319582.693339:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795840
00000100:00100000:1.0:1767319582.693395:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17078
00000100:00100000:1.0:1767319582.693403:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379795840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319582.693436:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319582.694716:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379795840:12345-0@lo:38:kworker.0 Request processed in 1304us (2258us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319582.694729:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17078
00000100:00080000:0.0:1767319582.695016:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319582.695023:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319582.695028:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379795840:0@lo:38:kworker.0
00010000:00010000:3.0:1767319583.198789:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319584.215737:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379795968:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319584.215861:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319584.217116:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379795968
00000100:00100000:2.0:1767319584.217133:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379795968
00000100:00100000:2.0:1767319584.217249:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343
00000100:00100000:2.0:1767319584.217262:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379795968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319584.217319:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319584.217416:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379795968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (1554us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319584.217424:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343
00010000:00010000:0.0:1767319584.218349:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319584.219073:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319584.219162:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379795968:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319584.719431:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319584.719693:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291925376
00000100:00100000:3.0:1767319584.719706:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291925376
00000100:00100000:3.0:1767319584.719779:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17079
00000100:00100000:3.0:1767319584.719789:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291925376:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319584.719819:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319584.719942:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291925376:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 151us (983us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319584.720190:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319584.720320:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291925504
00000100:00100000:2.0:1767319584.720326:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291925504
00000100:00080000:0.0:1767319584.720453:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319584.721857:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17079
00000100:00100000:2.0:1767319584.723312:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4332
00000100:00100000:2.0:1767319584.723339:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291925504:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319584.723472:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291925504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 148us (3282us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319584.723480:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4332
00010000:00010000:3.0:1767319585.239332:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319586.263322:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319587.287961:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319587.799038:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319587.799051:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319587.799055:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319587.799061:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319587.799067:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319587.799077:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4485
00000100:00080000:0.0:1767319587.799083:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319587.799091:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319587.799143:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379796096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319587.799161:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319587.799164:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319587.799167:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319587.799171:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4485
00000100:00080000:0.0:1767319587.799173:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319587.799177:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319587.799189:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18700 x1853164379796224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319587.799257:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319587.799260:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319587.799262:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319587.799266:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4485
00000100:00080000:0.0:1767319587.799268:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319587.799272:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319587.799283:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef480 x1853164379796736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319587.799309:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319587.799312:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319587.799314:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319587.799318:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4485
00000100:00080000:0.0:1767319587.799321:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319587.799324:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319587.799336:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680e00 x1853164379796992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319587.799385:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379796352:0@lo:400:kworker.0
00000100:00100000:0.0:1767319587.799476:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319587.799514:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379796608:0@lo:400:kworker.0
00000100:00100000:0.0:1767319587.799547:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319587.799553:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379796864:0@lo:400:kworker.0
00000100:00100000:0.0:1767319587.799581:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319587.799634:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319587.799658:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319587.799666:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379796480:0@lo:400:kworker.0
00000100:00100000:2.0:1767319587.799687:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319587.799816:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796352
00000100:00100000:2.0:1767319587.799826:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796352
00000100:00100000:1.0:1767319587.800336:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379797120:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319587.800375:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319587.800432:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379797120
00000100:00100000:1.0:1767319587.800438:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379797120
00000100:00080000:0.0:1767319587.802557:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319587.812510:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379796096:0@lo:38:kworker.0
00000100:00100000:3.0:1767319587.812638:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319587.812711:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379796224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319587.812748:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319587.812752:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344
00000100:00100000:1.0:1767319587.812774:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7020:x1853164379797120:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319587.812781:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379796736:0@lo:38:kworker.0
00000100:00100000:3.0:1767319587.812802:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319587.812819:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379796992:0@lo:38:kworker.0
00002000:00000024:1.0:1767319587.812823:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319587.812852:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319587.812894:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7020:x1853164379797120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (12517us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319587.812902:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344
00000100:00100000:3.0:1767319587.812927:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796864
00000100:00100000:3.0:1767319587.812937:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796864
00000100:00100000:3.0:1767319587.812995:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796608
00000100:00100000:3.0:1767319587.812999:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796608
00000100:00100000:3.0:1767319587.813016:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796096
00000100:00100000:3.0:1767319587.813019:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796096
00000100:00100000:3.0:1767319587.813029:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796736
00000100:00100000:3.0:1767319587.813031:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796736
00000100:00100000:3.0:1767319587.813039:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796992
00000100:00100000:3.0:1767319587.813041:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796992
00000100:00100000:3.0:1767319587.813051:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4333
00000100:00100000:3.0:1767319587.813057:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379796864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319587.813097:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379796864:12345-0@lo:400:kworker.0 Request processed in 40us (13514us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319587.813104:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4333
00000100:00100000:3.0:1767319587.813117:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4334
00000100:00100000:3.0:1767319587.813123:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379796608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319587.813159:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379796608:12345-0@lo:400:kworker.0 Request processed in 36us (13524us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319587.813165:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4334
00000100:00100000:3.0:1767319587.813176:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17080
00000100:00100000:3.0:1767319587.813180:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379796096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319587.813201:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319587.813235:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379796096:12345-0@lo:38:kworker.0 Request processed in 53us (599us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319587.813236:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379797120:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319587.813251:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17080
00000100:00100000:3.0:1767319587.813263:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17081
00000100:00100000:1.0:1767319587.813267:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379796864:0@lo:400:kworker.0
00000100:00100000:3.0:1767319587.813267:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379796736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319587.813277:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319587.813299:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379796736:12345-0@lo:38:kworker.0 Request processed in 31us (496us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319587.813305:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17081
00000100:00100000:3.0:1767319587.813314:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17082
00000100:00100000:3.0:1767319587.813317:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379796992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319587.813326:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319587.813347:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379796992:12345-0@lo:38:kworker.0 Request processed in 27us (494us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319587.813352:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17082
00000100:00100000:1.0:1767319587.813366:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796224
00000100:00100000:1.0:1767319587.813370:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796224
00000100:00080000:3.0:1767319587.813373:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319587.813379:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319587.813383:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379796096:0@lo:38:kworker.0
00000100:00080000:3.0:1767319587.813392:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319587.813393:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10
00000100:00080000:3.0:1767319587.813395:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319587.813397:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379796224:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319587.813398:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379796736:0@lo:38:kworker.0
00000100:00080000:3.0:1767319587.813405:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00010000:00020000:1.0:1767319587.813481:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319587.813572:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379796480
00000100:00100000:2.0:1767319587.813578:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379796480
00000100:00080000:3.0:1767319587.814151:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319587.814159:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379796992:0@lo:38:kworker.0
00000100:00080000:3.0:1767319587.814194:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319587.814199:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319587.814202:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379796224:0@lo:38:kworker.0
00000100:00100000:3.0:1767319587.814257:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379796608:0@lo:400:kworker.0
00000100:00100000:1.0:1767319587.814522:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379796224:12345-0@lo:38:kworker.0 Request processed in 111us (760us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319587.814531:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10
00000100:00080000:1.0:1767319587.814579:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319587.814585:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319587.816991:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568
00000100:00100000:2.0:1767319587.817026:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379796352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319587.817159:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379796352:12345-0@lo:400:kworker.0 Request processed in 153us (17683us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319587.817168:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568
00000100:00100000:2.0:1767319587.817190:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569
00000100:00100000:2.0:1767319587.817199:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379796480:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319587.817251:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379796480:12345-0@lo:400:kworker.0 Request processed in 44us (17552us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319587.817259:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569
00000100:00100000:2.0:1767319587.817436:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379796480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319587.817937:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379796352:0@lo:400:kworker.0
00010000:00010000:3.0:1767319588.311278:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767319588.819295:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291925632 offset 0 length 520: 4
00000100:00100000:2.0:1767319588.819373:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319588.819404:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319588.819498:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291925888
00000100:00100000:1.0:1767319588.819511:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291925888
00000100:00100000:1.0:1767319588.819617:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291925760
00000100:00100000:1.0:1767319588.819621:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291925760
00000100:00100000:1.0:1767319588.819645:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4335
00000100:00100000:1.0:1767319588.819657:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291925888:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319588.819764:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291925888:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 108us (389us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319588.819772:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4335
00000100:00100000:1.0:1767319588.819796:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17083
00000100:00100000:1.0:1767319588.819800:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291925760:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319588.819821:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319588.819842:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291925760:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (438us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319588.819846:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17083
00000100:00080000:2.0:1767319588.820327:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319589.335638:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319589.335661:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379797248:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319589.335729:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319589.335764:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319589.338742:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379797248
00000100:00100000:3.0:1767319589.338764:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379797248
00000100:00100000:3.0:1767319589.339028:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345
00000100:00100000:3.0:1767319589.339042:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379797248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319589.339086:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319589.339201:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379797248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (3436us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319589.339209:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345
00000100:00100000:0.0:1767319589.340373:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379797248:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319589.341715:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319590.362556:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319591.384939:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319592.409527:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319592.919023:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319567/real 1767319567]  req@ffff8b0e0dc23100 x1853164379791360/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319592.919062:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0dc23100 x1853164379791360/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319592.919084:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319592.919322:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319592.919340:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379797376:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319592.919411:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319592.921112:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379797376
00000100:00100000:2.0:1767319592.921131:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379797376
00000100:00100000:2.0:1767319592.921282:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346
00000100:00100000:2.0:1767319592.921293:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379797376:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319592.921331:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319592.921408:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379797376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (1997us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319592.921416:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346
00000100:00080000:3.0:1767319592.921636:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319592.921697:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379797376:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319592.925395:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319592.925429:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767319592.925434:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319592.925444:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4469
00000100:00080000:1.0:1767319592.925449:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319592.925458:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319592.925508:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe300 x1853164379797504/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319592.925530:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319592.925533:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319592.925535:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319592.925538:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4490
00000100:00080000:1.0:1767319592.925541:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319592.925544:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319592.925561:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe680 x1853164379797632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319592.925570:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319592.925572:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319592.925574:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319592.925577:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4490
00000100:00080000:1.0:1767319592.925579:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319592.925582:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319592.925593:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fdc00 x1853164379797760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319592.925728:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379797888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319592.925819:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319592.925961:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379797888
00000100:00100000:3.0:1767319592.925969:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379797888
00000100:00100000:3.0:1767319592.926054:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570
00000100:00100000:3.0:1767319592.926065:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379797888:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319592.933763:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319592.933776:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379791360:0@lo:250:kworker.0
00000100:00100000:0.0:1767319592.933821:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379797504:0@lo:250:kworker.0
00000400:00000100:0.0:1767319592.933894:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379797504 offset 0 length 520: 4
00000100:00100000:0.0:1767319592.933934:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379797632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319592.933966:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319592.934003:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379797760:0@lo:38:kworker.0
00000100:00100000:0.0:1767319592.934026:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319592.934072:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379797760
00000100:00100000:0.0:1767319592.934080:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379797760
00000100:00100000:0.0:1767319592.934116:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11
00000100:00100000:0.0:1767319592.934123:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379797760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319592.934948:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319592.935001:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379797760:12345-0@lo:38:kworker.0 Request processed in 876us (972us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319592.935009:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11
00000100:00080000:0.0:1767319592.935061:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319592.935066:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319592.935070:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379797760:0@lo:38:kworker.0
00000100:00100000:0.0:1767319592.935116:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379798016:0@lo:400:kworker.0
00000100:00100000:0.0:1767319592.935142:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319592.935207:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379797632
00000100:00100000:0.0:1767319592.935212:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379797632
00000100:00100000:0.0:1767319592.935235:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798016
00000100:00100000:0.0:1767319592.935238:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798016
00000100:00100000:0.0:1767319592.935271:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4336
00000100:00100000:0.0:1767319592.935279:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379798016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319592.935322:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379798016:12345-0@lo:400:kworker.0 Request processed in 45us (178us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319592.935328:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4336
00000100:00100000:0.0:1767319592.935343:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17084
00000100:00100000:0.0:1767319592.935347:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379797632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319592.935360:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319592.935385:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379797632:12345-0@lo:38:kworker.0 Request processed in 36us (1419us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319592.935392:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17084
00000100:00100000:0.0:1767319592.935419:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379798016:0@lo:400:kworker.0
00000100:00080000:0.0:1767319592.935438:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319592.935442:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319592.935445:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379797632:0@lo:38:kworker.0
00000100:00080000:0.0:1767319592.935497:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319592.935503:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319592.941968:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379797888:12345-0@lo:400:kworker.0 Request processed in 15895us (16138us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319592.941984:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570
00000100:00080000:1.0:1767319592.942307:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319592.942313:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319592.942317:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319592.942323:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4490
00000100:00080000:1.0:1767319592.942328:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319592.942333:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319592.942375:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc700 x1853164379798144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319592.942492:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319592.942496:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319592.942498:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319592.942501:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4490
00000100:00080000:1.0:1767319592.942504:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319592.942508:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319592.942520:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fdf80 x1853164379798400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319592.942570:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319592.942584:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379798272:0@lo:400:kworker.0
00000100:00100000:1.0:1767319592.942657:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319592.942698:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798272
00000100:00100000:1.0:1767319592.942704:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798272
00000100:00100000:1.0:1767319592.942771:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4337
00000100:00100000:1.0:1767319592.942780:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379798272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319592.942827:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379798272:12345-0@lo:400:kworker.0 Request processed in 48us (169us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319592.942833:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4337
00000100:00100000:1.0:1767319592.942894:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379798272:0@lo:400:kworker.0
00000100:00080000:1.0:1767319592.942916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319592.945265:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379798144:0@lo:38:kworker.0
00000100:00100000:0.0:1767319592.945383:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319592.945430:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379798400:0@lo:38:kworker.0
00000100:00100000:0.0:1767319592.945451:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319592.945795:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798144
00000100:00100000:3.0:1767319592.945804:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798144
00000100:00100000:3.0:1767319592.945843:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798400
00000100:00100000:3.0:1767319592.945847:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798400
00000100:00100000:3.0:1767319592.945897:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17085
00000100:00100000:3.0:1767319592.945905:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379798144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319592.945927:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319592.945943:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17086
00000100:00100000:0.0:1767319592.945950:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379798400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319592.945962:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319592.946100:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379798144:12345-0@lo:38:kworker.0 Request processed in 193us (715us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319592.946108:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17085
00000100:00100000:0.0:1767319592.948327:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379798400:12345-0@lo:38:kworker.0 Request processed in 2366us (2866us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319592.948344:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17086
00000100:00080000:1.0:1767319592.948380:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319592.948388:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319592.948394:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379798144:0@lo:38:kworker.0
00000100:00080000:1.0:1767319592.948407:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319592.948411:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319592.948414:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379798400:0@lo:38:kworker.0
00000100:00100000:2.0:1767319592.955884:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379797888:0@lo:400:kworker.0
00010000:00010000:3.0:1767319593.431306:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319593.875767:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319593.875841:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319593.875936:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926144
00000100:00100000:1.0:1767319593.875947:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926144
00000100:00100000:1.0:1767319593.876040:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926016
00000100:00100000:1.0:1767319593.876045:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926016
00000100:00100000:1.0:1767319593.876068:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4338
00000100:00100000:1.0:1767319593.876078:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291926144:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319593.876159:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291926144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (405us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319593.876169:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4338
00000100:00100000:1.0:1767319593.876207:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17087
00000100:00100000:1.0:1767319593.876211:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291926016:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:0.0:1767319593.876377:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767319593.876745:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319593.876833:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291926016:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 618us (990us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319593.876842:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17087
00010000:00010000:3.0:1767319594.455405:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319594.455897:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319594.455935:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379798528:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319594.456035:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319594.456391:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798528
00000100:00100000:1.0:1767319594.456409:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798528
00000100:00100000:1.0:1767319594.456511:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347
00000100:00100000:1.0:1767319594.456525:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379798528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319594.457226:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319594.457374:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379798528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 851us (1337us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319594.457383:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347
00000100:00100000:2.0:1767319594.457657:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379798528:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319594.461753:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319595.481553:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319596.503207:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319597.527414:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319598.039245:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379798656:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319598.039355:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319598.039541:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798656
00000100:00100000:0.0:1767319598.039550:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798656
00000100:00100000:0.0:1767319598.039615:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348
00000100:00100000:0.0:1767319598.039624:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379798656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319598.039653:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767319598.039843:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319598.039857:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319598.039862:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319598.039865:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319598.039887:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319598.039891:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319598.039896:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4495
00000100:00080000:3.0:1767319598.039900:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319598.039905:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319598.039929:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164379798784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319598.039956:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319598.039960:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319598.039962:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319598.039966:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4495
00000100:00080000:3.0:1767319598.039969:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319598.039972:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319598.039995:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379798912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319598.040061:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379799040:0@lo:400:kworker.0
00000100:00100000:1.0:1767319598.040121:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319598.040174:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379798784:0@lo:38:kworker.0
00000100:00100000:1.0:1767319598.040202:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319598.040221:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379798912:0@lo:38:kworker.0
00000100:00100000:1.0:1767319598.040244:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319598.040293:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798912
00000100:00100000:1.0:1767319598.040298:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798912
00000100:00100000:1.0:1767319598.040334:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12
00000100:00100000:1.0:1767319598.040340:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379798912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319598.040358:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319598.040395:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379798912:12345-0@lo:38:kworker.0 Request processed in 54us (150us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319598.040402:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12
00000100:00100000:1.0:1767319598.040432:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379798784
00000100:00100000:1.0:1767319598.040435:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379798784
00000100:00100000:1.0:1767319598.040453:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17088
00000100:00100000:1.0:1767319598.040457:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379798784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319598.040466:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319598.040494:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379798784:12345-0@lo:38:kworker.0 Request processed in 35us (291us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319598.040500:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17088
00000100:00080000:1.0:1767319598.040530:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319598.040534:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319598.040538:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379798784:0@lo:38:kworker.0
00000100:00080000:1.0:1767319598.040546:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319598.040549:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319598.040552:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379798912:0@lo:38:kworker.0
00000100:00100000:1.0:1767319598.040593:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799040
00000100:00100000:1.0:1767319598.040596:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799040
00000100:00100000:1.0:1767319598.040631:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571
00000100:00100000:1.0:1767319598.040638:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379799040:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319598.040676:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379799040:12345-0@lo:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319598.040686:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571
00000100:00080000:1.0:1767319598.040701:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319598.040719:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379799040:0@lo:400:kworker.0
00000100:00100000:0.0:1767319598.041628:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379798656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2000us (2267us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319598.041639:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348
00000100:00100000:2.0:1767319598.041769:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379798656:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319598.041955:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379799168:0@lo:400:kworker.0
00000100:00100000:2.0:1767319598.042006:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319598.042064:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799168
00000100:00100000:1.0:1767319598.042070:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799168
00000100:00100000:1.0:1767319598.042126:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4339
00000100:00100000:1.0:1767319598.042135:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379799168:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319598.042271:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319598.042586:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319598.042591:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319598.042594:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319598.042598:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4495
00000100:00080000:3.0:1767319598.042603:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319598.042607:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319598.042629:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164379799296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319598.042665:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319598.042668:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319598.042670:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319598.042674:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4495
00000100:00080000:3.0:1767319598.042677:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319598.042681:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319598.042692:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0de300 x1853164379799552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319598.042715:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379799424:0@lo:400:kworker.0
00000100:00100000:3.0:1767319598.042745:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319598.042779:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799424
00000100:00100000:3.0:1767319598.042783:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799424
00000100:00100000:3.0:1767319598.042838:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4340
00000100:00100000:3.0:1767319598.042845:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379799424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319598.042903:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379799424:12345-0@lo:400:kworker.0 Request processed in 59us (157us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319598.042910:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4340
00000100:00100000:3.0:1767319598.042938:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379799424:0@lo:400:kworker.0
00000100:00080000:3.0:1767319598.042952:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319598.043028:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379799296:0@lo:38:kworker.0
00000100:00100000:0.0:1767319598.043057:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319598.043082:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379799552:0@lo:38:kworker.0
00000100:00100000:0.0:1767319598.043102:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319598.043218:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799296
00000100:00100000:3.0:1767319598.043223:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799296
00000100:00100000:3.0:1767319598.043254:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799552
00000100:00100000:3.0:1767319598.043257:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799552
00000100:00100000:3.0:1767319598.043275:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17089
00000100:00100000:3.0:1767319598.043279:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379799296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319598.043298:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319598.043350:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379799296:12345-0@lo:38:kworker.0 Request processed in 69us (292us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319598.043357:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17089
00000100:00100000:3.0:1767319598.043369:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17090
00000100:00100000:3.0:1767319598.043373:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379799552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319598.043382:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319598.043405:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379799552:12345-0@lo:38:kworker.0 Request processed in 31us (302us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319598.043411:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17090
00000100:00080000:0.0:1767319598.043564:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319598.043570:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319598.043573:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379799296:0@lo:38:kworker.0
00000100:00080000:0.0:1767319598.043581:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319598.043584:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319598.043586:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379799552:0@lo:38:kworker.0
00000100:00100000:1.0:1767319598.043735:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379799168:12345-0@lo:400:kworker.0 Request processed in 1600us (1727us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319598.043742:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4339
00000100:00100000:2.0:1767319598.043947:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379799168:0@lo:400:kworker.0
00010000:00010000:3.0:1767319598.551137:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319598.999013:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319598.999108:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319598.999512:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926272
00000100:00100000:1.0:1767319598.999521:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926272
00000100:00100000:1.0:1767319598.999567:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926400
00000100:00100000:1.0:1767319598.999570:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926400
00000100:00100000:3.0:1767319598.999660:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17091
00000100:00100000:3.0:1767319598.999669:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291926272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319598.999691:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319598.999776:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291926272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 106us (773us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319598.999783:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17091
00000100:00100000:1.0:1767319599.000264:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4341
00000100:00100000:1.0:1767319599.000271:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291926400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319599.000326:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291926400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 55us (1217us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319599.000334:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4341
00000100:00080000:0.0:1767319599.001688:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319599.575694:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00010000:00010000:2.0:1767319599.576095:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319599.576163:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379799680:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319599.576314:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319599.576506:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799680
00000100:00100000:0.0:1767319599.576657:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799680
00000100:00100000:0.0:1767319599.576750:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349
00000100:00100000:0.0:1767319599.576759:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379799680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319599.576837:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319599.576917:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379799680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (602us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319599.576925:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349
00000100:00100000:3.0:1767319599.577013:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379799680:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319600.599172:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319601.623843:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319602.647243:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319603.159087:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319603.159098:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319603.159113:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319603.159118:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319603.159122:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319603.159155:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4500
00000100:00080000:3.0:1767319603.159169:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319603.159191:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319603.159242:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379799808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319603.159272:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319603.159276:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319603.159278:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319603.159282:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4500
00000100:00080000:3.0:1767319603.159285:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319603.159289:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319603.159303:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0de300 x1853164379799936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319603.159364:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319603.159367:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319603.159369:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319603.159373:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4500
00000100:00080000:3.0:1767319603.159376:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319603.159379:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319603.159391:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379800448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319603.159404:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319603.159407:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319603.159419:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319603.159422:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4500
00000100:00080000:3.0:1767319603.159425:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319603.159441:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319603.159455:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90700 x1853164379800704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319603.159485:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379800320:0@lo:400:kworker.0
00000100:00100000:3.0:1767319603.159562:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319603.159667:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319603.159674:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379800192:0@lo:400:kworker.0
00000100:00100000:3.0:1767319603.159719:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319603.159748:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379800576:0@lo:400:kworker.0
00000100:00100000:3.0:1767319603.159764:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800320
00000100:00100000:2.0:1767319603.159788:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319603.159788:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800320
00000100:00100000:2.0:1767319603.159810:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319603.159815:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379800064:0@lo:400:kworker.0
00000100:00100000:2.0:1767319603.159833:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319603.159846:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800576
00000100:00100000:3.0:1767319603.159850:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800576
00000100:00100000:2.0:1767319603.159935:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4342
00000100:00100000:2.0:1767319603.159944:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379800320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319603.160006:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379800320:12345-0@lo:400:kworker.0 Request processed in 63us (443us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319603.160013:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4342
00000100:00100000:2.0:1767319603.160032:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4343
00000100:00100000:2.0:1767319603.160038:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379800576:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319603.160065:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379800576:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319603.160070:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4343
00000100:00100000:2.0:1767319603.160113:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379800576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319603.160131:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319603.160137:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379800832:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319603.160159:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319603.160196:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800832
00000100:00100000:2.0:1767319603.160200:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800832
00000100:00100000:2.0:1767319603.160226:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350
00000100:00100000:2.0:1767319603.160232:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379800832:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319603.160267:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319603.160302:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379800832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319603.160308:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350
00000100:00100000:2.0:1767319603.160336:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379800832:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319603.160398:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379800320:0@lo:400:kworker.0
00000100:00100000:1.0:1767319603.160399:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800192
00000100:00100000:1.0:1767319603.160403:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800192
00000100:00100000:2.0:1767319603.160421:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800064
00000100:00100000:2.0:1767319603.160425:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800064
00000100:00100000:1.0:1767319603.160432:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572
00000100:00100000:1.0:1767319603.160438:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379800192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319603.160443:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573
00000100:00100000:2.0:1767319603.160448:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379800064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319603.160477:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379800064:12345-0@lo:400:kworker.0 Request processed in 28us (643us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319603.160483:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573
00000100:00100000:1.0:1767319603.160487:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379800192:12345-0@lo:400:kworker.0 Request processed in 50us (768us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319603.160496:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572
00000100:00100000:2.0:1767319603.160508:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379800064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319603.160538:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379800192:0@lo:400:kworker.0
00000100:00100000:0.0:1767319603.161455:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379799808:0@lo:38:kworker.0
00000100:00100000:0.0:1767319603.161501:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319603.161668:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379799936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319603.165687:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799808
00000100:00100000:3.0:1767319603.165704:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799808
00000100:00100000:3.0:1767319603.165779:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17092
00000100:00100000:3.0:1767319603.165787:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379799808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319603.165809:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767319603.165912:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319603.165919:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319603.165922:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319603.170448:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379799808:12345-0@lo:38:kworker.0 Request processed in 4650us (8935us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319603.170464:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17092
00000100:00100000:0.0:1767319603.171425:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319603.171478:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379800448:0@lo:38:kworker.0
00000100:00100000:0.0:1767319603.171516:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319603.171609:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379799936
00000100:00100000:1.0:1767319603.171617:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379799936
00000100:00100000:1.0:1767319603.171667:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13
00000100:00100000:1.0:1767319603.171674:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379799936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319603.171696:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319603.171737:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379799936:12345-0@lo:38:kworker.0 Request processed in 62us (313us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319603.171744:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13
00000100:00100000:0.0:1767319603.171908:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379800704:0@lo:38:kworker.0
00000100:00100000:0.0:1767319603.171933:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319603.173230:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319603.173240:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319603.173245:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379799808:0@lo:38:kworker.0
00000100:00080000:0.0:1767319603.173257:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319603.173259:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319603.173262:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379799936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319603.176407:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800448
00000100:00100000:3.0:1767319603.176507:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800448
00000100:00100000:3.0:1767319603.176566:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800704
00000100:00100000:3.0:1767319603.176569:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800704
00000100:00100000:3.0:1767319603.176697:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17093
00000100:00100000:3.0:1767319603.176705:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379800448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319603.176729:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319603.176837:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379800448:12345-0@lo:38:kworker.0 Request processed in 131us (5318us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319603.176843:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17093
00000100:00100000:3.0:1767319603.176859:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17094
00000100:00100000:3.0:1767319603.176863:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379800704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319603.176889:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319603.176916:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379800704:12345-0@lo:38:kworker.0 Request processed in 50us (4981us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319603.176921:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17094
00000100:00080000:1.0:1767319603.179171:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319603.179185:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319603.179189:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379800448:0@lo:38:kworker.0
00000100:00080000:1.0:1767319603.179202:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319603.179205:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319603.179208:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379800704:0@lo:38:kworker.0
00010000:00010000:2.0:1767319603.671743:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319604.112124:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319604.113608:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319604.116351:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926528
00000100:00100000:2.0:1767319604.116368:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926528
00000100:00100000:2.0:1767319604.116422:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926656
00000100:00100000:2.0:1767319604.116425:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926656
00000100:00100000:2.0:1767319604.116550:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4344
00000100:00100000:2.0:1767319604.116572:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291926656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319604.116654:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291926656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 94us (3052us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319604.116662:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4344
00000100:00100000:2.0:1767319604.116682:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17095
00000100:00100000:2.0:1767319604.116686:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291926528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319604.116718:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319604.116747:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291926528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (4633us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319604.116753:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17095
00000100:00080000:1.0:1767319604.116835:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319604.695312:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319604.701796:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319604.701820:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379800960:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319604.701908:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319604.702675:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379800960
00000100:00100000:1.0:1767319604.702686:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379800960
00000100:00100000:1.0:1767319604.702779:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351
00000100:00100000:1.0:1767319604.702789:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379800960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319604.702819:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319604.702903:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379800960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (994us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319604.702914:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351
00000100:00100000:1.0:1767319604.702970:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379800960:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319605.719154:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319606.743115:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319607.767891:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319608.279129:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319608.279151:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319608.279154:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319608.279159:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319608.279163:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319608.279173:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4505
00000100:00080000:0.0:1767319608.279179:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319608.279186:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319608.279230:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332300 x1853164379801088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319608.279258:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319608.279262:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319608.279263:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319608.279268:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4505
00000100:00080000:0.0:1767319608.279270:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319608.279274:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319608.279287:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331180 x1853164379801216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319608.279358:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319608.279361:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319608.279363:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319608.279366:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4505
00000100:00080000:0.0:1767319608.279369:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319608.279373:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319608.279384:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379801728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319608.279400:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319608.279403:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319608.279405:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319608.279408:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4505
00000100:00080000:0.0:1767319608.279410:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319608.279414:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319608.279425:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4a80 x1853164379801984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319608.279454:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379801600:0@lo:400:kworker.0
00000100:00100000:0.0:1767319608.279538:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319608.279605:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319608.279611:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379801472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319608.279639:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319608.279745:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801472
00000100:00100000:1.0:1767319608.279757:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801472
00000100:00100000:1.0:1767319608.279835:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574
00000100:00100000:1.0:1767319608.279845:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379801472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319608.279851:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379801344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319608.279911:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319608.279940:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379801472:12345-0@lo:400:kworker.0 Request processed in 95us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319608.279940:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319608.279952:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379801856:0@lo:400:kworker.0
00000100:00100000:1.0:1767319608.279953:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574
00000100:00100000:1.0:1767319608.279977:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801344
00000100:00100000:1.0:1767319608.279983:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801344
00000100:00100000:2.0:1767319608.280000:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319608.280010:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575
00000100:00100000:1.0:1767319608.280020:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379801344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319608.280040:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801600
00000100:00100000:2.0:1767319608.280046:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801600
00000100:00100000:1.0:1767319608.280074:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379801344:12345-0@lo:400:kworker.0 Request processed in 56us (162us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319608.280083:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575
00000100:00100000:3.0:1767319608.280099:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319608.280101:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801856
00000100:00100000:2.0:1767319608.280107:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801856
00000100:00100000:3.0:1767319608.280113:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379802112:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319608.280118:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379801088:0@lo:38:kworker.0
00000100:00100000:2.0:1767319608.280146:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4345
00000100:00100000:2.0:1767319608.280155:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379801600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319608.280163:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319608.280257:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319608.280262:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319608.280264:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319608.280302:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379801472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319608.280343:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4346
00000100:00100000:0.0:1767319608.280351:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379801856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319608.281244:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379801600:12345-0@lo:400:kworker.0 Request processed in 1086us (1701us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319608.281255:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4345
00000100:00100000:2.0:1767319608.281307:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379801344:0@lo:400:kworker.0
00000100:00100000:2.0:1767319608.281335:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379801600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319608.281458:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379802112
00000100:00100000:2.0:1767319608.281464:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379802112
00000100:00100000:2.0:1767319608.281499:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352
00000100:00100000:2.0:1767319608.281506:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379802112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319608.281559:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319608.281600:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379802112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (1437us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319608.281606:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352
00000100:00100000:3.0:1767319608.284705:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379802112:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319608.289285:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319608.289342:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379801216:0@lo:38:kworker.0
00000100:00100000:1.0:1767319608.289388:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319608.289437:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379801728:0@lo:38:kworker.0
00000100:00100000:1.0:1767319608.289466:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319608.289491:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379801984:0@lo:38:kworker.0
00000100:00100000:1.0:1767319608.289514:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319608.289563:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801088
00000100:00100000:1.0:1767319608.289571:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801088
00000100:00100000:1.0:1767319608.289602:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801728
00000100:00100000:1.0:1767319608.289607:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801728
00000100:00100000:1.0:1767319608.289659:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801984
00000100:00100000:1.0:1767319608.289662:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801984
00000100:00100000:1.0:1767319608.289677:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17096
00000100:00100000:1.0:1767319608.289684:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379801088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319608.289705:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319608.289750:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379801088:12345-0@lo:38:kworker.0 Request processed in 64us (471us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319608.289757:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17096
00000100:00100000:1.0:1767319608.289779:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17097
00000100:00100000:1.0:1767319608.289783:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379801728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319608.289793:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319608.289818:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379801728:12345-0@lo:38:kworker.0 Request processed in 32us (351us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319608.289824:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17097
00000100:00100000:1.0:1767319608.289835:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17098
00000100:00100000:1.0:1767319608.289839:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379801984:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319608.289848:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319608.289891:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379801984:12345-0@lo:38:kworker.0 Request processed in 50us (377us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319608.289934:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17098
00000100:00080000:1.0:1767319608.289975:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319608.289981:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319608.289984:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379801088:0@lo:38:kworker.0
00000100:00080000:1.0:1767319608.289994:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319608.289998:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319608.290001:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379801728:0@lo:38:kworker.0
00000100:00080000:1.0:1767319608.290008:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319608.290011:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319608.290013:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379801984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319608.290364:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379801856:12345-0@lo:400:kworker.0 Request processed in 10012us (10378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319608.290373:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4346
00000100:00100000:3.0:1767319608.290461:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379801216
00000100:00100000:3.0:1767319608.290467:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379801216
00000100:00100000:3.0:1767319608.290500:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14
00000100:00100000:3.0:1767319608.290505:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379801216:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319608.290516:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319608.290581:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379801216:12345-0@lo:38:kworker.0 Request processed in 66us (1183us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319608.290588:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14
00000100:00100000:2.0:1767319608.290709:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379801856:0@lo:400:kworker.0
00000100:00080000:0.0:1767319608.290778:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319608.290783:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319608.290786:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379801216:0@lo:38:kworker.0
00010000:00010000:3.0:1767319608.791142:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319609.236192:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319609.236280:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319609.241629:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926784
00000100:00100000:2.0:1767319609.241644:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926784
00000100:00100000:2.0:1767319609.241700:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291926912
00000100:00100000:2.0:1767319609.241703:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291926912
00000100:00100000:2.0:1767319609.241762:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4347
00000100:00100000:2.0:1767319609.241772:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291926912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319609.241861:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291926912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (5580us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319609.241885:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4347
00000100:00100000:2.0:1767319609.241907:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17099
00000100:00100000:2.0:1767319609.241912:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291926784:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319609.241932:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319609.241956:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291926784:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (5773us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319609.241963:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17099
00000100:00080000:3.0:1767319609.242442:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319609.815303:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319609.815578:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379802240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319609.815645:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319609.815813:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379802240
00000100:00100000:1.0:1767319609.815822:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379802240
00000100:00100000:1.0:1767319609.815889:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353
00000100:00100000:1.0:1767319609.815899:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379802240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319609.815937:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319609.815989:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379802240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (343us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319609.815997:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353
00000100:00100000:0.0:1767319609.816073:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379802240:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319610.839897:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319611.865381:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319612.887207:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319613.399029:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319613.399041:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319613.399044:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319613.399049:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319613.399054:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319613.399062:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4510
00000100:00080000:0.0:1767319613.399067:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319613.399074:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319613.399122:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4000 x1853164379802368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319613.399148:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319613.399151:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319613.399153:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319613.399157:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4510
00000100:00080000:0.0:1767319613.399159:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319613.399162:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319613.399173:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5f80 x1853164379802496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319613.399229:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319613.399232:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319613.399234:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319613.399238:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4510
00000100:00080000:0.0:1767319613.399240:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319613.399243:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319613.399253:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6d80 x1853164379803008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319613.399266:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319613.399269:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319613.399271:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319613.399274:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4510
00000100:00080000:0.0:1767319613.399276:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319613.399280:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319613.399289:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4700 x1853164379803264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319613.399429:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379803136:0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.399502:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319613.399517:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379802368:0@lo:38:kworker.0
00000100:00100000:1.0:1767319613.399547:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319613.399571:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379802496:0@lo:38:kworker.0
00000100:00100000:3.0:1767319613.399576:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319613.399581:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379802624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319613.399594:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319613.399602:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319613.399614:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379803008:0@lo:38:kworker.0
00000100:00100000:3.0:1767319613.399625:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379802752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319613.399632:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319613.399646:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319613.399647:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379803264:0@lo:38:kworker.0
00000100:00100000:1.0:1767319613.399664:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319613.399665:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319613.399669:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379802880:0@lo:400:kworker.0
00000100:00100000:1.0:1767319613.399691:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379803136
00000100:00100000:1.0:1767319613.399699:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379803136
00000100:00100000:3.0:1767319613.399738:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319613.399814:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379802624
00000100:00100000:2.0:1767319613.399820:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379802624
00000100:00100000:2.0:1767319613.399862:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379802752
00000100:00100000:2.0:1767319613.399866:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379802752
00000100:00100000:3.0:1767319613.399902:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576
00000100:00100000:3.0:1767319613.399915:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379802624:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319613.399929:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577
00000100:00100000:2.0:1767319613.399939:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379802752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.399965:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379802624:12345-0@lo:400:kworker.0 Request processed in 54us (360us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319613.399975:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576
00000100:00100000:2.0:1767319613.399993:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379802752:12345-0@lo:400:kworker.0 Request processed in 55us (343us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319613.400002:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577
00000100:00080000:3.0:1767319613.400003:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319613.400020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319613.400023:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319613.407047:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379802368
00000100:00100000:3.0:1767319613.407062:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379803008
00000100:00100000:1.0:1767319613.407065:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379802368
00000100:00100000:3.0:1767319613.407067:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379803008
00000100:00100000:3.0:1767319613.407121:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379803264
00000100:00100000:3.0:1767319613.407125:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379803264
00000100:00100000:3.0:1767319613.407134:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379802880
00000100:00100000:3.0:1767319613.407136:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379802880
00000100:00100000:3.0:1767319613.407193:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4348
00000100:00100000:3.0:1767319613.407204:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379803136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.407309:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379803136:12345-0@lo:400:kworker.0 Request processed in 107us (7807us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319613.407317:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4348
00000100:00100000:3.0:1767319613.407338:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4349
00000100:00100000:3.0:1767319613.407345:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379802880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.407374:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379802880:12345-0@lo:400:kworker.0 Request processed in 31us (7635us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319613.407380:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4349
00000100:00100000:3.0:1767319613.407392:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17100
00000100:00100000:3.0:1767319613.407396:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379803008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319613.407415:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319613.407450:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379803008:12345-0@lo:38:kworker.0 Request processed in 52us (7816us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319613.407456:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17100
00000100:00100000:3.0:1767319613.407469:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17101
00000100:00100000:3.0:1767319613.407472:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379803264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319613.407481:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319613.407505:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379803264:12345-0@lo:38:kworker.0 Request processed in 31us (7839us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319613.407511:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17101
00000100:00080000:3.0:1767319613.407540:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319613.407581:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379802880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.407594:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379802752:0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.407628:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379802624:0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.407639:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379803136:0@lo:400:kworker.0
00000100:00100000:3.0:1767319613.407649:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319613.407659:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379803392:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319613.407690:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319613.407755:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379803392
00000100:00100000:3.0:1767319613.407760:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379803392
00000100:00100000:3.0:1767319613.407788:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354
00000100:00100000:3.0:1767319613.407794:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379803392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319613.407814:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319613.407847:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379803392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (156us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319613.407853:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354
00000100:00100000:3.0:1767319613.407907:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379803392:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319613.407948:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379802496
00000100:00100000:3.0:1767319613.407953:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379802496
00000100:00100000:3.0:1767319613.407972:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15
00000100:00100000:3.0:1767319613.407977:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379802496:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319613.407987:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319613.408027:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379802496:12345-0@lo:38:kworker.0 Request processed in 48us (8430us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319613.408033:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15
00000100:00100000:1.0:1767319613.408047:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17102
00000100:00100000:1.0:1767319613.408053:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379802368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319613.408063:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319613.408075:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319613.408081:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319613.408084:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379802496:0@lo:38:kworker.0
00000100:00080000:3.0:1767319613.408094:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319613.408097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319613.408099:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379803008:0@lo:38:kworker.0
00000100:00080000:3.0:1767319613.408108:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319613.408110:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319613.408113:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379803264:0@lo:38:kworker.0
00000100:00100000:1.0:1767319613.408181:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379802368:12345-0@lo:38:kworker.0 Request processed in 126us (8631us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319613.408187:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17102
00000100:00080000:1.0:1767319613.409726:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319613.409734:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319613.409738:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379802368:0@lo:38:kworker.0
00010000:00010000:1.0:1767319613.911113:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319614.351296:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319614.351352:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319614.351427:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291927040
00000100:00100000:0.0:1767319614.351437:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291927168
00000100:00100000:2.0:1767319614.351438:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291927040
00000100:00100000:0.0:1767319614.351444:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291927168
00000100:00100000:2.0:1767319614.351493:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17103
00000100:00100000:2.0:1767319614.351502:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291927040:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:3.0:1767319614.351518:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:2.0:1767319614.351525:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319614.351594:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291927040:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 90us (309us total) trans 0 rc -19/-19
00000400:00000100:3.0:1767319614.353449:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291927296 offset 0 length 520: 4
00000100:00100000:0.0:1767319614.357618:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4350
00000100:00100000:0.0:1767319614.357639:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291927168:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319614.357716:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291927168:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (6366us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319614.357723:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4350
00000100:00100000:2.0:1767319614.357918:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17103
00000100:00100000:3.0:1767319614.938370:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319614.938395:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379803520:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319614.938465:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319614.938541:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379803520
00000100:00100000:3.0:1767319614.938549:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379803520
00000100:00100000:3.0:1767319614.938595:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355
00000100:00100000:3.0:1767319614.938603:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379803520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319614.938634:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319614.938674:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379803520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (208us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319614.938681:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355
00000100:00100000:3.0:1767319614.938727:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379803520:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319614.940135:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319615.959275:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319616.983172:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319617.495034:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319592/real 1767319592]  req@ffff8b0f2f3fe300 x1853164379797504/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319617 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319617.495078:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f3fe300 x1853164379797504/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319617 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319617.495093:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319617.495150:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319617.495154:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379797504:0@lo:250:kworker.0
00000100:00080000:0.0:1767319617.495930:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319617.495937:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319617.495940:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319617.495945:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4495
00000100:00080000:0.0:1767319617.495950:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319617.495956:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319617.496003:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4e00 x1853164379803648/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319617.496028:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319617.496031:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319617.496033:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319617.496037:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4515
00000100:00080000:0.0:1767319617.496039:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319617.496042:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319617.496065:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7b80 x1853164379803776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319617.496073:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319617.496076:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319617.496077:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319617.496080:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4515
00000100:00080000:0.0:1767319617.496083:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319617.496086:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319617.496096:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5880 x1853164379803904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319617.496172:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:0.0:1767319617.496353:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319617.496357:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319617.496358:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319617.496362:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4515
00000100:00080000:0.0:1767319617.496365:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319617.496369:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319617.496381:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4700 x1853164379804416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319617.496394:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379804288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319617.496447:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379803648:0@lo:250:kworker.0
00000100:00100000:3.0:1767319617.496475:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000400:00000100:1.0:1767319617.496480:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379803648 offset 0 length 520: 4
00000100:00100000:1.0:1767319617.496525:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379803776:0@lo:38:kworker.0
00000100:00100000:3.0:1767319617.496528:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319617.496537:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379804160:0@lo:400:kworker.0
00000100:00100000:1.0:1767319617.496550:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319617.496574:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319617.496577:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379803904:0@lo:38:kworker.0
00000100:00100000:3.0:1767319617.496615:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804160
00000100:00100000:3.0:1767319617.496623:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804160
00000100:00100000:3.0:1767319617.496674:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578
00000100:00100000:3.0:1767319617.496683:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379804160:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319617.496731:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379804160:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319617.496739:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578
00000100:00080000:3.0:1767319617.496760:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319617.496797:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379804160:0@lo:400:kworker.0
00000100:00100000:3.0:1767319617.496830:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804288
00000100:00100000:3.0:1767319617.496834:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804288
00000100:00100000:3.0:1767319617.496865:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379803776
00000100:00100000:3.0:1767319617.496890:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379803776
00000100:00100000:3.0:1767319617.496910:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4351
00000100:00100000:3.0:1767319617.496917:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379804288:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319617.496954:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379804288:12345-0@lo:400:kworker.0 Request processed in 38us (480us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319617.496962:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319617.496967:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4351
00000100:00100000:3.0:1767319617.496997:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17104
00000100:00100000:1.0:1767319617.497001:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379804416:0@lo:38:kworker.0
00000100:00100000:3.0:1767319617.497005:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379803776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319617.497025:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319617.497031:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319617.497062:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379803776:12345-0@lo:38:kworker.0 Request processed in 57us (512us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319617.497068:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17104
00000100:00080000:1.0:1767319617.497079:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319617.497080:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804416
00000100:00100000:3.0:1767319617.497085:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804416
00000100:00080000:1.0:1767319617.497087:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319617.497094:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379803776:0@lo:38:kworker.0
00000100:00100000:3.0:1767319617.497108:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17105
00000100:00100000:3.0:1767319617.497113:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379804416:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319617.497123:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319617.497134:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379803904
00000100:00100000:1.0:1767319617.497140:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379803904
00000100:00100000:3.0:1767319617.497155:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379804416:12345-0@lo:38:kworker.0 Request processed in 39us (124us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319617.497162:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17105
00000100:00100000:1.0:1767319617.497170:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16
00000100:00100000:1.0:1767319617.497178:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379803904:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767319617.497184:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767319617.497190:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319617.497218:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379804288:0@lo:400:kworker.0
00000100:00100000:1.0:1767319617.497222:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379803904:12345-0@lo:38:kworker.0 Request processed in 42us (263us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319617.497231:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16
00000100:00080000:1.0:1767319617.497282:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319617.497286:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319617.497289:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379803904:0@lo:38:kworker.0
00000100:00080000:1.0:1767319617.497297:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319617.497299:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319617.497302:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379804416:0@lo:38:kworker.0
00000100:00100000:3.0:1767319617.501485:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379804544:0@lo:400:kworker.0
00000100:00100000:3.0:1767319617.501565:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319617.501797:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379804032:0@lo:400:kworker.0
00000100:00100000:3.0:1767319617.501829:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319617.502397:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804544
00000100:00100000:2.0:1767319617.502408:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804544
00000100:00100000:2.0:1767319617.502491:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4352
00000100:00100000:2.0:1767319617.502499:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379804544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319617.502560:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379804544:12345-0@lo:400:kworker.0 Request processed in 61us (994us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319617.502569:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4352
00000100:00100000:2.0:1767319617.503047:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379804544:0@lo:400:kworker.0
00000100:00100000:1.0:1767319617.503362:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804032
00000100:00100000:1.0:1767319617.503368:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804032
00000100:00100000:1.0:1767319617.503407:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579
00000100:00100000:1.0:1767319617.503413:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379804032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319617.503476:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379804032:12345-0@lo:400:kworker.0 Request processed in 63us (1646us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319617.503483:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579
00000100:00100000:2.0:1767319617.503998:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379804032:0@lo:400:kworker.0
00000100:00080000:3.0:1767319617.504333:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319617.504339:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319617.505152:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319617.505159:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319617.505163:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319617.505168:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4515
00000100:00080000:0.0:1767319617.505301:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319617.505309:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319617.505355:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5f80 x1853164379804672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319617.505732:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379804672:0@lo:38:kworker.0
00000100:00100000:1.0:1767319617.505794:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319617.506404:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804672
00000100:00100000:2.0:1767319617.506413:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804672
00000100:00100000:2.0:1767319617.506800:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17106
00000100:00100000:2.0:1767319617.506811:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379804672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319617.506847:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319617.506955:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379804672:12345-0@lo:38:kworker.0 Request processed in 143us (1158us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319617.506962:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17106
00000100:00080000:1.0:1767319617.508611:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319617.508623:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319617.508628:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379804672:0@lo:38:kworker.0
00010000:00010000:1.0:1767319618.010771:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319618.519276:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379804800:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319618.519348:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319618.519445:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804800
00000100:00100000:0.0:1767319618.519453:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804800
00000100:00100000:0.0:1767319618.519515:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356
00000100:00100000:0.0:1767319618.519524:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379804800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319618.519552:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319618.519606:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379804800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (258us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319618.519613:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356
00000100:00100000:1.0:1767319618.519715:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379804800:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319619.031520:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319619.472435:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319619.472589:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291927424
00000100:00100000:2.0:1767319619.472613:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291927424
00000100:00100000:2.0:1767319619.472703:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17107
00000100:00100000:2.0:1767319619.472717:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291927424:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319619.472751:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319619.472915:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291927424:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 152us (451us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319619.472925:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17107
00000100:00100000:0.0:1767319619.473357:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319619.473461:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291927552
00000100:00100000:2.0:1767319619.473471:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291927552
00000100:00100000:2.0:1767319619.473550:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4353
00000100:00100000:2.0:1767319619.473562:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291927552:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319619.473641:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291927552:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (288us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319619.473649:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4353
00000100:00080000:3.0:1767319619.474121:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319620.055365:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319620.055399:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379804928:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319620.055506:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319620.055790:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379804928
00000100:00100000:3.0:1767319620.055801:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379804928
00000100:00100000:3.0:1767319620.055906:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357
00000100:00100000:3.0:1767319620.055917:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379804928:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319620.055970:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319620.056040:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379804928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (533us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319620.056048:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357
00000100:00080000:1.0:1767319620.056116:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319620.056190:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379804928:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319620.057697:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319621.079224:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319622.103182:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319622.489660:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319622.489715:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319622.489790:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291927808
00000100:00100000:2.0:1767319622.489795:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291927680
00000100:00100000:0.0:1767319622.489807:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291927808
00000100:00100000:2.0:1767319622.489807:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291927680
00000100:00100000:2.0:1767319622.489906:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4354
00000100:00100000:2.0:1767319622.489920:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291927808:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319622.489935:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17108
00000100:00100000:0.0:1767319622.489952:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291927680:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319622.489980:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319622.490082:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319622.490142:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291927680:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 194us (425us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319622.490150:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17108
00000100:00100000:2.0:1767319622.490165:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291927808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 240us (510us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319622.490175:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4354
00000100:00080000:0.0:1767319622.615241:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319622.615253:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319622.615256:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319622.615261:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319622.615266:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319622.615274:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4519
00000100:00080000:0.0:1767319622.615279:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319622.615286:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319622.615332:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7100 x1853164379805056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319622.615368:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319622.615372:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319622.615374:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319622.615378:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4519
00000100:00080000:0.0:1767319622.615381:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319622.615385:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319622.615507:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379805056:0@lo:38:kworker.0
00000100:00100000:1.0:1767319622.615589:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319622.615941:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7480 x1853164379805184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319622.616013:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379805312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319622.616052:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319622.616137:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805312
00000100:00100000:1.0:1767319622.616145:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805312
00000100:00100000:1.0:1767319622.616210:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580
00000100:00100000:1.0:1767319622.616220:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379805312:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.616318:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805056
00000100:00100000:2.0:1767319622.616322:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805056
00000100:00100000:2.0:1767319622.616350:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17109
00000100:00100000:2.0:1767319622.616356:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379805056:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319622.616374:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319622.616422:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379805056:12345-0@lo:38:kworker.0 Request processed in 65us (832us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319622.616430:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17109
00000100:00080000:2.0:1767319622.616473:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319622.616485:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379805184:0@lo:38:kworker.0
00000100:00100000:2.0:1767319622.616512:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319622.616551:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319622.616555:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319622.616559:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379805056:0@lo:38:kworker.0
00000100:00100000:2.0:1767319622.616604:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805184
00000100:00100000:2.0:1767319622.616608:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805184
00000100:00100000:2.0:1767319622.616627:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17
00000100:00100000:2.0:1767319622.616632:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379805184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319622.616643:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319622.616673:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379805184:12345-0@lo:38:kworker.0 Request processed in 40us (160us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319622.616679:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17
00000100:00080000:2.0:1767319622.616702:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319622.616706:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319622.616709:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379805184:0@lo:38:kworker.0
00000100:00080000:0.0:1767319622.617229:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319622.617232:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319622.617235:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319622.617239:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4519
00000100:00080000:0.0:1767319622.617243:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319622.617247:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319622.617262:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7100 x1853164379805696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319622.617326:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379805440:0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.617354:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319622.617376:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319622.617381:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379805568:0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.617618:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319622.617645:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805440
00000100:00100000:2.0:1767319622.617649:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805440
00000100:00100000:2.0:1767319622.617682:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581
00000100:00100000:2.0:1767319622.617688:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379805440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.617725:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379805440:12345-0@lo:400:kworker.0 Request processed in 36us (369us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319622.617731:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581
00000100:00080000:2.0:1767319622.617749:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319622.617768:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379805440:0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.617787:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805568
00000100:00100000:2.0:1767319622.617790:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805568
00000100:00100000:2.0:1767319622.617818:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4355
00000100:00100000:2.0:1767319622.617825:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379805568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.617861:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379805568:12345-0@lo:400:kworker.0 Request processed in 36us (243us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319622.617867:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4355
00000100:00080000:2.0:1767319622.617896:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319622.617912:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379805568:0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.617942:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379805696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319622.617965:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319622.617989:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805696
00000100:00100000:2.0:1767319622.617992:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805696
00000100:00100000:2.0:1767319622.618010:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17110
00000100:00100000:2.0:1767319622.618014:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379805696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319622.618027:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319622.618070:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379805696:12345-0@lo:38:kworker.0 Request processed in 53us (103us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319622.618076:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17110
00000100:00080000:2.0:1767319622.618099:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319622.618103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319622.618106:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379805696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319622.618137:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379805824:0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.618160:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319622.618185:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805824
00000100:00100000:2.0:1767319622.618188:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805824
00000100:00100000:2.0:1767319622.618212:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4356
00000100:00100000:2.0:1767319622.618218:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379805824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319622.618248:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379805824:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319622.618254:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4356
00000100:00080000:2.0:1767319622.618267:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319622.618283:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379805824:0@lo:400:kworker.0
00000100:00100000:1.0:1767319622.618597:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379805312:12345-0@lo:400:kworker.0 Request processed in 2378us (2543us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319622.618605:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580
00000100:00080000:0.0:1767319622.618680:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319622.618684:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319622.618687:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319622.618691:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4519
00000100:00080000:0.0:1767319622.618694:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319622.618699:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319622.618719:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5f80 x1853164379805952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319622.618772:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379805952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319622.618801:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319622.618824:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379805312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319622.618883:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379805952
00000100:00100000:0.0:1767319622.618888:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379805952
00000100:00100000:0.0:1767319622.618919:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17111
00000100:00100000:0.0:1767319622.618933:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379805952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319622.618945:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319622.618986:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379805952:12345-0@lo:38:kworker.0 Request processed in 61us (183us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319622.618993:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17111
00000100:00080000:1.0:1767319622.619084:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319622.619089:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319622.619092:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379805952:0@lo:38:kworker.0
00010000:00010000:2.0:1767319623.127046:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319623.640721:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319623.640745:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379806080:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319623.640834:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319623.642585:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806080
00000100:00100000:0.0:1767319623.642605:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806080
00000100:00100000:0.0:1767319623.642697:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358
00000100:00100000:0.0:1767319623.642709:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379806080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319623.642754:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319623.642860:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379806080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (2025us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319623.642953:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358
00000100:00100000:2.0:1767319623.643643:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379806080:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319624.151327:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319625.175213:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379806208:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319625.175252:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319625.175342:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319625.175503:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806208
00000100:00100000:1.0:1767319625.175528:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806208
00000100:00100000:1.0:1767319625.175619:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359
00000100:00100000:1.0:1767319625.175633:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379806208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319625.175682:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319625.175768:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379806208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (431us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319625.175780:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359
00000100:00080000:3.0:1767319625.175798:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319625.175935:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379806208:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319626.199193:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319627.223964:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319627.670349:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319627.670557:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291927936
00000100:00100000:2.0:1767319627.670577:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291927936
00000100:00100000:2.0:1767319627.670630:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17112
00000100:00100000:2.0:1767319627.670638:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291927936:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319627.670660:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319627.682288:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291927936:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 11637us (11935us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319627.682305:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17112
00000100:00100000:3.0:1767319627.682724:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319627.682936:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291928064
00000100:00100000:2.0:1767319627.682947:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291928064
00000100:00100000:2.0:1767319627.683012:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4357
00000100:00100000:2.0:1767319627.683023:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291928064:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767319627.683082:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319627.683844:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291928064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 819us (1117us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319627.683853:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4357
00000100:00080000:3.0:1767319627.735130:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319627.735140:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319627.735143:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319627.735147:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319627.735151:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319627.735159:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4525
00000100:00080000:3.0:1767319627.735163:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319627.735169:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319627.735205:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a680 x1853164379806336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319627.735232:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319627.735236:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319627.735237:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319627.735241:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4525
00000100:00080000:3.0:1767319627.735244:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319627.735247:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319627.735257:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b800 x1853164379806464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319627.735314:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319627.735318:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319627.735319:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319627.735323:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4525
00000100:00080000:3.0:1767319627.735325:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319627.735329:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319627.735338:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19880 x1853164379806976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319627.735352:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319627.735355:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319627.735357:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319627.735360:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4525
00000100:00080000:3.0:1767319627.735362:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319627.735365:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319627.735374:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a300 x1853164379807232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319627.735396:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379806848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319627.735471:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319627.735527:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319627.735533:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379806720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319627.735555:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319627.735741:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379806592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319627.735768:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319627.735793:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319627.735798:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379807104:0@lo:400:kworker.0
00000100:00100000:0.0:1767319627.735816:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319627.735846:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806848
00000100:00100000:0.0:1767319627.735852:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806848
00000100:00100000:0.0:1767319627.735940:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379807104
00000100:00100000:0.0:1767319627.735944:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379807104
00000100:00100000:0.0:1767319627.735963:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4358
00000100:00100000:0.0:1767319627.735969:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379806848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319627.736011:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379806848:12345-0@lo:400:kworker.0 Request processed in 42us (539us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319627.736018:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4358
00000100:00100000:0.0:1767319627.736032:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4359
00000100:00100000:0.0:1767319627.736037:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379807104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319627.736061:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379807104:12345-0@lo:400:kworker.0 Request processed in 24us (244us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319627.736078:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4359
00000100:00080000:0.0:1767319627.736093:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319627.736122:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379807104:0@lo:400:kworker.0
00000100:00100000:0.0:1767319627.736145:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379806848:0@lo:400:kworker.0
00000100:00100000:3.0:1767319627.736263:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806720
00000100:00100000:3.0:1767319627.736267:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806720
00000100:00100000:3.0:1767319627.736302:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806592
00000100:00100000:3.0:1767319627.736305:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806592
00000100:00100000:3.0:1767319627.736322:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582
00000100:00100000:3.0:1767319627.736328:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379806720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319627.736361:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379806720:12345-0@lo:400:kworker.0 Request processed in 34us (804us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319627.736371:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582
00000100:00100000:3.0:1767319627.736381:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583
00000100:00100000:3.0:1767319627.736387:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379806592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319627.736411:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379806592:12345-0@lo:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319627.736416:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583
00000100:00080000:0.0:1767319627.736475:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319627.736478:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319627.736493:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379806592:0@lo:400:kworker.0
00000100:00100000:0.0:1767319627.736514:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379806720:0@lo:400:kworker.0
00000100:00100000:2.0:1767319627.737151:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379806336:0@lo:38:kworker.0
00000100:00100000:2.0:1767319627.737187:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319627.737213:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379806464:0@lo:38:kworker.0
00000100:00100000:2.0:1767319627.737233:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319627.737262:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379806976:0@lo:38:kworker.0
00000100:00100000:2.0:1767319627.737280:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319627.737299:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379807232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319627.737315:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319627.737344:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806336
00000100:00100000:2.0:1767319627.737349:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806336
00000100:00100000:2.0:1767319627.737368:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806976
00000100:00100000:2.0:1767319627.737370:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806976
00000100:00100000:2.0:1767319627.737379:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379807232
00000100:00100000:2.0:1767319627.737381:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379807232
00000100:00100000:2.0:1767319627.737390:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17113
00000100:00100000:2.0:1767319627.737395:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379806336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319627.737414:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319627.737444:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379806336:12345-0@lo:38:kworker.0 Request processed in 48us (255us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319627.737544:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17114
00000100:00100000:0.0:1767319627.737549:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379806976:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319627.737568:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319627.737592:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379806976:12345-0@lo:38:kworker.0 Request processed in 42us (311us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319627.737598:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17114
00000100:00100000:0.0:1767319627.737614:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17115
00000100:00100000:0.0:1767319627.737618:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379807232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319627.737626:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319627.737643:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379807232:12345-0@lo:38:kworker.0 Request processed in 24us (327us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319627.737648:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17115
00000100:00100000:3.0:1767319627.737788:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379806464
00000100:00100000:3.0:1767319627.737793:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379806464
00000100:00100000:3.0:1767319627.737819:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18
00000100:00100000:3.0:1767319627.737824:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379806464:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319627.737833:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319627.737859:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379806464:12345-0@lo:38:kworker.0 Request processed in 34us (625us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319627.737864:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18
00000100:00080000:3.0:1767319627.737929:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319627.737934:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319627.737937:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379806336:0@lo:38:kworker.0
00000100:00080000:3.0:1767319627.737945:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319627.737949:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319627.737951:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379806464:0@lo:38:kworker.0
00000100:00080000:3.0:1767319627.737957:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319627.737960:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319627.737963:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379806976:0@lo:38:kworker.0
00000100:00080000:3.0:1767319627.737969:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319627.737972:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319627.737975:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379807232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319627.738038:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17113
00010000:00010000:3.0:1767319628.247084:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319628.761488:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319628.761513:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379807360:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319628.761582:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319628.761927:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379807360
00000100:00100000:0.0:1767319628.761937:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379807360
00000100:00100000:0.0:1767319628.761994:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360
00000100:00100000:0.0:1767319628.762003:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379807360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319628.762077:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319628.762134:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379807360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (550us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319628.762141:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360
00000100:00100000:3.0:1767319628.762289:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379807360:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319629.271097:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319630.296191:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319630.296213:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379807488:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319630.296274:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1767319630.296428:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319630.296696:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379807488
00000100:00100000:1.0:1767319630.296703:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379807488
00000100:00100000:1.0:1767319630.296771:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361
00000100:00100000:1.0:1767319630.296781:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379807488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319630.296810:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319630.296906:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379807488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (630us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319630.296914:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361
00000100:00100000:1.0:1767319630.296963:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379807488:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319630.297026:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319631.319180:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319632.345785:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319632.784354:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319632.789850:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291928320
00000100:00100000:2.0:1767319632.789937:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291928320
00000100:00100000:2.0:1767319632.790024:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4360
00000100:00100000:2.0:1767319632.790038:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291928320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319632.790139:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291928320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (5795us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319632.790147:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4360
00000100:00100000:3.0:1767319632.790402:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:0.0:1767319632.790553:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319632.791342:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291928192
00000100:00100000:2.0:1767319632.791354:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291928192
00000100:00100000:2.0:1767319632.791404:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17116
00000100:00100000:2.0:1767319632.791412:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291928192:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319632.791436:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319632.791505:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291928192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 92us (1104us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319632.791513:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17116
00000100:00080000:3.0:1767319632.854997:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319632.855005:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319632.855008:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319632.855011:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319632.855014:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319632.855021:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4530
00000100:00080000:3.0:1767319632.855025:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319632.855031:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319632.855066:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcf480 x1853164379807616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319632.855089:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319632.855092:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319632.855093:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319632.855096:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4530
00000100:00080000:3.0:1767319632.855098:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319632.855101:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319632.855110:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc380 x1853164379807744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319632.855139:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379807616:0@lo:38:kworker.0
00000100:00080000:3.0:1767319632.855158:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319632.855161:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319632.855162:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319632.855165:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4530
00000100:00080000:3.0:1767319632.855167:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319632.855169:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319632.855177:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcce00 x1853164379808256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319632.855188:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319632.855190:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319632.855191:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319632.855194:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4530
00000100:00080000:3.0:1767319632.855195:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319632.855198:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319632.855204:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcfb80 x1853164379808512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319632.855215:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319632.855227:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379808000:0@lo:400:kworker.0
00000100:00100000:3.0:1767319632.855260:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319632.855275:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379807744:0@lo:38:kworker.0
00000100:00100000:3.0:1767319632.855301:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319632.855308:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319632.855310:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379808128:0@lo:400:kworker.0
00000100:00100000:3.0:1767319632.855342:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319632.855345:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379808256:0@lo:38:kworker.0
00000100:00100000:0.0:1767319632.855377:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319632.855387:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808000
00000100:00100000:0.0:1767319632.855396:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379808512:0@lo:38:kworker.0
00000100:00100000:3.0:1767319632.855398:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808000
00000100:00100000:0.0:1767319632.855422:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319632.855457:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379807744
00000100:00100000:0.0:1767319632.855461:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379807744
00000100:00100000:3.0:1767319632.855464:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584
00000100:00100000:3.0:1767319632.855476:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379808000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319632.855491:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19
00000100:00100000:0.0:1767319632.855498:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379807744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319632.855516:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319632.855530:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379808000:12345-0@lo:400:kworker.0 Request processed in 57us (269us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319632.855537:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584
00000100:00100000:0.0:1767319632.855558:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379807744:12345-0@lo:38:kworker.0 Request processed in 57us (249us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319632.855560:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379808384:0@lo:400:kworker.0
00000100:00100000:0.0:1767319632.855571:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19
00000100:00100000:3.0:1767319632.855588:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319632.855596:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319632.855608:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319632.855613:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379807872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319632.855618:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379807616
00000100:00100000:0.0:1767319632.855623:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379807616
00000100:00100000:3.0:1767319632.855628:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319632.855647:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808128
00000100:00100000:0.0:1767319632.855651:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808128
00000100:00100000:3.0:1767319632.855662:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379808000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319632.855682:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808256
00000100:00100000:3.0:1767319632.855684:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379807872
00000100:00100000:0.0:1767319632.855686:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808256
00000100:00100000:3.0:1767319632.855688:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379807872
00000100:00100000:0.0:1767319632.855702:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808512
00000100:00100000:0.0:1767319632.855706:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808512
00000100:00100000:3.0:1767319632.855720:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585
00000100:00100000:0.0:1767319632.855721:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808384
00000100:00100000:0.0:1767319632.855726:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808384
00000100:00100000:3.0:1767319632.855731:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379807872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319632.855746:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4361
00000100:00100000:0.0:1767319632.855755:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379808128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319632.855772:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379807872:12345-0@lo:400:kworker.0 Request processed in 43us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319632.855779:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585
00000100:00100000:0.0:1767319632.855802:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379808128:12345-0@lo:400:kworker.0 Request processed in 47us (458us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319632.855809:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379807872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319632.855812:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4361
00000100:00100000:3.0:1767319632.855845:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4362
00000100:00100000:3.0:1767319632.855853:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379808384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319632.855890:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17117
00000100:00100000:0.0:1767319632.855897:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379807616:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319632.855904:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379808384:12345-0@lo:400:kworker.0 Request processed in 51us (317us total) trans 0 rc 0/0
00010000:00020000:0.0:1767319632.855910:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319632.855910:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4362
00000100:00100000:3.0:1767319632.855925:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17118
00000100:00100000:3.0:1767319632.855929:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379808256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319632.855938:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319632.855947:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379807616:12345-0@lo:38:kworker.0 Request processed in 47us (733us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319632.855956:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17117
00000100:00100000:3.0:1767319632.855962:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379808256:12345-0@lo:38:kworker.0 Request processed in 31us (584us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319632.855967:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17118
00000100:00100000:0.0:1767319632.855975:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17119
00000100:00100000:0.0:1767319632.855981:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379808512:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319632.855991:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379808384:0@lo:400:kworker.0
00010000:00020000:0.0:1767319632.855993:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319632.856027:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379808512:12345-0@lo:38:kworker.0 Request processed in 44us (603us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767319632.856029:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319632.856038:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319632.856039:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17119
00000100:00100000:3.0:1767319632.856042:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379808256:0@lo:38:kworker.0
00000100:00080000:3.0:1767319632.856051:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319632.856054:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319632.856056:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379808512:0@lo:38:kworker.0
00000100:00080000:0.0:1767319632.856062:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319632.856063:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319632.856069:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00080000:0.0:1767319632.856070:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319632.856071:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379807616:0@lo:38:kworker.0
00000100:00080000:3.0:1767319632.856081:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319632.856083:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319632.856085:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379807744:0@lo:38:kworker.0
00000100:00100000:0.0:1767319632.856096:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379808128:0@lo:400:kworker.0
00010000:00010000:1.0:1767319633.367353:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319633.884654:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379808640:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319633.884737:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319633.885176:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808640
00000100:00100000:2.0:1767319633.885188:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808640
00000100:00100000:2.0:1767319633.885258:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362
00000100:00100000:2.0:1767319633.885269:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379808640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319633.885303:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319633.885381:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379808640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (642us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319633.885389:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362
00000100:00100000:1.0:1767319633.885576:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379808640:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319634.391196:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319635.415310:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319635.415337:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379808768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319635.415420:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319635.415655:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808768
00000100:00100000:3.0:1767319635.415664:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808768
00000100:00080000:1.0:1767319635.415831:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319635.415905:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363
00000100:00100000:3.0:1767319635.415917:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379808768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319635.415954:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319635.416069:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379808768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (647us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319635.416078:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363
00010000:00010000:3.0:1767319635.416374:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319635.417370:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379808768:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319636.439252:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319637.463100:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319637.905971:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319637.906018:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319637.906407:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291928448
00000100:00100000:0.0:1767319637.906417:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291928448
00000100:00100000:0.0:1767319637.906585:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291928576
00000100:00100000:0.0:1767319637.906590:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291928576
00000100:00080000:3.0:1767319637.906892:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319637.907168:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4363
00000100:00100000:1.0:1767319637.907185:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291928576:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319637.907597:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291928576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 416us (1575us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319637.907607:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4363
00000100:00100000:1.0:1767319637.907637:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17120
00000100:00100000:1.0:1767319637.907642:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291928448:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319637.907664:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319637.907694:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291928448:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 50us (1734us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319637.907701:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17120
00000100:00080000:2.0:1767319637.975704:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319637.975713:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319637.975716:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319637.975719:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319637.975723:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319637.975730:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4535
00000100:00080000:2.0:1767319637.975735:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319637.975741:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319637.975800:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0de300 x1853164379808896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319637.975817:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319637.975820:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319637.975821:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319637.975824:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4535
00000100:00080000:2.0:1767319637.975827:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319637.975830:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319637.975845:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379809024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319637.975914:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319637.975918:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319637.975919:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319637.975923:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4535
00000100:00080000:2.0:1767319637.975926:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319637.975930:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319637.975939:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164379809536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319637.975957:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319637.975960:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319637.975962:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319637.975965:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4535
00000100:00080000:2.0:1767319637.975967:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319637.975970:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319637.975979:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae300 x1853164379809792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319637.976125:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379809152:0@lo:400:kworker.0
00000100:00100000:2.0:1767319637.976202:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319637.976263:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319637.976270:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379809664:0@lo:400:kworker.0
00000100:00100000:2.0:1767319637.976311:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319637.976340:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379809408:0@lo:400:kworker.0
00000100:00100000:2.0:1767319637.976365:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319637.976385:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319637.976391:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379809280:0@lo:400:kworker.0
00000100:00100000:3.0:1767319637.976534:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379808896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319637.976564:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319637.976590:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379809024:0@lo:38:kworker.0
00000100:00100000:3.0:1767319637.976614:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319637.976637:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379809536:0@lo:38:kworker.0
00000100:00100000:3.0:1767319637.976656:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319637.976673:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379809792:0@lo:38:kworker.0
00000100:00100000:3.0:1767319637.976691:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319637.976721:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809024
00000100:00100000:3.0:1767319637.976728:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809024
00000100:00100000:3.0:1767319637.976762:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20
00000100:00100000:3.0:1767319637.976769:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379809024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319637.976799:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319637.976842:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379809024:12345-0@lo:38:kworker.0 Request processed in 71us (226us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319637.976849:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20
00000100:00100000:3.0:1767319637.976887:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809664
00000100:00100000:3.0:1767319637.976891:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809664
00000100:00100000:3.0:1767319637.976927:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809408
00000100:00100000:3.0:1767319637.976930:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809408
00000100:00100000:3.0:1767319637.976942:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379808896
00000100:00100000:3.0:1767319637.976945:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379808896
00000100:00100000:3.0:1767319637.976952:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809536
00000100:00100000:3.0:1767319637.976954:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809536
00000100:00100000:3.0:1767319637.976960:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809792
00000100:00100000:3.0:1767319637.976962:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809792
00000100:00100000:3.0:1767319637.976971:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4364
00000100:00100000:3.0:1767319637.976977:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379809664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319637.977020:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379809664:12345-0@lo:400:kworker.0 Request processed in 43us (709us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319637.977026:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4364
00000100:00100000:3.0:1767319637.977038:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4365
00000100:00100000:3.0:1767319637.977044:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379809408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319637.977070:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379809408:12345-0@lo:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319637.977075:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4365
00000100:00100000:3.0:1767319637.977085:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17121
00000100:00100000:3.0:1767319637.977089:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379808896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319637.977097:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319637.977120:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379808896:12345-0@lo:38:kworker.0 Request processed in 30us (556us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319637.977126:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17121
00000100:00100000:3.0:1767319637.977136:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17122
00000100:00100000:3.0:1767319637.977139:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379809536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319637.977147:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319637.977167:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379809536:12345-0@lo:38:kworker.0 Request processed in 26us (510us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319637.977172:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17122
00000100:00100000:3.0:1767319637.977182:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17123
00000100:00100000:3.0:1767319637.977185:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379809792:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319637.977193:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319637.977213:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379809792:12345-0@lo:38:kworker.0 Request processed in 26us (522us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319637.977218:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17123
00000100:00080000:3.0:1767319637.977248:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319637.977285:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319637.977290:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319637.977293:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379808896:0@lo:38:kworker.0
00000100:00080000:3.0:1767319637.977302:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319637.977306:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319637.977308:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379809024:0@lo:38:kworker.0
00000100:00080000:3.0:1767319637.977315:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319637.977318:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319637.977320:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379809536:0@lo:38:kworker.0
00000100:00080000:3.0:1767319637.977326:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319637.977329:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319637.977331:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379809792:0@lo:38:kworker.0
00000100:00100000:3.0:1767319637.977371:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379809664:0@lo:400:kworker.0
00000100:00100000:3.0:1767319637.980584:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809152
00000100:00100000:3.0:1767319637.980603:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809152
00000100:00100000:3.0:1767319637.980675:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586
00000100:00100000:3.0:1767319637.980685:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379809152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319637.980776:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379809152:12345-0@lo:400:kworker.0 Request processed in 92us (4573us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319637.980795:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586
00000100:00080000:3.0:1767319637.981149:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319637.981188:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379809152:0@lo:400:kworker.0
00000100:00100000:2.0:1767319637.982711:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319637.982762:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809280
00000100:00100000:3.0:1767319637.982771:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809280
00000100:00100000:2.0:1767319637.982774:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379809408:0@lo:400:kworker.0
00000100:00100000:3.0:1767319637.982844:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587
00000100:00100000:3.0:1767319637.982852:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379809280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319637.982968:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379809280:0@lo:400:kworker.0
00000100:00080000:0.0:1767319637.983017:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319637.983198:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379809280:12345-0@lo:400:kworker.0 Request processed in 346us (489us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319637.983206:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587
00010000:00010000:3.0:1767319638.487320:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319638.929098:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319638.929142:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291928704 offset 0 length 520: 4
00000100:00100000:0.0:1767319638.929176:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291928960
00000100:00100000:3.0:1767319638.929176:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319638.929199:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291928960
00000100:00100000:2.0:1767319638.934503:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291928832
00000100:00100000:2.0:1767319638.934521:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291928832
00000100:00100000:2.0:1767319638.934860:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4366
00000100:00100000:2.0:1767319638.934897:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291928960:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319638.934994:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291928960:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 124us (5993us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319638.935003:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4366
00000100:00100000:2.0:1767319638.935036:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17124
00000100:00100000:2.0:1767319638.935042:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291928832:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319638.935063:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319638.935089:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291928832:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (5915us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319638.935095:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17124
00000100:00100000:1.0:1767319638.999236:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319638.999271:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379809920:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319638.999360:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319638.999567:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379809920
00000100:00100000:2.0:1767319638.999586:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379809920
00000100:00100000:2.0:1767319638.999643:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364
00000100:00100000:2.0:1767319638.999653:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379809920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319638.999685:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319638.999732:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379809920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319638.999739:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364
00000100:00100000:1.0:1767319639.000227:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379809920:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319639.513734:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319640.535300:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319640.536712:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319640.536735:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379810048:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319640.536827:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319640.537205:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379810048
00000100:00100000:0.0:1767319640.537213:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379810048
00000100:00100000:0.0:1767319640.537277:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365
00000100:00100000:0.0:1767319640.537287:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379810048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319640.537314:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319640.537370:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379810048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (552us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319640.537377:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365
00000100:00100000:1.0:1767319640.537540:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379810048:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319640.537899:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319641.562260:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319642.071217:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319617/real 1767319617]  req@ffff8b0e0bef4e00 x1853164379803648/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319642 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319642.071264:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bef4e00 x1853164379803648/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319642 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319642.071278:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319642.071308:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319642.071312:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379803648:0@lo:250:kworker.0
00000100:00080000:3.0:1767319642.071519:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319642.071524:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319642.071527:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319642.071532:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4519
00000100:00080000:3.0:1767319642.071535:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319642.071541:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319642.071586:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd500 x1853164379810176/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319642.071612:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319642.071616:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319642.071618:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319642.071621:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4540
00000100:00080000:3.0:1767319642.071623:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319642.071627:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319642.071641:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce300 x1853164379810304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319642.071649:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319642.071651:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319642.071653:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319642.071656:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4540
00000100:00080000:3.0:1767319642.071658:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319642.071661:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319642.071673:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcf100 x1853164379810432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319642.071739:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319642.071742:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319642.071744:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319642.071758:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4540
00000100:00080000:3.0:1767319642.071761:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319642.071764:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319642.071776:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046ce300 x1853164379810944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319642.071787:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379810560:0@lo:400:kworker.0
00000100:00080000:3.0:1767319642.071790:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319642.071794:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319642.071795:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319642.071798:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4540
00000100:00080000:3.0:1767319642.071800:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319642.071804:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319642.071812:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cca80 x1853164379811200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319642.071831:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379810816:0@lo:400:kworker.0
00000100:00100000:1.0:1767319642.071848:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319642.071858:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319642.071916:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319642.071922:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379811072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319642.071941:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379810176:0@lo:250:kworker.0
00000100:00100000:1.0:1767319642.071945:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000400:00000100:0.0:1767319642.071962:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379810176 offset 0 length 520: 4
00000100:00100000:1.0:1767319642.071967:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379810688:0@lo:400:kworker.0
00000100:00100000:0.0:1767319642.071979:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379810304:0@lo:38:kworker.0
00000100:00100000:1.0:1767319642.072001:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319642.072005:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319642.072018:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379810432:0@lo:38:kworker.0
00000100:00100000:0.0:1767319642.072038:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319642.072039:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379810816
00000100:00100000:0.0:1767319642.072054:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379810944:0@lo:38:kworker.0
00000100:00100000:1.0:1767319642.072056:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379810816
00000100:00100000:0.0:1767319642.072073:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319642.072086:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379811200:0@lo:38:kworker.0
00000100:00100000:0.0:1767319642.072103:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319642.072105:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811072
00000100:00100000:1.0:1767319642.072108:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811072
00000100:00100000:1.0:1767319642.072121:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379810304
00000100:00100000:1.0:1767319642.072123:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379810304
00000100:00100000:0.0:1767319642.072127:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379810944
00000100:00100000:0.0:1767319642.072130:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379810944
00000100:00100000:1.0:1767319642.072131:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811200
00000100:00100000:1.0:1767319642.072133:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811200
00000100:00100000:1.0:1767319642.072144:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4367
00000100:00100000:1.0:1767319642.072152:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379810816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319642.072196:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379810816:12345-0@lo:400:kworker.0 Request processed in 45us (335us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319642.072231:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379810816:0@lo:400:kworker.0
00000100:00100000:3.0:1767319642.072263:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379810560
00000100:00100000:3.0:1767319642.072266:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379810560
00000100:00100000:3.0:1767319642.072293:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379810688
00000100:00100000:3.0:1767319642.072296:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379810688
00000100:00100000:3.0:1767319642.072315:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588
00000100:00100000:3.0:1767319642.072322:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379810560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319642.072359:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379810560:12345-0@lo:400:kworker.0 Request processed in 38us (510us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319642.072632:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588
00000100:00100000:3.0:1767319642.072648:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589
00000100:00100000:3.0:1767319642.072655:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379810688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319642.072694:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379810688:12345-0@lo:400:kworker.0 Request processed in 40us (693us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319642.072700:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589
00000100:00100000:0.0:1767319642.080131:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4368
00000100:00100000:0.0:1767319642.080161:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379811072:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319642.080274:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379811072:12345-0@lo:400:kworker.0 Request processed in 130us (8327us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319642.080283:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4368
00000100:00100000:0.0:1767319642.080328:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17125
00000100:00100000:0.0:1767319642.080334:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379810304:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319642.080356:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319642.080419:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379810304:12345-0@lo:38:kworker.0 Request processed in 84us (8412us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319642.080436:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17125
00000100:00100000:0.0:1767319642.080452:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17126
00000100:00100000:0.0:1767319642.080456:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379810944:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319642.080467:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319642.080503:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379810944:12345-0@lo:38:kworker.0 Request processed in 45us (8428us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319642.080509:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17126
00000100:00100000:0.0:1767319642.080523:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17127
00000100:00100000:0.0:1767319642.080528:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379811200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319642.080537:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319642.080574:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379811200:12345-0@lo:38:kworker.0 Request processed in 44us (8469us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319642.080580:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17127
00000100:00080000:0.0:1767319642.080638:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319642.080644:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319642.080648:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379810304:0@lo:38:kworker.0
00000100:00080000:0.0:1767319642.080665:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319642.080668:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319642.080671:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379810944:0@lo:38:kworker.0
00000100:00080000:0.0:1767319642.080680:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319642.080683:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319642.080686:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379811200:0@lo:38:kworker.0
00000100:00080000:0.0:1767319642.080910:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319642.080916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319642.080919:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319642.080951:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379811072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319642.080965:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379810560:0@lo:400:kworker.0
00000100:00100000:0.0:1767319642.081021:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379810688:0@lo:400:kworker.0
00000100:00100000:0.0:1767319642.081067:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379810432
00000100:00100000:0.0:1767319642.081074:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379810432
00000100:00100000:0.0:1767319642.081110:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21
00000100:00100000:0.0:1767319642.081115:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379810432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319642.081126:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319642.081160:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379810432:12345-0@lo:38:kworker.0 Request processed in 44us (9120us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319642.081166:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21
00000100:00080000:0.0:1767319642.081190:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319642.081194:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319642.081197:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379810432:0@lo:38:kworker.0
00000100:00100000:1.0:1767319642.090841:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4367
00010000:00010000:3.0:1767319642.587218:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319643.608213:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319644.047179:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319644.047387:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929088
00000100:00100000:1.0:1767319644.047397:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929088
00000100:00100000:1.0:1767319644.047499:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17128
00000100:00100000:1.0:1767319644.047507:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291929088:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319644.047547:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319644.047611:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291929088:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 103us (442us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319644.047619:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17128
00000100:00100000:3.0:1767319644.050800:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319644.050969:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929216
00000100:00100000:1.0:1767319644.050978:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929216
00000100:00100000:1.0:1767319644.051175:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4369
00000100:00100000:1.0:1767319644.051186:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291929216:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319644.051263:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291929216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (472us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319644.051270:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4369
00000100:00080000:0.0:1767319644.052378:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319644.119357:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319644.119386:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379811328:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319644.119465:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319644.120676:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811328
00000100:00100000:3.0:1767319644.120689:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811328
00000100:00080000:0.0:1767319644.120766:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319644.120794:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366
00000100:00100000:3.0:1767319644.120807:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379811328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319644.120840:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319644.120942:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379811328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (1476us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319644.120950:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366
00000100:00100000:2.0:1767319644.121108:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379811328:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319644.634406:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319645.655278:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319645.655453:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379811456:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319645.655533:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319645.655671:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811456
00000100:00100000:3.0:1767319645.655680:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811456
00000100:00100000:3.0:1767319645.655746:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367
00000100:00100000:3.0:1767319645.655756:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379811456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319645.655783:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319645.655835:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379811456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (302us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319645.655842:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367
00000100:00100000:3.0:1767319645.655909:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379811456:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319645.656106:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319646.679171:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319647.191384:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319647.191395:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319647.191398:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319647.191402:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319647.191406:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319647.191413:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4544
00000100:00080000:0.0:1767319647.191417:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319647.191424:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319647.191464:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4380 x1853164379811584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319647.191498:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319647.191502:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319647.191504:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319647.191508:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4544
00000100:00080000:0.0:1767319647.191510:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319647.191514:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319647.191527:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6680 x1853164379811712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319647.191592:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319647.191595:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319647.191597:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319647.191611:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4544
00000100:00080000:0.0:1767319647.191613:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319647.191617:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319647.191628:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc700 x1853164379812224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319647.191643:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319647.191646:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319647.191648:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319647.191651:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4544
00000100:00080000:0.0:1767319647.191653:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319647.191657:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319647.191667:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce300 x1853164379812480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319647.191824:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379811840:0@lo:400:kworker.0
00000100:00100000:1.0:1767319647.191946:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319647.192006:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319647.192012:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379812352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319647.192036:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319647.192064:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811840
00000100:00100000:1.0:1767319647.192070:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379812096:0@lo:400:kworker.0
00000100:00100000:0.0:1767319647.192074:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811840
00000100:00100000:3.0:1767319647.192096:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812352
00000100:00100000:3.0:1767319647.192103:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812352
00000100:00100000:1.0:1767319647.192114:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319647.192136:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319647.192145:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379811968:0@lo:400:kworker.0
00000100:00100000:0.0:1767319647.192146:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590
00000100:00100000:3.0:1767319647.192158:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812096
00000100:00100000:0.0:1767319647.192162:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379811840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319647.192164:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812096
00000100:00100000:1.0:1767319647.192173:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319647.192203:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4370
00000100:00100000:3.0:1767319647.192213:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379812352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319647.192231:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379811840:12345-0@lo:400:kworker.0 Request processed in 73us (283us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319647.192243:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590
00000100:00100000:0.0:1767319647.192261:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811968
00000100:00100000:0.0:1767319647.192265:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811968
00000100:00100000:3.0:1767319647.192270:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379812352:12345-0@lo:400:kworker.0 Request processed in 58us (231us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319647.192287:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591
00000100:00100000:0.0:1767319647.192294:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379811968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319647.192325:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379811968:12345-0@lo:400:kworker.0 Request processed in 31us (152us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319647.192331:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591
00000100:00080000:0.0:1767319647.192348:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319647.192352:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319647.192354:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319647.193452:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4371
00000100:00100000:1.0:1767319647.193494:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379812352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319647.193577:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379811840:0@lo:400:kworker.0
00000100:00100000:1.0:1767319647.193726:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379811968:0@lo:400:kworker.0
00000100:00100000:1.0:1767319647.193746:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379812096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319647.193796:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379812096:12345-0@lo:400:kworker.0 Request processed in 335us (1684us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319647.193803:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4371
00000100:00100000:1.0:1767319647.193828:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379812096:0@lo:400:kworker.0
00000100:00100000:2.0:1767319647.193979:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379811584:0@lo:38:kworker.0
00000100:00100000:2.0:1767319647.194017:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319647.194035:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379811712:0@lo:38:kworker.0
00000100:00100000:2.0:1767319647.194054:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319647.194974:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4370
00000100:00100000:0.0:1767319647.194992:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811584
00000100:00100000:0.0:1767319647.195000:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811584
00000100:00100000:0.0:1767319647.195026:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17129
00000100:00100000:0.0:1767319647.195030:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379811584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319647.195047:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319647.195086:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379811584:12345-0@lo:38:kworker.0 Request processed in 54us (1071us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319647.195093:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17129
00000100:00100000:2.0:1767319647.195411:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379812224:0@lo:38:kworker.0
00000100:00100000:2.0:1767319647.195444:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319647.195516:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379812480:0@lo:38:kworker.0
00000100:00100000:2.0:1767319647.195538:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319647.195560:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379811712
00000100:00100000:0.0:1767319647.195568:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379811712
00000100:00100000:0.0:1767319647.195613:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22
00000100:00100000:0.0:1767319647.195618:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379811712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319647.195627:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319647.195652:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379811712:12345-0@lo:38:kworker.0 Request processed in 33us (1597us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319647.195658:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22
00000100:00080000:2.0:1767319647.195814:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319647.195821:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319647.195830:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379811584:0@lo:38:kworker.0
00000100:00080000:2.0:1767319647.195841:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319647.195847:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319647.195849:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379811712:0@lo:38:kworker.0
00000100:00100000:1.0:1767319647.196015:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812224
00000100:00100000:1.0:1767319647.196019:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812224
00000100:00100000:1.0:1767319647.196091:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812480
00000100:00100000:1.0:1767319647.196095:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812480
00000100:00100000:2.0:1767319647.196226:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17130
00000100:00100000:2.0:1767319647.196232:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379812224:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319647.196243:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319647.196282:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379812224:12345-0@lo:38:kworker.0 Request processed in 49us (837us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319647.196289:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17130
00000100:00100000:2.0:1767319647.196309:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17131
00000100:00100000:2.0:1767319647.196313:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379812480:12345-0@lo:38:kworker.0
00000100:00080000:3.0:1767319647.196320:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00010000:00020000:2.0:1767319647.196324:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319647.196329:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319647.196334:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379812224:0@lo:38:kworker.0
00000100:00080000:3.0:1767319647.196773:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319647.196776:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379812480:12345-0@lo:38:kworker.0 Request processed in 458us (1234us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767319647.196778:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319647.196783:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379812480:0@lo:38:kworker.0
00000100:00100000:2.0:1767319647.196793:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17131
00010000:00010000:1.0:1767319647.703190:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319648.728369:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319649.169162:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319649.169219:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319649.169316:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929472
00000100:00100000:0.0:1767319649.169326:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929472
00000100:00100000:0.0:1767319649.169398:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929344
00000100:00100000:0.0:1767319649.169401:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929344
00000100:00100000:0.0:1767319649.169422:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4372
00000100:00100000:0.0:1767319649.169433:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291929472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319649.169508:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291929472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 76us (356us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319649.169516:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4372
00000100:00100000:0.0:1767319649.169537:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17132
00000100:00100000:0.0:1767319649.169541:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291929344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319649.169562:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319649.169591:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291929344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (371us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319649.169597:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17132
00000100:00080000:3.0:1767319649.169728:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319649.239338:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379812608:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319649.239414:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319649.239708:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812608
00000100:00100000:2.0:1767319649.239717:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812608
00000100:00100000:2.0:1767319649.239784:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368
00000100:00080000:3.0:1767319649.239790:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319649.239796:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379812608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319649.239827:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319649.239900:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379812608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (486us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319649.239907:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368
00000100:00100000:1.0:1767319649.239995:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379812608:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319649.751204:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319650.777805:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319650.778040:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379812736:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319650.778115:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319650.778272:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812736
00000100:00100000:0.0:1767319650.778280:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812736
00000100:00100000:0.0:1767319650.778342:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369
00000100:00100000:0.0:1767319650.778351:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379812736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319650.778378:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319650.778429:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379812736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (314us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319650.778436:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369
00000100:00080000:3.0:1767319650.778912:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319650.780379:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379812736:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319651.799321:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319652.311975:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319652.311987:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319652.311999:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319652.312004:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319652.312009:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319652.312018:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319652.312023:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319652.312030:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319652.312075:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046cca80 x1853164379812864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319652.321503:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319652.321523:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319652.321526:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319652.321534:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319652.321539:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319652.321545:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319652.321583:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046ce300 x1853164379812992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319652.321674:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319652.321678:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319652.321680:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319652.321684:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319652.321687:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319652.321691:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319652.321703:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907100 x1853164379813504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319652.321721:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319652.321724:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319652.321726:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319652.321729:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4549
00000100:00080000:3.0:1767319652.321731:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319652.321735:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319652.321744:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fca80 x1853164379813760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319652.321798:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379813120:0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.321914:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319652.321986:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319652.322003:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379813632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322030:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319652.322073:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379813376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322096:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319652.322114:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319652.322120:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379813248:0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322154:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319652.322196:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379813632
00000100:00100000:2.0:1767319652.322203:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379813632
00000100:00100000:2.0:1767319652.322264:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379813376
00000100:00100000:2.0:1767319652.322268:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379813376
00000100:00100000:2.0:1767319652.322294:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4373
00000100:00100000:2.0:1767319652.322301:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379813632:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322351:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379813632:12345-0@lo:400:kworker.0 Request processed in 50us (319us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319652.322359:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4373
00000100:00100000:2.0:1767319652.322379:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4374
00000100:00100000:2.0:1767319652.322386:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379813376:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322416:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379813376:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319652.322422:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4374
00000100:00100000:2.0:1767319652.322458:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379813376:0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322489:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379813632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322521:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379813120
00000100:00100000:2.0:1767319652.322524:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379813120
00000100:00100000:2.0:1767319652.322550:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379813248
00000100:00100000:2.0:1767319652.322553:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379813248
00000100:00100000:2.0:1767319652.322572:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592
00000100:00100000:2.0:1767319652.322578:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379813120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322612:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379813120:12345-0@lo:400:kworker.0 Request processed in 34us (698us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319652.322619:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592
00000100:00100000:2.0:1767319652.322630:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593
00000100:00100000:2.0:1767319652.322636:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379813248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322677:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379813248:12345-0@lo:400:kworker.0 Request processed in 41us (535us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319652.322683:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593
00000100:00100000:2.0:1767319652.322707:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379813248:0@lo:400:kworker.0
00000100:00100000:2.0:1767319652.322727:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379813120:0@lo:400:kworker.0
00000100:00080000:2.0:1767319652.322747:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319652.322750:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319652.322753:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319652.322846:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379812864:0@lo:38:kworker.0
00000100:00100000:1.0:1767319652.322898:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319652.322924:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379812992:0@lo:38:kworker.0
00000100:00100000:1.0:1767319652.322949:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319652.323428:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812864
00000100:00100000:2.0:1767319652.323434:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812864
00000100:00100000:2.0:1767319652.323459:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17133
00000100:00100000:2.0:1767319652.323464:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379812864:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319652.323483:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319652.323530:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379812864:12345-0@lo:38:kworker.0 Request processed in 63us (631us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319652.323535:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17133
00000100:00100000:1.0:1767319652.324883:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379813504:0@lo:38:kworker.0
00000100:00100000:1.0:1767319652.324944:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319652.325426:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379813504
00000100:00100000:2.0:1767319652.325435:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379813504
00000100:00100000:1.0:1767319652.325475:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379813760:0@lo:38:kworker.0
00000100:00100000:2.0:1767319652.325477:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17134
00000100:00100000:2.0:1767319652.325488:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379813504:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319652.325507:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319652.325513:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319652.325558:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319652.325564:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379813504:12345-0@lo:38:kworker.0 Request processed in 76us (619us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319652.325565:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319652.325574:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379812864:0@lo:38:kworker.0
00000100:00100000:2.0:1767319652.325578:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17134
00000100:00080000:1.0:1767319652.325589:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319652.325594:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379813760
00000100:00080000:1.0:1767319652.325595:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319652.325600:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379813760
00000100:00100000:1.0:1767319652.325601:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379813504:0@lo:38:kworker.0
00000100:00100000:2.0:1767319652.325620:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17135
00000100:00100000:2.0:1767319652.325625:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379813760:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319652.325634:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319652.325667:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379813760:12345-0@lo:38:kworker.0 Request processed in 41us (157us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319652.325672:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17135
00000100:00080000:1.0:1767319652.325819:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319652.325824:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319652.325828:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379813760:0@lo:38:kworker.0
00000100:00100000:1.0:1767319652.329469:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379812992
00000100:00100000:1.0:1767319652.329486:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379812992
00000100:00100000:1.0:1767319652.329534:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23
00000100:00100000:1.0:1767319652.329542:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379812992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319652.329565:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319652.330096:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379812992:12345-0@lo:38:kworker.0 Request processed in 553us (7144us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319652.330103:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23
00000100:00080000:1.0:1767319652.330155:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319652.330160:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319652.330164:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379812992:0@lo:38:kworker.0
00010000:00010000:3.0:1767319652.824818:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319653.847704:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319654.288978:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319654.289024:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319654.289376:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929728
00000100:00100000:2.0:1767319654.289386:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929728
00000100:00100000:2.0:1767319654.289456:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929600
00000100:00100000:2.0:1767319654.289460:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929600
00000100:00100000:2.0:1767319654.289479:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4375
00000100:00100000:2.0:1767319654.289489:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291929728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319654.289570:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291929728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (600us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319654.289578:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4375
00000100:00100000:2.0:1767319654.289598:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17136
00000100:00100000:2.0:1767319654.289602:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291929600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319654.289621:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319654.289657:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291929600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (631us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319654.289663:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17136
00000100:00080000:3.0:1767319654.290204:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319654.360147:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379813888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319654.360220:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319654.360340:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379813888
00000100:00100000:1.0:1767319654.360348:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379813888
00000100:00100000:1.0:1767319654.360411:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370
00000100:00100000:1.0:1767319654.360421:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379813888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319654.360455:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767319654.360528:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319654.371430:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379813888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11000us (11199us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319654.371446:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370
00000100:00100000:2.0:1767319654.372072:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379813888:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319654.871200:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319655.895179:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319655.895206:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379814016:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319655.895284:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319655.895711:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814016
00000100:00100000:0.0:1767319655.895720:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814016
00000100:00100000:0.0:1767319655.895789:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371
00000100:00100000:0.0:1767319655.895799:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379814016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319655.895828:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319655.895900:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379814016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (614us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319655.895907:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371
00000100:00100000:0.0:1767319655.895987:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379814016:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319655.896056:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319655.897830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319656.919185:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319657.431023:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319657.431033:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319657.431036:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319657.431040:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319657.431044:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319657.431052:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4554
00000100:00080000:3.0:1767319657.431056:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319657.431063:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319657.431102:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164379814144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319657.431132:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319657.431135:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319657.431138:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319657.431142:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4554
00000100:00080000:3.0:1767319657.431144:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319657.431148:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319657.431162:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609180 x1853164379814272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319657.431193:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379814144:0@lo:38:kworker.0
00000100:00080000:3.0:1767319657.431224:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319657.431226:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319657.431228:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319657.431231:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4554
00000100:00080000:3.0:1767319657.431233:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319657.431237:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319657.431246:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f100 x1853164379814784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319657.431260:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319657.431261:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319657.431263:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319657.431264:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319657.431267:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4554
00000100:00080000:3.0:1767319657.431270:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319657.431273:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319657.431283:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90700 x1853164379815040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319657.431331:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379814272:0@lo:38:kworker.0
00000100:00100000:1.0:1767319657.431359:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319657.431361:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379814528:0@lo:400:kworker.0
00000100:00100000:1.0:1767319657.431384:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379814784:0@lo:38:kworker.0
00000100:00100000:3.0:1767319657.431390:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319657.431445:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379814400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319657.431519:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379814912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.435939:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319657.435960:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379814656:0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.436029:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319657.436103:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814528
00000100:00100000:3.0:1767319657.436113:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814528
00000100:00100000:3.0:1767319657.436170:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594
00000100:00100000:3.0:1767319657.436178:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379814528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.436233:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379814528:12345-0@lo:400:kworker.0 Request processed in 56us (4842us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319657.436240:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594
00000100:00080000:3.0:1767319657.436261:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319657.436294:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379814528:0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.436330:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814144
00000100:00100000:3.0:1767319657.436334:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814144
00000100:00100000:3.0:1767319657.436353:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814656
00000100:00100000:3.0:1767319657.436356:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814656
00000100:00100000:3.0:1767319657.436382:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4376
00000100:00100000:3.0:1767319657.436388:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379814656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.436423:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379814656:12345-0@lo:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319657.436429:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4376
00000100:00100000:3.0:1767319657.436442:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17137
00000100:00100000:3.0:1767319657.436446:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379814144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319657.436467:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319657.436497:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379814144:12345-0@lo:38:kworker.0 Request processed in 50us (5235us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319657.436503:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17137
00000100:00080000:3.0:1767319657.436517:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319657.436533:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379814656:0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.436579:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814272
00000100:00100000:3.0:1767319657.436583:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814272
00000100:00100000:3.0:1767319657.436641:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24
00000100:00100000:3.0:1767319657.436645:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379814272:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319657.436666:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319657.436699:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379814272:12345-0@lo:38:kworker.0 Request processed in 51us (5339us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319657.436705:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24
00000100:00100000:1.0:1767319657.437255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319657.437300:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379815040:0@lo:38:kworker.0
00000100:00100000:1.0:1767319657.437327:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319657.437350:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814784
00000100:00100000:1.0:1767319657.437354:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814784
00000100:00100000:1.0:1767319657.437374:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815040
00000100:00100000:1.0:1767319657.437377:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815040
00000100:00100000:1.0:1767319657.437389:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17138
00000100:00100000:1.0:1767319657.437393:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379814784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319657.437404:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319657.437432:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379814784:12345-0@lo:38:kworker.0 Request processed in 36us (177us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319657.437437:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17138
00000100:00100000:1.0:1767319657.437453:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17139
00000100:00100000:1.0:1767319657.437456:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379815040:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319657.437467:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319657.437488:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379815040:12345-0@lo:38:kworker.0 Request processed in 30us (161us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319657.437493:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17139
00000100:00080000:1.0:1767319657.437522:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319657.437526:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319657.437530:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379815040:0@lo:38:kworker.0
00000100:00080000:1.0:1767319657.437540:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319657.437544:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319657.437547:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379814144:0@lo:38:kworker.0
00000100:00080000:1.0:1767319657.437555:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319657.437558:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319657.437561:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379814272:0@lo:38:kworker.0
00000100:00080000:1.0:1767319657.437589:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319657.437592:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319657.439020:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379814784:0@lo:38:kworker.0
00000100:00100000:0.0:1767319657.439189:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319657.439317:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814400
00000100:00100000:3.0:1767319657.439329:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814400
00000100:00100000:3.0:1767319657.439393:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595
00000100:00100000:3.0:1767319657.439402:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379814400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.439459:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379814400:12345-0@lo:400:kworker.0 Request processed in 59us (270us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319657.439466:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595
00000100:00080000:0.0:1767319657.439521:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319657.439548:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379814400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319657.443792:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319657.443973:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379814912
00000100:00100000:3.0:1767319657.443983:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379814912
00000100:00100000:3.0:1767319657.444063:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4377
00000100:00100000:3.0:1767319657.444073:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379814912:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319657.444149:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379814912:12345-0@lo:400:kworker.0 Request processed in 77us (364us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319657.444156:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4377
00000100:00100000:2.0:1767319657.444266:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379814912:0@lo:400:kworker.0
00000100:00080000:0.0:1767319657.444908:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319657.943053:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319658.967462:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319659.409560:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319659.409614:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319659.409634:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929856
00000100:00100000:1.0:1767319659.409645:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929856
00000100:00100000:1.0:1767319659.409734:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291929984
00000100:00100000:1.0:1767319659.409738:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291929984
00000100:00080000:2.0:1767319659.409826:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319659.409900:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4378
00000100:00100000:3.0:1767319659.409913:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291929984:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319659.410029:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291929984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (414us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319659.410037:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4378
00000100:00100000:3.0:1767319659.410061:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17140
00000100:00100000:3.0:1767319659.410066:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291929856:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319659.410088:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319659.410114:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291929856:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (565us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319659.410120:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17140
00000100:00100000:3.0:1767319659.479239:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319659.479257:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379815168:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319659.479330:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319659.479520:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815168
00000100:00100000:0.0:1767319659.479529:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815168
00000100:00100000:0.0:1767319659.479609:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372
00000100:00100000:0.0:1767319659.479620:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379815168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319659.479649:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319659.479696:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379815168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (364us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319659.479704:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372
00000100:00100000:0.0:1767319659.479756:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379815168:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319659.479824:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319659.992236:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319661.015266:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319661.015452:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379815296:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319661.015522:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319661.015889:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815296
00000100:00100000:0.0:1767319661.015897:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815296
00000100:00100000:0.0:1767319661.015970:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373
00000100:00100000:0.0:1767319661.015982:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379815296:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319661.016086:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:0.0:1767319661.016180:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319661.016234:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379815296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 255us (711us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319661.016241:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373
00000100:00100000:3.0:1767319661.016328:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379815296:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319662.039226:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319662.551147:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319662.551158:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319662.551161:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319662.551164:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319662.551168:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319662.551175:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319662.551180:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319662.551187:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319662.551234:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc380 x1853164379815424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319662.551263:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319662.551267:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319662.551268:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319662.551272:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319662.551275:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319662.551279:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319662.551293:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc700 x1853164379815552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319662.551370:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319662.551373:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319662.551375:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319662.551378:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319662.551381:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319662.551384:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319662.551395:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19f80 x1853164379816064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319662.551409:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319662.551412:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319662.551413:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319662.551416:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4559
00000100:00080000:0.0:1767319662.551418:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319662.551422:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319662.551430:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19880 x1853164379816320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319662.551455:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379815808:0@lo:400:kworker.0
00000100:00100000:0.0:1767319662.551518:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319662.551607:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319662.551613:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379815936:0@lo:400:kworker.0
00000100:00100000:0.0:1767319662.551640:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319662.551674:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815936
00000100:00100000:0.0:1767319662.551680:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815936
00000100:00100000:1.0:1767319662.551843:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815808
00000100:00100000:1.0:1767319662.551848:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815808
00000100:00100000:1.0:1767319662.551905:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596
00000100:00100000:1.0:1767319662.551915:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379815808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552067:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379815808:12345-0@lo:400:kworker.0 Request processed in 153us (548us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319662.552072:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596
00000100:00100000:1.0:1767319662.552095:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4379
00000100:00100000:1.0:1767319662.552100:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379815936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552120:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379815936:12345-0@lo:400:kworker.0 Request processed in 21us (480us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319662.552124:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4379
00000100:00100000:1.0:1767319662.552141:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379816192:0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552156:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319662.552170:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319662.552173:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379815680:0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552185:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319662.552201:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816192
00000100:00100000:1.0:1767319662.552204:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816192
00000100:00100000:1.0:1767319662.552220:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4380
00000100:00100000:1.0:1767319662.552223:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379816192:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552243:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379816192:12345-0@lo:400:kworker.0 Request processed in 19us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319662.552247:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4380
00000100:00100000:1.0:1767319662.552256:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815680
00000100:00100000:1.0:1767319662.552258:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815680
00000100:00100000:1.0:1767319662.552271:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597
00000100:00100000:1.0:1767319662.552274:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379815680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552290:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379815680:12345-0@lo:400:kworker.0 Request processed in 16us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319662.552294:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597
00000100:00100000:1.0:1767319662.552316:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379815680:0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552322:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379816192:0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552344:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379815936:0@lo:400:kworker.0
00000100:00100000:1.0:1767319662.552353:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379815808:0@lo:400:kworker.0
00000100:00100000:2.0:1767319662.552479:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379815424:0@lo:38:kworker.0
00000100:00100000:2.0:1767319662.552511:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319662.552537:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379815552:0@lo:38:kworker.0
00000100:00100000:2.0:1767319662.552571:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319662.552595:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815552
00000100:00100000:2.0:1767319662.552598:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815552
00000100:00100000:2.0:1767319662.552616:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25
00000100:00100000:2.0:1767319662.552619:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379815552:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319662.552634:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319662.552655:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379815552:12345-0@lo:38:kworker.0 Request processed in 36us (96us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319662.552659:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25
00000100:00080000:2.0:1767319662.552680:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319662.552684:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319662.552686:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379815552:0@lo:38:kworker.0
00000100:00100000:2.0:1767319662.552689:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379816064:0@lo:38:kworker.0
00000100:00100000:2.0:1767319662.552704:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319662.552716:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379815424
00000100:00100000:2.0:1767319662.552718:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379815424
00000100:00100000:2.0:1767319662.552738:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816064
00000100:00100000:2.0:1767319662.552740:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816064
00000100:00100000:2.0:1767319662.552750:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17141
00000100:00100000:2.0:1767319662.552753:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379815424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319662.552760:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319662.552775:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379815424:12345-0@lo:38:kworker.0 Request processed in 21us (265us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319662.552779:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17141
00000100:00100000:2.0:1767319662.552786:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17142
00000100:00100000:2.0:1767319662.552788:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379816064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319662.552792:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319662.552804:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379816064:12345-0@lo:38:kworker.0 Request processed in 15us (99us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319662.552807:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17142
00000100:00080000:2.0:1767319662.552823:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319662.552826:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319662.552829:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379816064:0@lo:38:kworker.0
00000100:00100000:2.0:1767319662.552834:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379816320:0@lo:38:kworker.0
00000100:00100000:2.0:1767319662.552857:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319662.552895:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816320
00000100:00100000:2.0:1767319662.552898:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816320
00000100:00100000:2.0:1767319662.552917:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17143
00000100:00100000:2.0:1767319662.552921:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379816320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319662.552931:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319662.552955:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379816320:12345-0@lo:38:kworker.0 Request processed in 32us (97us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319662.552960:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17143
00000100:00080000:2.0:1767319662.552983:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319662.552987:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319662.552990:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379816320:0@lo:38:kworker.0
00000100:00080000:2.0:1767319662.553010:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319662.553013:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319662.553016:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379815424:0@lo:38:kworker.0
00000100:00080000:3.0:1767319662.553179:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319662.553183:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319663.065439:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319663.517178:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291930112 offset 0 length 520: 4
00000100:00100000:3.0:1767319663.517222:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319663.517262:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319663.517619:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291930368
00000100:00100000:2.0:1767319663.517629:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291930368
00000100:00100000:2.0:1767319663.517700:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291930240
00000100:00100000:2.0:1767319663.517704:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291930240
00000100:00100000:2.0:1767319663.517724:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4381
00000100:00100000:2.0:1767319663.517734:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291930368:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319663.517803:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291930368:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (579us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319663.517810:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4381
00000100:00100000:2.0:1767319663.517827:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17144
00000100:00100000:2.0:1767319663.517831:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291930240:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319663.517850:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319663.518184:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291930240:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 349us (921us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319663.518191:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17144
00000100:00080000:3.0:1767319663.518378:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319664.087325:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319664.606521:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379816448:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319664.606602:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319664.608801:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816448
00000100:00100000:0.0:1767319664.608815:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816448
00000100:00100000:0.0:1767319664.608939:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374
00000100:00100000:0.0:1767319664.608950:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379816448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319664.608981:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319664.609047:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379816448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (2445us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319664.609053:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374
00000100:00080000:2.0:1767319664.610029:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319664.610070:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379816448:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319665.111434:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319666.135754:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319666.136620:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319666.136643:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379816576:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319666.136729:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319666.136922:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816576
00000100:00100000:1.0:1767319666.136931:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816576
00000100:00080000:2.0:1767319666.136966:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319666.136994:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375
00000100:00100000:1.0:1767319666.137005:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379816576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319666.137040:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319666.137099:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379816576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (369us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319666.137107:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375
00000100:00100000:3.0:1767319666.137206:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379816576:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319667.159830:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319667.671220:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319667.671225:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319667.671228:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319667.671230:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319667.671233:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319667.671238:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319667.671241:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319667.671247:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319667.671283:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28e300 x1853164379816704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319667.671296:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319667.671298:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319667.671300:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319667.671303:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319667.671304:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319667.671306:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319667.671313:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe680 x1853164379816832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319667.671383:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319667.671385:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319667.671387:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319667.671389:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319667.671391:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319667.671393:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319667.671400:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164379817344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319667.671410:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319667.671412:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319667.671413:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319667.671415:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4564
00000100:00080000:3.0:1767319667.671417:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319667.671419:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319667.671424:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164379817600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319667.671524:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379816960:0@lo:400:kworker.0
00000100:00100000:1.0:1767319667.671595:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319667.671657:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319667.671664:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379817472:0@lo:400:kworker.0
00000100:00100000:1.0:1767319667.671688:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319667.671725:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379817472
00000100:00100000:1.0:1767319667.671730:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379817472
00000100:00100000:1.0:1767319667.671768:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4382
00000100:00100000:1.0:1767319667.671774:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379817472:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319667.671811:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379817472:12345-0@lo:400:kworker.0 Request processed in 37us (122us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319667.671816:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4382
00000100:00100000:1.0:1767319667.671847:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379817472:0@lo:400:kworker.0
00000100:00100000:3.0:1767319667.671911:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816960
00000100:00100000:3.0:1767319667.671914:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816960
00000100:00100000:3.0:1767319667.671947:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598
00000100:00100000:3.0:1767319667.671954:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379816960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319667.671994:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379816960:12345-0@lo:400:kworker.0 Request processed in 41us (398us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319667.672000:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598
00000100:00100000:2.0:1767319667.672177:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379817216:0@lo:400:kworker.0
00000100:00100000:2.0:1767319667.672202:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319667.672225:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319667.672229:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379817088:0@lo:400:kworker.0
00000100:00100000:2.0:1767319667.672244:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319667.672265:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319667.672268:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319667.672276:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379817216
00000100:00100000:2.0:1767319667.672278:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379817216
00000100:00100000:2.0:1767319667.672299:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4383
00000100:00100000:2.0:1767319667.672302:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379817216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319667.672338:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379817216:12345-0@lo:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319667.672345:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4383
00000100:00080000:2.0:1767319667.672359:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319667.672379:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379817216:0@lo:400:kworker.0
00000100:00100000:2.0:1767319667.672390:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379817088
00000100:00100000:2.0:1767319667.672392:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379817088
00000100:00100000:2.0:1767319667.672405:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599
00000100:00100000:2.0:1767319667.672409:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379817088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319667.672429:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379817088:12345-0@lo:400:kworker.0 Request processed in 20us (185us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319667.672433:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599
00000100:00100000:2.0:1767319667.672446:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379817088:0@lo:400:kworker.0
00000100:00100000:0.0:1767319667.672704:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319642/real 1767319642]  req@ffff8b0e0cfcd500 x1853164379810176/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319667 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319667.672722:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0cfcd500 x1853164379810176/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319667 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319667.672732:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379816704:0@lo:38:kworker.0
00000100:00100000:0.0:1767319667.672751:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319667.672762:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379816832:0@lo:38:kworker.0
00000100:00100000:0.0:1767319667.672774:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319667.672789:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379817344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319667.672801:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319667.672808:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379817600:0@lo:38:kworker.0
00000100:00100000:0.0:1767319667.672818:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319667.672826:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319667.672836:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319667.672838:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379810176:0@lo:250:kworker.0
00000100:00100000:2.0:1767319667.672921:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816704
00000100:00100000:2.0:1767319667.672925:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816704
00000100:00100000:2.0:1767319667.672944:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379817344
00000100:00100000:2.0:1767319667.672945:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379817344
00000100:00100000:2.0:1767319667.672950:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379817600
00000100:00100000:2.0:1767319667.672951:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379817600
00000100:00100000:2.0:1767319667.672957:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17145
00000100:00100000:2.0:1767319667.672960:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379816704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319667.672976:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319667.673112:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379816832
00000100:00100000:3.0:1767319667.673116:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379816832
00000100:00100000:3.0:1767319667.673136:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26
00000100:00100000:3.0:1767319667.673139:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379816832:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319667.673146:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319667.673181:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379816832:12345-0@lo:38:kworker.0 Request processed in 40us (405us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319667.673185:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26
00000100:00100000:3.0:1767319667.673218:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17146
00000100:00100000:3.0:1767319667.673222:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379817344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319667.673231:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319667.673255:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379817344:12345-0@lo:38:kworker.0 Request processed in 31us (452us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319667.673260:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17146
00000100:00100000:3.0:1767319667.673272:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17147
00000100:00100000:3.0:1767319667.673275:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379817600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319667.673283:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319667.673306:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379817600:12345-0@lo:38:kworker.0 Request processed in 29us (486us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319667.673310:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17147
00000100:00080000:3.0:1767319667.673324:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319667.673328:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319667.673331:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319667.673334:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4544
00000100:00080000:3.0:1767319667.673338:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319667.673342:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319667.673362:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dca80 x1853164379817728/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319667.673552:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379816960:0@lo:400:kworker.0
00000100:00100000:2.0:1767319667.673684:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379816704:12345-0@lo:38:kworker.0 Request processed in 40us (249us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319667.673692:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17145
00000100:00100000:0.0:1767319667.673761:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379817728:0@lo:250:kworker.0
00000400:00000100:0.0:1767319667.673788:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379817728 offset 0 length 520: 4
00000100:00080000:0.0:1767319667.673814:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319667.673818:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319667.673821:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379816704:0@lo:38:kworker.0
00000100:00080000:0.0:1767319667.673829:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319667.673833:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319667.673835:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379816832:0@lo:38:kworker.0
00000100:00080000:0.0:1767319667.673843:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319667.673846:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319667.673849:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379817344:0@lo:38:kworker.0
00000100:00080000:0.0:1767319667.673857:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319667.673859:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319667.673862:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379817600:0@lo:38:kworker.0
00010000:00010000:1.0:1767319668.184236:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319668.622984:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319668.623096:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291930624
00000100:00100000:0.0:1767319668.623106:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291930624
00000100:00100000:0.0:1767319668.623256:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4384
00000100:00100000:0.0:1767319668.623267:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291930624:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319668.623354:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291930624:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (380us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319668.623361:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4384
00000100:00100000:3.0:1767319668.626443:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319668.626727:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291930496
00000100:00100000:1.0:1767319668.626739:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291930496
00000100:00100000:1.0:1767319668.626789:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17148
00000100:00100000:1.0:1767319668.626797:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291930496:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319668.626818:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319668.626926:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291930496:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 127us (493us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319668.626934:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17148
00000100:00080000:2.0:1767319668.627902:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319669.207138:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319669.724528:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379817856:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319669.724616:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319669.724835:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379817856
00000100:00100000:0.0:1767319669.724843:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379817856
00000100:00100000:0.0:1767319669.724936:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376
00000100:00100000:0.0:1767319669.724946:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379817856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319669.724977:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319669.725026:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379817856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (410us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319669.725034:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376
00000100:00080000:3.0:1767319669.725103:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319669.725742:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379817856:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319670.231220:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319671.255364:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319671.255580:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379817984:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319671.255657:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319671.255858:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379817984
00000100:00100000:1.0:1767319671.255885:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379817984
00000100:00100000:1.0:1767319671.255949:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377
00000100:00100000:1.0:1767319671.255959:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379817984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319671.255987:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319671.256060:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379817984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (404us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319671.256068:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377
00000100:00080000:2.0:1767319671.256400:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319671.256597:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379817984:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319672.279190:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319672.791742:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319672.791753:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319672.791756:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319672.791760:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319672.791765:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319672.791773:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4570
00000100:00080000:3.0:1767319672.791778:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319672.791784:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319672.791821:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0de300 x1853164379818112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319672.791853:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319672.791856:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319672.791858:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319672.791862:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4570
00000100:00080000:3.0:1767319672.791865:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319672.791886:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319672.791902:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379818240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319672.791908:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379818112:0@lo:38:kworker.0
00000100:00080000:3.0:1767319672.791976:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319672.791979:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319672.791981:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767319672.791986:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319672.791988:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4570
00000100:00080000:3.0:1767319672.791994:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319672.791998:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319672.792014:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6300 x1853164379818752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319672.792031:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319672.792034:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319672.792036:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319672.792039:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4570
00000100:00080000:3.0:1767319672.792041:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319672.792045:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319672.792055:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379818240:0@lo:38:kworker.0
00000100:00100000:3.0:1767319672.792059:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed4700 x1853164379819008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319672.792099:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319672.792108:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379818112
00000100:00100000:3.0:1767319672.792117:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379818112
00000100:00100000:0.0:1767319672.792127:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379818752:0@lo:38:kworker.0
00000100:00100000:0.0:1767319672.792152:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319672.792157:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17149
00000100:00100000:3.0:1767319672.792166:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379818112:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319672.792173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379819008:0@lo:38:kworker.0
00010000:00020000:3.0:1767319672.792188:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319672.792216:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319672.792249:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379818112:12345-0@lo:38:kworker.0 Request processed in 82us (263us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319672.792258:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17149
00000100:00100000:3.0:1767319672.792275:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379818752
00000100:00100000:3.0:1767319672.792279:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379818752
00000100:00100000:2.0:1767319672.792289:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379818368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319672.792297:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819008
00000100:00100000:3.0:1767319672.792302:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819008
00000100:00100000:3.0:1767319672.792330:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17150
00000100:00100000:3.0:1767319672.792336:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379818752:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319672.792347:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319672.792405:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319672.792410:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319672.792414:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379818112:0@lo:38:kworker.0
00000100:00100000:0.0:1767319672.792452:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379818624:0@lo:400:kworker.0
00000100:00100000:0.0:1767319672.792508:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319672.792532:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319672.792538:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379818496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319672.792562:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319672.792589:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379818880:0@lo:400:kworker.0
00000100:00100000:0.0:1767319672.792611:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319672.792642:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379818624
00000100:00100000:0.0:1767319672.792646:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379818624
00000100:00100000:0.0:1767319672.792678:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379818880
00000100:00100000:0.0:1767319672.792680:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379818880
00000100:00100000:0.0:1767319672.792694:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4385
00000100:00100000:0.0:1767319672.792699:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379818624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319672.792753:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379818624:12345-0@lo:400:kworker.0 Request processed in 53us (244us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319672.792760:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4385
00000100:00100000:0.0:1767319672.792776:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4386
00000100:00100000:0.0:1767319672.792783:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379818880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319672.792812:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379818880:12345-0@lo:400:kworker.0 Request processed in 30us (200us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319672.792818:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4386
00000100:00100000:0.0:1767319672.792830:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17151
00000100:00100000:0.0:1767319672.792834:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379819008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319672.792845:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319672.792888:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379819008:12345-0@lo:38:kworker.0 Request processed in 52us (671us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319672.792893:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17151
00000100:00100000:0.0:1767319672.792924:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379818880:0@lo:400:kworker.0
00000100:00100000:0.0:1767319672.792946:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379818624:0@lo:400:kworker.0
00000100:00080000:0.0:1767319672.792965:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319672.792969:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319672.792971:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379819008:0@lo:38:kworker.0
00000100:00100000:0.0:1767319672.793019:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379818240
00000100:00100000:0.0:1767319672.793023:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379818240
00000100:00100000:0.0:1767319672.793041:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27
00000100:00100000:0.0:1767319672.793046:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379818240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319672.793056:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319672.793085:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379818240:12345-0@lo:38:kworker.0 Request processed in 38us (987us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319672.793091:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27
00000100:00080000:0.0:1767319672.793111:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319672.793115:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319672.793118:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379818240:0@lo:38:kworker.0
00000100:00080000:0.0:1767319672.793143:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319672.794142:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379818496
00000100:00100000:1.0:1767319672.794152:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379818496
00000100:00100000:1.0:1767319672.794268:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600
00000100:00100000:1.0:1767319672.794276:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379818496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319672.794337:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379818496:12345-0@lo:400:kworker.0 Request processed in 63us (1774us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319672.794345:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600
00000100:00100000:1.0:1767319672.794389:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379818496:0@lo:400:kworker.0
00000100:00100000:2.0:1767319672.797068:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319672.798044:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379818368
00000100:00100000:0.0:1767319672.798054:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379818368
00000100:00100000:0.0:1767319672.798369:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601
00000100:00100000:0.0:1767319672.798380:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379818368:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319672.798463:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379818368:12345-0@lo:400:kworker.0 Request processed in 85us (1401us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319672.798481:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601
00000100:00080000:2.0:1767319672.798845:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319672.798911:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379818368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319672.800143:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379818752:12345-0@lo:38:kworker.0 Request processed in 7801us (7985us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319672.800157:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17150
00000100:00080000:0.0:1767319672.800198:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319672.800205:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319672.800210:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379818752:0@lo:38:kworker.0
00010000:00010000:3.0:1767319673.304564:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319673.746479:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319673.746533:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319673.746717:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291930880
00000100:00100000:2.0:1767319673.746727:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291930880
00000100:00100000:2.0:1767319673.746791:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291930752
00000100:00100000:2.0:1767319673.746794:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291930752
00000100:00100000:2.0:1767319673.746809:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4387
00000100:00100000:2.0:1767319673.746817:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291930880:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319673.746902:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291930880:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (435us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319673.746907:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4387
00000100:00100000:2.0:1767319673.746921:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17152
00000100:00100000:2.0:1767319673.746924:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291930752:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319673.746940:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319673.746956:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291930752:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 32us (425us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319673.746963:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17152
00000100:00080000:3.0:1767319673.747151:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319674.327241:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319674.841858:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379819136:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319674.841957:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319674.842491:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819136
00000100:00100000:3.0:1767319674.842502:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819136
00000100:00100000:3.0:1767319674.842585:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378
00000100:00100000:3.0:1767319674.842597:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379819136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319674.842630:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319674.842714:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379819136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (756us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319674.842722:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378
00000100:00100000:1.0:1767319674.844551:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379819136:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319674.846077:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319675.351198:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319676.375486:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319676.376029:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379819264:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319676.376097:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319676.376146:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819264
00000100:00100000:2.0:1767319676.376155:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819264
00000100:00100000:2.0:1767319676.376214:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379
00000100:00080000:3.0:1767319676.376220:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319676.376224:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379819264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319676.376253:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319676.376321:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379819264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (223us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319676.376328:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379
00000100:00100000:0.0:1767319676.376473:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379819264:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319677.399078:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319677.911373:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319677.911386:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319677.911389:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319677.911393:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319677.911398:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319677.911405:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4575
00000100:00080000:0.0:1767319677.911410:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319677.911416:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319677.911466:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164379819392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319677.911492:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319677.911496:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319677.911498:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319677.911501:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4575
00000100:00080000:0.0:1767319677.911504:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319677.911508:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319677.911522:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379819520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319677.911583:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319677.911587:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319677.911589:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319677.911592:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4575
00000100:00080000:0.0:1767319677.911594:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319677.911598:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319677.911609:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333100 x1853164379820032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319677.911623:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319677.911626:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319677.911628:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319677.911631:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4575
00000100:00080000:0.0:1767319677.911633:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319677.911636:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319677.911645:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332300 x1853164379820288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319677.911712:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379819904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319677.911788:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319677.911853:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319677.911859:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379819776:0@lo:400:kworker.0
00000100:00100000:1.0:1767319677.911909:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319677.911951:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819776
00000100:00100000:1.0:1767319677.911959:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819776
00000100:00100000:1.0:1767319677.912007:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602
00000100:00100000:1.0:1767319677.912016:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379819776:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319677.912068:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379819776:12345-0@lo:400:kworker.0 Request processed in 52us (157us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319677.912074:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602
00000100:00100000:1.0:1767319677.912104:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379819648:0@lo:400:kworker.0
00000100:00100000:1.0:1767319677.912126:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319677.912142:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319677.912147:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379820160:0@lo:400:kworker.0
00000100:00100000:1.0:1767319677.912168:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319677.912193:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819904
00000100:00100000:1.0:1767319677.912197:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819904
00000100:00100000:1.0:1767319677.912232:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820160
00000100:00100000:1.0:1767319677.912235:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820160
00000100:00100000:1.0:1767319677.912253:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4388
00000100:00100000:1.0:1767319677.912259:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379819904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319677.912290:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379819904:12345-0@lo:400:kworker.0 Request processed in 31us (503us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319677.912296:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4388
00000100:00100000:1.0:1767319677.912309:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4389
00000100:00100000:1.0:1767319677.912315:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379820160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319677.912344:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379820160:12345-0@lo:400:kworker.0 Request processed in 30us (176us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319677.912351:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4389
00000100:00080000:1.0:1767319677.912367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319677.912380:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819648
00000100:00100000:1.0:1767319677.912384:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819648
00000100:00100000:1.0:1767319677.912409:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603
00000100:00100000:1.0:1767319677.912415:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379819648:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319677.912498:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379819392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319677.912533:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319677.912550:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379819520:0@lo:38:kworker.0
00000100:00100000:2.0:1767319677.912574:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319677.912596:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379820032:0@lo:38:kworker.0
00000100:00100000:2.0:1767319677.912614:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319677.912628:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379820288:0@lo:38:kworker.0
00000100:00100000:2.0:1767319677.912645:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319677.912671:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819520
00000100:00100000:2.0:1767319677.912675:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819520
00000100:00100000:2.0:1767319677.912693:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28
00000100:00100000:2.0:1767319677.912698:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379819520:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319677.912716:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319677.912749:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379819520:12345-0@lo:38:kworker.0 Request processed in 49us (174us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319677.912755:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28
00000100:00100000:2.0:1767319677.912771:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379819392
00000100:00100000:2.0:1767319677.912774:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379819392
00000100:00100000:2.0:1767319677.912791:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820032
00000100:00100000:2.0:1767319677.912793:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820032
00000100:00100000:2.0:1767319677.912806:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820288
00000100:00100000:2.0:1767319677.912808:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820288
00000100:00100000:2.0:1767319677.912818:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17153
00000100:00100000:2.0:1767319677.912822:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379819392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319677.912831:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319677.912855:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379819392:12345-0@lo:38:kworker.0 Request processed in 31us (322us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319677.912860:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17153
00000100:00100000:2.0:1767319677.912886:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17154
00000100:00100000:2.0:1767319677.912890:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379820032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319677.912898:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319677.912917:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379820032:12345-0@lo:38:kworker.0 Request processed in 26us (303us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319677.912922:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17154
00000100:00100000:2.0:1767319677.912932:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17155
00000100:00100000:2.0:1767319677.912936:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379820288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319677.912943:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319677.912961:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379820288:12345-0@lo:38:kworker.0 Request processed in 23us (314us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319677.912968:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17155
00000100:00080000:2.0:1767319677.913004:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319677.913008:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319677.913012:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379819392:0@lo:38:kworker.0
00000100:00080000:2.0:1767319677.913019:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319677.913022:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319677.913024:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379819520:0@lo:38:kworker.0
00000100:00080000:2.0:1767319677.913029:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319677.913032:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319677.913034:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379820032:0@lo:38:kworker.0
00000100:00080000:2.0:1767319677.913039:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319677.913041:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319677.913043:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379820288:0@lo:38:kworker.0
00000100:00100000:2.0:1767319677.913107:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379820160:0@lo:400:kworker.0
00000100:00100000:2.0:1767319677.913127:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379819776:0@lo:400:kworker.0
00000100:00100000:2.0:1767319677.913137:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379819904:0@lo:400:kworker.0
00000100:00080000:2.0:1767319677.913157:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319677.913375:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379819648:12345-0@lo:400:kworker.0 Request processed in 960us (1247us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319677.913383:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603
00000100:00100000:2.0:1767319677.913820:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379819648:0@lo:400:kworker.0
00010000:00010000:3.0:1767319678.423192:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319678.863780:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319678.863830:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319678.864074:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291931136
00000100:00100000:0.0:1767319678.864087:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291931136
00000100:00100000:0.0:1767319678.864176:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291931008
00000100:00100000:0.0:1767319678.864180:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291931008
00000100:00100000:0.0:1767319678.864200:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4390
00000100:00100000:0.0:1767319678.864211:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291931136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319678.864323:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291931136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 114us (553us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319678.864332:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4390
00000100:00100000:0.0:1767319678.864352:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17156
00000100:00100000:0.0:1767319678.864357:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291931008:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319678.864380:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319678.864403:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291931008:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (574us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319678.864437:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17156
00000100:00080000:3.0:1767319678.864816:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319679.447143:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319679.959153:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379820416:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319679.959231:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319679.959282:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820416
00000100:00100000:0.0:1767319679.959291:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820416
00000100:00100000:0.0:1767319679.959349:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380
00000100:00100000:0.0:1767319679.959361:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379820416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319679.959388:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319679.959451:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379820416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (220us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319679.959458:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380
00000100:00080000:3.0:1767319679.959514:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319679.959673:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379820416:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319680.471304:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319681.496279:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319681.496456:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379820544:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319681.496525:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319681.496601:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820544
00000100:00100000:2.0:1767319681.496610:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820544
00000100:00080000:3.0:1767319681.496658:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319681.496676:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381
00000100:00100000:2.0:1767319681.496686:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379820544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319681.496713:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319681.496770:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379820544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (243us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319681.496777:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381
00000100:00100000:3.0:1767319681.496964:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379820544:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319682.519846:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319683.031004:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319683.031017:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319683.031020:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319683.031024:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319683.031028:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319683.031036:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4580
00000100:00080000:0.0:1767319683.031252:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319683.031334:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319683.031388:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332680 x1853164379820672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319683.031419:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319683.031423:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319683.031425:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319683.031429:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4580
00000100:00080000:0.0:1767319683.031432:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319683.031435:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319683.031450:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332d80 x1853164379820800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319683.031519:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319683.031522:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319683.031524:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319683.031527:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4580
00000100:00080000:0.0:1767319683.031530:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319683.031533:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319683.031618:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379821312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319683.031635:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319683.031639:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319683.031640:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319683.031643:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4580
00000100:00080000:0.0:1767319683.031646:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319683.031650:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319683.031661:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333100 x1853164379821568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319683.031691:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379821056:0@lo:400:kworker.0
00000100:00100000:0.0:1767319683.031761:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319683.031820:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319683.031826:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379821184:0@lo:400:kworker.0
00000100:00100000:0.0:1767319683.031850:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319683.032173:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379821440:0@lo:400:kworker.0
00000100:00100000:3.0:1767319683.032202:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319683.032234:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319683.032239:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379820928:0@lo:400:kworker.0
00000100:00100000:3.0:1767319683.032268:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319683.032922:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821056
00000100:00100000:1.0:1767319683.032932:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821056
00000100:00100000:1.0:1767319683.033003:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820928
00000100:00100000:1.0:1767319683.033007:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820928
00000100:00100000:1.0:1767319683.033030:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604
00000100:00100000:0.0:1767319683.033220:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821184
00000100:00100000:0.0:1767319683.033224:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821184
00000100:00100000:0.0:1767319683.033253:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821440
00000100:00100000:1.0:1767319683.033341:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379821056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319683.033423:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379821056:12345-0@lo:400:kworker.0 Request processed in 384us (1660us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319683.033431:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604
00000100:00100000:1.0:1767319683.033453:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605
00000100:00100000:1.0:1767319683.033461:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379820928:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319683.033492:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379820928:12345-0@lo:400:kworker.0 Request processed in 33us (1223us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319683.033497:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605
00000100:00100000:1.0:1767319683.033522:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379820672:0@lo:38:kworker.0
00000100:00100000:2.0:1767319683.033667:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4391
00000100:00100000:2.0:1767319683.033677:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379821184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319683.033714:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379821184:12345-0@lo:400:kworker.0 Request processed in 39us (1862us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319683.033720:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4391
00000100:00100000:2.0:1767319683.033796:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379821184:0@lo:400:kworker.0
00000100:00100000:2.0:1767319683.033810:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379821056:0@lo:400:kworker.0
00000100:00100000:0.0:1767319683.033901:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821440
00000100:00100000:0.0:1767319683.033943:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4392
00000100:00100000:0.0:1767319683.033951:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379821440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319683.033987:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379821440:12345-0@lo:400:kworker.0 Request processed in 37us (1783us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319683.033993:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4392
00000100:00080000:3.0:1767319683.034243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319683.034249:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319683.034251:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319683.034291:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379820928:0@lo:400:kworker.0
00000100:00100000:3.0:1767319683.034304:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379821440:0@lo:400:kworker.0
00000100:00100000:1.0:1767319683.034464:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319683.034492:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379820800:0@lo:38:kworker.0
00000100:00100000:1.0:1767319683.034517:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319683.034755:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820672
00000100:00100000:2.0:1767319683.034761:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820672
00000100:00100000:2.0:1767319683.034787:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17157
00000100:00100000:2.0:1767319683.034792:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379820672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319683.034808:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319683.034840:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379820672:12345-0@lo:38:kworker.0 Request processed in 47us (376us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319683.034847:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17157
00000100:00100000:3.0:1767319683.035038:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379820800
00000100:00100000:1.0:1767319683.035206:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379821312:0@lo:38:kworker.0
00000100:00100000:1.0:1767319683.035234:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319683.035331:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379820800
00000100:00100000:3.0:1767319683.035362:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29
00000100:00100000:3.0:1767319683.035367:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379820800:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319683.035387:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319683.035422:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379820800:12345-0@lo:38:kworker.0 Request processed in 53us (904us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319683.035428:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29
00000100:00100000:1.0:1767319683.035729:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379821568:0@lo:38:kworker.0
00000100:00100000:1.0:1767319683.035758:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319683.035801:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319683.035806:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319683.035810:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379820672:0@lo:38:kworker.0
00000100:00080000:1.0:1767319683.035819:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319683.035822:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319683.035825:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379820800:0@lo:38:kworker.0
00000100:00100000:0.0:1767319683.035902:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821312
00000100:00100000:0.0:1767319683.035907:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821312
00000100:00100000:0.0:1767319683.035936:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821568
00000100:00100000:0.0:1767319683.035939:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821568
00000100:00100000:0.0:1767319683.035961:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17158
00000100:00100000:0.0:1767319683.035967:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379821312:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319683.036213:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319683.036251:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379821312:12345-0@lo:38:kworker.0 Request processed in 283us (1015us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319683.036359:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17159
00000100:00100000:2.0:1767319683.036365:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379821568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319683.036386:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319683.036415:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379821568:12345-0@lo:38:kworker.0 Request processed in 49us (656us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319683.036421:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17159
00000100:00100000:0.0:1767319683.036628:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17158
00000100:00080000:1.0:1767319683.036757:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319683.036762:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319683.036766:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379821312:0@lo:38:kworker.0
00000100:00080000:1.0:1767319683.036774:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319683.036778:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319683.036780:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379821568:0@lo:38:kworker.0
00010000:00010000:3.0:1767319683.543498:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319683.988663:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319683.988709:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319683.988793:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291931264
00000100:00100000:1.0:1767319683.988804:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291931264
00000100:00100000:1.0:1767319683.988958:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291931392
00000100:00100000:1.0:1767319683.988962:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291931392
00000100:00100000:1.0:1767319683.989022:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4393
00000100:00100000:1.0:1767319683.989033:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291931392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319683.989112:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291931392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (402us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319683.989120:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4393
00000100:00100000:1.0:1767319683.989142:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17160
00000100:00100000:1.0:1767319683.989146:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291931264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319683.989166:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319683.989191:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291931264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (540us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319683.989196:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17160
00000100:00080000:3.0:1767319683.994226:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319684.567135:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319685.080385:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379821696:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319685.080466:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319685.080540:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821696
00000100:00100000:3.0:1767319685.080551:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821696
00000100:00100000:3.0:1767319685.080630:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382
00000100:00100000:3.0:1767319685.080641:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379821696:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319685.080672:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:3.0:1767319685.080675:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319685.080960:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379821696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 320us (493us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319685.080968:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382
00000100:00100000:2.0:1767319685.085112:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379821696:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319685.591241:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319686.616650:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319686.616946:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379821824:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319686.617036:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319686.617272:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821824
00000100:00100000:1.0:1767319686.617281:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821824
00000100:00100000:1.0:1767319686.617381:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383
00000100:00100000:1.0:1767319686.617393:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379821824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319686.617451:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319686.617512:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379821824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (477us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319686.617522:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383
00000100:00100000:1.0:1767319686.617595:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379821824:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319686.618568:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319687.639995:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319688.151209:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319688.151219:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319688.151222:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319688.151227:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319688.151232:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319688.151240:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4585
00000100:00080000:0.0:1767319688.151245:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319688.151252:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319688.151289:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379821952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319688.151310:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319688.151313:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319688.151315:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319688.151319:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4585
00000100:00080000:0.0:1767319688.151322:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319688.151336:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319688.151350:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebc000 x1853164379822080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319688.151363:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379821952:0@lo:38:kworker.0
00000100:00080000:0.0:1767319688.151405:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319688.151409:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319688.151410:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319688.151414:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4585
00000100:00080000:0.0:1767319688.151416:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319688.151420:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319688.151429:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebe680 x1853164379822592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319688.151439:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319688.151446:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319688.151450:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319688.151452:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319688.151455:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4585
00000100:00080000:0.0:1767319688.151457:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319688.151461:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319688.151471:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164379822848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319688.151499:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379822080:0@lo:38:kworker.0
00000100:00100000:2.0:1767319688.151527:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319688.151551:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379822592:0@lo:38:kworker.0
00000100:00100000:2.0:1767319688.151571:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319688.151588:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379822848:0@lo:38:kworker.0
00000100:00100000:2.0:1767319688.151608:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319688.151639:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822080
00000100:00100000:2.0:1767319688.151647:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822080
00000100:00100000:2.0:1767319688.151678:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30
00000100:00100000:2.0:1767319688.151685:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379822080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319688.151705:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319688.151745:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379822080:12345-0@lo:38:kworker.0 Request processed in 58us (216us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319688.151752:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30
00000100:00080000:2.0:1767319688.151788:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319688.151793:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319688.151797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379822080:0@lo:38:kworker.0
00000100:00100000:2.0:1767319688.152066:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379822464:0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.152092:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319688.152115:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319688.152121:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379822336:0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.152144:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319688.152170:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822336
00000100:00100000:2.0:1767319688.152174:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822336
00000100:00100000:2.0:1767319688.152230:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606
00000100:00100000:2.0:1767319688.152237:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379822336:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.152279:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379822336:12345-0@lo:400:kworker.0 Request processed in 42us (134us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319688.152285:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606
00000100:00080000:2.0:1767319688.152302:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319688.152337:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379822336:0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.152358:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379821952
00000100:00100000:2.0:1767319688.152362:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379821952
00000100:00100000:2.0:1767319688.152381:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822592
00000100:00100000:2.0:1767319688.152384:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822592
00000100:00100000:2.0:1767319688.152395:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822848
00000100:00100000:2.0:1767319688.152398:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822848
00000100:00100000:2.0:1767319688.152407:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822464
00000100:00100000:2.0:1767319688.152409:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822464
00000100:00100000:2.0:1767319688.152432:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4394
00000100:00100000:2.0:1767319688.152438:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379822464:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.152473:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379822464:12345-0@lo:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319688.152479:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4394
00000100:00100000:2.0:1767319688.152492:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17161
00000100:00100000:2.0:1767319688.152495:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379821952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319688.152507:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319688.152536:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379821952:12345-0@lo:38:kworker.0 Request processed in 39us (1099us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319688.152542:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17161
00000100:00100000:2.0:1767319688.152554:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17162
00000100:00100000:2.0:1767319688.152558:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379822592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319688.152567:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319688.152591:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379822592:12345-0@lo:38:kworker.0 Request processed in 32us (1019us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319688.152597:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17162
00000100:00100000:2.0:1767319688.152608:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17163
00000100:00100000:2.0:1767319688.152612:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379822848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319688.152621:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319688.152644:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379822848:12345-0@lo:38:kworker.0 Request processed in 30us (1035us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319688.152649:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17163
00000100:00080000:2.0:1767319688.152667:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319688.152686:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319688.152690:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319688.152694:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379822592:0@lo:38:kworker.0
00000100:00080000:2.0:1767319688.152701:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319688.152706:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319688.152708:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379822848:0@lo:38:kworker.0
00000100:00080000:2.0:1767319688.152716:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319688.152719:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319688.152722:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379821952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319688.152752:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379822464:0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.154224:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379822208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.154283:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319688.154335:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319688.154343:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379822720:0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.154366:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319688.154403:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822720
00000100:00100000:2.0:1767319688.154409:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822720
00000100:00100000:2.0:1767319688.154456:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4395
00000100:00100000:2.0:1767319688.154463:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379822720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.154508:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379822720:12345-0@lo:400:kworker.0 Request processed in 44us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319688.154514:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4395
00000100:00100000:2.0:1767319688.154538:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822208
00000100:00100000:2.0:1767319688.154542:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822208
00000100:00100000:2.0:1767319688.154570:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607
00000100:00100000:2.0:1767319688.154576:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379822208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.154605:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379822208:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319688.154611:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607
00000100:00080000:2.0:1767319688.154630:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319688.154634:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319688.154661:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379822720:0@lo:400:kworker.0
00000100:00100000:2.0:1767319688.154670:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379822208:0@lo:400:kworker.0
00010000:00010000:3.0:1767319688.663159:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319689.105176:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767319689.105259:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291931520 offset 0 length 520: 4
00000100:00100000:2.0:1767319689.105753:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291931776
00000100:00100000:2.0:1767319689.105764:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291931776
00000100:00100000:2.0:1767319689.105930:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4396
00000100:00100000:2.0:1767319689.105943:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291931776:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319689.106090:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291931776:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 149us (921us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319689.106098:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4396
00000100:00080000:0.0:1767319689.106304:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319689.106819:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319689.107016:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291931648
00000100:00100000:3.0:1767319689.107023:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291931648
00000100:00100000:3.0:1767319689.107162:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17164
00000100:00100000:3.0:1767319689.107169:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291931648:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319689.107191:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319689.107243:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291931648:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 72us (424us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319689.107249:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17164
00010000:00010000:3.0:1767319689.689558:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319690.201926:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379822976:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319690.202012:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319690.202173:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379822976
00000100:00100000:3.0:1767319690.202184:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379822976
00000100:00080000:0.0:1767319690.202249:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319690.202263:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384
00000100:00100000:3.0:1767319690.202275:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379822976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319690.202314:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319690.202377:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379822976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (365us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319690.202384:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384
00000100:00100000:0.0:1767319690.202522:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379822976:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319690.711452:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319691.735067:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379823104:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319691.735157:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319691.735226:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319691.735258:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379823104
00000100:00100000:1.0:1767319691.735266:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379823104
00000100:00100000:1.0:1767319691.735352:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385
00000100:00100000:1.0:1767319691.735362:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379823104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319691.735390:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319691.735441:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379823104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319691.735449:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385
00000100:00100000:1.0:1767319691.735510:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379823104:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319691.735674:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319692.246977:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319667/real 1767319667]  req@ffff8b0e0e0dca80 x1853164379817728/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319692 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319692.247013:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0e0dca80 x1853164379817728/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319692 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319692.247034:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319692.247068:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319692.247073:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379817728:0@lo:250:kworker.0
00000100:00080000:2.0:1767319692.247384:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319692.247391:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319692.247395:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319692.247399:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4570
00000100:00080000:2.0:1767319692.247403:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319692.247409:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319692.247441:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebed80 x1853164379823232/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319692.247457:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319692.247461:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319692.247463:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319692.247467:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4590
00000100:00080000:2.0:1767319692.247469:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319692.247473:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319692.247487:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164379823360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319692.247496:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319692.247500:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319692.247501:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319692.247505:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4590
00000100:00080000:2.0:1767319692.247507:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319692.247511:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319692.247523:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379823488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319692.247592:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319692.247596:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319692.247599:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319692.247602:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4590
00000100:00080000:2.0:1767319692.247605:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319692.247609:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319692.247619:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebc000 x1853164379823872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319692.247637:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319692.247640:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319692.247642:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319692.247645:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4590
00000100:00080000:2.0:1767319692.247647:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319692.247650:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319692.247659:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379824128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319692.247718:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379823744:0@lo:400:kworker.0
00000100:00100000:2.0:1767319692.247780:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319692.247837:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319692.247843:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379824000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319692.247889:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319692.247921:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379823744
00000100:00100000:2.0:1767319692.247928:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379823744
00000100:00100000:2.0:1767319692.247974:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824000
00000100:00100000:2.0:1767319692.247978:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824000
00000100:00100000:2.0:1767319692.248001:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4397
00000100:00100000:2.0:1767319692.248010:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379823744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319692.248061:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379823744:12345-0@lo:400:kworker.0 Request processed in 52us (281us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319692.248068:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4397
00000100:00100000:2.0:1767319692.248098:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4398
00000100:00100000:2.0:1767319692.248108:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379824000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319692.248145:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379824000:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319692.248151:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4398
00000100:00100000:2.0:1767319692.248191:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379824000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319692.248204:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379823744:0@lo:400:kworker.0
00000100:00100000:3.0:1767319692.248227:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379823616:0@lo:400:kworker.0
00000100:00100000:3.0:1767319692.248266:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319692.248487:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379823616
00000100:00100000:2.0:1767319692.248492:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379823616
00000100:00100000:2.0:1767319692.248532:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608
00000100:00100000:2.0:1767319692.248539:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379823616:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319692.248579:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379823616:12345-0@lo:400:kworker.0 Request processed in 40us (313us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319692.248586:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608
00000100:00100000:2.0:1767319692.248613:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379823616:0@lo:400:kworker.0
00000100:00080000:0.0:1767319692.248714:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319692.248720:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319692.248971:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379823232:0@lo:250:kworker.0
00000400:00000100:1.0:1767319692.248999:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379823232 offset 0 length 520: 4
00000100:00100000:1.0:1767319692.249019:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379823360:0@lo:38:kworker.0
00000100:00100000:1.0:1767319692.249042:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319692.249066:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379823488:0@lo:38:kworker.0
00000100:00100000:1.0:1767319692.249103:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319692.249138:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379823872:0@lo:38:kworker.0
00000100:00100000:1.0:1767319692.249159:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319692.249177:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379824128:0@lo:38:kworker.0
00000100:00100000:1.0:1767319692.249198:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319692.249226:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379823360
00000100:00100000:1.0:1767319692.249231:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379823360
00000100:00100000:1.0:1767319692.249251:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379823872
00000100:00100000:1.0:1767319692.249254:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379823872
00000100:00100000:0.0:1767319692.249417:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379823488
00000100:00100000:0.0:1767319692.249422:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379823488
00000100:00100000:0.0:1767319692.249446:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31
00000100:00100000:0.0:1767319692.249452:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379823488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319692.249473:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319692.249513:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379823488:12345-0@lo:38:kworker.0 Request processed in 59us (409us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319692.249519:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31
00000100:00100000:0.0:1767319692.249554:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824128
00000100:00100000:0.0:1767319692.249558:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824128
00000100:00100000:0.0:1767319692.249579:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17165
00000100:00100000:0.0:1767319692.249583:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379823360:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319692.249593:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319692.249618:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379823360:12345-0@lo:38:kworker.0 Request processed in 33us (575us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319692.249624:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17165
00000100:00100000:0.0:1767319692.249640:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17166
00000100:00100000:0.0:1767319692.249644:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379824128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319692.249653:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319692.249675:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379824128:12345-0@lo:38:kworker.0 Request processed in 29us (476us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319692.249681:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17166
00000100:00080000:0.0:1767319692.249738:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319692.249743:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319692.249747:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379823360:0@lo:38:kworker.0
00000100:00080000:0.0:1767319692.249756:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319692.249760:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319692.249763:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379823488:0@lo:38:kworker.0
00000100:00080000:0.0:1767319692.249771:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319692.249774:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319692.249777:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379824128:0@lo:38:kworker.0
00000100:00100000:1.0:1767319692.250002:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17167
00000100:00100000:1.0:1767319692.250007:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379823872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319692.250017:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319692.250046:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379823872:12345-0@lo:38:kworker.0 Request processed in 38us (886us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319692.250051:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17167
00000100:00080000:0.0:1767319692.250268:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319692.250274:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319692.250277:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379823872:0@lo:38:kworker.0
00010000:00010000:3.0:1767319692.759077:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319693.783246:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319694.223770:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319694.223835:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319694.223998:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291931904
00000100:00100000:2.0:1767319694.224509:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291931904
00000100:00100000:2.0:1767319694.224569:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291932032
00000100:00100000:2.0:1767319694.224573:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291932032
00000100:00100000:1.0:1767319694.224701:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17168
00000100:00100000:1.0:1767319694.224712:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291931904:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319694.224743:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319694.224833:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291931904:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 122us (1087us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319694.224842:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17168
00000100:00100000:2.0:1767319694.225377:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4399
00000100:00100000:2.0:1767319694.225387:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291932032:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319694.225440:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291932032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 56us (1605us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319694.225447:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4399
00000100:00080000:3.0:1767319694.228361:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319694.807361:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319695.321415:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319695.321450:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379824256:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319695.321555:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319695.321657:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824256
00000100:00100000:3.0:1767319695.321667:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824256
00000100:00100000:3.0:1767319695.321755:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386
00000100:00100000:3.0:1767319695.321768:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379824256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319695.321810:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319695.321906:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379824256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (313us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319695.321914:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386
00000100:00080000:3.0:1767319695.321936:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319695.321978:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379824256:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319695.831195:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319696.855162:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319696.855179:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379824384:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319696.855262:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319696.855454:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824384
00000100:00100000:1.0:1767319696.855463:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824384
00000100:00100000:1.0:1767319696.855534:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387
00000100:00100000:1.0:1767319696.855543:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379824384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319696.855573:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319696.855622:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379824384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (359us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319696.855629:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387
00010000:00010000:0.0:1767319696.855798:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319696.855853:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319696.855933:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379824384:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319697.367043:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319697.367061:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319697.367064:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319697.367070:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319697.367077:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319697.367091:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319697.367098:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319697.367109:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319697.367168:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ca80 x1853164379824512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319697.367208:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319697.367212:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319697.367214:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319697.367218:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319697.367221:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319697.367225:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319697.367250:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ce00 x1853164379824640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319697.367320:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319697.367324:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319697.367326:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319697.367331:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319697.367333:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319697.367338:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319697.367349:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ea00 x1853164379825024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319697.367382:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319697.367386:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319697.367388:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319697.367391:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4594
00000100:00080000:0.0:1767319697.367393:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319697.367397:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319697.367408:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f800 x1853164379825280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319697.367571:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379824896:0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.367674:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319697.367766:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319697.367773:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379824768:0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.367813:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319697.367860:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824768
00000100:00100000:3.0:1767319697.367897:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824768
00000100:00100000:3.0:1767319697.367964:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609
00000100:00100000:3.0:1767319697.367974:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379824768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.368040:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379824768:12345-0@lo:400:kworker.0 Request processed in 67us (226us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319697.368049:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609
00000100:00100000:3.0:1767319697.368105:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379824768:0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.368148:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319697.368159:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379825152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.368188:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319697.368221:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824896
00000100:00100000:3.0:1767319697.368224:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824896
00000100:00100000:3.0:1767319697.368268:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825152
00000100:00100000:3.0:1767319697.368271:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825152
00000100:00100000:3.0:1767319697.368295:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4400
00000100:00100000:3.0:1767319697.368302:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379824896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.368338:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379824896:12345-0@lo:400:kworker.0 Request processed in 37us (665us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319697.368345:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4400
00000100:00100000:3.0:1767319697.368356:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4401
00000100:00100000:3.0:1767319697.368361:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379825152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.368387:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379825152:12345-0@lo:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319697.368393:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4401
00000100:00100000:3.0:1767319697.368433:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379825152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319697.368457:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379824896:0@lo:400:kworker.0
00000100:00100000:2.0:1767319697.369297:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379824512:0@lo:38:kworker.0
00000100:00100000:2.0:1767319697.369355:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319697.369394:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379824640:0@lo:38:kworker.0
00000100:00100000:2.0:1767319697.369433:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319697.369466:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379825024:0@lo:38:kworker.0
00000100:00100000:2.0:1767319697.369492:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319697.369514:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379825280:0@lo:38:kworker.0
00000100:00100000:2.0:1767319697.369553:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319697.369859:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319697.369867:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319697.369912:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824512
00000100:00100000:2.0:1767319697.369920:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824512
00000100:00100000:2.0:1767319697.369960:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825024
00000100:00100000:2.0:1767319697.369963:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825024
00000100:00100000:2.0:1767319697.369972:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825280
00000100:00100000:2.0:1767319697.369975:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825280
00000100:00100000:2.0:1767319697.369988:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17169
00000100:00100000:2.0:1767319697.369995:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379824512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319697.370020:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319697.370072:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379824512:12345-0@lo:38:kworker.0 Request processed in 76us (716us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319697.370079:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17169
00000100:00100000:2.0:1767319697.370098:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17170
00000100:00100000:2.0:1767319697.370102:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379825024:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319697.370111:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319697.370132:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379825024:12345-0@lo:38:kworker.0 Request processed in 29us (640us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319697.370138:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17170
00000100:00100000:2.0:1767319697.370146:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17171
00000100:00100000:2.0:1767319697.370150:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379825280:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319697.370157:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319697.370177:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379825280:12345-0@lo:38:kworker.0 Request processed in 26us (624us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319697.370183:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17171
00000100:00080000:2.0:1767319697.370232:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319697.370237:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319697.370253:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379824512:0@lo:38:kworker.0
00000100:00080000:2.0:1767319697.370264:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319697.370268:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319697.370271:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379825024:0@lo:38:kworker.0
00000100:00080000:2.0:1767319697.370277:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319697.370281:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319697.370283:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379825280:0@lo:38:kworker.0
00000100:00100000:0.0:1767319697.370397:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379824640
00000100:00100000:0.0:1767319697.370403:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379824640
00000100:00100000:0.0:1767319697.370447:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32
00000100:00100000:0.0:1767319697.370454:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379824640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319697.370464:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319697.370505:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379824640:12345-0@lo:38:kworker.0 Request processed in 50us (1071us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319697.370511:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32
00000100:00080000:0.0:1767319697.370550:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319697.370554:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319697.370557:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379824640:0@lo:38:kworker.0
00010000:00010000:3.0:1767319697.879563:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319698.903820:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319699.350403:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319699.354976:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291932288
00000100:00100000:3.0:1767319699.354998:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291932288
00000100:00100000:3.0:1767319699.355159:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4402
00000100:00100000:3.0:1767319699.355173:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291932288:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319699.355318:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291932288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 149us (4930us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319699.355328:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4402
00000100:00080000:2.0:1767319699.355395:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319699.356406:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319699.360492:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291932160
00000100:00100000:0.0:1767319699.360509:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291932160
00000100:00100000:0.0:1767319699.360570:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17172
00000100:00100000:0.0:1767319699.360579:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291932160:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319699.360604:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319699.360697:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291932160:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 118us (4304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319699.360705:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17172
00010000:00010000:1.0:1767319699.929505:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319700.440127:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379825408:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319700.440267:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319700.443208:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825408
00000100:00100000:3.0:1767319700.443243:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825408
00000100:00100000:3.0:1767319700.443381:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388
00000100:00100000:3.0:1767319700.443395:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379825408:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319700.443460:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319700.443595:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379825408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 203us (3327us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319700.443605:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388
00000100:00080000:2.0:1767319700.444179:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319700.445081:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379825408:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319700.951187:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319701.975671:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379825536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319701.975773:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319701.976027:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825536
00000100:00100000:1.0:1767319701.976038:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825536
00000100:00100000:1.0:1767319701.976128:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389
00000100:00100000:1.0:1767319701.976139:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379825536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319701.976179:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319701.976248:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379825536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (474us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319701.976257:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389
00000100:00080000:2.0:1767319701.976328:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319701.976374:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379825536:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319701.977843:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319702.489251:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319702.489261:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319702.489265:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319702.489269:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319702.489275:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319702.489286:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4599
00000100:00080000:2.0:1767319702.489292:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319702.489301:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319702.489351:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebc000 x1853164379825664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319702.489383:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319702.489387:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319702.489389:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319702.489393:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4599
00000100:00080000:2.0:1767319702.489395:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319702.489399:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319702.489413:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379825792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319702.489476:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319702.489480:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319702.489481:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319702.489485:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4599
00000100:00080000:2.0:1767319702.489488:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319702.489492:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319702.489502:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebca80 x1853164379826176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319702.489519:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319702.489522:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319702.489524:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319702.489528:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4599
00000100:00080000:2.0:1767319702.489530:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319702.489534:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319702.489544:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddf80 x1853164379826432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319702.489738:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379826048:0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.489822:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319702.489936:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319702.489943:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379826304:0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.489967:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319702.490004:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826048
00000100:00100000:2.0:1767319702.490013:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826048
00000100:00100000:2.0:1767319702.490075:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826304
00000100:00100000:2.0:1767319702.490079:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826304
00000100:00100000:2.0:1767319702.490106:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4403
00000100:00100000:2.0:1767319702.490116:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379826048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.490173:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379826048:12345-0@lo:400:kworker.0 Request processed in 58us (352us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319702.490181:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4403
00000100:00100000:2.0:1767319702.490212:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4404
00000100:00100000:2.0:1767319702.490218:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379826304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.490246:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379826304:12345-0@lo:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319702.490252:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4404
00000100:00080000:2.0:1767319702.490284:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319702.490318:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379826304:0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.490329:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379826048:0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.490353:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319702.490361:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379825920:0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.490392:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319702.490427:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825920
00000100:00100000:2.0:1767319702.490430:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825920
00000100:00100000:2.0:1767319702.490462:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610
00000100:00100000:2.0:1767319702.490467:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379825920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319702.490498:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379825920:12345-0@lo:400:kworker.0 Request processed in 31us (106us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319702.490504:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610
00000100:00080000:2.0:1767319702.490518:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319702.490532:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379825920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319702.490922:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379825664:0@lo:38:kworker.0
00000100:00100000:0.0:1767319702.490966:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319702.490993:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379825792:0@lo:38:kworker.0
00000100:00100000:0.0:1767319702.491022:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319702.491053:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379826176:0@lo:38:kworker.0
00000100:00100000:0.0:1767319702.491079:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319702.491104:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379826432:0@lo:38:kworker.0
00000100:00100000:0.0:1767319702.491129:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319702.491174:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825792
00000100:00100000:0.0:1767319702.491181:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379825664
00000100:00100000:0.0:1767319702.491188:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825664
00000100:00100000:3.0:1767319702.491204:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379825792
00000100:00100000:0.0:1767319702.491229:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826176
00000100:00100000:0.0:1767319702.491235:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826176
00000100:00100000:0.0:1767319702.491265:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826432
00000100:00100000:0.0:1767319702.491269:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826432
00000100:00100000:3.0:1767319702.491272:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33
00000100:00100000:3.0:1767319702.491285:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379825792:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319702.491298:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17173
00000100:00100000:0.0:1767319702.491305:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379825664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319702.491312:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:0.0:1767319702.491325:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319702.491382:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379825664:12345-0@lo:38:kworker.0 Request processed in 75us (415us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319702.491391:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17173
00000100:00100000:3.0:1767319702.491416:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379825792:12345-0@lo:38:kworker.0 Request processed in 129us (389us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319702.491418:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17174
00000100:00100000:0.0:1767319702.491432:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379826176:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319702.491442:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33
00010000:00020000:0.0:1767319702.491452:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319702.491488:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17175
00000100:00100000:0.0:1767319702.491496:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379826176:12345-0@lo:38:kworker.0 Request processed in 60us (412us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319702.491506:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379826432:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319702.491515:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17174
00010000:00020000:3.0:1767319702.491525:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319702.491579:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319702.491586:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319702.491591:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379825664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319702.491821:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379826432:12345-0@lo:38:kworker.0 Request processed in 316us (689us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319702.491830:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17175
00000100:00080000:0.0:1767319702.498785:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319702.498802:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319702.498808:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379825792:0@lo:38:kworker.0
00000100:00080000:0.0:1767319702.498827:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319702.498830:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319702.498833:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379826176:0@lo:38:kworker.0
00000100:00080000:0.0:1767319702.498844:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319702.498848:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319702.498850:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379826432:0@lo:38:kworker.0
00010000:00010000:3.0:1767319703.003182:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319704.023850:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319704.466006:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319704.466062:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319704.470310:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291932416
00000100:00100000:2.0:1767319704.470335:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291932416
00000100:00100000:2.0:1767319704.470415:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291932544
00000100:00100000:2.0:1767319704.470420:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291932544
00000100:00100000:2.0:1767319704.470516:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4405
00000100:00100000:2.0:1767319704.470531:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291932544:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319704.470601:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17176
00000100:00100000:3.0:1767319704.470608:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291932416:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319704.470634:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319704.470690:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291932416:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 80us (4703us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319704.470698:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17176
00000100:00100000:2.0:1767319704.470919:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291932544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 391us (4855us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319704.470927:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4405
00000100:00080000:1.0:1767319704.471148:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319705.047064:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319705.567603:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319705.567637:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379826560:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319705.567749:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319705.569418:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826560
00000100:00100000:3.0:1767319705.569440:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826560
00000100:00100000:3.0:1767319705.569567:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390
00000100:00100000:3.0:1767319705.569590:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379826560:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319705.569638:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319705.569743:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379826560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (1994us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319705.569753:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390
00000100:00080000:1.0:1767319705.570112:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319705.570367:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379826560:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319706.071427:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319707.095458:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319707.095491:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379826688:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319707.095607:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319707.095809:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826688
00000100:00100000:1.0:1767319707.095820:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826688
00000100:00100000:1.0:1767319707.095920:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391
00000100:00100000:1.0:1767319707.095930:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379826688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319707.095980:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319707.096037:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379826688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (430us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319707.096045:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391
00000100:00080000:3.0:1767319707.096361:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319707.096416:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379826688:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319707.096746:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767319707.610040:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319707.610056:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319707.610060:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319707.610065:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319707.610071:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319707.610091:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4604
00000100:00080000:1.0:1767319707.610098:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319707.610107:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319707.610180:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7a680 x1853164379826816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319707.610476:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319707.610481:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319707.610483:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319707.610488:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4604
00000100:00080000:1.0:1767319707.610491:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319707.610495:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319707.610515:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78380 x1853164379826944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319707.610609:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319707.610614:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319707.610617:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319707.610621:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4604
00000100:00080000:1.0:1767319707.610624:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319707.610628:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319707.610640:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79500 x1853164379827456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319707.610661:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379826816:0@lo:38:kworker.0
00000100:00080000:1.0:1767319707.610675:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319707.610679:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319707.610681:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319707.610685:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4604
00000100:00080000:1.0:1767319707.610688:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319707.610692:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319707.610705:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7ad80 x1853164379827712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319707.610743:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379827584:0@lo:400:kworker.0
00000100:00100000:0.0:1767319707.610778:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319707.610859:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379826944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319707.610904:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379827200:0@lo:400:kworker.0
00000100:00100000:0.0:1767319707.610918:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319707.610948:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319707.610963:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379827456:0@lo:38:kworker.0
00000100:00100000:3.0:1767319707.610991:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319707.610994:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319707.611001:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379827072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319707.611017:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379827712:0@lo:38:kworker.0
00000100:00100000:3.0:1767319707.611037:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319707.611047:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319707.611077:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379827328:0@lo:400:kworker.0
00000100:00100000:0.0:1767319707.611098:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826816
00000100:00100000:0.0:1767319707.611109:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826816
00000100:00100000:3.0:1767319707.611117:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319707.611165:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827456
00000100:00100000:0.0:1767319707.611169:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827456
00000100:00100000:0.0:1767319707.611184:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827712
00000100:00100000:0.0:1767319707.611187:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827712
00000100:00100000:3.0:1767319707.611194:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827200
00000100:00100000:0.0:1767319707.611197:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827328
00000100:00100000:3.0:1767319707.611200:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827200
00000100:00100000:0.0:1767319707.611202:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827328
00000100:00100000:0.0:1767319707.611252:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4406
00000100:00100000:3.0:1767319707.611259:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827072
00000100:00100000:3.0:1767319707.611264:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827072
00000100:00100000:0.0:1767319707.611266:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379827328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319707.611292:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611
00000100:00100000:3.0:1767319707.611300:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379827200:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319707.611343:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379827328:12345-0@lo:400:kworker.0 Request processed in 80us (225us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319707.611357:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4406
00000100:00100000:3.0:1767319707.611358:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379827200:12345-0@lo:400:kworker.0 Request processed in 55us (406us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319707.611368:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611
00000100:00100000:0.0:1767319707.611388:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17177
00000100:00100000:3.0:1767319707.611389:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612
00000100:00100000:0.0:1767319707.611397:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379826816:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319707.611401:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379827072:12345-0@lo:400:kworker.0
00010000:00020000:0.0:1767319707.611425:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319707.611441:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379827072:12345-0@lo:400:kworker.0 Request processed in 42us (404us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319707.611449:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612
00000100:00100000:0.0:1767319707.611467:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379826816:12345-0@lo:38:kworker.0 Request processed in 71us (691us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319707.611476:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17177
00000100:00100000:3.0:1767319707.611770:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17178
00000100:00100000:3.0:1767319707.611777:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379827456:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319707.613049:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17179
00000100:00100000:1.0:1767319707.613063:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379827712:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767319707.613331:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319707.613339:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319707.613416:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379827328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319707.613472:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379827072:0@lo:400:kworker.0
00000100:00100000:2.0:1767319707.613487:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379827200:0@lo:400:kworker.0
00000100:00100000:2.0:1767319707.613532:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379826944
00000100:00100000:2.0:1767319707.613540:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379826944
00000100:00100000:2.0:1767319707.613583:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34
00000100:00100000:2.0:1767319707.613588:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379826944:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319707.613653:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319707.613747:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379827456:12345-0@lo:38:kworker.0 Request processed in 1968us (2752us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319707.613756:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17178
00000100:00100000:3.0:1767319707.614185:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319707.614234:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827584
00000100:00100000:3.0:1767319707.614239:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827584
00000100:00100000:3.0:1767319707.614288:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4407
00000100:00100000:3.0:1767319707.614296:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379827584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319707.614348:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379827584:12345-0@lo:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319707.614355:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4407
00000100:00080000:3.0:1767319707.614375:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319707.614398:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379827584:0@lo:400:kworker.0
00000100:00080000:3.0:1767319707.614453:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319707.614460:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319707.614463:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379827456:0@lo:38:kworker.0
00000100:00080000:3.0:1767319707.614477:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319707.614480:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319707.614483:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379826816:0@lo:38:kworker.0
00010000:00020000:1.0:1767319707.614718:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319707.614762:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379827712:12345-0@lo:38:kworker.0 Request processed in 1699us (3715us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319707.614771:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17179
00010000:00020000:2.0:1767319707.616396:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319707.616504:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379826944:12345-0@lo:38:kworker.0 Request processed in 2911us (5583us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319707.616517:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34
00000100:00080000:3.0:1767319707.616841:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319707.616848:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319707.616852:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379827712:0@lo:38:kworker.0
00000100:00080000:3.0:1767319707.616887:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319707.616892:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319707.616894:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379826944:0@lo:38:kworker.0
00010000:00010000:2.0:1767319708.119899:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319709.143092:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319709.583962:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319709.584269:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319709.584990:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291932800
00000100:00100000:0.0:1767319709.585006:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291932800
00000100:00100000:0.0:1767319709.585100:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291932672
00000100:00100000:0.0:1767319709.585103:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291932672
00000100:00100000:0.0:1767319709.585125:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4408
00000100:00100000:0.0:1767319709.585149:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291932800:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319709.585250:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291932800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (1301us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319709.585259:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4408
00000100:00100000:0.0:1767319709.585283:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17180
00000100:00100000:0.0:1767319709.585288:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291932672:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319709.585312:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319709.585343:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291932672:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (1074us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319709.585349:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17180
00000100:00080000:3.0:1767319709.586040:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319710.169041:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319710.679473:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319710.679510:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379827840:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319710.679611:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319710.679717:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827840
00000100:00100000:0.0:1767319710.679727:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827840
00000100:00100000:0.0:1767319710.679799:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392
00000100:00100000:0.0:1767319710.679810:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379827840:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319710.679848:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319710.679921:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379827840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (309us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319710.679929:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392
00000100:00100000:0.0:1767319710.679993:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379827840:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319710.680139:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319711.192197:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319712.215274:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319712.217486:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319712.220743:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379827968:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319712.220866:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319712.228989:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379827968
00000100:00100000:0.0:1767319712.229015:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379827968
00000100:00080000:3.0:1767319712.229644:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319712.230316:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393
00000100:00100000:0.0:1767319712.230346:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379827968:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319712.230396:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319712.230532:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379827968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 202us (9666us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319712.230541:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393
00000100:00100000:1.0:1767319712.230848:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379827968:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319712.727337:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319712.727353:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319712.727356:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319712.727362:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319712.727367:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319712.727379:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319712.727386:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319712.727396:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319712.727450:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ff480 x1853164379828096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319712.727498:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319712.727502:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319712.727504:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319712.727509:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319712.727512:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319712.727516:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319712.727532:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fce00 x1853164379828224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319712.727540:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379828096:0@lo:38:kworker.0
00000100:00100000:2.0:1767319712.727629:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379828352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319712.727644:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319712.727673:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319712.727731:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379828224:0@lo:38:kworker.0
00000100:00080000:3.0:1767319712.727751:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319712.727755:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319712.727757:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767319712.727761:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319712.727761:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319712.727764:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319712.727768:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319712.727780:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fc000 x1853164379828736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319712.727800:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379828608:0@lo:400:kworker.0
00000100:00080000:3.0:1767319712.727813:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319712.727817:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319712.727819:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319712.727823:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4610
00000100:00080000:3.0:1767319712.727825:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767319712.727826:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319712.727830:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319712.727842:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fdc00 x1853164379828992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319712.727852:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319712.727857:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379828864:0@lo:400:kworker.0
00000100:00100000:3.0:1767319712.727866:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379828480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319712.727901:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319712.727913:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319712.727935:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828096
00000100:00100000:1.0:1767319712.727944:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828096
00000100:00100000:1.0:1767319712.727980:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828608
00000100:00100000:3.0:1767319712.727981:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828224
00000100:00100000:1.0:1767319712.727984:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828608
00000100:00100000:3.0:1767319712.727984:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828224
00000100:00100000:3.0:1767319712.728009:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35
00000100:00100000:3.0:1767319712.728017:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379828224:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319712.728024:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828864
00000100:00100000:1.0:1767319712.728026:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828864
00010000:00020000:3.0:1767319712.728044:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319712.728048:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4409
00000100:00100000:1.0:1767319712.728053:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379828608:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319712.728087:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379828224:12345-0@lo:38:kworker.0 Request processed in 69us (323us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319712.728094:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35
00000100:00100000:1.0:1767319712.728098:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379828608:12345-0@lo:400:kworker.0 Request processed in 46us (272us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319712.728118:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4409
00000100:00100000:3.0:1767319712.728133:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828352
00000100:00100000:1.0:1767319712.728134:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4410
00000100:00100000:3.0:1767319712.728136:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828352
00000100:00100000:1.0:1767319712.728141:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379828864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319712.728165:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828480
00000100:00100000:3.0:1767319712.728168:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828480
00000100:00100000:1.0:1767319712.728169:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379828864:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319712.728175:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4410
00000100:00100000:1.0:1767319712.728187:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17181
00000100:00100000:3.0:1767319712.728187:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613
00000100:00100000:1.0:1767319712.728190:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379828096:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319712.728193:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379828352:12345-0@lo:400:kworker.0
00010000:00020000:1.0:1767319712.728201:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319712.728221:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379828096:12345-0@lo:38:kworker.0 Request processed in 29us (577us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319712.728222:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379828352:12345-0@lo:400:kworker.0 Request processed in 30us (549us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319712.728228:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17181
00000100:00100000:3.0:1767319712.728228:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613
00000100:00100000:3.0:1767319712.728239:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614
00000100:00100000:3.0:1767319712.728245:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379828480:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319712.728256:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319712.728261:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319712.728272:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379828480:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319712.728277:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614
00000100:00100000:1.0:1767319712.728292:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379828864:0@lo:400:kworker.0
00000100:00100000:1.0:1767319712.728303:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379828608:0@lo:400:kworker.0
00000100:00100000:3.0:1767319712.728316:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379828480:0@lo:400:kworker.0
00000100:00100000:1.0:1767319712.728327:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379828736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319712.728351:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319712.728370:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828736
00000100:00100000:1.0:1767319712.728371:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379828992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319712.728373:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828736
00000100:00100000:1.0:1767319712.728391:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319712.728393:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17182
00000100:00100000:3.0:1767319712.728398:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379828736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319712.728408:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319712.728411:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319712.728416:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319712.728419:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379828224:0@lo:38:kworker.0
00000100:00080000:1.0:1767319712.728427:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319712.728431:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319712.728434:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379828096:0@lo:38:kworker.0
00000100:00100000:3.0:1767319712.728434:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379828736:12345-0@lo:38:kworker.0 Request processed in 35us (82us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319712.728440:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17182
00000100:00100000:3.0:1767319712.728448:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379828992
00000100:00100000:3.0:1767319712.728451:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379828992
00000100:00080000:1.0:1767319712.728452:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319712.728455:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319712.728458:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379828736:0@lo:38:kworker.0
00000100:00100000:3.0:1767319712.728465:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17183
00000100:00100000:3.0:1767319712.728469:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379828992:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319712.728478:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319712.728507:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379828992:12345-0@lo:38:kworker.0 Request processed in 36us (115us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319712.728513:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17183
00000100:00080000:1.0:1767319712.728521:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319712.728525:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319712.728528:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379828992:0@lo:38:kworker.0
00000100:00100000:3.0:1767319712.737194:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379828352:0@lo:400:kworker.0
00010000:00010000:0.0:1767319713.240997:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319713.684038:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767319713.684073:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291932928 offset 0 length 520: 4
00000100:00100000:1.0:1767319713.684114:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319713.684310:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933184
00000100:00100000:2.0:1767319713.684326:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933184
00000100:00100000:2.0:1767319713.684428:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933056
00000100:00100000:2.0:1767319713.684431:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933056
00000100:00100000:2.0:1767319713.684458:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4411
00000100:00100000:2.0:1767319713.684470:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291933184:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319713.684597:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291933184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 116us (562us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319713.684613:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4411
00000100:00100000:2.0:1767319713.684640:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17184
00000100:00100000:2.0:1767319713.684645:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291933056:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319713.684675:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319713.684708:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291933056:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 61us (593us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319713.684714:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17184
00000100:00080000:1.0:1767319713.686996:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319714.263654:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319715.287094:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319715.802524:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379829120:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319715.802635:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319715.803003:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379829120
00000100:00100000:2.0:1767319715.803014:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379829120
00000100:00100000:2.0:1767319715.803113:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394
00000100:00100000:2.0:1767319715.803125:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379829120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319715.803169:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319715.803236:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379829120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (600us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319715.803245:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394
00000100:00080000:1.0:1767319715.803329:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319715.803481:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379829120:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319716.311339:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319717.335180:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319717.336324:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319717.336358:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379829248:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319717.336464:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319717.336694:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379829248
00000100:00100000:3.0:1767319717.336705:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379829248
00000100:00100000:3.0:1767319717.336789:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395
00000100:00100000:3.0:1767319717.336801:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379829248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319717.336842:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319717.336923:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379829248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (460us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319717.336933:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395
00000100:00100000:3.0:1767319717.337003:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379829248:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319717.337054:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319717.847240:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319692/real 1767319692]  req@ffff8b0e08ebed80 x1853164379823232/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319717 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319717.847286:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e08ebed80 x1853164379823232/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319717 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319717.847312:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319717.847354:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319717.847360:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379823232:0@lo:250:kworker.0
00000100:00080000:2.0:1767319717.848796:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319717.848808:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319717.848812:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319717.848820:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4594
00000100:00080000:2.0:1767319717.848826:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319717.848835:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319717.848946:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379829376/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319717.848981:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319717.848985:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319717.848987:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319717.848991:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319717.848994:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319717.848999:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319717.849018:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebc000 x1853164379829504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319717.849027:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319717.849031:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319717.849032:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319717.849036:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319717.849039:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319717.849042:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319717.849071:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164379829632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319717.849159:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319717.849162:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319717.849164:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319717.849168:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319717.849170:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319717.849174:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319717.849186:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571880 x1853164379830144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319717.849201:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319717.849205:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319717.849207:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319717.849210:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4615
00000100:00080000:2.0:1767319717.849212:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319717.849217:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319717.849228:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571180 x1853164379830400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319717.849307:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379829888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319717.849394:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319717.849699:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379829376:0@lo:250:kworker.0
00000400:00000100:1.0:1767319717.849727:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379829376 offset 0 length 520: 4
00000100:00100000:1.0:1767319717.849774:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379830272:0@lo:400:kworker.0
00000100:00100000:1.0:1767319717.849806:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319717.850117:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379829888
00000100:00100000:3.0:1767319717.850128:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379829888
00000100:00100000:1.0:1767319717.850166:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379829504:0@lo:38:kworker.0
00000100:00100000:1.0:1767319717.850194:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319717.850194:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615
00000100:00100000:3.0:1767319717.850206:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379829888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319717.850213:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379829632:0@lo:38:kworker.0
00000100:00100000:1.0:1767319717.850237:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319717.850255:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379830144:0@lo:38:kworker.0
00000100:00100000:3.0:1767319717.850277:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379829888:12345-0@lo:400:kworker.0 Request processed in 73us (883us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319717.850285:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615
00000100:00100000:3.0:1767319717.850324:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830272
00000100:00100000:3.0:1767319717.850328:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830272
00000100:00100000:0.0:1767319717.850340:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379829504
00000100:00100000:0.0:1767319717.850344:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379829504
00000100:00100000:3.0:1767319717.850367:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4412
00000100:00100000:3.0:1767319717.850373:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379830272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319717.856943:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319717.857074:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379829888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319717.857124:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319717.857140:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379829760:0@lo:400:kworker.0
00000100:00100000:3.0:1767319717.857192:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379830272:12345-0@lo:400:kworker.0 Request processed in 6816us (7381us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319717.857207:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4412
00000100:00100000:2.0:1767319717.862396:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319717.862590:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379829632
00000100:00100000:2.0:1767319717.862604:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379829632
00000100:00100000:2.0:1767319717.862658:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36
00000100:00100000:2.0:1767319717.862830:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379829632:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319717.862862:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319717.862947:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379829632:12345-0@lo:38:kworker.0 Request processed in 120us (12707us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319717.862955:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36
00000100:00080000:2.0:1767319717.862983:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319717.863010:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379830016:0@lo:400:kworker.0
00000100:00100000:1.0:1767319717.863307:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379830400:0@lo:38:kworker.0
00000100:00100000:1.0:1767319717.863336:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319717.864896:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830144
00000100:00100000:3.0:1767319717.864910:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830144
00000100:00100000:3.0:1767319717.864970:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17185
00000100:00100000:3.0:1767319717.864980:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379829504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319717.865006:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319717.865103:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379829504:12345-0@lo:38:kworker.0 Request processed in 123us (14906us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319717.865113:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17185
00000100:00100000:3.0:1767319717.865135:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17186
00000100:00100000:3.0:1767319717.865140:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379830144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319717.865150:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319717.865180:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379830144:12345-0@lo:38:kworker.0 Request processed in 38us (8250us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319717.865186:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17186
00000100:00100000:3.0:1767319717.865233:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379829760
00000100:00100000:3.0:1767319717.865238:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379829760
00000100:00100000:3.0:1767319717.865284:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616
00000100:00100000:3.0:1767319717.865291:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379829760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319717.865353:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379829760:12345-0@lo:400:kworker.0 Request processed in 62us (2969us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319717.865359:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616
00000100:00080000:3.0:1767319717.865379:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319717.865430:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379829760:0@lo:400:kworker.0
00000100:00100000:3.0:1767319717.865512:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379830272:0@lo:400:kworker.0
00000100:00080000:1.0:1767319717.870235:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319717.870253:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319717.870259:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379829504:0@lo:38:kworker.0
00000100:00080000:1.0:1767319717.870275:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319717.870279:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319717.870283:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379829632:0@lo:38:kworker.0
00000100:00080000:1.0:1767319717.870296:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319717.870300:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319717.870303:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379830144:0@lo:38:kworker.0
00000100:00100000:2.0:1767319717.870528:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830400
00000100:00100000:2.0:1767319717.870540:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830400
00000100:00100000:2.0:1767319717.870608:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17187
00000100:00100000:2.0:1767319717.870620:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379830400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319717.870651:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319717.870767:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379830400:12345-0@lo:38:kworker.0 Request processed in 145us (7427us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319717.870775:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17187
00000100:00100000:3.0:1767319717.870947:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319717.871168:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830016
00000100:00100000:2.0:1767319717.871174:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830016
00000100:00100000:2.0:1767319717.871232:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4413
00000100:00100000:2.0:1767319717.871240:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379830016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319717.871293:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379830016:12345-0@lo:400:kworker.0 Request processed in 54us (347us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319717.871300:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4413
00000100:00100000:2.0:1767319717.871336:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379830016:0@lo:400:kworker.0
00000100:00080000:3.0:1767319717.871576:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319717.871651:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319717.871658:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319717.871672:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379830400:0@lo:38:kworker.0
00010000:00010000:3.0:1767319718.359344:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319718.800695:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319718.800756:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319718.800821:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933440
00000100:00100000:3.0:1767319718.800835:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933440
00000100:00100000:3.0:1767319718.800989:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933312
00000100:00100000:3.0:1767319718.800993:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933312
00000100:00100000:3.0:1767319718.801017:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4414
00000100:00100000:3.0:1767319718.801028:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291933440:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319718.801145:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291933440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 119us (465us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319718.801154:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4414
00000100:00100000:3.0:1767319718.801176:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17188
00000100:00100000:3.0:1767319718.801181:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291933312:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319718.801208:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319718.801237:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291933312:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (480us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319718.801244:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17188
00000100:00080000:2.0:1767319718.801303:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319719.383813:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319720.408462:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319720.919290:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379830528:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319720.919414:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319720.919653:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830528
00000100:00100000:3.0:1767319720.919666:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830528
00000100:00100000:3.0:1767319720.919760:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396
00000100:00100000:3.0:1767319720.919773:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379830528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319720.919813:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319720.919901:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379830528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (486us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319720.919909:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396
00000100:00080000:0.0:1767319720.920918:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319720.920987:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379830528:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319721.431119:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319722.457396:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319722.457536:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379830656:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319722.457638:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319722.458423:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830656
00000100:00100000:3.0:1767319722.458437:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830656
00000100:00100000:3.0:1767319722.458536:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397
00000100:00100000:3.0:1767319722.458548:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379830656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319722.458589:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319722.458669:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379830656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1030us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319722.458682:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397
00000100:00100000:2.0:1767319722.459313:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379830656:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319722.459401:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319722.969106:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319722.969121:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319722.969125:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319722.969130:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319722.969136:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319722.969148:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4620
00000100:00080000:3.0:1767319722.969155:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319722.969165:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319722.969225:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fc000 x1853164379830784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319722.969272:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319722.969277:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319722.969279:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319722.969285:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4620
00000100:00080000:3.0:1767319722.969288:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319722.969292:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319722.969307:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ff480 x1853164379830912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319722.969395:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319722.969400:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319722.969402:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319722.969405:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4620
00000100:00080000:3.0:1767319722.969409:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319722.969412:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319722.969424:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd180 x1853164379831424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319722.969442:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319722.969445:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319722.969447:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319722.969450:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4620
00000100:00080000:3.0:1767319722.969453:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319722.969457:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319722.969471:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05500 x1853164379831680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319722.969511:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379831296:0@lo:400:kworker.0
00000100:00100000:3.0:1767319722.969606:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319722.969697:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319722.969704:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379831552:0@lo:400:kworker.0
00000100:00100000:3.0:1767319722.969729:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319722.969764:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831296
00000100:00100000:3.0:1767319722.969773:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831296
00000100:00100000:3.0:1767319722.969847:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831552
00000100:00100000:3.0:1767319722.969850:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831552
00000100:00100000:3.0:1767319722.969934:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4415
00000100:00100000:3.0:1767319722.969946:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379831296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319722.970034:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379831296:12345-0@lo:400:kworker.0 Request processed in 89us (427us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319722.970042:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4415
00000100:00100000:3.0:1767319722.970063:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4416
00000100:00100000:3.0:1767319722.970070:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379831552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319722.970098:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379831552:12345-0@lo:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319722.970105:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4416
00000100:00080000:3.0:1767319722.970125:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319722.970173:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379831552:0@lo:400:kworker.0
00000100:00100000:3.0:1767319722.970185:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379831296:0@lo:400:kworker.0
00000100:00100000:1.0:1767319722.970492:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379830784:0@lo:38:kworker.0
00000100:00100000:1.0:1767319722.970532:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319722.970568:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379830912:0@lo:38:kworker.0
00000100:00100000:1.0:1767319722.970594:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319722.970618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379831424:0@lo:38:kworker.0
00000100:00100000:1.0:1767319722.970638:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319722.970652:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379831680:0@lo:38:kworker.0
00000100:00100000:1.0:1767319722.970669:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319722.970701:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830912
00000100:00100000:1.0:1767319722.970706:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830912
00000100:00100000:1.0:1767319722.970731:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37
00000100:00100000:1.0:1767319722.970737:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379830912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319722.970760:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319722.970810:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379830912:12345-0@lo:38:kworker.0 Request processed in 72us (215us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319722.970817:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37
00000100:00100000:1.0:1767319722.970840:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379830784
00000100:00100000:1.0:1767319722.970844:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379830784
00000100:00100000:1.0:1767319722.970862:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831424
00000100:00100000:1.0:1767319722.970864:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831424
00000100:00100000:1.0:1767319722.970904:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831680
00000100:00100000:1.0:1767319722.970907:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831680
00000100:00100000:1.0:1767319722.970923:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17189
00000100:00100000:1.0:1767319722.970928:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379830784:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319722.970938:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319722.970977:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379830784:12345-0@lo:38:kworker.0 Request processed in 48us (444us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319722.970983:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17189
00000100:00100000:1.0:1767319722.970996:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17190
00000100:00100000:1.0:1767319722.971000:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379831424:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319722.971018:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319722.971047:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379831424:12345-0@lo:38:kworker.0 Request processed in 45us (407us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319722.971052:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17190
00000100:00100000:1.0:1767319722.971077:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17191
00000100:00100000:1.0:1767319722.971081:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379831680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319722.971090:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319722.971111:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379831680:12345-0@lo:38:kworker.0 Request processed in 29us (440us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319722.971116:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17191
00000100:00080000:1.0:1767319722.971151:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319722.971157:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319722.971160:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379830784:0@lo:38:kworker.0
00000100:00080000:1.0:1767319722.971169:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319722.971173:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319722.971176:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379830912:0@lo:38:kworker.0
00000100:00080000:1.0:1767319722.971183:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319722.971187:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319722.971190:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379831424:0@lo:38:kworker.0
00000100:00080000:1.0:1767319722.971197:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319722.971200:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319722.971202:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379831680:0@lo:38:kworker.0
00000100:00100000:2.0:1767319722.971583:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379831040:0@lo:400:kworker.0
00000100:00100000:2.0:1767319722.971629:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319722.971673:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319722.971681:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379831168:0@lo:400:kworker.0
00000100:00100000:2.0:1767319722.971703:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319722.972920:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831040
00000100:00100000:3.0:1767319722.972934:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831040
00000100:00100000:1.0:1767319722.973075:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831168
00000100:00100000:1.0:1767319722.973080:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831168
00000100:00100000:1.0:1767319722.973153:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617
00000100:00100000:1.0:1767319722.973166:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379831168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319722.973288:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379831168:12345-0@lo:400:kworker.0 Request processed in 125us (1583us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319722.973298:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617
00000100:00100000:0.0:1767319722.973606:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379831168:0@lo:400:kworker.0
00000100:00100000:3.0:1767319722.973848:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618
00000100:00100000:3.0:1767319722.973857:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379831040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319722.973957:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379831040:12345-0@lo:400:kworker.0 Request processed in 101us (2327us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319722.973972:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618
00000100:00100000:1.0:1767319722.975003:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379831040:0@lo:400:kworker.0
00000100:00080000:0.0:1767319722.976190:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319723.479545:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319723.929136:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319723.929259:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319723.929421:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933696
00000100:00100000:0.0:1767319723.929434:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933696
00000100:00100000:0.0:1767319723.929524:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933568
00000100:00100000:0.0:1767319723.929528:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933568
00000100:00100000:0.0:1767319723.929552:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4417
00000100:00100000:0.0:1767319723.929564:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291933696:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319723.929660:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291933696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (540us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319723.929667:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4417
00000100:00100000:0.0:1767319723.929688:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17192
00000100:00100000:0.0:1767319723.929691:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291933568:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319723.929712:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319723.929735:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291933568:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 42us (477us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319723.929739:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17192
00000100:00080000:3.0:1767319723.930084:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767319724.503286:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319725.527137:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319726.040185:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319726.040213:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379831808:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319726.040329:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319726.040702:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831808
00000100:00100000:3.0:1767319726.040714:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831808
00000100:00100000:3.0:1767319726.040807:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398
00000100:00100000:3.0:1767319726.040820:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379831808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319726.040860:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319726.040967:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379831808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (636us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319726.040976:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398
00000100:00100000:1.0:1767319726.041028:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379831808:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319726.041140:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319726.551339:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319727.575225:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319727.575361:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379831936:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319727.575461:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319727.576925:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379831936
00000100:00100000:3.0:1767319727.576944:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379831936
00000100:00100000:3.0:1767319727.577070:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399
00000100:00100000:3.0:1767319727.577082:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379831936:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319727.577113:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:3.0:1767319727.577134:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319727.586764:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379831936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9667us (11284us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319727.586797:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399
00000100:00100000:1.0:1767319727.593945:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379831936:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319728.087646:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319728.087669:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319728.087672:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319728.087677:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319728.087684:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319728.087695:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319728.087702:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319728.087713:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319728.087779:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04380 x1853164379832064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319728.087829:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319728.087834:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319728.087836:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319728.087840:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319728.087843:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319728.087848:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319728.087892:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04700 x1853164379832192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319728.088003:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319728.088292:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379832064:0@lo:38:kworker.0
00000100:00100000:1.0:1767319728.088390:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319728.088487:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379832192:0@lo:38:kworker.0
00000100:00100000:1.0:1767319728.088525:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319728.088584:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832192
00000100:00100000:1.0:1767319728.088596:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832192
00000100:00100000:1.0:1767319728.088648:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38
00000100:00100000:1.0:1767319728.088659:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379832192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319728.088689:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319728.088741:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379832192:12345-0@lo:38:kworker.0 Request processed in 81us (214us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319728.088749:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38
00000100:00080000:1.0:1767319728.088804:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319728.088811:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319728.088814:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379832192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319728.089346:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832064
00000100:00100000:2.0:1767319728.089354:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832064
00000100:00100000:2.0:1767319728.089397:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17193
00000100:00100000:2.0:1767319728.089405:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379832064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319728.089429:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319728.089483:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379832064:12345-0@lo:38:kworker.0 Request processed in 78us (1094us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319728.089490:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17193
00000100:00080000:2.0:1767319728.089524:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319728.089529:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319728.089533:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379832064:0@lo:38:kworker.0
00000100:00100000:0.0:1767319728.093095:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379832448:0@lo:400:kworker.0
00000100:00100000:0.0:1767319728.093215:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319728.093280:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379832320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319728.093305:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319728.096107:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319728.096116:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319728.096120:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319728.096129:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319728.096135:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319728.096142:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319728.096174:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07480 x1853164379832704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319728.096205:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319728.096209:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319728.096211:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319728.096215:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4625
00000100:00080000:3.0:1767319728.096218:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319728.096223:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319728.096234:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164379832960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319728.096302:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379832704:0@lo:38:kworker.0
00000100:00100000:3.0:1767319728.096381:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319728.096595:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379832960:0@lo:38:kworker.0
00000100:00100000:3.0:1767319728.096626:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319728.096757:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832704
00000100:00100000:3.0:1767319728.096767:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832704
00000100:00100000:3.0:1767319728.097025:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832960
00000100:00100000:3.0:1767319728.097029:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832960
00000100:00100000:3.0:1767319728.097055:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17194
00000100:00100000:3.0:1767319728.097322:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379832704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319728.097351:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319728.097511:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379832704:12345-0@lo:38:kworker.0 Request processed in 103us (1041us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319728.097522:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17194
00000100:00100000:3.0:1767319728.097544:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17195
00000100:00100000:3.0:1767319728.097549:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379832960:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319728.097560:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319728.097588:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379832960:12345-0@lo:38:kworker.0 Request processed in 38us (961us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319728.097593:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17195
00000100:00100000:3.0:1767319728.097630:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379832832:0@lo:400:kworker.0
00000100:00100000:3.0:1767319728.097662:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319728.097823:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379832576:0@lo:400:kworker.0
00000100:00100000:3.0:1767319728.099059:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832832
00000100:00080000:0.0:1767319728.099230:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319728.099239:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319728.099245:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379832704:0@lo:38:kworker.0
00000100:00080000:0.0:1767319728.099262:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319728.099265:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319728.099268:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379832960:0@lo:38:kworker.0
00000100:00100000:0.0:1767319728.099330:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319728.099419:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832832
00000100:00100000:3.0:1767319728.099581:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832576
00000100:00100000:3.0:1767319728.099585:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832576
00000100:00100000:3.0:1767319728.099610:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4418
00000100:00100000:3.0:1767319728.099619:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379832832:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767319728.100001:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319728.100039:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4419
00000100:00100000:0.0:1767319728.100049:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379832576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319728.100146:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832448
00000100:00100000:1.0:1767319728.100152:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832448
00000100:00100000:1.0:1767319728.100188:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379832320
00000100:00100000:1.0:1767319728.100192:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379832320
00000100:00100000:1.0:1767319728.100222:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619
00000100:00100000:1.0:1767319728.100230:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379832448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319728.100335:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620
00000100:00100000:2.0:1767319728.100346:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379832320:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319728.101183:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379832576:12345-0@lo:400:kworker.0 Request processed in 1134us (1850us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319728.101194:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4419
00000100:00100000:0.0:1767319728.101266:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379832576:0@lo:400:kworker.0
00000100:00080000:0.0:1767319728.101322:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319728.101359:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379832448:0@lo:400:kworker.0
00000100:00100000:1.0:1767319728.101437:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379832448:12345-0@lo:400:kworker.0 Request processed in 1207us (8221us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319728.101445:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619
00000100:00100000:3.0:1767319728.101638:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379832832:12345-0@lo:400:kworker.0 Request processed in 2018us (3972us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319728.101646:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4418
00000100:00100000:1.0:1767319728.102229:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379832832:0@lo:400:kworker.0
00000100:00100000:2.0:1767319728.102380:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379832320:12345-0@lo:400:kworker.0 Request processed in 2036us (9072us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319728.102390:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620
00000100:00100000:0.0:1767319728.102538:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379832320:0@lo:400:kworker.0
00010000:00010000:2.0:1767319728.603822:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319729.040038:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319729.040404:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933952
00000100:00100000:3.0:1767319729.040423:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933952
00000100:00100000:3.0:1767319729.040511:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4420
00000100:00100000:3.0:1767319729.040523:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291933952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319729.040625:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291933952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (611us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319729.040633:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4420
00000100:00100000:3.0:1767319729.040754:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319729.041110:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291933824
00000100:00100000:0.0:1767319729.041117:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291933824
00000100:00100000:0.0:1767319729.041158:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17196
00000100:00100000:0.0:1767319729.041164:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291933824:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319729.041192:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319729.041234:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291933824:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 69us (480us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319729.041241:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17196
00000100:00080000:1.0:1767319729.041359:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319729.623412:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319730.647449:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319731.159565:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319731.159590:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379833088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319731.159691:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319731.160191:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833088
00000100:00100000:3.0:1767319731.160203:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833088
00000100:00100000:3.0:1767319731.160296:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400
00000100:00100000:3.0:1767319731.160310:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379833088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319731.160347:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319731.160416:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379833088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (724us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319731.160425:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400
00000100:00100000:3.0:1767319731.160483:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379833088:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319731.160562:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319731.673620:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319732.695254:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379833216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319732.695371:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319732.695583:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319732.695719:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833216
00000100:00100000:2.0:1767319732.695731:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833216
00000100:00100000:2.0:1767319732.695916:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401
00000100:00100000:2.0:1767319732.695937:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379833216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319732.695981:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319732.696062:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379833216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (690us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319732.696071:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401
00000100:00100000:0.0:1767319732.697607:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379833216:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319732.702092:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319733.207328:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319733.207343:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319733.207346:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319733.207351:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319733.207356:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319733.207366:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4630
00000100:00080000:2.0:1767319733.207371:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319733.207379:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319733.207440:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572680 x1853164379833344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319733.207528:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379833344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319733.207629:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319733.207687:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319733.207691:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319733.207693:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319733.207697:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4630
00000100:00080000:2.0:1767319733.207700:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319733.207704:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319733.207720:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573800 x1853164379833472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319733.207769:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319733.207772:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319733.207774:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319733.207778:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4630
00000100:00080000:2.0:1767319733.207780:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319733.207784:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319733.207794:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573100 x1853164379833856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319733.207828:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319733.207832:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319733.207833:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319733.207837:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4630
00000100:00080000:2.0:1767319733.207839:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319733.207843:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319733.207853:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573480 x1853164379834112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319733.207935:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379833984:0@lo:400:kworker.0
00000100:00100000:0.0:1767319733.208088:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379833472:0@lo:38:kworker.0
00000100:00100000:0.0:1767319733.208120:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319733.208142:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379833856:0@lo:38:kworker.0
00000100:00100000:0.0:1767319733.208166:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319733.208559:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379833600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319733.208609:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319733.208643:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319733.208650:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379833728:0@lo:400:kworker.0
00000100:00100000:1.0:1767319733.208690:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833472
00000100:00100000:1.0:1767319733.208699:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833472
00000100:00100000:1.0:1767319733.208742:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39
00000100:00100000:1.0:1767319733.208751:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379833472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319733.208777:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319733.208824:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379833472:12345-0@lo:38:kworker.0 Request processed in 71us (702us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319733.208832:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39
00000100:00100000:2.0:1767319733.209095:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833600
00000100:00100000:2.0:1767319733.209100:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833600
00000100:00100000:2.0:1767319733.209162:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621
00000100:00100000:2.0:1767319733.209170:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379833600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319733.209226:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379833600:12345-0@lo:400:kworker.0 Request processed in 59us (617us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319733.209232:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621
00000100:00080000:1.0:1767319733.209304:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319733.211308:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379834112:0@lo:38:kworker.0
00000100:00100000:0.0:1767319733.211399:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319733.211979:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833344
00000100:00100000:3.0:1767319733.211992:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833344
00000100:00100000:3.0:1767319733.212088:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833856
00000100:00100000:3.0:1767319733.212092:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833856
00000100:00080000:0.0:1767319733.212362:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319733.212370:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319733.212376:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379833472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319733.212566:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379834112
00000100:00100000:1.0:1767319733.212571:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379834112
00000100:00100000:1.0:1767319733.212617:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17197
00000100:00100000:1.0:1767319733.212627:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379833344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319733.212657:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319733.212723:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379833344:12345-0@lo:38:kworker.0 Request processed in 96us (5094us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319733.212730:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17197
00000100:00100000:1.0:1767319733.212747:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17198
00000100:00100000:1.0:1767319733.212751:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379833856:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319733.212760:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319733.212784:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379833856:12345-0@lo:38:kworker.0 Request processed in 32us (4617us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319733.212789:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17198
00000100:00100000:1.0:1767319733.212799:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17199
00000100:00100000:1.0:1767319733.212803:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379834112:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319733.212811:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319733.212832:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379834112:12345-0@lo:38:kworker.0 Request processed in 27us (1433us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319733.212838:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17199
00000100:00080000:1.0:1767319733.212911:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319733.212923:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319733.212927:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379833856:0@lo:38:kworker.0
00000100:00080000:1.0:1767319733.212937:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319733.212940:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319733.212943:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379834112:0@lo:38:kworker.0
00000100:00080000:1.0:1767319733.212952:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319733.212956:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319733.212959:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379833344:0@lo:38:kworker.0
00000100:00100000:1.0:1767319733.212997:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319733.213033:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379833600:0@lo:400:kworker.0
00000100:00100000:1.0:1767319733.213052:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833728
00000100:00100000:1.0:1767319733.213055:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833728
00000100:00100000:1.0:1767319733.213099:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4421
00000100:00100000:1.0:1767319733.213105:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379833728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319733.213151:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379833728:12345-0@lo:400:kworker.0 Request processed in 45us (153us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319733.213157:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4421
00000100:00080000:1.0:1767319733.213177:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319733.213196:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379833728:0@lo:400:kworker.0
00000100:00100000:1.0:1767319733.213216:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319733.213250:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379833984
00000100:00100000:1.0:1767319733.213253:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379833984
00000100:00100000:1.0:1767319733.213275:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4422
00000100:00100000:1.0:1767319733.213280:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379833984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319733.213312:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379833984:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319733.213318:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4422
00000100:00080000:1.0:1767319733.213332:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319733.213348:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379833984:0@lo:400:kworker.0
00010000:00010000:0.0:1767319733.719481:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319734.159762:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319734.159836:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319734.160077:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291934208
00000100:00100000:3.0:1767319734.160091:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291934208
00000100:00100000:3.0:1767319734.160210:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291934080
00000100:00100000:3.0:1767319734.160213:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291934080
00000100:00100000:3.0:1767319734.160239:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4423
00000100:00100000:3.0:1767319734.160252:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291934208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319734.160366:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291934208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 117us (621us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319734.160376:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4423
00000100:00100000:1.0:1767319734.160578:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17200
00000100:00100000:1.0:1767319734.160585:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291934080:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319734.160613:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319734.160661:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291934080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 75us (825us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319734.160668:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17200
00000100:00080000:1.0:1767319734.160694:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319734.743339:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319735.770036:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319736.279746:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319736.279773:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379834240:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319736.279952:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319736.280557:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379834240
00000100:00100000:3.0:1767319736.280573:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379834240
00000100:00100000:3.0:1767319736.280687:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402
00000100:00100000:3.0:1767319736.280703:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379834240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319736.280755:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319736.280851:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379834240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 152us (898us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319736.280860:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402
00000100:00080000:1.0:1767319736.280972:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319736.281186:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379834240:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319736.792346:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319737.815089:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319737.816159:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319737.816183:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379834368:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319737.816253:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319737.816410:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379834368
00000100:00100000:2.0:1767319737.816419:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379834368
00000100:00100000:2.0:1767319737.816499:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403
00000100:00100000:2.0:1767319737.816508:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379834368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319737.816548:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319737.816602:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379834368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (348us total) trans 0 rc 0/0
00000100:00080000:0.0:1767319737.816866:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319737.816935:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403
00000100:00100000:3.0:1767319737.817035:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379834368:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319738.327192:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319738.327204:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319738.327208:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319738.327212:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319738.327217:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319738.327225:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4635
00000100:00080000:1.0:1767319738.327230:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319738.327237:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319738.327281:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858e00 x1853164379834496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319738.327318:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319738.327322:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319738.327324:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319738.327328:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4635
00000100:00080000:1.0:1767319738.327331:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319738.327335:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319738.327348:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859880 x1853164379834624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319738.327408:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319738.327412:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319738.327414:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319738.327417:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4635
00000100:00080000:1.0:1767319738.327420:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319738.327423:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319738.327434:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858700 x1853164379835008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319738.327464:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319738.327467:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319738.327469:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319738.327473:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4635
00000100:00080000:1.0:1767319738.327476:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319738.327480:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319738.327490:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85a300 x1853164379835264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319738.327520:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379835136:0@lo:400:kworker.0
00000100:00100000:1.0:1767319738.327607:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319738.327691:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319738.327698:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379834880:0@lo:400:kworker.0
00000100:00100000:1.0:1767319738.327722:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319738.327754:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379835136
00000100:00100000:1.0:1767319738.327761:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379835136
00000100:00100000:1.0:1767319738.327821:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379834880
00000100:00100000:1.0:1767319738.327824:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379834880
00000100:00100000:1.0:1767319738.327851:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4424
00000100:00100000:1.0:1767319738.327860:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379835136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319738.327964:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379835136:12345-0@lo:400:kworker.0 Request processed in 104us (355us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319738.327972:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4424
00000100:00100000:1.0:1767319738.327996:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4425
00000100:00100000:1.0:1767319738.328003:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379834880:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319738.328031:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379834880:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319738.328037:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4425
00000100:00100000:1.0:1767319738.328078:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379834880:0@lo:400:kworker.0
00000100:00100000:1.0:1767319738.328089:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379835136:0@lo:400:kworker.0
00000100:00100000:3.0:1767319738.328255:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379834752:0@lo:400:kworker.0
00000100:00100000:3.0:1767319738.328291:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319738.328334:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379834752
00000100:00100000:3.0:1767319738.328339:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379834752
00000100:00100000:3.0:1767319738.328367:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622
00000100:00100000:3.0:1767319738.328374:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379834752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319738.328411:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379834752:12345-0@lo:400:kworker.0 Request processed in 38us (120us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319738.328417:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622
00000100:00100000:3.0:1767319738.328444:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379834752:0@lo:400:kworker.0
00000100:00100000:0.0:1767319738.329127:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379834496:0@lo:38:kworker.0
00000100:00100000:0.0:1767319738.329167:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319738.329199:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379834624:0@lo:38:kworker.0
00000100:00100000:0.0:1767319738.329223:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319738.329248:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379835008:0@lo:38:kworker.0
00000100:00100000:0.0:1767319738.329269:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319738.329285:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379835264:0@lo:38:kworker.0
00000100:00100000:0.0:1767319738.329304:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319738.329334:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379834624
00000100:00100000:0.0:1767319738.329339:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379834624
00000100:00100000:0.0:1767319738.329365:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40
00000100:00100000:0.0:1767319738.329370:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379834624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319738.329390:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319738.329427:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379834624:12345-0@lo:38:kworker.0 Request processed in 56us (203us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319738.329434:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40
00000100:00100000:0.0:1767319738.329453:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379834496
00000100:00100000:0.0:1767319738.329457:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379834496
00000100:00100000:0.0:1767319738.329474:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379835008
00000100:00100000:0.0:1767319738.329476:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379835008
00000100:00100000:0.0:1767319738.329488:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379835264
00000100:00100000:0.0:1767319738.329490:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379835264
00000100:00100000:0.0:1767319738.329505:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17201
00000100:00100000:0.0:1767319738.329510:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379834496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319738.329519:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319738.329543:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379834496:12345-0@lo:38:kworker.0 Request processed in 33us (376us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319738.329549:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17201
00000100:00100000:0.0:1767319738.329561:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17202
00000100:00100000:0.0:1767319738.329565:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379835008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319738.329573:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319738.329593:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379835008:12345-0@lo:38:kworker.0 Request processed in 26us (322us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319738.329597:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17202
00000100:00100000:0.0:1767319738.329607:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17203
00000100:00100000:0.0:1767319738.329610:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379835264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319738.329618:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319738.329637:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379835264:12345-0@lo:38:kworker.0 Request processed in 25us (331us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319738.329642:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17203
00000100:00080000:0.0:1767319738.329682:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319738.329688:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319738.329708:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319738.329714:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319738.329717:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379834496:0@lo:38:kworker.0
00000100:00080000:0.0:1767319738.329725:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319738.329729:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319738.329732:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379834624:0@lo:38:kworker.0
00000100:00080000:0.0:1767319738.329738:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319738.329741:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319738.329744:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379835008:0@lo:38:kworker.0
00000100:00080000:0.0:1767319738.329751:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319738.329754:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319738.329756:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379835264:0@lo:38:kworker.0
00010000:00010000:3.0:1767319738.844995:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319739.289723:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291934336 offset 0 length 520: 4
00000100:00100000:3.0:1767319739.289787:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319739.289964:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319739.290011:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291934464
00000100:00100000:1.0:1767319739.290022:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291934464
00000100:00100000:1.0:1767319739.290075:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291934592
00000100:00100000:1.0:1767319739.290078:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291934592
00000100:00100000:1.0:1767319739.290117:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4426
00000100:00100000:1.0:1767319739.290128:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291934592:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319739.290231:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291934592:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 105us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319739.290238:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4426
00000100:00100000:1.0:1767319739.290282:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17204
00000100:00100000:1.0:1767319739.290287:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291934464:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:0.0:1767319739.290290:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767319739.290310:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319739.290383:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291934464:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 93us (595us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319739.290389:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17204
00010000:00010000:1.0:1767319739.863349:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319740.887157:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319741.399895:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379835392:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319741.399972:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319741.400079:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379835392
00000100:00100000:3.0:1767319741.400087:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379835392
00000100:00100000:3.0:1767319741.400145:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404
00000100:00100000:3.0:1767319741.400155:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379835392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319741.400182:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319741.400228:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379835392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (255us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319741.400236:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404
00000100:00100000:2.0:1767319741.400275:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379835392:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319741.400713:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767319741.911097:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319742.423215:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319717/real 1767319717]  req@ffff8b0e08ebdc00 x1853164379829376/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319742.423264:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e08ebdc00 x1853164379829376/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319742.423285:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319742.423475:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319742.423482:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379829376:0@lo:250:kworker.0
00000100:00080000:3.0:1767319742.425003:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319742.425013:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319742.425017:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319742.425025:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4620
00000100:00080000:3.0:1767319742.425029:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319742.425037:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319742.425079:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07480 x1853164379835520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319742.425112:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319742.425117:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319742.425118:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319742.425122:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4640
00000100:00080000:3.0:1767319742.425124:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319742.425128:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319742.425144:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06d80 x1853164379835648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319742.425152:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319742.425155:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319742.425157:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319742.425160:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4640
00000100:00080000:3.0:1767319742.425162:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319742.425166:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319742.425179:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fce00 x1853164379835776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319742.425258:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:3.0:1767319742.425324:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319742.425328:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319742.425329:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319742.425333:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4640
00000100:00080000:3.0:1767319742.425336:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319742.425339:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319742.425354:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fc000 x1853164379836288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319742.425405:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319742.425430:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379836416:0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.425501:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319742.425574:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379836032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.425603:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319742.425630:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319742.425634:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379836160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.425655:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319742.425685:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836032
00000100:00100000:0.0:1767319742.425692:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836032
00000100:00100000:0.0:1767319742.425757:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623
00000100:00100000:0.0:1767319742.425766:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379836032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.425809:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379836032:12345-0@lo:400:kworker.0 Request processed in 44us (205us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319742.425817:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623
00000100:00100000:0.0:1767319742.425894:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836416
00000100:00100000:0.0:1767319742.425899:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836416
00000100:00100000:0.0:1767319742.425922:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836160
00000100:00100000:0.0:1767319742.425924:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836160
00000100:00100000:0.0:1767319742.425940:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4427
00000100:00100000:0.0:1767319742.425946:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379836416:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.425975:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379836416:12345-0@lo:400:kworker.0 Request processed in 29us (474us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319742.425980:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4427
00000100:00100000:0.0:1767319742.425991:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4428
00000100:00100000:0.0:1767319742.425996:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379836160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.426017:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379836160:12345-0@lo:400:kworker.0 Request processed in 21us (361us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319742.426022:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4428
00000100:00080000:0.0:1767319742.426036:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319742.426040:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319742.426075:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379836160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.426083:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379836032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.426106:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379836416:0@lo:400:kworker.0
00000100:00100000:2.0:1767319742.428075:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379835520:0@lo:250:kworker.0
00000400:00000100:2.0:1767319742.428131:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379835520 offset 0 length 520: 4
00000100:00100000:2.0:1767319742.428169:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379835648:0@lo:38:kworker.0
00000100:00100000:2.0:1767319742.428202:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319742.428245:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379835776:0@lo:38:kworker.0
00000100:00100000:2.0:1767319742.428274:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319742.428299:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379836288:0@lo:38:kworker.0
00000100:00100000:2.0:1767319742.428334:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319742.428372:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379835776
00000100:00100000:2.0:1767319742.428379:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379835776
00000100:00100000:2.0:1767319742.428412:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41
00000100:00100000:2.0:1767319742.428419:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379835776:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319742.428439:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319742.428482:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379835776:12345-0@lo:38:kworker.0 Request processed in 62us (207us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319742.428489:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41
00000100:00100000:2.0:1767319742.428515:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379835648
00000100:00100000:2.0:1767319742.428518:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379835648
00000100:00100000:2.0:1767319742.428536:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836288
00000100:00100000:2.0:1767319742.428538:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836288
00000100:00100000:2.0:1767319742.428552:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17205
00000100:00100000:2.0:1767319742.428557:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379835648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319742.428566:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319742.428590:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379835648:12345-0@lo:38:kworker.0 Request processed in 32us (389us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319742.428596:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17205
00000100:00100000:2.0:1767319742.428607:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17206
00000100:00100000:2.0:1767319742.428611:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379836288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319742.428619:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319742.428638:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379836288:12345-0@lo:38:kworker.0 Request processed in 26us (305us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319742.428642:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17206
00000100:00080000:2.0:1767319742.428674:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319742.428679:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319742.428682:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379835648:0@lo:38:kworker.0
00000100:00080000:2.0:1767319742.428689:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319742.428691:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319742.428694:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379835776:0@lo:38:kworker.0
00000100:00080000:2.0:1767319742.428702:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319742.428705:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319742.428707:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379836288:0@lo:38:kworker.0
00000100:00100000:1.0:1767319742.430986:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379835904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319742.431052:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319742.431146:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379835904
00000100:00100000:0.0:1767319742.431154:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379835904
00000100:00100000:0.0:1767319742.431200:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624
00000100:00100000:0.0:1767319742.431208:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379835904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319742.431271:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379835904:12345-0@lo:400:kworker.0 Request processed in 63us (219us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319742.431279:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624
00000100:00100000:1.0:1767319742.431589:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379835904:0@lo:400:kworker.0
00000100:00080000:3.0:1767319742.432358:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319742.432364:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319742.432367:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319742.432373:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4640
00000100:00080000:3.0:1767319742.432377:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319742.432382:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319742.432411:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fdc00 x1853164379836544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319742.432841:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379836544:0@lo:38:kworker.0
00000100:00100000:2.0:1767319742.432903:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319742.433028:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836544
00000100:00100000:0.0:1767319742.433035:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836544
00000100:00100000:0.0:1767319742.433070:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17207
00000100:00100000:0.0:1767319742.433076:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379836544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319742.433095:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319742.438074:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379836544:12345-0@lo:38:kworker.0 Request processed in 4985us (5159us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319742.438088:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17207
00000100:00080000:2.0:1767319742.438204:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319742.438210:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319742.438214:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379836544:0@lo:38:kworker.0
00010000:00010000:0.0:1767319742.935523:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319742.935680:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379836672:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319742.935768:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319742.935890:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836672
00000100:00100000:2.0:1767319742.935898:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836672
00000100:00100000:2.0:1767319742.935954:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405
00000100:00100000:2.0:1767319742.935963:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379836672:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319742.935995:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319742.936049:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379836672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (281us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319742.936056:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405
00000100:00100000:1.0:1767319742.936320:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379836672:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319743.960795:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319744.399728:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319744.399945:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291934848
00000100:00100000:0.0:1767319744.399958:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291934848
00000100:00100000:0.0:1767319744.400059:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4429
00000100:00100000:0.0:1767319744.400075:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291934848:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319744.400189:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291934848:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 119us (476us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319744.400197:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4429
00000100:00080000:1.0:1767319744.400559:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319744.404130:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319744.404428:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291934720
00000100:00100000:3.0:1767319744.404443:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291934720
00000100:00100000:3.0:1767319744.404515:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17208
00000100:00100000:3.0:1767319744.404527:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291934720:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319744.404557:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319744.409114:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291934720:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 4566us (4977us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319744.409136:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17208
00010000:00010000:1.0:1767319744.983263:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319746.007183:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319746.523312:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319746.523346:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379836800:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319746.523447:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319746.523841:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836800
00000100:00100000:2.0:1767319746.523852:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836800
00000100:00100000:2.0:1767319746.523973:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406
00000100:00100000:2.0:1767319746.523984:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379836800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319746.524023:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319746.524089:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379836800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (641us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319746.524101:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406
00000100:00100000:2.0:1767319746.524173:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379836800:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319746.524329:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767319747.031299:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319747.543827:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.543843:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319747.543847:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.543852:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.543858:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.543883:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4644
00000100:00080000:0.0:1767319747.543890:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.543898:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319747.543952:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab800 x1853164379836928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319747.544035:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.544039:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.544041:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.544046:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4644
00000100:00080000:0.0:1767319747.544049:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.544052:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319747.544068:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9180 x1853164379837056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319747.544118:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.544122:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.544124:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.544128:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4644
00000100:00080000:0.0:1767319747.544130:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.544133:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319747.544142:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9c00 x1853164379837568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319747.544156:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319747.544160:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319747.544161:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319747.544165:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4644
00000100:00080000:0.0:1767319747.544167:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319747.544171:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319747.544181:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063aa680 x1853164379837824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319747.544224:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379837312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319747.544312:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319747.544384:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319747.544390:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379837440:0@lo:400:kworker.0
00000100:00100000:0.0:1767319747.544431:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319747.544470:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837440
00000100:00100000:0.0:1767319747.544479:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837440
00000100:00100000:0.0:1767319747.544548:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4430
00000100:00100000:0.0:1767319747.544558:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379837440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319747.544619:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379837440:12345-0@lo:400:kworker.0 Request processed in 62us (187us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319747.544627:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4430
00000100:00100000:0.0:1767319747.544727:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379837440:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.545348:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837312
00000100:00100000:2.0:1767319747.545356:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837312
00000100:00100000:2.0:1767319747.545404:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625
00000100:00100000:2.0:1767319747.545414:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379837312:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.545477:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379837312:12345-0@lo:400:kworker.0 Request processed in 66us (1164us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319747.545484:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625
00000100:00100000:2.0:1767319747.545534:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379837696:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.545569:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319747.545595:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319747.545601:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379837184:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.545640:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319747.545755:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837184
00000100:00100000:2.0:1767319747.545759:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837184
00000100:00100000:2.0:1767319747.545793:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626
00000100:00100000:2.0:1767319747.545799:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379837184:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.545839:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379837184:12345-0@lo:400:kworker.0 Request processed in 40us (199us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319747.545845:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626
00000100:00100000:2.0:1767319747.545864:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837696
00000100:00100000:2.0:1767319747.545890:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837696
00000100:00100000:2.0:1767319747.545920:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4431
00000100:00100000:2.0:1767319747.545927:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379837696:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.545963:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379837696:12345-0@lo:400:kworker.0 Request processed in 37us (394us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319747.545971:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4431
00000100:00100000:0.0:1767319747.546006:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379837312:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.546010:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379837184:0@lo:400:kworker.0
00000100:00100000:2.0:1767319747.546024:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379837696:0@lo:400:kworker.0
00000100:00080000:1.0:1767319747.546151:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319747.546157:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319747.549008:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379836928:0@lo:38:kworker.0
00000100:00100000:3.0:1767319747.549112:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319747.550123:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379837056:0@lo:38:kworker.0
00000100:00100000:3.0:1767319747.551417:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319747.551511:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379837568:0@lo:38:kworker.0
00000100:00100000:3.0:1767319747.551551:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319747.551831:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837056
00000100:00100000:1.0:1767319747.551846:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837056
00000100:00100000:1.0:1767319747.551942:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42
00000100:00100000:1.0:1767319747.551951:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379837056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319747.551981:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319747.552040:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379837056:12345-0@lo:38:kworker.0 Request processed in 87us (628us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319747.552048:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42
00000100:00100000:3.0:1767319747.552441:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379837824:0@lo:38:kworker.0
00000100:00100000:3.0:1767319747.552485:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319747.552818:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379836928
00000100:00100000:2.0:1767319747.552826:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379836928
00000100:00100000:2.0:1767319747.552887:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837568
00000100:00100000:2.0:1767319747.552890:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837568
00000100:00100000:2.0:1767319747.552914:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17209
00000100:00100000:2.0:1767319747.552921:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379836928:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319747.552929:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17210
00000100:00100000:1.0:1767319747.552936:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379837568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319747.552939:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767319747.552950:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319747.552988:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379836928:12345-0@lo:38:kworker.0 Request processed in 66us (3876us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319747.552996:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379837568:12345-0@lo:38:kworker.0 Request processed in 58us (1443us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319747.552997:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17209
00000100:00100000:1.0:1767319747.553008:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17210
00000100:00080000:3.0:1767319747.553309:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319747.553315:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319747.553320:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379836928:0@lo:38:kworker.0
00000100:00080000:3.0:1767319747.553343:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319747.553346:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319747.553350:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379837056:0@lo:38:kworker.0
00000100:00080000:3.0:1767319747.553360:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319747.553363:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319747.553366:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379837568:0@lo:38:kworker.0
00000100:00100000:0.0:1767319747.553797:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837824
00000100:00100000:0.0:1767319747.553804:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837824
00000100:00100000:0.0:1767319747.553851:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17211
00000100:00100000:0.0:1767319747.553858:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379837824:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319747.553888:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319747.553949:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379837824:12345-0@lo:38:kworker.0 Request processed in 91us (1463us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319747.553958:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17211
00000100:00080000:2.0:1767319747.554261:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319747.554266:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319747.554270:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379837824:0@lo:38:kworker.0
00000100:00100000:1.0:1767319748.055501:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379837952:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319748.055626:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319748.056458:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379837952
00000100:00100000:1.0:1767319748.056469:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379837952
00000100:00100000:1.0:1767319748.056529:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407
00000100:00100000:1.0:1767319748.056540:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379837952:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319748.056582:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319748.056962:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379837952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 422us (1352us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319748.056971:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407
00000100:00100000:2.0:1767319748.057375:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379837952:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319748.059968:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319749.085693:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319749.522593:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319749.523346:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291935104
00000100:00100000:1.0:1767319749.523362:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291935104
00000100:00100000:1.0:1767319749.523476:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4432
00000100:00100000:1.0:1767319749.523490:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291935104:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319749.523601:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291935104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (1024us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319749.523609:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4432
00000100:00100000:2.0:1767319749.524058:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319749.524213:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291934976
00000100:00100000:0.0:1767319749.524221:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291934976
00000100:00100000:0.0:1767319749.524270:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17212
00000100:00100000:0.0:1767319749.524279:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291934976:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319749.524307:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319749.524359:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291934976:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 81us (301us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319749.524365:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17212
00000100:00080000:3.0:1767319749.524618:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319750.103358:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319751.127313:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319751.639737:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319751.639774:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379838080:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319751.639925:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319751.640153:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838080
00000100:00100000:3.0:1767319751.640164:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838080
00000100:00100000:3.0:1767319751.640248:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408
00000100:00100000:3.0:1767319751.640262:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379838080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319751.640302:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319751.640379:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379838080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (453us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319751.640389:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408
00000100:00100000:2.0:1767319751.640420:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379838080:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319751.640511:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319752.151260:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319752.664801:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319752.664816:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319752.664821:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319752.664825:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319752.664830:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319752.664839:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4649
00000100:00080000:2.0:1767319752.664845:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319752.664852:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319752.664933:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379838208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319752.664964:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319752.664968:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319752.664970:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319752.664974:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4649
00000100:00080000:2.0:1767319752.664976:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319752.664981:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319752.664995:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164379838336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319752.665065:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319752.665069:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319752.665072:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319752.665077:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4649
00000100:00080000:2.0:1767319752.665081:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319752.665086:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319752.665104:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448a80 x1853164379838848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319752.665108:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:2.0:1767319752.665140:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319752.665141:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379838464:0@lo:400:kworker.0
00000100:00080000:2.0:1767319752.665155:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319752.665159:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319752.665165:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4649
00000100:00080000:2.0:1767319752.665168:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319752.665173:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319752.665188:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44ad80 x1853164379839104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319752.665219:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379838720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319752.665241:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319752.665317:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379838976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319752.665343:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319752.665379:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838464
00000100:00100000:3.0:1767319752.665387:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838464
00000100:00100000:1.0:1767319752.665436:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838976
00000100:00100000:1.0:1767319752.665445:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838976
00000100:00100000:1.0:1767319752.665510:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4433
00000100:00100000:1.0:1767319752.665522:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379838976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319752.665610:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627
00000100:00100000:1.0:1767319752.665622:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379838976:12345-0@lo:400:kworker.0 Request processed in 100us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319752.665626:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379838464:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319752.665641:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4433
00000100:00080000:1.0:1767319752.665676:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319752.665700:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379838464:12345-0@lo:400:kworker.0 Request processed in 78us (457us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319752.665708:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627
00000100:00100000:1.0:1767319752.665724:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379838976:0@lo:400:kworker.0
00000100:00100000:1.0:1767319752.665765:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379838464:0@lo:400:kworker.0
00000100:00100000:3.0:1767319752.665766:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379838592:0@lo:400:kworker.0
00000100:00100000:3.0:1767319752.665821:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.665855:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838592
00000100:00100000:1.0:1767319752.665861:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838592
00000100:00080000:3.0:1767319752.665923:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319752.665937:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628
00000100:00100000:1.0:1767319752.665949:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379838592:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319752.666004:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379838592:12345-0@lo:400:kworker.0 Request processed in 58us (187us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319752.666016:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628
00000100:00100000:3.0:1767319752.666064:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379838592:0@lo:400:kworker.0
00000100:00100000:2.0:1767319752.666126:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.666203:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838720
00000100:00100000:1.0:1767319752.666208:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838720
00000100:00100000:1.0:1767319752.666340:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4434
00000100:00100000:1.0:1767319752.666347:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379838720:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319752.666386:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379838720:12345-0@lo:400:kworker.0 Request processed in 40us (262us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319752.666393:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4434
00000100:00100000:0.0:1767319752.666425:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379838208:0@lo:38:kworker.0
00000100:00100000:0.0:1767319752.666464:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319752.666495:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379838336:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.666504:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838208
00000100:00100000:1.0:1767319752.666509:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838208
00000100:00100000:0.0:1767319752.666525:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.666533:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17213
00000100:00100000:1.0:1767319752.666540:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379838208:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319752.666562:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379838848:0@lo:38:kworker.0
00010000:00020000:1.0:1767319752.666563:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319752.666608:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.666614:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379838208:12345-0@lo:38:kworker.0 Request processed in 72us (148us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319752.666622:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17213
00000100:00100000:0.0:1767319752.666630:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379839104:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.666637:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838848
00000100:00100000:1.0:1767319752.666641:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838848
00000100:00100000:0.0:1767319752.666659:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319752.666665:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17214
00000100:00100000:1.0:1767319752.666670:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379838848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319752.666679:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319752.666697:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319752.666705:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319752.666711:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379838208:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.666713:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379838848:12345-0@lo:38:kworker.0 Request processed in 39us (103us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319752.666725:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17214
00000100:00080000:0.0:1767319752.666729:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319752.666747:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319752.666748:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379839104
00000100:00100000:0.0:1767319752.666752:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379838848:0@lo:38:kworker.0
00000100:00100000:1.0:1767319752.666755:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379839104
00000100:00100000:1.0:1767319752.666777:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17215
00000100:00100000:1.0:1767319752.666783:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379839104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319752.666793:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319752.666798:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379838336
00000100:00080000:3.0:1767319752.666802:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319752.666805:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379838336
00000100:00100000:2.0:1767319752.666931:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379838720:0@lo:400:kworker.0
00000100:00100000:1.0:1767319752.666990:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379839104:12345-0@lo:38:kworker.0 Request processed in 50us (176us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319752.666997:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17215
00000100:00100000:0.0:1767319752.674942:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43
00000100:00100000:0.0:1767319752.674960:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379838336:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319752.674994:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319752.675121:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379838336:12345-0@lo:38:kworker.0 Request processed in 161us (8594us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319752.675130:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43
00000100:00080000:0.0:1767319752.675248:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319752.675254:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319752.675259:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379838336:0@lo:38:kworker.0
00000100:00080000:0.0:1767319752.675275:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319752.675279:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319752.675282:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379839104:0@lo:38:kworker.0
00010000:00010000:0.0:1767319753.175101:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319753.175136:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379839232:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319753.175252:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319753.175389:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379839232
00000100:00100000:0.0:1767319753.175399:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379839232
00000100:00100000:0.0:1767319753.175463:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409
00000100:00100000:0.0:1767319753.175475:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379839232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319753.175514:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319753.175566:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379839232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319753.175575:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409
00000100:00100000:2.0:1767319753.175645:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379839232:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319754.199055:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319754.639674:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319754.639927:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291935360
00000100:00100000:0.0:1767319754.639940:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291935360
00000100:00100000:0.0:1767319754.640024:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4435
00000100:00100000:0.0:1767319754.640035:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291935360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319754.640118:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291935360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (455us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319754.640127:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4435
00000100:00080000:3.0:1767319754.643237:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319754.643536:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319754.643833:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291935232
00000100:00100000:1.0:1767319754.643847:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291935232
00000100:00100000:1.0:1767319754.643938:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17216
00000100:00100000:1.0:1767319754.643948:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291935232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319754.643974:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319754.644060:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291935232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 110us (536us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319754.644067:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17216
00010000:00010000:3.0:1767319755.223439:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319756.247482:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319756.759497:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319756.762476:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379839360:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319756.762580:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319756.762900:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379839360
00000100:00100000:0.0:1767319756.762911:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379839360
00000100:00100000:0.0:1767319756.762990:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410
00000100:00100000:0.0:1767319756.763001:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379839360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319756.763044:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319756.763115:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379839360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (535us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319756.763124:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410
00000100:00080000:3.0:1767319756.763337:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319756.763426:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379839360:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319757.271180:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319757.783900:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.783914:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319757.783918:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.783924:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.783930:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.783940:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4655
00000100:00080000:2.0:1767319757.783946:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.783955:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319757.784009:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448e00 x1853164379839488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319757.784029:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.784032:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.784034:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.784038:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4655
00000100:00080000:2.0:1767319757.784041:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.784046:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319757.784322:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379839488:0@lo:38:kworker.0
00000100:00100000:3.0:1767319757.784432:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319757.784615:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b480 x1853164379839616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319757.784684:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379839744:0@lo:400:kworker.0
00000100:00080000:2.0:1767319757.784772:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.784776:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.784778:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.784783:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4655
00000100:00080000:2.0:1767319757.784786:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.784791:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319757.784808:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379840128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319757.784822:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319757.784826:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319757.784827:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319757.784830:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4655
00000100:00080000:2.0:1767319757.784832:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319757.784837:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319757.784850:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379840384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319757.784928:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379839488
00000100:00100000:0.0:1767319757.784940:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379839488
00000100:00100000:2.0:1767319757.786727:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379840256:0@lo:400:kworker.0
00000100:00100000:1.0:1767319757.786908:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319757.789156:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17217
00000100:00100000:0.0:1767319757.789173:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379839488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319757.789208:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319757.789412:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379839616:0@lo:38:kworker.0
00000100:00100000:0.0:1767319757.789687:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379839488:12345-0@lo:38:kworker.0 Request processed in 514us (5253us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319757.789708:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17217
00000100:00100000:0.0:1767319757.789808:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379839872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.789847:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319757.789920:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319757.789929:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379840000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.789958:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319757.789990:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840000
00000100:00100000:0.0:1767319757.790000:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840000
00000100:00100000:0.0:1767319757.790066:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4436
00000100:00100000:0.0:1767319757.790075:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379840000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.790127:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379840000:12345-0@lo:400:kworker.0 Request processed in 55us (168us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319757.790134:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4436
00000100:00100000:0.0:1767319757.790183:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379840000:0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.790225:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379839744
00000100:00100000:0.0:1767319757.790229:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379839744
00000100:00100000:0.0:1767319757.790254:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379839872
00000100:00100000:0.0:1767319757.790257:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379839872
00000100:00100000:3.0:1767319757.790346:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319757.790387:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379840128:0@lo:38:kworker.0
00000100:00100000:3.0:1767319757.790415:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319757.790434:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379840384:0@lo:38:kworker.0
00000100:00100000:3.0:1767319757.790457:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319757.790641:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319757.790648:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319757.790652:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379839488:0@lo:38:kworker.0
00000100:00100000:3.0:1767319757.790684:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379839616
00000100:00100000:3.0:1767319757.790688:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379839616
00000100:00100000:3.0:1767319757.790726:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44
00000100:00100000:3.0:1767319757.790732:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379839616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319757.790750:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319757.790787:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379839616:12345-0@lo:38:kworker.0 Request processed in 54us (440us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319757.790794:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44
00000100:00080000:3.0:1767319757.790816:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319757.790827:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840128
00000100:00100000:3.0:1767319757.790830:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840128
00000100:00100000:3.0:1767319757.790844:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840384
00000100:00100000:3.0:1767319757.790847:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840384
00000100:00100000:3.0:1767319757.790889:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17218
00000100:00100000:3.0:1767319757.790894:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379840128:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319757.790904:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319757.790930:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379840128:12345-0@lo:38:kworker.0 Request processed in 35us (514us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319757.790937:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17218
00000100:00100000:3.0:1767319757.790947:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17219
00000100:00100000:3.0:1767319757.790951:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379840384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319757.790960:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319757.790980:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379840384:12345-0@lo:38:kworker.0 Request processed in 27us (522us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319757.790986:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17219
00000100:00100000:3.0:1767319757.791009:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629
00000100:00100000:3.0:1767319757.791018:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379839744:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319757.791056:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379839744:12345-0@lo:400:kworker.0 Request processed in 40us (4149us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319757.791062:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629
00000100:00080000:3.0:1767319757.791092:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319757.791097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319757.791100:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379839616:0@lo:38:kworker.0
00000100:00080000:3.0:1767319757.791108:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319757.791112:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319757.791114:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379840128:0@lo:38:kworker.0
00000100:00080000:3.0:1767319757.791121:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319757.791124:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319757.791127:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379840384:0@lo:38:kworker.0
00000100:00100000:0.0:1767319757.793811:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630
00000100:00100000:0.0:1767319757.793826:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379839872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.793971:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379839872:12345-0@lo:400:kworker.0 Request processed in 149us (4124us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319757.793980:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630
00000100:00100000:0.0:1767319757.794073:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379839872:0@lo:400:kworker.0
00000100:00100000:2.0:1767319757.794170:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319757.794201:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319757.794331:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379839744:0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.795851:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840256
00000100:00100000:0.0:1767319757.795896:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840256
00000100:00100000:0.0:1767319757.796012:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4437
00000100:00100000:0.0:1767319757.796023:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379840256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319757.796388:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379840256:12345-0@lo:400:kworker.0 Request processed in 363us (2214us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319757.796415:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4437
00000100:00080000:3.0:1767319757.798376:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319757.800739:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379840256:0@lo:400:kworker.0
00010000:00010000:0.0:1767319758.295148:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319758.295789:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319758.295828:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379840512:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319758.295972:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319758.296258:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840512
00000100:00100000:2.0:1767319758.296268:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840512
00000100:00100000:2.0:1767319758.296326:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411
00000100:00100000:2.0:1767319758.296336:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379840512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319758.296372:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319758.296593:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379840512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 257us (619us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319758.296671:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411
00000100:00100000:0.0:1767319758.297843:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379840512:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319759.330758:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319759.762195:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319759.762299:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291935488
00000100:00100000:0.0:1767319759.762317:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291935488
00000100:00100000:0.0:1767319759.762404:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17220
00000100:00100000:0.0:1767319759.762415:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291935488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319759.762448:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319759.762563:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291935488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 147us (375us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319759.762571:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17220
00000100:00100000:3.0:1767319759.779976:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319759.780080:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291935616
00000100:00100000:1.0:1767319759.780096:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291935616
00000100:00100000:1.0:1767319759.780199:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4438
00000100:00100000:1.0:1767319759.780210:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291935616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319759.780339:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291935616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 130us (372us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319759.780347:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4438
00000100:00080000:3.0:1767319759.780393:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319760.343367:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319761.367762:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319761.879351:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319761.879374:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379840640:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319761.879453:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319761.879501:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840640
00000100:00100000:0.0:1767319761.879510:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840640
00000100:00080000:3.0:1767319761.879568:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319761.879583:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412
00000100:00100000:0.0:1767319761.879592:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379840640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319761.879623:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319761.879706:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379840640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (252us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319761.879713:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412
00000100:00100000:3.0:1767319761.879861:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379840640:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319762.391743:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319762.903044:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319762.903055:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319762.903059:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319762.903065:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319762.903070:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319762.903078:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4660
00000100:00080000:2.0:1767319762.903082:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319762.903091:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319762.903136:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a680 x1853164379840768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319762.903163:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319762.903167:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319762.903169:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319762.903173:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4660
00000100:00080000:2.0:1767319762.903176:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319762.903180:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319762.903194:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448700 x1853164379840896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319762.903264:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319762.903268:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319762.903269:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319762.903273:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4660
00000100:00080000:2.0:1767319762.903275:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319762.903279:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319762.903290:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448e00 x1853164379841408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319762.903304:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319762.903307:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319762.903309:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319762.903312:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4660
00000100:00080000:2.0:1767319762.903314:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319762.903318:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319762.903328:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44ad80 x1853164379841664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319762.903543:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379840768:0@lo:38:kworker.0
00000100:00100000:3.0:1767319762.903625:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319762.903717:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379840896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319762.903749:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319762.903784:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379841408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319762.903822:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319762.903839:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379841664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319762.903858:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319762.903913:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840896
00000100:00100000:3.0:1767319762.903921:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840896
00000100:00100000:3.0:1767319762.903970:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45
00000100:00100000:3.0:1767319762.903980:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f391a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379840896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319762.904001:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319762.904044:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f391a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379840896:12345-0@lo:38:kworker.0 Request processed in 64us (293us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319762.904051:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45
00000100:00100000:3.0:1767319762.904225:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379840768
00000100:00100000:3.0:1767319762.904229:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379840768
00000100:00100000:3.0:1767319762.904248:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841408
00000100:00100000:3.0:1767319762.904250:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841408
00000100:00100000:3.0:1767319762.904261:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841664
00000100:00100000:3.0:1767319762.904263:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841664
00000100:00100000:3.0:1767319762.904278:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17221
00000100:00100000:3.0:1767319762.904283:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379840768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319762.904294:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319762.904322:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379840768:12345-0@lo:38:kworker.0 Request processed in 38us (697us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319762.904328:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17221
00000100:00100000:3.0:1767319762.904340:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17222
00000100:00100000:3.0:1767319762.904344:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379841408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319762.904353:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319762.904377:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379841408:12345-0@lo:38:kworker.0 Request processed in 31us (554us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319762.904382:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17222
00000100:00100000:3.0:1767319762.904392:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17223
00000100:00100000:3.0:1767319762.904396:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379841664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319762.904405:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319762.904427:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379841664:12345-0@lo:38:kworker.0 Request processed in 29us (568us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319762.904432:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17223
00000100:00080000:3.0:1767319762.904484:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319762.904489:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319762.904493:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379840768:0@lo:38:kworker.0
00000100:00080000:3.0:1767319762.904502:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319762.904505:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319762.904508:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379840896:0@lo:38:kworker.0
00000100:00080000:3.0:1767319762.904516:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319762.904519:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319762.904521:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379841408:0@lo:38:kworker.0
00000100:00080000:3.0:1767319762.904529:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319762.904531:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319762.904534:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379841664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319762.904566:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379841280:0@lo:400:kworker.0
00000100:00100000:3.0:1767319762.904594:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319762.904615:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319762.904621:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379841152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319762.904654:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319762.904681:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841280
00000100:00100000:3.0:1767319762.904684:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841280
00000100:00100000:3.0:1767319762.904723:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4439
00000100:00100000:3.0:1767319762.904729:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379841280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319762.904770:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379841280:12345-0@lo:400:kworker.0 Request processed in 42us (175us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319762.904782:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4439
00000100:00080000:3.0:1767319762.904803:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319762.904823:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379841280:0@lo:400:kworker.0
00000100:00100000:0.0:1767319762.904960:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841152
00000100:00100000:0.0:1767319762.904964:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841152
00000100:00100000:0.0:1767319762.905019:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631
00000100:00100000:0.0:1767319762.905026:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379841152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319762.905062:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379841152:12345-0@lo:400:kworker.0 Request processed in 37us (419us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319762.905067:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631
00000100:00100000:0.0:1767319762.905093:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379841024:0@lo:400:kworker.0
00000100:00100000:0.0:1767319762.905118:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319762.905137:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319762.905143:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379841536:0@lo:400:kworker.0
00000100:00100000:0.0:1767319762.905164:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319762.905188:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841024
00000100:00100000:0.0:1767319762.905192:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841024
00000100:00100000:0.0:1767319762.905211:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632
00000100:00100000:0.0:1767319762.905229:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379841024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319762.905263:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379841024:12345-0@lo:400:kworker.0 Request processed in 46us (144us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319762.905268:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632
00000100:00100000:0.0:1767319762.905283:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841536
00000100:00100000:0.0:1767319762.905286:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841536
00000100:00100000:0.0:1767319762.905309:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4440
00000100:00100000:0.0:1767319762.905314:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379841536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319762.905740:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379841536:12345-0@lo:400:kworker.0 Request processed in 423us (573us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319762.905747:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4440
00000100:00100000:2.0:1767319762.905777:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379841536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319762.905789:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379841024:0@lo:400:kworker.0
00000100:00080000:3.0:1767319762.906078:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319762.906083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319762.906109:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379841152:0@lo:400:kworker.0
00000100:00100000:3.0:1767319763.415752:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379841792:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319763.415977:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319763.419440:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841792
00000100:00100000:0.0:1767319763.419457:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841792
00000100:00100000:0.0:1767319763.419537:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413
00000100:00100000:0.0:1767319763.419548:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379841792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319763.419598:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319763.419719:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379841792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (3743us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319763.419727:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413
00000100:00100000:3.0:1767319763.419985:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379841792:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319763.423138:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319763.855403:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319763.856527:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291935744 offset 0 length 520: 4
00000100:00100000:3.0:1767319763.856558:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319763.856692:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936000
00000100:00100000:1.0:1767319763.856703:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936000
00000100:00100000:1.0:1767319763.856777:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291935872
00000100:00100000:1.0:1767319763.856780:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291935872
00000100:00100000:1.0:1767319763.856800:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4441
00000100:00100000:1.0:1767319763.856810:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291936000:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319763.856925:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291936000:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 116us (1531us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319763.856933:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4441
00000100:00100000:1.0:1767319763.856957:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17224
00000100:00100000:1.0:1767319763.856962:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291935872:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319763.856982:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319763.857009:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291935872:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (450us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319763.857015:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17224
00000100:00080000:3.0:1767319763.857347:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319764.439584:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319765.463719:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319766.487223:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319767.000002:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319767.000021:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379841920:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319767.000094:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319767.000239:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379841920
00000100:00100000:1.0:1767319767.000247:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379841920
00000100:00100000:1.0:1767319767.000314:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414
00000100:00100000:1.0:1767319767.000323:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379841920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319767.000352:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319767.000397:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379841920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319767.000405:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414
00000100:00080000:0.0:1767319767.000675:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319767.001211:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379841920:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319767.523813:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319768.023317:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319768.023327:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319768.023330:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319768.023334:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319768.023338:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319768.023345:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4665
00000100:00080000:0.0:1767319768.023349:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319768.023355:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319768.023393:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8000 x1853164379842048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319768.023409:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319768.023412:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319768.023414:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319768.023417:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4665
00000100:00080000:0.0:1767319768.023420:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319768.023423:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319768.023434:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab100 x1853164379842176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319768.023489:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319768.023493:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319768.023495:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319768.023498:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4665
00000100:00080000:0.0:1767319768.023500:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319768.023503:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319768.023515:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4000 x1853164379842688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319768.023529:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319768.023532:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319768.023533:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319768.023537:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4665
00000100:00080000:0.0:1767319768.023539:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319768.023542:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319768.023549:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef5500 x1853164379842944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319768.023639:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379842816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319768.023705:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319768.023780:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319768.023786:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379842304:0@lo:400:kworker.0
00000100:00100000:2.0:1767319768.023811:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319768.023863:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842304
00000100:00100000:2.0:1767319768.023889:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842304
00000100:00100000:2.0:1767319768.023949:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633
00000100:00100000:2.0:1767319768.023958:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379842304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319768.024015:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379842304:12345-0@lo:400:kworker.0 Request processed in 52us (196us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319768.024023:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633
00000100:00100000:2.0:1767319768.024065:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379842304:0@lo:400:kworker.0
00000100:00100000:1.0:1767319768.024225:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379842432:0@lo:400:kworker.0
00000100:00100000:1.0:1767319768.024253:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319768.024286:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319768.024291:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379842560:0@lo:400:kworker.0
00000100:00100000:1.0:1767319768.024315:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319768.024398:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842816
00000100:00100000:3.0:1767319768.024403:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842816
00000100:00100000:3.0:1767319768.024442:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842560
00000100:00100000:3.0:1767319768.024446:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842560
00000100:00100000:3.0:1767319768.024467:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4442
00000100:00100000:3.0:1767319768.024474:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379842816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319768.024519:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379842816:12345-0@lo:400:kworker.0 Request processed in 45us (814us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319768.024525:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4442
00000100:00100000:3.0:1767319768.024537:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4443
00000100:00100000:3.0:1767319768.024544:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379842560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319768.024571:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379842560:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319768.024576:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4443
00000100:00100000:3.0:1767319768.024610:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319742/real 1767319742]  req@ffff8b0e0be07480 x1853164379835520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319768.024627:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0be07480 x1853164379835520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319768.024640:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379842048:0@lo:38:kworker.0
00000100:00100000:3.0:1767319768.024664:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319768.024682:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379842176:0@lo:38:kworker.0
00000100:00100000:3.0:1767319768.024705:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319768.024727:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379842688:0@lo:38:kworker.0
00000100:00100000:3.0:1767319768.024747:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319768.024762:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379842944:0@lo:38:kworker.0
00000100:00100000:3.0:1767319768.024780:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319768.024793:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319768.024803:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319768.024807:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379835520:0@lo:250:kworker.0
00000100:00100000:3.0:1767319768.024828:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842176
00000100:00100000:3.0:1767319768.024845:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842176
00000100:00100000:3.0:1767319768.024866:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46
00000100:00100000:3.0:1767319768.024899:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379842176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319768.024919:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319768.024956:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379842176:12345-0@lo:38:kworker.0 Request processed in 56us (249us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319768.024962:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46
00000100:00100000:3.0:1767319768.024978:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842048
00000100:00100000:3.0:1767319768.024981:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842048
00000100:00100000:3.0:1767319768.024993:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842688
00000100:00100000:3.0:1767319768.024995:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842688
00000100:00100000:3.0:1767319768.025001:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842944
00000100:00100000:3.0:1767319768.025003:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842944
00000100:00100000:3.0:1767319768.025011:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17225
00000100:00100000:3.0:1767319768.025015:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379842048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319768.025025:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319768.025049:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379842048:12345-0@lo:38:kworker.0 Request processed in 32us (384us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319768.025054:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17225
00000100:00100000:3.0:1767319768.025064:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17226
00000100:00100000:3.0:1767319768.025069:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379842688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319768.025077:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319768.025099:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379842688:12345-0@lo:38:kworker.0 Request processed in 29us (351us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319768.025105:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17226
00000100:00100000:3.0:1767319768.025115:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17227
00000100:00100000:3.0:1767319768.025118:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379842944:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319768.025126:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319768.025147:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379842944:12345-0@lo:38:kworker.0 Request processed in 27us (367us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319768.025153:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17227
00000100:00080000:3.0:1767319768.025188:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319768.025192:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319768.025195:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379842048:0@lo:38:kworker.0
00000100:00080000:3.0:1767319768.025203:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319768.025205:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319768.025208:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379842176:0@lo:38:kworker.0
00000100:00080000:3.0:1767319768.025216:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319768.025219:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319768.025221:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379842688:0@lo:38:kworker.0
00000100:00080000:3.0:1767319768.025228:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319768.025231:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319768.025234:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379842944:0@lo:38:kworker.0
00000100:00100000:1.0:1767319768.025420:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379842560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319768.025492:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379842432
00000100:00100000:2.0:1767319768.025497:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379842432
00000100:00100000:2.0:1767319768.025538:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634
00000100:00100000:2.0:1767319768.025545:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379842432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319768.025607:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379842432:12345-0@lo:400:kworker.0 Request processed in 51us (1341us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319768.025614:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634
00000100:00100000:2.0:1767319768.025644:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379842816:0@lo:400:kworker.0
00000100:00100000:1.0:1767319768.025712:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379842432:0@lo:400:kworker.0
00000100:00080000:0.0:1767319768.025803:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319768.025808:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319768.025810:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319768.025823:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319768.025827:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319768.025830:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319768.025845:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4644
00000100:00080000:0.0:1767319768.025849:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319768.025853:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319768.025897:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6a00 x1853164379843072/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319768.026161:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379843072:0@lo:250:kworker.0
00000400:00000100:2.0:1767319768.026187:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379843072 offset 0 length 520: 4
00010000:00010000:1.0:1767319768.535499:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319768.536746:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379843200:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319768.536824:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319768.536943:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379843200
00000100:00100000:0.0:1767319768.536952:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379843200
00000100:00100000:0.0:1767319768.537008:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415
00000100:00100000:0.0:1767319768.537023:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379843200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319768.537056:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319768.540807:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379843200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3779us (3971us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319768.540824:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415
00000100:00100000:3.0:1767319768.549168:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379843200:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319768.977756:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319768.977811:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319768.977894:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936128
00000100:00100000:1.0:1767319768.977904:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936128
00000100:00100000:1.0:1767319768.977943:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936256
00000100:00100000:1.0:1767319768.977945:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936256
00000100:00100000:1.0:1767319768.977987:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4444
00000100:00100000:1.0:1767319768.977995:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291936256:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767319768.977996:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319768.978071:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291936256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (261us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319768.978077:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4444
00000100:00100000:1.0:1767319768.978092:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17228
00000100:00100000:1.0:1767319768.978095:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291936128:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319768.978113:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319768.978131:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291936128:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 35us (399us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319768.978135:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17228
00010000:00010000:1.0:1767319769.559219:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319770.584011:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319771.608430:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319772.120047:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319772.120073:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379843328:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319772.120152:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319772.120502:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379843328
00000100:00100000:0.0:1767319772.120511:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379843328
00000100:00080000:2.0:1767319772.120633:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319772.120672:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416
00000100:00100000:0.0:1767319772.120683:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379843328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319772.120716:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319772.120771:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379843328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (619us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319772.120779:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416
00000100:00100000:3.0:1767319772.120854:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379843328:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319772.631165:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319773.143646:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319773.143658:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319773.143661:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319773.143665:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319773.143670:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319773.143679:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4670
00000100:00080000:2.0:1767319773.143684:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319773.143691:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319773.143733:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379843456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319773.143767:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319773.143771:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319773.143773:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319773.143776:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4670
00000100:00080000:2.0:1767319773.143779:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319773.143782:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319773.143795:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379843584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319773.143857:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319773.143900:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379843456:0@lo:38:kworker.0
00000100:00100000:3.0:1767319773.143971:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319773.144028:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379843584:0@lo:38:kworker.0
00000100:00100000:3.0:1767319773.144066:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319773.144108:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379843456
00000100:00100000:3.0:1767319773.144115:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379843456
00000100:00100000:3.0:1767319773.144147:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17229
00000100:00100000:3.0:1767319773.144155:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379843456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319773.144175:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319773.144215:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379843456:12345-0@lo:38:kworker.0 Request processed in 59us (244us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319773.144222:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17229
00000100:00100000:3.0:1767319773.144245:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379843584
00000100:00100000:3.0:1767319773.144249:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379843584
00000100:00100000:3.0:1767319773.144266:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47
00000100:00100000:3.0:1767319773.144270:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379843584:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319773.144280:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319773.144305:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379843584:12345-0@lo:38:kworker.0 Request processed in 33us (238us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319773.144310:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47
00000100:00080000:3.0:1767319773.144348:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319773.144353:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319773.144356:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379843456:0@lo:38:kworker.0
00000100:00080000:3.0:1767319773.144366:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319773.144369:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319773.144371:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379843584:0@lo:38:kworker.0
00000100:00080000:2.0:1767319773.144596:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319773.144599:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319773.144601:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319773.144605:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4670
00000100:00080000:2.0:1767319773.144608:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319773.144612:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319773.144623:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448700 x1853164379844096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319773.144679:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379843968:0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.144708:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319773.144728:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319773.144733:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379843840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.144755:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319773.144780:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379843840
00000100:00100000:3.0:1767319773.144783:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379843840
00000100:00100000:3.0:1767319773.144821:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635
00000100:00100000:3.0:1767319773.144827:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379843840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.144884:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379843840:12345-0@lo:400:kworker.0 Request processed in 43us (113us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319773.144891:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635
00000100:00100000:3.0:1767319773.144908:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379843968
00000100:00100000:3.0:1767319773.144912:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379843968
00000100:00100000:3.0:1767319773.144935:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4445
00000100:00100000:3.0:1767319773.145046:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379843968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.145080:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379843968:12345-0@lo:400:kworker.0 Request processed in 139us (371us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319773.145086:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4445
00000100:00100000:3.0:1767319773.145115:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379843840:0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.145123:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379843968:0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.145157:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379844096:0@lo:38:kworker.0
00000100:00100000:3.0:1767319773.145180:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319773.145203:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844096
00000100:00100000:3.0:1767319773.145206:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844096
00000100:00100000:3.0:1767319773.145222:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17230
00000100:00100000:3.0:1767319773.145227:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379844096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319773.145239:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319773.145266:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379844096:12345-0@lo:38:kworker.0 Request processed in 38us (86us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319773.145273:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17230
00000100:00080000:3.0:1767319773.145294:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319773.145298:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319773.145301:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379844096:0@lo:38:kworker.0
00000100:00080000:3.0:1767319773.145322:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319773.145326:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319773.153399:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379844224:0@lo:400:kworker.0
00000100:00100000:1.0:1767319773.153475:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319773.153524:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379843712:0@lo:400:kworker.0
00000100:00100000:1.0:1767319773.153561:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319773.153686:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379843712
00000100:00100000:0.0:1767319773.153697:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379843712
00000100:00100000:0.0:1767319773.153758:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636
00000100:00100000:0.0:1767319773.153768:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379843712:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319773.153828:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379843712:12345-0@lo:400:kworker.0 Request processed in 61us (277us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319773.153835:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636
00000100:00100000:0.0:1767319773.153901:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379843712:0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.154021:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844224
00000100:00100000:3.0:1767319773.154026:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844224
00000100:00100000:3.0:1767319773.154083:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4446
00000100:00100000:3.0:1767319773.154090:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379844224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319773.154131:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379844224:12345-0@lo:400:kworker.0 Request processed in 43us (656us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319773.154138:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4446
00000100:00080000:0.0:1767319773.154193:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319773.154215:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379844224:0@lo:400:kworker.0
00000100:00080000:2.0:1767319773.154332:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319773.154338:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319773.154341:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319773.154347:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4670
00000100:00080000:2.0:1767319773.154350:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319773.154354:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319773.154383:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a680 x1853164379844352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319773.154464:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379844352:0@lo:38:kworker.0
00000100:00100000:1.0:1767319773.154492:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319773.154607:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844352
00000100:00100000:2.0:1767319773.154612:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844352
00000100:00100000:2.0:1767319773.154643:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17231
00000100:00100000:2.0:1767319773.154648:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379844352:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319773.154668:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319773.154711:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379844352:12345-0@lo:38:kworker.0 Request processed in 61us (217us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319773.154718:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17231
00000100:00080000:1.0:1767319773.154779:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319773.154785:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319773.154788:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379844352:0@lo:38:kworker.0
00000100:00100000:3.0:1767319773.655151:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379844480:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319773.655155:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319773.655236:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319773.655360:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844480
00000100:00100000:0.0:1767319773.655369:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844480
00000100:00100000:0.0:1767319773.655428:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417
00000100:00100000:0.0:1767319773.655438:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379844480:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319773.655482:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319773.656141:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379844480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 703us (903us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319773.656151:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417
00000100:00100000:3.0:1767319773.656411:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379844480:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319774.097166:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319774.098041:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319774.106687:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936384
00000100:00100000:0.0:1767319774.106702:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936384
00000100:00100000:0.0:1767319774.106757:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936512
00000100:00100000:0.0:1767319774.106761:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936512
00000100:00100000:0.0:1767319774.106829:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4447
00000100:00100000:0.0:1767319774.106840:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291936512:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319774.106942:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291936512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (8905us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319774.106950:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4447
00000100:00100000:0.0:1767319774.106970:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17232
00000100:00100000:0.0:1767319774.106974:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291936384:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319774.106995:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319774.107017:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291936384:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (9860us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319774.107023:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17232
00000100:00080000:3.0:1767319774.107704:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319774.679306:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319775.703592:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319776.727298:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319777.239427:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379844608:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319777.239504:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319777.239895:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844608
00000100:00100000:0.0:1767319777.239906:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844608
00000100:00100000:0.0:1767319777.239985:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418
00000100:00100000:0.0:1767319777.239994:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379844608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319777.240027:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319777.240082:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379844608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (578us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319777.240226:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379844608:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319777.240297:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319777.240373:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418
00010000:00010000:1.0:1767319777.751980:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319778.263377:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319778.263388:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319778.263390:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319778.263395:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319778.263400:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319778.263407:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4675
00000100:00080000:2.0:1767319778.263412:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319778.263418:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319778.263458:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44ad80 x1853164379844736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319778.263491:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319778.263495:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319778.263497:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319778.263502:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4675
00000100:00080000:2.0:1767319778.263513:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319778.263517:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319778.263530:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379844864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319778.263590:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379844736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319778.263646:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319778.263658:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379844992:0@lo:400:kworker.0
00000100:00100000:3.0:1767319778.263694:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319778.263700:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379844864:0@lo:38:kworker.0
00000100:00100000:1.0:1767319778.263733:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319778.263748:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844736
00000100:00100000:3.0:1767319778.263754:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844736
00000100:00100000:1.0:1767319778.263779:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844992
00000100:00100000:1.0:1767319778.263784:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844992
00000100:00100000:3.0:1767319778.263787:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17233
00000100:00100000:3.0:1767319778.263794:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379844736:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319778.263812:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637
00010000:00020000:3.0:1767319778.263813:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319778.263819:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379844992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319778.263855:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379844992:12345-0@lo:400:kworker.0 Request processed in 37us (163us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319778.263860:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637
00000100:00100000:1.0:1767319778.263891:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379844864
00000100:00100000:1.0:1767319778.263894:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379844864
00000100:00100000:1.0:1767319778.263906:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48
00000100:00100000:1.0:1767319778.263909:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379844864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319778.263917:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319778.263942:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379844864:12345-0@lo:38:kworker.0 Request processed in 32us (210us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319778.263946:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48
00000100:00100000:1.0:1767319778.263985:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379844992:0@lo:400:kworker.0
00000100:00080000:1.0:1767319778.264012:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319778.264016:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319778.264019:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379844864:0@lo:38:kworker.0
00000100:00100000:3.0:1767319778.265022:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379844736:12345-0@lo:38:kworker.0 Request processed in 1222us (1371us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319778.265031:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17233
00000100:00080000:1.0:1767319778.265210:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319778.265215:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319778.265218:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379844736:0@lo:38:kworker.0
00000100:00080000:2.0:1767319778.265649:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319778.265654:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319778.265658:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319778.265663:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4675
00000100:00080000:2.0:1767319778.265666:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319778.265671:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319778.265689:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379845376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319778.265766:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379845120:0@lo:400:kworker.0
00000100:00100000:3.0:1767319778.265775:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379845248:0@lo:400:kworker.0
00000100:00100000:0.0:1767319778.265823:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319778.265829:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319778.265884:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379845504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319778.265893:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379845248
00000100:00100000:3.0:1767319778.265900:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379845248
00000100:00100000:1.0:1767319778.265911:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379845376:0@lo:38:kworker.0
00000100:00100000:0.0:1767319778.265919:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319778.265945:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379845504
00000100:00100000:1.0:1767319778.265946:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319778.265948:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379845504
00000100:00100000:0.0:1767319778.265968:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379845376
00000100:00100000:0.0:1767319778.265974:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379845376
00000100:00100000:3.0:1767319778.265977:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4448
00000100:00100000:3.0:1767319778.265985:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379845248:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319778.266006:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4449
00000100:00100000:1.0:1767319778.266013:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17234
00000100:00100000:0.0:1767319778.266018:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379845504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319778.266023:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379845376:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319778.266026:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379845248:12345-0@lo:400:kworker.0 Request processed in 42us (206us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319778.266034:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4448
00010000:00020000:1.0:1767319778.266045:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319778.266054:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319778.266067:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379845504:12345-0@lo:400:kworker.0 Request processed in 53us (150us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319778.266074:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4449
00000100:00100000:1.0:1767319778.266086:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379845376:12345-0@lo:38:kworker.0 Request processed in 64us (139us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319778.266090:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379845248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319778.266094:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17234
00000100:00100000:0.0:1767319778.266118:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379845504:0@lo:400:kworker.0
00000100:00080000:1.0:1767319778.266126:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319778.266131:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319778.266133:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379845120
00000100:00100000:1.0:1767319778.266136:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379845376:0@lo:38:kworker.0
00000100:00100000:3.0:1767319778.266138:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379845120
00000100:00100000:3.0:1767319778.266168:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638
00000100:00100000:3.0:1767319778.266177:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379845120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319778.266222:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379845120:12345-0@lo:400:kworker.0 Request processed in 47us (399us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319778.266228:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638
00000100:00080000:3.0:1767319778.266243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319778.266495:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379845120:0@lo:400:kworker.0
00000100:00080000:2.0:1767319778.271392:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319778.271403:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319778.271407:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319778.271415:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4675
00000100:00080000:2.0:1767319778.271420:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319778.271427:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319778.271468:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b480 x1853164379845632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319778.271570:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379845632:0@lo:38:kworker.0
00000100:00100000:1.0:1767319778.271627:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319778.271862:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379845632
00000100:00100000:0.0:1767319778.271894:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379845632
00000100:00100000:0.0:1767319778.271939:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17235
00000100:00100000:0.0:1767319778.271946:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379845632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319778.271967:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319778.272026:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379845632:12345-0@lo:38:kworker.0 Request processed in 79us (397us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319778.272033:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17235
00000100:00080000:2.0:1767319778.272225:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319778.272232:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319778.272235:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379845632:0@lo:38:kworker.0
00000100:00100000:3.0:1767319778.775711:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379845760:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319778.775794:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:3.0:1767319778.779401:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319778.780952:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379845760
00000100:00100000:2.0:1767319778.780968:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379845760
00000100:00100000:2.0:1767319778.781049:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419
00000100:00100000:2.0:1767319778.781060:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379845760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319778.781096:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319778.781199:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379845760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (5404us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319778.781219:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419
00000100:00100000:3.0:1767319778.781432:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379845760:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319779.215700:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319779.215803:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936768
00000100:00100000:1.0:1767319779.215816:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936768
00000100:00100000:1.0:1767319779.215933:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4450
00000100:00100000:1.0:1767319779.215946:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291936768:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767319779.215980:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319779.216033:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291936768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (341us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319779.216041:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4450
00000100:00100000:0.0:1767319779.223263:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319779.227304:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936640
00000100:00100000:1.0:1767319779.227320:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936640
00000100:00100000:1.0:1767319779.227387:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17236
00000100:00100000:1.0:1767319779.227396:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291936640:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319779.227420:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319779.227667:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291936640:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 269us (4862us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319779.227675:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17236
00010000:00010000:2.0:1767319779.800893:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319780.823559:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319781.847267:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319782.361896:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319782.361921:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379845888:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319782.361989:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319782.364649:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379845888
00000100:00100000:2.0:1767319782.364667:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379845888
00000100:00100000:2.0:1767319782.364781:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420
00000100:00100000:2.0:1767319782.364794:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379845888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319782.364844:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319782.364989:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379845888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 198us (2999us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319782.364997:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420
00000100:00100000:1.0:1767319782.365601:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379845888:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319782.365740:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319782.874192:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319783.385509:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319783.385523:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319783.385527:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319783.385532:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319783.385537:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319783.385545:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4680
00000100:00080000:3.0:1767319783.385550:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319783.385557:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319783.385610:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904380 x1853164379846016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319783.385648:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319783.385652:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319783.385654:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319783.385659:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4680
00000100:00080000:3.0:1767319783.385661:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319783.385665:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319783.385679:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904e00 x1853164379846144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319783.385759:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319783.385763:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319783.385765:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319783.385769:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4680
00000100:00080000:3.0:1767319783.385771:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319783.385774:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319783.385783:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379846272:0@lo:400:kworker.0
00000100:00100000:3.0:1767319783.385785:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379846656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319783.385798:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319783.385802:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319783.385803:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319783.385806:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4680
00000100:00080000:3.0:1767319783.385808:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319783.385811:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319783.385821:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddf80 x1853164379846912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319783.385841:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379846528:0@lo:400:kworker.0
00000100:00100000:1.0:1767319783.385851:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319783.385903:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319783.385992:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379846784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319783.386022:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319783.386050:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379846400:0@lo:400:kworker.0
00000100:00100000:0.0:1767319783.386084:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319783.386112:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846528
00000100:00100000:0.0:1767319783.386119:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846528
00000100:00100000:0.0:1767319783.386167:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846784
00000100:00100000:0.0:1767319783.386171:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846784
00000100:00100000:0.0:1767319783.386194:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4451
00000100:00100000:0.0:1767319783.386203:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379846528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319783.386250:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379846528:12345-0@lo:400:kworker.0 Request processed in 48us (346us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319783.386258:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4451
00000100:00100000:0.0:1767319783.386277:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4452
00000100:00100000:0.0:1767319783.386283:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379846784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319783.386320:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379846784:12345-0@lo:400:kworker.0 Request processed in 37us (297us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319783.386326:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4452
00000100:00080000:0.0:1767319783.386348:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319783.386388:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846272
00000100:00100000:0.0:1767319783.386392:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846272
00000100:00100000:0.0:1767319783.386412:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846400
00000100:00100000:0.0:1767319783.386414:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846400
00000100:00100000:0.0:1767319783.386436:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639
00000100:00100000:0.0:1767319783.386442:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379846272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319783.386485:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379846272:12345-0@lo:400:kworker.0 Request processed in 43us (634us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319783.386490:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639
00000100:00100000:0.0:1767319783.386502:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640
00000100:00100000:0.0:1767319783.386507:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379846400:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319783.386537:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379846400:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319783.386542:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640
00000100:00080000:0.0:1767319783.386570:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319783.387055:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379846528:0@lo:400:kworker.0
00000100:00100000:2.0:1767319783.387573:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379846016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319783.387623:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319783.388915:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846016
00000100:00100000:3.0:1767319783.388928:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846016
00000100:00100000:3.0:1767319783.388984:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17237
00000100:00100000:3.0:1767319783.388992:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379846016:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319783.389016:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319783.389101:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379846016:12345-0@lo:38:kworker.0 Request processed in 108us (1477us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319783.389108:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17237
00000100:00100000:0.0:1767319783.389305:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379846784:0@lo:400:kworker.0
00000100:00080000:2.0:1767319783.389413:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319783.389419:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319783.389424:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379846016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319783.389433:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379846144:0@lo:38:kworker.0
00000100:00100000:2.0:1767319783.389480:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319783.389522:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379846656:0@lo:38:kworker.0
00000100:00100000:2.0:1767319783.389546:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319783.389578:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379846912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319783.389599:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319783.389635:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846656
00000100:00100000:2.0:1767319783.389640:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846656
00000100:00100000:2.0:1767319783.389662:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846912
00000100:00100000:2.0:1767319783.389664:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846912
00000100:00100000:2.0:1767319783.389680:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17238
00000100:00100000:2.0:1767319783.389685:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379846656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319783.389697:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319783.389711:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379846272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319783.389742:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379846656:12345-0@lo:38:kworker.0 Request processed in 55us (194us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319783.389748:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17238
00000100:00100000:1.0:1767319783.389754:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17239
00000100:00100000:1.0:1767319783.389759:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379846912:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767319783.389774:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319783.389778:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319783.389781:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379846656:0@lo:38:kworker.0
00010000:00020000:1.0:1767319783.389783:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319783.389820:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379846912:12345-0@lo:38:kworker.0 Request processed in 58us (220us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319783.389826:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17239
00000100:00080000:2.0:1767319783.389837:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319783.389841:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319783.389844:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379846912:0@lo:38:kworker.0
00000100:00100000:0.0:1767319783.389973:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379846144
00000100:00100000:0.0:1767319783.389978:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379846144
00000100:00100000:0.0:1767319783.390007:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49
00000100:00100000:0.0:1767319783.390012:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379846144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319783.390023:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319783.390071:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379846144:12345-0@lo:38:kworker.0 Request processed in 50us (584us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319783.390077:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49
00000100:00100000:3.0:1767319783.390361:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379846400:0@lo:400:kworker.0
00000100:00080000:2.0:1767319783.390431:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319783.390435:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319783.390438:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379846144:0@lo:38:kworker.0
00010000:00010000:2.0:1767319783.895234:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319783.895600:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379847040:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319783.895675:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319783.895774:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847040
00000100:00100000:0.0:1767319783.895783:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847040
00000100:00100000:0.0:1767319783.895832:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421
00000100:00100000:0.0:1767319783.895842:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379847040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319783.895896:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319783.895949:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379847040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (273us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319783.895960:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421
00000100:00100000:1.0:1767319783.896274:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379847040:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319784.341408:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319784.341978:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319784.345378:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291937024
00000100:00100000:1.0:1767319784.345396:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291937024
00000100:00100000:1.0:1767319784.345509:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291936896
00000100:00100000:1.0:1767319784.345513:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291936896
00000100:00100000:1.0:1767319784.345539:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4453
00000100:00100000:1.0:1767319784.345560:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291937024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319784.345803:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17240
00000100:00100000:3.0:1767319784.345810:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291936896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319784.345831:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319784.345909:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291936896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 97us (3931us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319784.345917:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17240
00000100:00100000:1.0:1767319784.347218:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291937024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1651us (5802us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319784.347230:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4453
00000100:00080000:2.0:1767319784.348036:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319784.920668:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319785.943211:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319786.967152:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319787.479804:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379847168:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319787.479901:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319787.480148:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847168
00000100:00100000:2.0:1767319787.480156:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847168
00000100:00100000:2.0:1767319787.480227:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422
00000100:00100000:2.0:1767319787.480238:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379847168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319787.480271:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767319787.480341:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319787.480815:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379847168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 578us (913us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319787.480825:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422
00000100:00100000:3.0:1767319787.480986:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379847168:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319787.991181:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319788.434849:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291937152 offset 0 length 520: 4
00000100:00100000:2.0:1767319788.453513:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319788.453557:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319788.453764:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291937280
00000100:00100000:0.0:1767319788.453774:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291937280
00000100:00100000:0.0:1767319788.453822:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291937408
00000100:00100000:0.0:1767319788.453825:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291937408
00000100:00100000:0.0:1767319788.453920:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4454
00000100:00100000:0.0:1767319788.453931:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291937408:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319788.454026:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291937408:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (467us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319788.454034:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4454
00000100:00100000:0.0:1767319788.454055:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17241
00000100:00100000:0.0:1767319788.454060:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291937280:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319788.454297:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319788.454326:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291937280:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 264us (822us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319788.454333:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17241
00000100:00080000:2.0:1767319788.455618:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319788.503991:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319788.503999:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319788.504002:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319788.504007:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319788.504010:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319788.504018:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4685
00000100:00080000:3.0:1767319788.504022:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319788.504029:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319788.504059:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379847296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319788.504082:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319788.504085:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319788.504087:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319788.504090:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4685
00000100:00080000:3.0:1767319788.504093:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319788.504095:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319788.504107:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddf80 x1853164379847424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319788.504146:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319788.504149:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319788.504151:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319788.504154:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4685
00000100:00080000:3.0:1767319788.504156:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319788.504159:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319788.504168:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682680 x1853164379847936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319788.504182:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319788.504185:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319788.504187:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319788.504190:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4685
00000100:00080000:3.0:1767319788.504192:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319788.504196:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319788.504206:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fed80 x1853164379848192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319788.504257:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379847296:0@lo:38:kworker.0
00000100:00100000:3.0:1767319788.504320:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319788.504391:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379847424:0@lo:38:kworker.0
00000100:00100000:3.0:1767319788.504424:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319788.504448:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379847936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319788.504471:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319788.504486:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379848192:0@lo:38:kworker.0
00000100:00100000:3.0:1767319788.504502:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319788.504530:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847296
00000100:00100000:3.0:1767319788.504536:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847296
00000100:00100000:3.0:1767319788.504565:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847936
00000100:00100000:3.0:1767319788.504567:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847936
00000100:00100000:3.0:1767319788.504577:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848192
00000100:00100000:3.0:1767319788.504579:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848192
00000100:00100000:3.0:1767319788.504594:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17242
00000100:00100000:3.0:1767319788.504599:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379847296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319788.504619:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319788.504653:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379847296:12345-0@lo:38:kworker.0 Request processed in 53us (333us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319788.504660:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17242
00000100:00100000:3.0:1767319788.504674:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17243
00000100:00100000:3.0:1767319788.504678:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379847936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319788.504686:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319788.504703:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379847936:12345-0@lo:38:kworker.0 Request processed in 24us (232us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319788.504708:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17243
00000100:00100000:3.0:1767319788.504716:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17244
00000100:00100000:3.0:1767319788.504719:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379848192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319788.504726:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319788.504741:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379848192:12345-0@lo:38:kworker.0 Request processed in 21us (238us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319788.504746:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17244
00000100:00100000:3.0:1767319788.504768:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847424
00000100:00100000:3.0:1767319788.504772:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847424
00000100:00100000:3.0:1767319788.504787:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50
00000100:00100000:3.0:1767319788.504791:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379847424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319788.504800:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319788.504823:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379847424:12345-0@lo:38:kworker.0 Request processed in 31us (399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319788.504829:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50
00000100:00100000:3.0:1767319788.504843:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379847680:0@lo:400:kworker.0
00000100:00100000:3.0:1767319788.504865:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319788.504911:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319788.504917:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379847808:0@lo:400:kworker.0
00000100:00100000:3.0:1767319788.504936:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319788.504958:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847808
00000100:00100000:3.0:1767319788.504961:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847808
00000100:00100000:3.0:1767319788.504993:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4455
00000100:00100000:3.0:1767319788.504999:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379847808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319788.505039:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379847808:12345-0@lo:400:kworker.0 Request processed in 41us (102us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319788.505045:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4455
00000100:00100000:3.0:1767319788.505082:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379847808:0@lo:400:kworker.0
00000100:00080000:3.0:1767319788.505110:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319788.505115:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319788.505118:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379847296:0@lo:38:kworker.0
00000100:00080000:3.0:1767319788.505125:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319788.505128:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319788.505131:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379847424:0@lo:38:kworker.0
00000100:00080000:3.0:1767319788.505139:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319788.505141:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319788.505144:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379847936:0@lo:38:kworker.0
00000100:00080000:3.0:1767319788.505150:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319788.505154:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319788.505156:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379848192:0@lo:38:kworker.0
00000100:00100000:1.0:1767319788.505457:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379848064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319788.505490:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319788.505518:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319788.505523:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379847552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319788.505544:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319788.505576:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848064
00000100:00100000:1.0:1767319788.505579:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848064
00000100:00100000:1.0:1767319788.505605:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4456
00000100:00100000:1.0:1767319788.505611:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379848064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319788.505640:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379848064:12345-0@lo:400:kworker.0 Request processed in 29us (150us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319788.505646:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4456
00000100:00100000:1.0:1767319788.505671:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847680
00000100:00100000:1.0:1767319788.505674:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847680
00000100:00100000:1.0:1767319788.505695:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379847552
00000100:00100000:1.0:1767319788.505697:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379847552
00000100:00100000:1.0:1767319788.505710:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641
00000100:00100000:1.0:1767319788.505715:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379847680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319788.505741:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379847680:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319788.505746:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641
00000100:00100000:1.0:1767319788.505756:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642
00000100:00100000:1.0:1767319788.505761:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379847552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319788.505783:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379847552:12345-0@lo:400:kworker.0 Request processed in 22us (238us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319788.505788:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642
00000100:00100000:1.0:1767319788.505814:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379847552:0@lo:400:kworker.0
00000100:00100000:1.0:1767319788.505822:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379848064:0@lo:400:kworker.0
00000100:00100000:1.0:1767319788.505841:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379847680:0@lo:400:kworker.0
00000100:00080000:2.0:1767319788.506232:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319788.506238:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319789.016219:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319789.021377:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379848320:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319789.021464:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319789.021827:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848320
00000100:00100000:2.0:1767319789.021837:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848320
00000100:00100000:2.0:1767319789.021916:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423
00000100:00100000:2.0:1767319789.021927:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379848320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319789.021958:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319789.022018:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379848320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (553us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319789.022025:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423
00000100:00100000:0.0:1767319789.022676:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379848320:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319790.039574:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319791.064423:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319792.087279:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319792.599903:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319792.599921:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379848448:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319792.599988:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319792.600096:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848448
00000100:00100000:0.0:1767319792.600104:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848448
00000100:00100000:0.0:1767319792.600162:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424
00000100:00100000:0.0:1767319792.600170:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379848448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319792.600195:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319792.600236:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379848448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (247us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319792.600247:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424
00000100:00100000:0.0:1767319792.600289:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379848448:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319792.600336:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319793.111219:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319793.552795:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319793.552912:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319793.552975:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291937664
00000100:00100000:2.0:1767319793.552985:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291937664
00000100:00100000:2.0:1767319793.553048:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291937536
00000100:00100000:2.0:1767319793.553052:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291937536
00000100:00100000:2.0:1767319793.553076:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4457
00000100:00100000:2.0:1767319793.553087:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291937664:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319793.553104:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17245
00000100:00100000:0.0:1767319793.553113:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291937536:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319793.553133:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319793.553163:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291937664:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319793.553172:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291937536:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (258us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319793.553173:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4457
00000100:00080000:3.0:1767319793.553355:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319793.561823:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17245
00000100:00080000:3.0:1767319793.624838:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319793.624859:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319793.624863:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319793.624887:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319793.624891:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319793.624900:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4690
00000100:00080000:3.0:1767319793.624905:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319793.624911:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319793.624949:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fed80 x1853164379848576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319793.624966:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319793.624969:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319793.624971:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319793.624974:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4690
00000100:00080000:3.0:1767319793.624977:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319793.624980:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319793.624994:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682680 x1853164379848704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319793.625058:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319793.625061:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319793.625064:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319793.625067:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4690
00000100:00080000:3.0:1767319793.625070:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319793.625073:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319793.625082:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379849216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319793.625096:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319793.625099:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319793.625101:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319793.625103:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4690
00000100:00080000:3.0:1767319793.625106:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319793.625109:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319793.625119:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe300 x1853164379849472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319793.625149:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379849344:0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625215:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319793.625282:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319793.625288:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379848832:0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625314:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319793.625352:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848832
00000100:00100000:3.0:1767319793.625359:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848832
00000100:00100000:3.0:1767319793.625413:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643
00000100:00100000:3.0:1767319793.625422:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379848832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625473:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379848832:12345-0@lo:400:kworker.0 Request processed in 52us (157us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319793.625483:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643
00000100:00100000:3.0:1767319793.625509:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379849088:0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625533:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319793.625552:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319793.625558:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379848960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625578:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319793.625600:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848960
00000100:00100000:3.0:1767319793.625605:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848960
00000100:00100000:3.0:1767319793.625635:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644
00000100:00100000:3.0:1767319793.625641:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379848960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625675:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379848960:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319793.625681:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644
00000100:00080000:3.0:1767319793.625696:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319793.625725:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379848832:0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625754:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379848960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625769:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379849344
00000100:00100000:3.0:1767319793.625772:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379849344
00000100:00100000:3.0:1767319793.625800:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379849088
00000100:00100000:3.0:1767319793.625803:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379849088
00000100:00100000:3.0:1767319793.625818:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4458
00000100:00100000:3.0:1767319793.625823:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379849344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625860:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379849344:12345-0@lo:400:kworker.0 Request processed in 36us (645us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319793.625890:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4458
00000100:00100000:3.0:1767319793.625908:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4459
00000100:00100000:3.0:1767319793.625913:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379849088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.625946:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379849088:12345-0@lo:400:kworker.0 Request processed in 32us (412us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319793.625952:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4459
00000100:00080000:3.0:1767319793.625966:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319793.625982:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379849344:0@lo:400:kworker.0
00000100:00100000:3.0:1767319793.626002:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379849088:0@lo:400:kworker.0
00000100:00100000:0.0:1767319793.626257:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319768/real 1767319768]  req@ffff8b0e0bef6a00 x1853164379843072/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319793 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319793.626276:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bef6a00 x1853164379843072/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319793 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319793.626290:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379848576:0@lo:38:kworker.0
00000100:00100000:0.0:1767319793.626317:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319793.626345:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379848704:0@lo:38:kworker.0
00000100:00100000:0.0:1767319793.626382:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319793.626405:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379849216:0@lo:38:kworker.0
00000100:00100000:0.0:1767319793.626424:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319793.626440:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379849472:0@lo:38:kworker.0
00000100:00100000:0.0:1767319793.626459:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319793.626474:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319793.626486:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319793.626490:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379843072:0@lo:250:kworker.0
00000100:00100000:0.0:1767319793.626513:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848576
00000100:00100000:0.0:1767319793.626517:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848576
00000100:00100000:0.0:1767319793.626532:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379849216
00000100:00100000:0.0:1767319793.626534:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379849216
00000100:00100000:0.0:1767319793.626541:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379849472
00000100:00100000:0.0:1767319793.626543:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379849472
00000100:00100000:0.0:1767319793.626552:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17246
00000100:00100000:0.0:1767319793.626557:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379848576:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319793.626574:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319793.626609:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379848576:12345-0@lo:38:kworker.0 Request processed in 50us (290us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319793.626615:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17246
00000100:00100000:0.0:1767319793.626630:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17247
00000100:00100000:0.0:1767319793.626634:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379849216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319793.626643:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319793.626671:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379849216:12345-0@lo:38:kworker.0 Request processed in 36us (246us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319793.626677:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17247
00000100:00100000:0.0:1767319793.626687:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17248
00000100:00100000:0.0:1767319793.626691:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379849472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319793.626700:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319793.626718:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379849472:12345-0@lo:38:kworker.0 Request processed in 26us (258us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319793.626723:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17248
00000100:00080000:0.0:1767319793.626740:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319793.626743:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319793.626745:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319793.626749:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4670
00000100:00080000:0.0:1767319793.626752:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319793.626756:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319793.626771:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae680 x1853164379849600/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319793.626794:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379849600:0@lo:250:kworker.0
00000400:00000100:0.0:1767319793.626810:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379849600 offset 0 length 520: 4
00000100:00080000:0.0:1767319793.626832:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319793.626836:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319793.626838:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379848576:0@lo:38:kworker.0
00000100:00080000:0.0:1767319793.626845:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319793.626848:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319793.626850:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379849216:0@lo:38:kworker.0
00000100:00080000:0.0:1767319793.626893:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319793.626896:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319793.626899:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379849472:0@lo:38:kworker.0
00000100:00100000:1.0:1767319793.627112:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379848704
00000100:00100000:1.0:1767319793.627116:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379848704
00000100:00100000:1.0:1767319793.627149:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51
00000100:00100000:1.0:1767319793.627154:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379848704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319793.627164:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319793.627200:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379848704:12345-0@lo:38:kworker.0 Request processed in 45us (817us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319793.627206:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51
00000100:00080000:1.0:1767319793.627283:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319793.627287:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319793.627290:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379848704:0@lo:38:kworker.0
00010000:00010000:1.0:1767319794.135167:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319794.135722:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379849728:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319794.135806:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319794.135925:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379849728
00000100:00100000:2.0:1767319794.135934:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379849728
00000100:00100000:2.0:1767319794.135991:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425
00000100:00100000:2.0:1767319794.136001:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379849728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319794.136031:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319794.136091:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379849728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319794.136098:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425
00000100:00100000:1.0:1767319794.136194:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379849728:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319795.159482:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319796.183186:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319797.207037:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319797.719146:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379849856:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319797.719239:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319797.719510:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379849856
00000100:00100000:0.0:1767319797.719522:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379849856
00000100:00100000:0.0:1767319797.719598:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426
00000100:00100000:0.0:1767319797.719608:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379849856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319797.719640:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319797.719691:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379849856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (462us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319797.719699:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426
00000100:00080000:3.0:1767319797.720492:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319797.720543:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379849856:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319798.231625:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319798.676224:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319798.676274:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319798.676342:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291937792
00000100:00100000:0.0:1767319798.676354:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291937792
00000100:00100000:2.0:1767319798.676370:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291937920
00000100:00100000:2.0:1767319798.676376:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291937920
00000100:00100000:0.0:1767319798.676420:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17249
00000100:00100000:0.0:1767319798.676427:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291937792:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319798.676450:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319798.676451:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319798.676511:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291937792:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 82us (297us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319798.676519:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17249
00000100:00100000:0.0:1767319798.676538:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4460
00000100:00100000:0.0:1767319798.676544:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291937920:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319798.676581:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291937920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 37us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319798.676587:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4460
00000100:00080000:3.0:1767319798.744833:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319798.744844:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319798.744847:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319798.744851:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319798.744855:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319798.744863:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4696
00000100:00080000:3.0:1767319798.744879:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319798.744886:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319798.744926:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddf80 x1853164379849984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319798.744952:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319798.744956:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319798.744957:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319798.744961:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4696
00000100:00080000:3.0:1767319798.744963:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319798.744967:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319798.744981:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164379850112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319798.745035:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319798.745038:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319798.745040:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319798.745043:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4696
00000100:00080000:3.0:1767319798.745046:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319798.745049:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319798.745060:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608000 x1853164379850624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319798.745075:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319798.745078:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319798.745080:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319798.745083:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4696
00000100:00080000:3.0:1767319798.745085:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319798.745088:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319798.745097:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b100 x1853164379850880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319798.745123:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379850496:0@lo:400:kworker.0
00000100:00100000:3.0:1767319798.745190:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319798.745256:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319798.745262:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379850368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319798.745288:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319798.745345:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379850496
00000100:00100000:3.0:1767319798.745357:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379850496
00000100:00100000:1.0:1767319798.745383:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379849984:0@lo:38:kworker.0
00000100:00100000:3.0:1767319798.745410:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4461
00000100:00100000:1.0:1767319798.745411:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319798.745419:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379850496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319798.745429:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379850112:0@lo:38:kworker.0
00000100:00100000:1.0:1767319798.745451:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319798.745465:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379850496:12345-0@lo:400:kworker.0 Request processed in 48us (276us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319798.745471:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379850624:0@lo:38:kworker.0
00000100:00100000:3.0:1767319798.745472:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4461
00000100:00100000:3.0:1767319798.745486:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379849984
00000100:00100000:3.0:1767319798.745490:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379849984
00000100:00100000:1.0:1767319798.745491:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319798.745504:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379850624
00000100:00100000:1.0:1767319798.745505:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379850880:0@lo:38:kworker.0
00000100:00100000:3.0:1767319798.745506:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379850624
00000100:00100000:3.0:1767319798.745521:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17250
00000100:00100000:1.0:1767319798.745523:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319798.745525:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379849984:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319798.745542:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379850112
00000100:00100000:1.0:1767319798.745545:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379850112
00000100:00100000:1.0:1767319798.745565:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52
00000100:00100000:1.0:1767319798.745569:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379850112:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319798.745581:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319798.745614:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379850112:12345-0@lo:38:kworker.0 Request processed in 43us (162us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319798.745620:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52
00000100:00080000:1.0:1767319798.745663:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319798.745669:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319798.745672:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379850112:0@lo:38:kworker.0
00000100:00100000:1.0:1767319798.745695:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379850880
00000100:00100000:1.0:1767319798.745698:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379850880
00000100:00100000:1.0:1767319798.745712:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17251
00000100:00100000:1.0:1767319798.745717:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379850624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319798.745727:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319798.745753:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379850624:12345-0@lo:38:kworker.0 Request processed in 35us (261us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319798.745758:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17251
00000100:00100000:1.0:1767319798.745768:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17252
00000100:00100000:1.0:1767319798.745771:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379850880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319798.745779:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319798.745795:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379850880:12345-0@lo:38:kworker.0 Request processed in 23us (271us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319798.745800:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17252
00000100:00080000:1.0:1767319798.745816:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319798.745820:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319798.745823:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379850624:0@lo:38:kworker.0
00000100:00080000:1.0:1767319798.745829:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319798.745832:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319798.745834:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379850880:0@lo:38:kworker.0
00000100:00080000:1.0:1767319798.745867:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319798.745908:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379850368
00000100:00100000:1.0:1767319798.745911:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379850368
00000100:00100000:1.0:1767319798.745938:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645
00000100:00100000:1.0:1767319798.745944:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379850368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319798.745970:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379850368:12345-0@lo:400:kworker.0 Request processed in 26us (682us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319798.745975:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645
00000100:00080000:1.0:1767319798.745992:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319798.746169:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379850368:0@lo:400:kworker.0
00000100:00100000:1.0:1767319798.746192:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379850496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319798.746287:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379850752:0@lo:400:kworker.0
00000100:00100000:0.0:1767319798.746328:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319798.746351:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319798.746356:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379850240:0@lo:400:kworker.0
00000100:00100000:0.0:1767319798.746376:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319798.746396:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379850240
00000100:00100000:0.0:1767319798.746399:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379850240
00000100:00100000:0.0:1767319798.746421:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646
00000100:00100000:0.0:1767319798.746427:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379850240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319798.746453:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379850240:12345-0@lo:400:kworker.0 Request processed in 26us (77us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319798.746459:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646
00000100:00100000:0.0:1767319798.746482:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379850240:0@lo:400:kworker.0
00000100:00100000:1.0:1767319798.746534:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379850752
00000100:00100000:1.0:1767319798.746538:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379850752
00000100:00100000:1.0:1767319798.746604:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4462
00000100:00100000:1.0:1767319798.746610:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379850752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319798.746644:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379850752:12345-0@lo:400:kworker.0 Request processed in 34us (315us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319798.746649:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4462
00010000:00020000:3.0:1767319798.746654:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319798.746681:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379850752:0@lo:400:kworker.0
00000100:00100000:3.0:1767319798.746690:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379849984:12345-0@lo:38:kworker.0 Request processed in 1163us (1278us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319798.746696:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17250
00000100:00080000:3.0:1767319798.746720:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319798.746724:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319798.746727:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379849984:0@lo:38:kworker.0
00000100:00080000:0.0:1767319798.751622:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319799.255151:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319799.256646:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319799.256673:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379851008:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319799.256769:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319799.257125:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851008
00000100:00100000:2.0:1767319799.257134:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851008
00000100:00100000:2.0:1767319799.257189:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427
00000100:00100000:2.0:1767319799.257199:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379851008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319799.257237:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319799.257420:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379851008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 222us (650us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319799.257428:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427
00000100:00100000:0.0:1767319799.257583:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379851008:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319800.279688:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319801.303332:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319802.328204:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319802.839477:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319802.839502:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379851136:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319802.839570:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319802.839682:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851136
00000100:00100000:0.0:1767319802.839690:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851136
00000100:00100000:0.0:1767319802.839752:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428
00000100:00100000:0.0:1767319802.839760:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379851136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319802.839793:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319802.839846:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379851136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (277us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319802.839854:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428
00000100:00100000:3.0:1767319802.839918:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379851136:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319802.839932:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319803.351221:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319803.792144:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319803.792207:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319803.794420:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291938048
00000100:00100000:3.0:1767319803.794439:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291938048
00000100:00100000:3.0:1767319803.794504:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291938176
00000100:00100000:3.0:1767319803.794508:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291938176
00000100:00100000:3.0:1767319803.794563:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4463
00000100:00100000:3.0:1767319803.794578:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291938176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767319803.794588:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319803.794863:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291938176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 288us (2653us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319803.794893:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4463
00000100:00100000:3.0:1767319803.794916:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17253
00000100:00100000:3.0:1767319803.794921:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291938048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319803.794943:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319803.794977:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291938048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (2845us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319803.794984:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17253
00000100:00080000:0.0:1767319803.863799:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319803.863807:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319803.863810:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319803.863813:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319803.863816:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319803.863831:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4701
00000100:00080000:0.0:1767319803.863835:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319803.863842:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319803.863911:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19f80 x1853164379851264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319803.863936:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319803.863939:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319803.863940:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319803.863943:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4701
00000100:00080000:0.0:1767319803.863944:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319803.863947:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319803.863959:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19180 x1853164379851392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319803.864010:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319803.864013:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319803.864014:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319803.864017:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4701
00000100:00080000:0.0:1767319803.864018:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319803.864020:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319803.864028:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330000 x1853164379851904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319803.864037:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319803.864039:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319803.864041:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319803.864043:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4701
00000100:00080000:0.0:1767319803.864044:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319803.864046:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319803.864052:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379852160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319803.864072:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379851648:0@lo:400:kworker.0
00000100:00100000:0.0:1767319803.864127:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319803.864180:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319803.864186:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379851776:0@lo:400:kworker.0
00000100:00100000:0.0:1767319803.864211:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319803.864240:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851648
00000100:00100000:0.0:1767319803.864247:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851648
00000100:00100000:0.0:1767319803.864315:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647
00000100:00100000:0.0:1767319803.864326:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379851648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319803.864386:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379851648:12345-0@lo:400:kworker.0 Request processed in 62us (257us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319803.864393:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647
00000100:00080000:0.0:1767319803.864424:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319803.864442:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851776
00000100:00100000:0.0:1767319803.864445:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851776
00000100:00100000:0.0:1767319803.864477:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4464
00000100:00100000:0.0:1767319803.864483:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379851776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319803.864515:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379851776:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319803.864520:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4464
00000100:00080000:0.0:1767319803.864535:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319803.864560:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379851776:0@lo:400:kworker.0
00000100:00100000:0.0:1767319803.864571:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379851648:0@lo:400:kworker.0
00000100:00100000:1.0:1767319803.864686:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379852032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319803.864712:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319803.864734:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319803.864738:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379851520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319803.864751:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319803.864770:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852032
00000100:00100000:1.0:1767319803.864773:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852032
00000100:00100000:1.0:1767319803.864795:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4465
00000100:00100000:1.0:1767319803.864798:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379852032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319803.864821:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379852032:12345-0@lo:400:kworker.0 Request processed in 22us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319803.864825:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4465
00000100:00100000:1.0:1767319803.864841:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851520
00000100:00100000:1.0:1767319803.864843:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851520
00000100:00100000:1.0:1767319803.864858:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648
00000100:00100000:1.0:1767319803.864861:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379851520:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319803.864923:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379851520:12345-0@lo:400:kworker.0 Request processed in 60us (169us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319803.864929:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648
00000100:00080000:1.0:1767319803.864947:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319803.864962:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379851520:0@lo:400:kworker.0
00000100:00100000:1.0:1767319803.864971:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379852032:0@lo:400:kworker.0
00000100:00100000:3.0:1767319803.865358:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379851264:0@lo:38:kworker.0
00000100:00100000:3.0:1767319803.865395:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319803.865427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379851392:0@lo:38:kworker.0
00000100:00100000:3.0:1767319803.865447:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319803.865475:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379851904:0@lo:38:kworker.0
00000100:00100000:3.0:1767319803.865497:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319803.865513:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379852160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319803.865531:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319803.865561:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851392
00000100:00100000:3.0:1767319803.865565:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851392
00000100:00100000:3.0:1767319803.865589:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53
00000100:00100000:3.0:1767319803.865595:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379851392:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319803.865614:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319803.865788:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379851392:12345-0@lo:38:kworker.0 Request processed in 45us (193us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319803.865794:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53
00000100:00100000:3.0:1767319803.865811:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851264
00000100:00100000:3.0:1767319803.865814:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851264
00000100:00100000:3.0:1767319803.865824:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379851904
00000100:00100000:3.0:1767319803.865826:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379851904
00000100:00100000:3.0:1767319803.865833:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852160
00000100:00100000:3.0:1767319803.865835:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852160
00000100:00100000:3.0:1767319803.865840:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17254
00000100:00100000:3.0:1767319803.865843:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379851264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319803.865851:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319803.865889:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379851264:12345-0@lo:38:kworker.0 Request processed in 44us (494us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319803.865893:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17254
00000100:00100000:3.0:1767319803.865900:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17255
00000100:00100000:3.0:1767319803.865902:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379851904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319803.865908:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319803.865927:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379851904:12345-0@lo:38:kworker.0 Request processed in 23us (429us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767319803.866062:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319803.866066:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319803.866069:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379851264:0@lo:38:kworker.0
00000100:00080000:2.0:1767319803.866074:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319803.866076:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319803.866078:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379851392:0@lo:38:kworker.0
00000100:00080000:2.0:1767319803.866083:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319803.866085:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319803.866086:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379851904:0@lo:38:kworker.0
00000100:00100000:2.0:1767319803.866106:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17256
00000100:00100000:2.0:1767319803.866109:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379852160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319803.866116:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319803.866141:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379852160:12345-0@lo:38:kworker.0 Request processed in 31us (609us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319803.866145:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17256
00000100:00080000:2.0:1767319803.866160:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319803.866163:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319803.866164:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379852160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319803.866285:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17255
00010000:00010000:3.0:1767319804.375518:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319804.375542:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379852288:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319804.375630:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319804.375740:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852288
00000100:00100000:0.0:1767319804.375748:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852288
00000100:00100000:0.0:1767319804.375807:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429
00000100:00100000:0.0:1767319804.375816:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379852288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319804.375845:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319804.393364:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379852288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 17534us (17719us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319804.393382:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429
00000100:00100000:1.0:1767319804.394087:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379852288:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319805.401381:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319806.423111:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319807.448093:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319807.960355:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319807.960380:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379852416:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319807.960458:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319807.961111:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852416
00000100:00100000:0.0:1767319807.961121:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852416
00000100:00100000:0.0:1767319807.961194:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430
00000100:00100000:0.0:1767319807.961203:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379852416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319807.961247:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319807.961300:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379852416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (842us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319807.961322:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430
00000100:00080000:1.0:1767319807.961833:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319807.962070:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379852416:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319808.474259:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319808.914529:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319808.914626:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319808.915187:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291938432
00000100:00100000:1.0:1767319808.915199:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291938432
00000100:00100000:1.0:1767319808.915288:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4466
00000100:00100000:1.0:1767319808.915300:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291938432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319808.915382:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291938432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (864us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319808.915391:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4466
00000100:00100000:1.0:1767319808.915414:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291938304
00000100:00100000:1.0:1767319808.915417:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291938304
00000100:00100000:1.0:1767319808.915439:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17257
00000100:00100000:1.0:1767319808.915444:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291938304:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319808.915466:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319808.915494:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291938304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 48us (868us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319808.915500:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17257
00000100:00080000:2.0:1767319808.915696:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319808.987435:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319808.987447:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319808.987450:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319808.987454:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319808.987458:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319808.987465:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4706
00000100:00080000:3.0:1767319808.987470:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319808.987477:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319808.987518:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c700 x1853164379852544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319808.987550:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319808.987554:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319808.987556:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319808.987559:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4706
00000100:00080000:3.0:1767319808.987562:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319808.987565:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319808.987579:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d180 x1853164379852672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319808.987647:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319808.987651:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319808.987653:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319808.987656:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4706
00000100:00080000:3.0:1767319808.987659:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319808.987661:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319808.987675:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628700 x1853164379853184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319808.987688:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319808.987691:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319808.987692:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319808.987695:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4706
00000100:00080000:3.0:1767319808.987697:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319808.987700:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319808.987707:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629c00 x1853164379853440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319808.987733:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379852928:0@lo:400:kworker.0
00000100:00100000:3.0:1767319808.987807:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319808.987902:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319808.987908:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379853056:0@lo:400:kworker.0
00000100:00100000:3.0:1767319808.987934:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319808.987960:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379853312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319808.988168:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853056
00000100:00100000:0.0:1767319808.988176:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853056
00000100:00100000:0.0:1767319808.988243:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4467
00000100:00100000:0.0:1767319808.988253:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379853056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319808.988308:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379853056:12345-0@lo:400:kworker.0 Request processed in 57us (373us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319808.988316:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4467
00000100:00080000:0.0:1767319808.988340:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319808.988373:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379853056:0@lo:400:kworker.0
00000100:00100000:0.0:1767319808.988397:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379852800:0@lo:400:kworker.0
00000100:00100000:0.0:1767319808.988423:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319808.988458:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852928
00000100:00100000:0.0:1767319808.988462:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852928
00000100:00100000:0.0:1767319808.988490:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852800
00000100:00100000:0.0:1767319808.988493:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852800
00000100:00100000:0.0:1767319808.988512:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649
00000100:00100000:0.0:1767319808.988517:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379852928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319808.988551:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379852928:12345-0@lo:400:kworker.0 Request processed in 33us (743us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319808.988559:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649
00000100:00100000:0.0:1767319808.988573:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650
00000100:00100000:0.0:1767319808.988579:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379852800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319808.988608:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379852800:12345-0@lo:400:kworker.0 Request processed in 29us (184us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319808.988614:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650
00000100:00080000:0.0:1767319808.988628:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319808.988651:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379852928:0@lo:400:kworker.0
00000100:00100000:0.0:1767319808.988671:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379852800:0@lo:400:kworker.0
00000100:00100000:3.0:1767319808.988915:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319808.989567:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379852544:0@lo:38:kworker.0
00000100:00100000:2.0:1767319808.989606:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319808.989637:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379852672:0@lo:38:kworker.0
00000100:00100000:2.0:1767319808.989660:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319808.989687:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379853184:0@lo:38:kworker.0
00000100:00100000:2.0:1767319808.989710:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319808.989728:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379853440:0@lo:38:kworker.0
00000100:00100000:2.0:1767319808.989747:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319808.989779:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852672
00000100:00100000:2.0:1767319808.989784:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852672
00000100:00100000:2.0:1767319808.989823:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54
00000100:00100000:2.0:1767319808.989829:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379852672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319808.989848:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319808.989917:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379852672:12345-0@lo:38:kworker.0 Request processed in 87us (255us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319808.989925:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54
00000100:00100000:2.0:1767319808.989953:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853312
00000100:00100000:2.0:1767319808.989957:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853312
00000100:00100000:2.0:1767319808.990217:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379852544
00000100:00100000:2.0:1767319808.990221:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379852544
00000100:00100000:2.0:1767319808.990247:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853184
00000100:00100000:2.0:1767319808.990250:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853184
00000100:00100000:2.0:1767319808.990257:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853440
00000100:00100000:2.0:1767319808.990259:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853440
00000100:00100000:2.0:1767319808.990268:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4468
00000100:00100000:2.0:1767319808.990275:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379853312:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319808.990317:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379853312:12345-0@lo:400:kworker.0 Request processed in 43us (1402us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319808.990323:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4468
00000100:00100000:2.0:1767319808.990336:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17258
00000100:00100000:2.0:1767319808.990340:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379852544:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319808.990350:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319808.990375:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379852544:12345-0@lo:38:kworker.0 Request processed in 34us (768us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319808.990381:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17258
00000100:00100000:2.0:1767319808.990391:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17259
00000100:00100000:2.0:1767319808.990394:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379853184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319808.990402:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319808.990419:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379853184:12345-0@lo:38:kworker.0 Request processed in 24us (709us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319808.990424:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17259
00000100:00100000:2.0:1767319808.990432:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17260
00000100:00100000:2.0:1767319808.990435:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379853440:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319808.990442:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319808.990457:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379853440:12345-0@lo:38:kworker.0 Request processed in 21us (710us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319808.990462:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17260
00000100:00080000:2.0:1767319808.990475:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319808.990508:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319808.990513:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319808.990517:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379852544:0@lo:38:kworker.0
00000100:00080000:2.0:1767319808.990527:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319808.990530:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319808.990532:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379852672:0@lo:38:kworker.0
00000100:00080000:2.0:1767319808.990539:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319808.990542:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319808.990545:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379853184:0@lo:38:kworker.0
00000100:00080000:2.0:1767319808.990552:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319808.990555:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319808.990558:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379853440:0@lo:38:kworker.0
00000100:00100000:3.0:1767319808.990807:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379853312:0@lo:400:kworker.0
00010000:00010000:1.0:1767319809.495436:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319809.495579:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379853568:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319809.495646:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319809.495765:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853568
00000100:00100000:2.0:1767319809.495774:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853568
00000100:00100000:2.0:1767319809.495824:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431
00000100:00100000:2.0:1767319809.495834:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379853568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319809.495863:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319809.495931:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379853568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319809.495938:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431
00000100:00100000:1.0:1767319809.496198:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379853568:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319810.521234:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319811.543259:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319812.567251:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319813.079282:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379853696:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319813.079365:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319813.079895:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853696
00000100:00100000:0.0:1767319813.079904:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853696
00000100:00100000:0.0:1767319813.079977:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432
00000100:00100000:0.0:1767319813.079988:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379853696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319813.080017:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319813.080077:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379853696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (712us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319813.080084:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432
00000100:00100000:1.0:1767319813.080178:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379853696:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319813.080314:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319813.593260:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319814.041042:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319814.041085:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767319814.041121:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291938816 offset 0 length 520: 4
00000100:00100000:3.0:1767319814.041161:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291938688
00000100:00100000:3.0:1767319814.041172:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291938688
00000100:00100000:0.0:1767319814.041215:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291938560
00000100:00100000:0.0:1767319814.041222:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291938560
00000100:00080000:2.0:1767319814.041281:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319814.041328:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4469
00000100:00100000:0.0:1767319814.041341:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291938688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319814.041427:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291938688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (395us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319814.041434:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4469
00000100:00100000:0.0:1767319814.041453:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17261
00000100:00100000:0.0:1767319814.041458:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291938560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319814.041478:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319814.041505:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291938560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (419us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319814.041512:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17261
00000100:00080000:0.0:1767319814.104928:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319814.104940:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319814.104943:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319814.104946:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319814.104951:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319814.104960:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4711
00000100:00080000:0.0:1767319814.104965:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319814.104973:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319814.105017:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330a80 x1853164379853824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319814.105104:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319814.105108:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319814.105110:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319814.105114:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4711
00000100:00080000:0.0:1767319814.105116:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319814.105120:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319814.105136:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d180 x1853164379853952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319814.105450:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379853824:0@lo:38:kworker.0
00000100:00100000:2.0:1767319814.105545:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319814.106018:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319814.106022:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319814.106025:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319814.106030:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4711
00000100:00080000:0.0:1767319814.106033:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319814.106038:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319814.106054:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7ad80 x1853164379854464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319814.106073:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319814.106076:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319814.106078:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319814.106081:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4711
00000100:00080000:0.0:1767319814.106084:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319814.106088:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319814.106097:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046ced80 x1853164379854720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319814.106205:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379854080:0@lo:400:kworker.0
00000100:00100000:3.0:1767319814.106247:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319814.108807:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379854592:0@lo:400:kworker.0
00000100:00100000:1.0:1767319814.108916:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319814.110844:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853824
00000100:00100000:0.0:1767319814.110858:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853824
00000100:00100000:0.0:1767319814.110914:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854592
00000100:00100000:0.0:1767319814.110918:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854592
00000100:00100000:0.0:1767319814.110965:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4470
00000100:00100000:3.0:1767319814.111122:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17262
00000100:00100000:3.0:1767319814.111130:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379853824:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319814.111152:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319814.111223:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379854336:0@lo:400:kworker.0
00000100:00100000:1.0:1767319814.111272:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319814.112228:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379853952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319814.112541:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319814.112588:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379854464:0@lo:38:kworker.0
00000100:00100000:2.0:1767319814.112619:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319814.112634:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379854720:0@lo:38:kworker.0
00000100:00100000:2.0:1767319814.112655:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319814.112678:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854336
00000100:00100000:1.0:1767319814.112686:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854336
00000100:00100000:1.0:1767319814.112715:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854464
00000100:00100000:1.0:1767319814.112717:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854464
00000100:00100000:1.0:1767319814.112724:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854720
00000100:00100000:1.0:1767319814.112726:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854720
00000100:00100000:1.0:1767319814.112735:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4471
00000100:00100000:1.0:1767319814.112742:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379854336:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767319814.112790:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319814.112807:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17263
00000100:00100000:2.0:1767319814.112813:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379854464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319814.112828:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319814.112861:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379854336:12345-0@lo:400:kworker.0 Request processed in 117us (1586us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319814.112888:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4471
00000100:00100000:2.0:1767319814.112896:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379854464:12345-0@lo:38:kworker.0 Request processed in 80us (275us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319814.112904:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17263
00000100:00100000:1.0:1767319814.112912:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17264
00000100:00100000:1.0:1767319814.112918:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379854720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319814.112930:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319814.112930:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379853952
00000100:00100000:2.0:1767319814.112937:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379853952
00000100:00100000:1.0:1767319814.112960:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379854720:12345-0@lo:38:kworker.0 Request processed in 40us (302us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319814.112962:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55
00000100:00100000:1.0:1767319814.112972:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17264
00000100:00100000:2.0:1767319814.112972:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379853952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319814.113080:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319814.113108:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379853952:12345-0@lo:38:kworker.0 Request processed in 137us (569us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319814.113115:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55
00000100:00100000:2.0:1767319814.113147:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379854208:0@lo:400:kworker.0
00000100:00100000:2.0:1767319814.113203:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319814.113243:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854080
00000100:00100000:2.0:1767319814.113247:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854080
00000100:00100000:0.0:1767319814.113373:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379854592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319814.113436:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854208
00000100:00100000:2.0:1767319814.113440:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854208
00000100:00100000:2.0:1767319814.113466:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651
00000100:00100000:2.0:1767319814.113473:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379854080:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319814.113742:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379854336:0@lo:400:kworker.0
00000100:00100000:1.0:1767319814.113892:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652
00000100:00100000:1.0:1767319814.113901:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379854208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319814.114935:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379854592:12345-0@lo:400:kworker.0 Request processed in 3958us (6016us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319814.114945:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4470
00000100:00100000:0.0:1767319814.115011:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379854592:0@lo:400:kworker.0
00000100:00080000:0.0:1767319814.115057:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319814.115080:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319814.115085:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319814.115089:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379854464:0@lo:38:kworker.0
00000100:00080000:0.0:1767319814.115100:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319814.115103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319814.115106:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379854720:0@lo:38:kworker.0
00000100:00080000:0.0:1767319814.115117:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319814.115120:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319814.115123:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379853952:0@lo:38:kworker.0
00000100:00100000:2.0:1767319814.119702:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379854080:12345-0@lo:400:kworker.0 Request processed in 6219us (13442us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319814.119720:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651
00000100:00100000:2.0:1767319814.119825:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379854080:0@lo:400:kworker.0
00000100:00100000:1.0:1767319814.120490:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379854208:12345-0@lo:400:kworker.0 Request processed in 6587us (7283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319814.120500:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652
00000100:00100000:2.0:1767319814.120917:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379854208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319814.122126:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379853824:12345-0@lo:38:kworker.0 Request processed in 10990us (16574us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319814.122139:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17262
00000100:00080000:0.0:1767319814.122435:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319814.122442:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319814.122446:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379853824:0@lo:38:kworker.0
00010000:00010000:1.0:1767319814.615748:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319814.618709:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379854848:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319814.618788:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319814.618931:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854848
00000100:00100000:2.0:1767319814.618940:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854848
00000100:00100000:2.0:1767319814.619002:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433
00000100:00100000:2.0:1767319814.619012:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379854848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319814.619043:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319814.619113:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379854848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (325us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319814.619122:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433
00000100:00100000:2.0:1767319814.619185:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379854848:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319815.639541:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319816.663353:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319817.687124:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319818.199060:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319793/real 1767319793]  req@ffff8b0f380ae680 x1853164379849600/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319818 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319818.199095:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f380ae680 x1853164379849600/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319818 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767319818.199116:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319818.199151:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319818.199156:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379849600:0@lo:250:kworker.0
00000100:00080000:3.0:1767319818.199266:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319818.199273:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319818.199276:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319818.199281:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4696
00000100:00080000:3.0:1767319818.199285:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319818.199291:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319818.199490:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379854976:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319818.199561:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319818.200014:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379854976
00000100:00100000:1.0:1767319818.200024:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379854976
00000100:00100000:1.0:1767319818.200096:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434
00000100:00100000:1.0:1767319818.200105:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379854976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319818.200134:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319818.200198:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379854976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (637us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319818.200206:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434
00000100:00100000:1.0:1767319818.200257:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379854976:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319818.200378:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319818.200627:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ca80 x1853164379855104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319818.200682:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379855104:0@lo:250:kworker.0
00000400:00000100:2.0:1767319818.200707:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379855104 offset 0 length 520: 4
00000100:00080000:3.0:1767319818.200744:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319818.200758:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319818.200760:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319818.200765:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4716
00000100:00080000:3.0:1767319818.200768:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319818.200772:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319818.200792:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ea00 x1853164379855232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319818.212065:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379855232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319818.212173:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319818.212331:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379855232
00000100:00100000:0.0:1767319818.212341:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379855232
00000100:00100000:0.0:1767319818.212394:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17265
00000100:00100000:0.0:1767319818.212402:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379855232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319818.212425:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319818.212477:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379855232:12345-0@lo:38:kworker.0 Request processed in 74us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319818.212493:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17265
00000100:00080000:3.0:1767319818.214573:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319818.214582:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319818.214586:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319818.214594:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4716
00000100:00080000:3.0:1767319818.214599:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319818.214605:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319818.214647:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379855360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319818.214758:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319818.214762:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319818.214764:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319818.214767:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4716
00000100:00080000:3.0:1767319818.214770:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319818.214773:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319818.214786:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b95180 x1853164379855744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319818.214803:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319818.214806:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319818.214808:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319818.214812:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4716
00000100:00080000:3.0:1767319818.214814:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319818.214818:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319818.214837:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b96300 x1853164379856000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319818.214891:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379855616:0@lo:400:kworker.0
00000100:00100000:3.0:1767319818.214947:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319818.214989:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319818.214995:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379855872:0@lo:400:kworker.0
00000100:00100000:3.0:1767319818.215016:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319818.215043:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319818.215051:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379855488:0@lo:400:kworker.0
00000100:00100000:3.0:1767319818.215079:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319818.215895:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379855616
00000100:00100000:1.0:1767319818.215905:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379855616
00000100:00100000:1.0:1767319818.215972:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379855872
00000100:00100000:1.0:1767319818.215976:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379855872
00000100:00100000:1.0:1767319818.216003:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4472
00000100:00100000:1.0:1767319818.216012:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379855616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319818.216073:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379855616:12345-0@lo:400:kworker.0 Request processed in 62us (1124us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319818.216080:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4472
00000100:00100000:1.0:1767319818.216100:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4473
00000100:00100000:1.0:1767319818.216105:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379855872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319818.216132:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379855872:12345-0@lo:400:kworker.0 Request processed in 28us (1116us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319818.216240:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4473
00000100:00100000:1.0:1767319818.216267:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379855488
00000100:00100000:1.0:1767319818.216271:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379855488
00000100:00100000:1.0:1767319818.216299:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653
00000100:00100000:1.0:1767319818.216305:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379855488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319818.216341:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379855488:12345-0@lo:400:kworker.0 Request processed in 36us (1262us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319818.216347:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653
00000100:00100000:1.0:1767319818.216396:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379855872:0@lo:400:kworker.0
00000100:00100000:1.0:1767319818.216409:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379855616:0@lo:400:kworker.0
00000100:00100000:1.0:1767319818.216438:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379855488:0@lo:400:kworker.0
00000100:00100000:2.0:1767319818.217051:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379855360:0@lo:38:kworker.0
00000100:00100000:2.0:1767319818.217091:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319818.217124:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379855744:0@lo:38:kworker.0
00000100:00100000:2.0:1767319818.217158:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319818.217178:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379856000:0@lo:38:kworker.0
00000100:00100000:2.0:1767319818.217197:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319818.217222:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319818.217227:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319818.217231:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379855232:0@lo:38:kworker.0
00000100:00100000:2.0:1767319818.217259:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379855744
00000100:00100000:2.0:1767319818.217262:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379855744
00000100:00100000:2.0:1767319818.217281:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856000
00000100:00100000:2.0:1767319818.217283:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856000
00000100:00100000:2.0:1767319818.217296:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17266
00000100:00100000:2.0:1767319818.217301:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379855744:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319818.217318:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319818.217351:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379855744:12345-0@lo:38:kworker.0 Request processed in 48us (192us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319818.217357:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17266
00000100:00100000:2.0:1767319818.217371:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17267
00000100:00100000:2.0:1767319818.217375:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379856000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319818.217384:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319818.217407:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379856000:12345-0@lo:38:kworker.0 Request processed in 30us (209us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319818.217412:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17267
00000100:00080000:2.0:1767319818.217439:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319818.217443:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319818.217446:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379855744:0@lo:38:kworker.0
00000100:00080000:2.0:1767319818.217454:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319818.217457:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319818.217459:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379856000:0@lo:38:kworker.0
00000100:00080000:0.0:1767319818.217766:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319818.217772:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319818.218229:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379855360
00000100:00100000:1.0:1767319818.218234:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379855360
00000100:00100000:1.0:1767319818.218270:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56
00000100:00100000:1.0:1767319818.218287:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379855360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319818.218299:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319818.218350:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379855360:12345-0@lo:38:kworker.0 Request processed in 73us (1259us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319818.218357:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56
00000100:00080000:3.0:1767319818.218431:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319818.218436:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319818.218439:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379855360:0@lo:38:kworker.0
00010000:00010000:1.0:1767319818.711288:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319819.154371:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319819.154471:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319819.156185:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291938944
00000100:00100000:0.0:1767319819.156202:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291938944
00000100:00100000:0.0:1767319819.156320:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291939072
00000100:00100000:0.0:1767319819.156325:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291939072
00000100:00100000:0.0:1767319819.156387:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4474
00000100:00100000:0.0:1767319819.156397:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291939072:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319819.156479:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291939072:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (2006us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319819.156487:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4474
00000100:00100000:0.0:1767319819.156510:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17268
00000100:00100000:0.0:1767319819.156515:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291938944:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319819.156535:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319819.156562:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291938944:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (2202us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319819.156569:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17268
00000100:00080000:3.0:1767319819.156749:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319819.735464:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319819.736762:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319819.736789:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379856128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319819.736892:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319819.737193:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856128
00000100:00100000:2.0:1767319819.737203:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856128
00000100:00100000:2.0:1767319819.737650:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435
00000100:00100000:2.0:1767319819.737664:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379856128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319819.737693:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319819.737752:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379856128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (859us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319819.737830:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379856128:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319819.738179:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435
00010000:00010000:3.0:1767319820.759154:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319821.783454:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319822.807138:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319823.319148:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319823.319158:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319823.319161:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319823.319166:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319823.319170:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319823.319186:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4720
00000100:00080000:2.0:1767319823.319191:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319823.319199:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319823.319241:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28bb80 x1853164379856256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319823.319267:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319823.319270:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319823.319272:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319823.319276:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4720
00000100:00080000:2.0:1767319823.319278:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319823.319282:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319823.319295:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a680 x1853164379856384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319823.319365:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319823.319368:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319823.319370:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319823.319374:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4720
00000100:00080000:2.0:1767319823.319376:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319823.319379:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319823.319387:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379856512:0@lo:400:kworker.0
00000100:00100000:2.0:1767319823.319389:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288a80 x1853164379856896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319823.319403:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319823.319406:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319823.319408:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319823.319411:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4720
00000100:00080000:2.0:1767319823.319413:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319823.319417:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319823.319426:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289c00 x1853164379857152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319823.319449:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379856640:0@lo:400:kworker.0
00000100:00100000:0.0:1767319823.319462:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319823.319481:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319823.319535:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379856256:0@lo:38:kworker.0
00000100:00100000:3.0:1767319823.319565:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319823.319609:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379856768:0@lo:400:kworker.0
00000100:00100000:3.0:1767319823.319631:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319823.319658:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856256
00000100:00100000:3.0:1767319823.319666:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856256
00000100:00100000:3.0:1767319823.319696:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856768
00000100:00100000:3.0:1767319823.319699:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856768
00000100:00100000:3.0:1767319823.319739:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4475
00000100:00100000:3.0:1767319823.319748:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379856768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319823.319806:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379856768:12345-0@lo:400:kworker.0 Request processed in 59us (173us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319823.319813:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4475
00000100:00100000:3.0:1767319823.319830:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17269
00000100:00100000:3.0:1767319823.319834:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379856256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319823.319852:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319823.319903:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379856256:12345-0@lo:38:kworker.0 Request processed in 66us (335us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319823.319908:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17269
00000100:00080000:3.0:1767319823.319928:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319823.320057:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856512
00000100:00100000:0.0:1767319823.320191:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319823.320198:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379857024:0@lo:400:kworker.0
00000100:00100000:0.0:1767319823.320221:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319823.320255:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857024
00000100:00100000:0.0:1767319823.320259:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857024
00000100:00100000:0.0:1767319823.320289:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4476
00000100:00100000:0.0:1767319823.320296:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379857024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319823.320331:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379857024:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319823.320337:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4476
00000100:00080000:0.0:1767319823.320377:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319823.320381:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319823.320384:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379856256:0@lo:38:kworker.0
00000100:00100000:0.0:1767319823.320389:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379856384:0@lo:38:kworker.0
00000100:00100000:0.0:1767319823.320413:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319823.320436:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379856896:0@lo:38:kworker.0
00000100:00100000:0.0:1767319823.320456:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319823.320470:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379857152:0@lo:38:kworker.0
00000100:00100000:0.0:1767319823.320487:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319823.320516:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319823.320524:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856896
00000100:00100000:0.0:1767319823.320527:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856896
00000100:00100000:0.0:1767319823.320544:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857152
00000100:00100000:0.0:1767319823.320546:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857152
00000100:00100000:0.0:1767319823.320560:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17270
00000100:00100000:0.0:1767319823.320564:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379856896:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319823.320575:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319823.320601:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379856896:12345-0@lo:38:kworker.0 Request processed in 36us (145us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319823.320607:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17270
00000100:00100000:0.0:1767319823.320617:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17271
00000100:00100000:0.0:1767319823.320621:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379857152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319823.320628:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319823.320647:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379857152:12345-0@lo:38:kworker.0 Request processed in 25us (159us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319823.320652:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17271
00000100:00100000:0.0:1767319823.320676:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379856768:0@lo:400:kworker.0
00000100:00100000:0.0:1767319823.320692:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856384
00000100:00100000:0.0:1767319823.320695:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856384
00000100:00100000:0.0:1767319823.320710:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57
00000100:00100000:0.0:1767319823.320714:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379856384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319823.320723:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319823.320744:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379856384:12345-0@lo:38:kworker.0 Request processed in 29us (331us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319823.320749:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57
00000100:00080000:0.0:1767319823.320777:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319823.320781:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319823.320784:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379856384:0@lo:38:kworker.0
00000100:00080000:0.0:1767319823.320791:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319823.320794:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319823.320797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379856896:0@lo:38:kworker.0
00000100:00080000:0.0:1767319823.320803:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319823.320806:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319823.320808:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379857152:0@lo:38:kworker.0
00000100:00100000:0.0:1767319823.320832:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379857024:0@lo:400:kworker.0
00000100:00100000:3.0:1767319823.321722:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856512
00000100:00100000:3.0:1767319823.321776:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379856640
00000100:00100000:3.0:1767319823.321780:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379856640
00000100:00100000:3.0:1767319823.321801:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654
00000100:00100000:3.0:1767319823.321808:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379856512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319823.321857:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379856512:12345-0@lo:400:kworker.0 Request processed in 49us (2393us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319823.321863:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654
00000100:00100000:3.0:1767319823.321892:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655
00000100:00100000:3.0:1767319823.321899:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379856640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319823.321928:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379856640:12345-0@lo:400:kworker.0 Request processed in 29us (2445us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319823.321933:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655
00000100:00100000:1.0:1767319823.322428:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319823.322439:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379857280:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319823.322472:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319823.322514:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857280
00000100:00100000:1.0:1767319823.322518:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857280
00000100:00100000:1.0:1767319823.322544:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436
00000100:00100000:1.0:1767319823.322550:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379857280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319823.322571:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319823.322601:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379857280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (128us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319823.322607:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436
00000100:00100000:1.0:1767319823.322645:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379857280:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319823.323482:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319823.323488:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319823.323595:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379856512:0@lo:400:kworker.0
00000100:00100000:2.0:1767319823.326164:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379856640:0@lo:400:kworker.0
00010000:00010000:3.0:1767319823.831788:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319824.284497:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319824.284540:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319824.284642:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291939200
00000100:00100000:0.0:1767319824.284654:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291939200
00000100:00100000:0.0:1767319824.284702:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291939328
00000100:00100000:0.0:1767319824.284705:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291939328
00000100:00100000:0.0:1767319824.284755:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4477
00000100:00100000:0.0:1767319824.284765:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291939328:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319824.284813:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17272
00000100:00100000:2.0:1767319824.284821:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291939200:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:0.0:1767319824.284842:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291939328:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 77us (300us total) trans 0 rc 0/0
00010000:00020000:2.0:1767319824.284845:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319824.284854:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4477
00000100:00080000:0.0:1767319824.284913:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319824.284919:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291939200:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 95us (432us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319824.284927:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17272
00000100:00100000:2.0:1767319824.859253:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379857408:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319824.859437:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319824.873565:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319824.873741:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857408
00000100:00100000:1.0:1767319824.873751:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857408
00000100:00100000:1.0:1767319824.873811:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437
00000100:00100000:1.0:1767319824.873821:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379857408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319824.873854:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319824.874794:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379857408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 972us (1235us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319824.874804:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437
00000100:00100000:3.0:1767319824.874950:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379857408:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319825.879163:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319826.904127:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319827.927204:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319828.439800:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319828.439819:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379857536:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319828.439897:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319828.440834:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857536
00000100:00100000:2.0:1767319828.440845:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857536
00000100:00100000:2.0:1767319828.441068:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438
00000100:00100000:2.0:1767319828.441079:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379857536:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319828.441113:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319828.441119:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319828.441122:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319828.441126:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319828.441130:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319828.441135:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4725
00000100:00080000:0.0:1767319828.441139:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319828.441144:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319828.441175:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d180 x1853164379857664/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319828.441195:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319828.441208:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319828.441209:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319828.441213:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4725
00000100:00080000:0.0:1767319828.441215:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319828.441219:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319828.441234:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b480 x1853164379857792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319828.441265:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319828.441268:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319828.441270:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319828.441273:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4725
00000100:00080000:0.0:1767319828.441275:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319828.441279:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319828.441288:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b800 x1853164379858176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319828.441308:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319828.441311:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319828.441313:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319828.441317:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4725
00000100:00080000:0.0:1767319828.441319:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319828.441322:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319828.441332:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23b80 x1853164379858432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319828.441351:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319828.441363:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379858048:0@lo:400:kworker.0
00000100:00100000:0.0:1767319828.441413:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319828.441440:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319828.441445:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379857920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319828.441468:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319828.441494:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319828.441502:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379858304:0@lo:400:kworker.0
00000100:00100000:0.0:1767319828.441523:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:2.0:1767319828.441581:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319828.441618:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379857536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 542us (1721us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319828.441626:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438
00000100:00100000:1.0:1767319828.444035:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379857664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319828.444599:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379857536:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319828.444825:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857920
00000100:00100000:1.0:1767319828.444831:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857920
00000100:00100000:1.0:1767319828.444919:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656
00000100:00100000:1.0:1767319828.444928:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379857920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319828.444995:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379857920:12345-0@lo:400:kworker.0 Request processed in 68us (3525us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319828.445002:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656
00000100:00080000:0.0:1767319828.449185:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319828.449242:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379857920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319828.449278:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319828.450742:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858048
00000100:00100000:3.0:1767319828.450753:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858048
00000100:00100000:1.0:1767319828.450857:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858304
00000100:00100000:1.0:1767319828.450862:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858304
00000100:00100000:3.0:1767319828.450963:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4478
00000100:00100000:3.0:1767319828.450974:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379858048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319828.451078:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379858048:12345-0@lo:400:kworker.0 Request processed in 105us (9664us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319828.451095:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4478
00000100:00100000:0.0:1767319828.451412:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379857792:0@lo:38:kworker.0
00000100:00100000:0.0:1767319828.451462:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319828.451490:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379858176:0@lo:38:kworker.0
00000100:00100000:0.0:1767319828.451520:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319828.451538:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379858432:0@lo:38:kworker.0
00000100:00100000:0.0:1767319828.451558:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319828.451591:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857792
00000100:00100000:0.0:1767319828.451594:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857792
00000100:00100000:0.0:1767319828.451615:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58
00000100:00100000:0.0:1767319828.451620:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379857792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319828.451638:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319828.452017:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379857792:12345-0@lo:38:kworker.0 Request processed in 395us (554us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319828.452023:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58
00000100:00100000:0.0:1767319828.452042:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379857664
00000100:00100000:0.0:1767319828.452057:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379857664
00000100:00100000:0.0:1767319828.452074:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858176
00000100:00100000:0.0:1767319828.452077:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858176
00000100:00100000:0.0:1767319828.452087:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858432
00000100:00100000:0.0:1767319828.452089:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858432
00000100:00100000:0.0:1767319828.452098:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17273
00000100:00100000:0.0:1767319828.452103:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379857664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319828.452114:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319828.452139:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379857664:12345-0@lo:38:kworker.0 Request processed in 35us (2861us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319828.452145:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17273
00000100:00100000:0.0:1767319828.452155:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17274
00000100:00100000:0.0:1767319828.452158:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379858176:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319828.452166:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319828.452198:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379858176:12345-0@lo:38:kworker.0 Request processed in 38us (677us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319828.452213:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17274
00000100:00100000:0.0:1767319828.452223:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17275
00000100:00100000:0.0:1767319828.452227:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379858432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319828.452235:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319828.452255:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379858432:12345-0@lo:38:kworker.0 Request processed in 27us (696us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319828.452260:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17275
00000100:00100000:0.0:1767319828.452305:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379858048:0@lo:400:kworker.0
00000100:00080000:0.0:1767319828.452333:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319828.452339:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319828.452739:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379857664:0@lo:38:kworker.0
00000100:00080000:0.0:1767319828.452754:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319828.452757:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319828.452760:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379857792:0@lo:38:kworker.0
00000100:00080000:0.0:1767319828.452769:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319828.452772:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319828.452774:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379858176:0@lo:38:kworker.0
00000100:00080000:0.0:1767319828.452781:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319828.452784:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319828.452787:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379858432:0@lo:38:kworker.0
00000100:00080000:2.0:1767319828.453085:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319828.453647:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4479
00000100:00100000:1.0:1767319828.453825:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379858304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319828.453906:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379858304:12345-0@lo:400:kworker.0 Request processed in 251us (12382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319828.453913:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4479
00000100:00100000:0.0:1767319828.454002:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379858304:0@lo:400:kworker.0
00010000:00010000:0.0:1767319828.951058:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319829.409692:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319829.409735:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319829.409952:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291939584
00000100:00100000:1.0:1767319829.409961:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291939584
00000100:00100000:1.0:1767319829.410025:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291939456
00000100:00100000:1.0:1767319829.410027:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291939456
00000100:00100000:1.0:1767319829.410055:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4480
00000100:00100000:1.0:1767319829.410065:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291939584:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319829.410119:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17276
00000100:00100000:3.0:1767319829.410128:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291939456:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319829.410148:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319829.410152:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291939584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (467us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319829.410161:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4480
00000100:00100000:3.0:1767319829.410183:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291939456:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (446us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319829.410191:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17276
00000100:00080000:0.0:1767319829.415801:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319829.976387:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319829.976420:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379858560:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319829.976507:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319829.976651:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319829.977130:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858560
00000100:00100000:3.0:1767319829.977226:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858560
00000100:00100000:3.0:1767319829.977510:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439
00000100:00100000:3.0:1767319829.977521:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379858560:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319829.977553:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319829.977636:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379858560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1128us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319829.977653:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439
00000100:00100000:0.0:1767319829.977756:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379858560:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319830.999105:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319832.023535:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319833.047380:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319833.559653:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319833.559676:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379858688:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319833.559751:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319833.559989:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858688
00000100:00100000:1.0:1767319833.560008:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858688
00000100:00100000:1.0:1767319833.560081:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440
00000100:00100000:1.0:1767319833.560090:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379858688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319833.560122:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319833.560173:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379858688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (422us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319833.560181:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440
00000100:00100000:1.0:1767319833.560233:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379858688:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319833.560314:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319833.560424:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319833.560430:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319833.560433:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319833.560436:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319833.560440:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319833.560445:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4730
00000100:00080000:2.0:1767319833.560449:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319833.560454:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319833.560479:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b800 x1853164379858816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319833.560504:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319833.560508:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319833.560510:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319833.560514:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4730
00000100:00080000:2.0:1767319833.560516:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319833.560519:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319833.560532:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164379858944/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319833.560579:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319833.560583:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319833.560585:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319833.560588:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4730
00000100:00080000:2.0:1767319833.560591:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319833.560594:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319833.560606:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289c00 x1853164379859328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319833.560621:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319833.560624:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319833.560626:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319833.560628:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4730
00000100:00080000:2.0:1767319833.560631:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319833.560635:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319833.560644:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a680 x1853164379859584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319833.561270:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379859200:0@lo:400:kworker.0
00000100:00100000:0.0:1767319833.561317:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319833.561353:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319833.561359:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379859456:0@lo:400:kworker.0
00000100:00100000:0.0:1767319833.561377:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319833.561406:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859200
00000100:00100000:0.0:1767319833.561411:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859200
00000100:00100000:0.0:1767319833.561445:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859456
00000100:00100000:0.0:1767319833.561447:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859456
00000100:00100000:0.0:1767319833.561465:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4481
00000100:00100000:0.0:1767319833.561471:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379859200:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319833.561521:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379859200:12345-0@lo:400:kworker.0 Request processed in 50us (204us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319833.561528:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4481
00000100:00100000:0.0:1767319833.561542:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4482
00000100:00100000:0.0:1767319833.561547:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379859456:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319833.561566:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379859456:12345-0@lo:400:kworker.0 Request processed in 20us (188us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319833.561571:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4482
00000100:00100000:0.0:1767319833.561803:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379858816:0@lo:38:kworker.0
00000100:00100000:0.0:1767319833.561831:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319833.561847:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379858944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319833.561865:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319833.561905:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379859328:0@lo:38:kworker.0
00000100:00100000:0.0:1767319833.561922:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319833.561947:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379859584:0@lo:38:kworker.0
00000100:00100000:0.0:1767319833.561968:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319833.561997:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858944
00000100:00100000:0.0:1767319833.562009:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858944
00000100:00100000:0.0:1767319833.562029:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59
00000100:00100000:0.0:1767319833.562034:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379858944:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319833.562051:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319833.562101:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379858944:12345-0@lo:38:kworker.0 Request processed in 66us (234us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319833.562107:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59
00000100:00100000:0.0:1767319833.562122:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379858816
00000100:00100000:0.0:1767319833.562125:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379858816
00000100:00100000:0.0:1767319833.562134:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859328
00000100:00100000:0.0:1767319833.562136:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859328
00000100:00100000:0.0:1767319833.562141:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859584
00000100:00100000:0.0:1767319833.562143:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859584
00000100:00100000:0.0:1767319833.562151:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17277
00000100:00100000:0.0:1767319833.562155:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379858816:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319833.562163:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319833.562196:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379858816:12345-0@lo:38:kworker.0 Request processed in 40us (364us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319833.562205:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17277
00000100:00100000:0.0:1767319833.562215:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17278
00000100:00100000:0.0:1767319833.562219:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379859328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319833.562228:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319833.562249:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379859328:12345-0@lo:38:kworker.0 Request processed in 28us (325us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319833.562254:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17278
00000100:00100000:0.0:1767319833.562263:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17279
00000100:00100000:0.0:1767319833.562266:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379859584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319833.562274:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319833.562290:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379859584:12345-0@lo:38:kworker.0 Request processed in 22us (321us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319833.562295:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17279
00000100:00080000:0.0:1767319833.562312:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319833.562323:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319833.562331:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379859072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319833.562352:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319833.562374:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859072
00000100:00100000:0.0:1767319833.562377:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859072
00000100:00100000:0.0:1767319833.562401:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657
00000100:00100000:0.0:1767319833.562407:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379859072:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319833.562433:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379859072:12345-0@lo:400:kworker.0 Request processed in 27us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319833.562439:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657
00000100:00080000:0.0:1767319833.562450:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319833.562982:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379859456:0@lo:400:kworker.0
00000100:00100000:3.0:1767319833.562996:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379859200:0@lo:400:kworker.0
00000100:00080000:3.0:1767319833.563042:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319833.563046:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319833.563049:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379858816:0@lo:38:kworker.0
00000100:00080000:3.0:1767319833.563057:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319833.563061:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319833.563062:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379858944:0@lo:38:kworker.0
00000100:00080000:3.0:1767319833.563069:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319833.563071:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319833.563073:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379859328:0@lo:38:kworker.0
00000100:00080000:3.0:1767319833.563077:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319833.563079:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319833.563081:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379859584:0@lo:38:kworker.0
00000100:00100000:0.0:1767319833.565779:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379859072:0@lo:400:kworker.0
00010000:00010000:1.0:1767319834.071381:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319834.512578:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319834.512679:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291939840
00000100:00100000:2.0:1767319834.512696:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291939840
00000100:00100000:2.0:1767319834.512786:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4483
00000100:00100000:2.0:1767319834.512795:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291939840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319834.512950:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291939840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 147us (377us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319834.512960:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4483
00000100:00080000:0.0:1767319834.513491:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319834.514008:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319834.514354:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291939712
00000100:00100000:2.0:1767319834.514362:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291939712
00000100:00100000:2.0:1767319834.514402:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17280
00000100:00100000:2.0:1767319834.514412:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291939712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319834.514439:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319834.514499:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291939712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 86us (509us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319834.514507:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17280
00000100:00100000:0.0:1767319835.095455:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319835.095480:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379859712:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319835.095549:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319835.095642:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319835.095685:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859712
00000100:00100000:3.0:1767319835.095702:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859712
00000100:00100000:3.0:1767319835.095811:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441
00000100:00100000:3.0:1767319835.095821:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379859712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319835.095852:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319835.095933:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379859712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (383us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319835.095942:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441
00000100:00100000:2.0:1767319835.096131:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379859712:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319835.096584:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319836.120293:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319837.143151:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319838.170920:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767319838.614750:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291939968 offset 0 length 520: 4
00000100:00100000:3.0:1767319838.614795:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319838.614835:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319838.614893:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940096
00000100:00100000:0.0:1767319838.614903:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940096
00000100:00100000:0.0:1767319838.614949:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940224
00000100:00100000:0.0:1767319838.614977:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940224
00000100:00100000:2.0:1767319838.615020:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17281
00000100:00100000:2.0:1767319838.615032:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291940096:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319838.615056:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319838.615107:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319838.615334:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291940096:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 302us (537us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319838.624424:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4484
00000100:00100000:0.0:1767319838.624460:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291940224:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319838.624573:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291940224:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 126us (9736us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319838.624582:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4484
00000100:00100000:2.0:1767319838.630859:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17281
00000100:00100000:2.0:1767319838.679500:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379859840:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319838.679582:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319838.679675:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319838.679681:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319838.679684:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319838.679688:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319838.679692:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319838.679698:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4735
00000100:00080000:2.0:1767319838.679701:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319838.679708:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319838.679733:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28bb80 x1853164379859968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319838.679761:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319838.679764:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319838.679767:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319838.679770:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4735
00000100:00080000:2.0:1767319838.679773:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319838.679777:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319838.679793:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288700 x1853164379860096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319838.679837:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319838.679841:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319838.679843:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319838.679847:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4735
00000100:00080000:2.0:1767319838.679851:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319838.679856:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319838.679857:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379860352:0@lo:400:kworker.0
00000100:00100000:2.0:1767319838.679891:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164379860480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319838.679916:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319838.679919:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319838.679923:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319838.679925:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319838.679929:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4735
00000100:00080000:2.0:1767319838.679931:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319838.679935:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319838.679945:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319838.679947:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289500 x1853164379860736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319838.679965:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379860224:0@lo:400:kworker.0
00000100:00100000:0.0:1767319838.679993:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319838.680026:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379860224
00000100:00100000:0.0:1767319838.680033:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379860224
00000100:00100000:0.0:1767319838.680089:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658
00000100:00100000:0.0:1767319838.680100:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379860224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319838.680105:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859840
00000100:00100000:1.0:1767319838.680121:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859840
00000100:00100000:0.0:1767319838.680154:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379860224:12345-0@lo:400:kworker.0 Request processed in 56us (158us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319838.680161:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442
00000100:00100000:0.0:1767319838.680166:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658
00000100:00100000:1.0:1767319838.680173:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379859840:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319838.680192:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:1.0:1767319838.680198:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767319838.680199:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319838.680215:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379859968:0@lo:38:kworker.0
00000100:00100000:1.0:1767319838.680243:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379859840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (660us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319838.680250:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442
00000100:00100000:0.0:1767319838.680261:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319838.680282:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379860096:0@lo:38:kworker.0
00000100:00100000:0.0:1767319838.680306:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319838.680317:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379860224:0@lo:400:kworker.0
00000100:00100000:0.0:1767319838.680333:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379860480:0@lo:38:kworker.0
00000100:00100000:3.0:1767319838.680370:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379859840:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319838.680371:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379860352
00000100:00100000:1.0:1767319838.680376:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379860352
00000100:00100000:3.0:1767319838.680388:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319838.680397:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379860608:0@lo:400:kworker.0
00000100:00100000:1.0:1767319838.680409:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379859968
00000100:00100000:1.0:1767319838.680420:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379859968
00000100:00100000:1.0:1767319838.680439:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4485
00000100:00100000:1.0:1767319838.680445:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379860352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319838.680582:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17282
00000100:00100000:2.0:1767319838.680586:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379859968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319838.680603:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319838.687883:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319838.687930:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379860736:0@lo:38:kworker.0
00000100:00100000:0.0:1767319838.687972:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319838.687997:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319838.688024:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379860096
00000100:00100000:3.0:1767319838.688031:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379860480
00000100:00100000:0.0:1767319838.688032:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379860096
00000100:00100000:3.0:1767319838.688034:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379860480
00000100:00100000:3.0:1767319838.688057:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379860736
00000100:00100000:3.0:1767319838.688060:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379860736
00000100:00100000:0.0:1767319838.688064:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60
00000100:00100000:3.0:1767319838.688067:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379860608
00000100:00100000:0.0:1767319838.688072:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379860096:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319838.688080:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379860608
00010000:00020000:0.0:1767319838.688094:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319838.688106:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4486
00000100:00100000:3.0:1767319838.688112:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379860608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319838.688136:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379860096:12345-0@lo:38:kworker.0 Request processed in 63us (7829us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319838.688144:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60
00000100:00100000:3.0:1767319838.688151:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379860608:12345-0@lo:400:kworker.0 Request processed in 40us (155us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319838.688156:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4486
00000100:00100000:0.0:1767319838.688168:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17283
00000100:00100000:0.0:1767319838.688172:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379860480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319838.688182:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319838.688205:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379860480:12345-0@lo:38:kworker.0 Request processed in 32us (345us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319838.693757:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379860352:12345-0@lo:400:kworker.0 Request processed in 13303us (13833us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319838.693883:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379859968:12345-0@lo:38:kworker.0 Request processed in 13293us (13622us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319838.695098:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17284
00000100:00100000:3.0:1767319838.695111:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379860736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319838.695137:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319838.695212:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379860736:12345-0@lo:38:kworker.0 Request processed in 101us (7238us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319838.695220:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17284
00000100:00100000:3.0:1767319838.695294:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379860608:0@lo:400:kworker.0
00000100:00080000:3.0:1767319838.695829:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319838.695899:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17283
00000100:00100000:3.0:1767319838.695919:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379860352:0@lo:400:kworker.0
00000100:00080000:0.0:1767319838.695936:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319838.695941:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319838.695944:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379859968:0@lo:38:kworker.0
00000100:00080000:0.0:1767319838.695967:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319838.695970:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319838.695974:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379860096:0@lo:38:kworker.0
00000100:00080000:0.0:1767319838.695984:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319838.695987:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319838.695989:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379860480:0@lo:38:kworker.0
00000100:00080000:0.0:1767319838.695998:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319838.696001:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319838.696003:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379860736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319838.696633:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4485
00000100:00100000:2.0:1767319838.701228:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17282
00010000:00010000:1.0:1767319839.191067:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319840.215989:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319840.216697:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379860864:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319840.216764:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319840.216910:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379860864
00000100:00100000:1.0:1767319840.216919:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379860864
00000100:00100000:1.0:1767319840.216996:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443
00000100:00100000:1.0:1767319840.217005:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379860864:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319840.217034:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319840.217082:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379860864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (318us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319840.217088:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443
00000100:00100000:1.0:1767319840.217137:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379860864:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319840.217377:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767319841.239277:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319842.263285:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319843.291426:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319843.727988:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319843.728078:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319843.728240:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940480
00000100:00100000:2.0:1767319843.728251:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940480
00000100:00100000:2.0:1767319843.728311:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940352
00000100:00100000:2.0:1767319843.728314:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940352
00000100:00100000:2.0:1767319843.728334:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4487
00000100:00100000:2.0:1767319843.728358:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291940480:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319843.728460:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291940480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (516us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319843.728468:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4487
00000100:00100000:2.0:1767319843.728490:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17285
00000100:00100000:2.0:1767319843.728494:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291940352:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319843.728518:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319843.728545:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291940352:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (467us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319843.728552:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17285
00000100:00080000:1.0:1767319843.729051:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319843.798987:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319818/real 1767319818]  req@ffff8b0f08e9ca80 x1853164379855104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319843 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319843.799025:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f08e9ca80 x1853164379855104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319843 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319843.799046:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319843.799101:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319843.799107:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379855104:0@lo:250:kworker.0
00000100:00080000:2.0:1767319843.799148:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319843.799155:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319843.799159:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319843.799165:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4720
00000100:00080000:2.0:1767319843.799169:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319843.799176:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319843.799207:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288a80 x1853164379860992/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319843.799231:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319843.799234:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319843.799236:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319843.799241:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4741
00000100:00080000:2.0:1767319843.799244:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319843.799247:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319843.799253:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379860992:0@lo:250:kworker.0
00000100:00100000:2.0:1767319843.799265:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289500 x1853164379861120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319843.799277:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319843.799281:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319843.799283:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319843.799286:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4741
00000100:00080000:2.0:1767319843.799289:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319843.799292:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000400:00000100:0.0:1767319843.799305:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379860992 offset 0 length 520: 4
00000100:00100000:2.0:1767319843.799307:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164379861248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319843.799371:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319843.799374:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319843.799376:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319843.799380:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4741
00000100:00080000:2.0:1767319843.799385:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319843.799389:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319843.799401:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b800 x1853164379861760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319843.799419:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767319843.799423:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379861120:0@lo:38:kworker.0
00000100:00080000:2.0:1767319843.799424:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319843.799429:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319843.799435:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4741
00000100:00080000:2.0:1767319843.799437:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319843.799441:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319843.799455:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319843.799466:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ca80 x1853164379862016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319843.799472:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379861248:0@lo:38:kworker.0
00000100:00100000:0.0:1767319843.799497:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319843.799507:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379861760:0@lo:38:kworker.0
00000100:00100000:2.0:1767319843.799521:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379861888:0@lo:400:kworker.0
00000100:00100000:0.0:1767319843.799522:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319843.799538:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379862016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319843.799565:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319843.799628:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379861632:0@lo:400:kworker.0
00000100:00100000:3.0:1767319843.799671:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379861376:0@lo:400:kworker.0
00000100:00100000:3.0:1767319843.799704:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319843.799733:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319843.799738:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379861504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319843.799759:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319843.799927:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379861120
00000100:00100000:0.0:1767319843.799935:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379861120
00000100:00100000:1.0:1767319843.800811:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319843.800825:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379862144:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319843.801082:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319843.801124:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862144
00000100:00100000:1.0:1767319843.801130:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862144
00000100:00100000:1.0:1767319843.801178:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444
00000100:00100000:1.0:1767319843.801187:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379862144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319843.801217:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319843.801262:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379862144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (180us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319843.801270:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444
00000100:00080000:1.0:1767319843.801294:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319843.801328:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379862144:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319843.801700:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379861376
00000100:00100000:1.0:1767319843.801706:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379861376
00000100:00100000:1.0:1767319843.801731:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659
00000100:00100000:1.0:1767319843.801738:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379861376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319843.801772:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379861376:12345-0@lo:400:kworker.0 Request processed in 34us (2068us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319843.801778:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659
00000100:00100000:1.0:1767319843.801789:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379861504
00000100:00100000:1.0:1767319843.801793:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379861504
00000100:00100000:1.0:1767319843.801816:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660
00000100:00100000:1.0:1767319843.801821:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379861504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319843.801847:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379861504:12345-0@lo:400:kworker.0 Request processed in 25us (2087us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319843.801855:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660
00000100:00080000:1.0:1767319843.802037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319843.802059:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319843.802176:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379861760
00000100:00100000:0.0:1767319843.802184:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379861760
00000100:00100000:0.0:1767319843.802209:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379861888
00000100:00100000:0.0:1767319843.802213:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379861888
00000100:00100000:1.0:1767319843.802220:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862016
00000100:00100000:1.0:1767319843.802225:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862016
00000100:00100000:1.0:1767319843.802251:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4488
00000100:00100000:0.0:1767319843.802258:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17286
00000100:00100000:1.0:1767319843.802262:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379861888:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319843.802269:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379861120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319843.802289:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319843.802303:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379861888:12345-0@lo:400:kworker.0 Request processed in 44us (2738us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319843.802309:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4488
00000100:00100000:1.0:1767319843.802327:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17287
00000100:00100000:1.0:1767319843.802333:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379861760:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319843.802348:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379861120:12345-0@lo:38:kworker.0 Request processed in 79us (2890us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767319843.802357:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319843.802358:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17286
00000100:00100000:0.0:1767319843.802376:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17288
00000100:00100000:0.0:1767319843.802381:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379862016:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319843.802391:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379861760:12345-0@lo:38:kworker.0 Request processed in 57us (2869us total) trans 0 rc -19/-19
00010000:00020000:0.0:1767319843.802393:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319843.802404:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17287
00000100:00100000:0.0:1767319843.802437:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379862016:12345-0@lo:38:kworker.0 Request processed in 53us (376us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319843.802438:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767319843.802448:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17288
00000100:00080000:0.0:1767319843.802467:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319843.802498:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379861248
00000100:00100000:0.0:1767319843.802502:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379861248
00000100:00100000:0.0:1767319843.802521:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61
00000100:00100000:0.0:1767319843.802526:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379861248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319843.802536:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319843.802561:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379861248:12345-0@lo:38:kworker.0 Request processed in 34us (3064us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319843.802567:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61
00000100:00100000:0.0:1767319843.802590:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319843.802627:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319843.802633:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379861120:0@lo:38:kworker.0
00000100:00100000:0.0:1767319843.802641:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379861504:0@lo:400:kworker.0
00000100:00080000:1.0:1767319843.802652:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319843.802658:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319843.802660:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379861376:0@lo:400:kworker.0
00000100:00100000:1.0:1767319843.802664:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379861248:0@lo:38:kworker.0
00000100:00080000:1.0:1767319843.802681:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319843.802686:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319843.802689:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379861632
00000100:00100000:1.0:1767319843.802690:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379861760:0@lo:38:kworker.0
00000100:00100000:0.0:1767319843.802696:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379861632
00000100:00080000:1.0:1767319843.802718:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319843.802723:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319843.802727:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379862016:0@lo:38:kworker.0
00000100:00100000:0.0:1767319843.802733:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4489
00000100:00100000:0.0:1767319843.802741:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379861632:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767319843.802761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319843.802783:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379861632:12345-0@lo:400:kworker.0 Request processed in 41us (190us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319843.802791:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4489
00000100:00100000:1.0:1767319843.802796:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379861888:0@lo:400:kworker.0
00000100:00100000:0.0:1767319843.802826:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379861632:0@lo:400:kworker.0
00010000:00010000:3.0:1767319844.311069:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319845.335031:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319845.335067:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379862272:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319845.335139:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319845.335268:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862272
00000100:00100000:1.0:1767319845.335276:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862272
00000100:00100000:1.0:1767319845.335328:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445
00000100:00100000:1.0:1767319845.335336:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379862272:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319845.335365:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319845.335417:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379862272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (277us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319845.335425:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445
00000100:00080000:0.0:1767319845.335492:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319845.335502:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379862272:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319846.359739:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319847.383056:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319848.407204:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319848.851165:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319848.851293:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940608
00000100:00100000:2.0:1767319848.851306:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940608
00000100:00100000:2.0:1767319848.851362:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17289
00000100:00100000:2.0:1767319848.851370:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291940608:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319848.851398:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319848.851487:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291940608:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 115us (341us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319848.851495:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17289
00000100:00100000:2.0:1767319848.856055:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319848.856167:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940736
00000100:00100000:3.0:1767319848.856181:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940736
00000100:00100000:3.0:1767319848.856277:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4490
00000100:00100000:3.0:1767319848.856291:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291940736:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319848.856396:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291940736:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (354us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319848.856403:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4490
00000100:00080000:0.0:1767319848.857601:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319848.921080:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319848.921095:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319848.921098:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319848.921103:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319848.921108:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319848.921118:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4746
00000100:00080000:1.0:1767319848.921124:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319848.921132:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319848.921163:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379862528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319848.921180:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319848.921183:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319848.921185:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319848.921188:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4746
00000100:00080000:1.0:1767319848.921191:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319848.921194:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319848.921197:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319848.921209:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebe680 x1853164379862656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319848.921219:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379862400:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319848.921251:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319848.921254:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319848.921256:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319848.921260:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4746
00000100:00080000:1.0:1767319848.921263:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319848.921267:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319848.921281:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162a300 x1853164379863168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319848.921295:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319848.921298:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319848.921300:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319848.921304:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4746
00000100:00080000:1.0:1767319848.921306:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767319848.921310:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319848.921310:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319848.921321:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f046ce300 x1853164379863424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319848.921504:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379863296:0@lo:400:kworker.0
00000100:00100000:3.0:1767319848.921550:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319848.921623:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862400
00000100:00100000:3.0:1767319848.921634:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862400
00000100:00100000:3.0:1767319848.921710:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446
00000100:00100000:3.0:1767319848.921721:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379862400:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319848.921764:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319848.921816:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379862400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (503us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319848.921825:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446
00000100:00100000:3.0:1767319848.921856:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379862912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319848.921925:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319848.921968:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862912
00000100:00100000:3.0:1767319848.921972:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862912
00000100:00100000:3.0:1767319848.922015:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661
00000100:00100000:3.0:1767319848.922024:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379862912:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319848.922065:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379862912:12345-0@lo:400:kworker.0 Request processed in 43us (140us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319848.922072:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661
00000100:00080000:3.0:1767319848.922092:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767319848.922097:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319848.922584:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379862400:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319848.922617:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379862784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319848.922644:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319848.922677:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862784
00000100:00100000:0.0:1767319848.922681:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862784
00000100:00100000:0.0:1767319848.922711:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662
00000100:00100000:0.0:1767319848.922717:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379862784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319848.922758:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379862784:12345-0@lo:400:kworker.0 Request processed in 40us (112us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319848.922765:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662
00000100:00100000:0.0:1767319848.922803:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379862784:0@lo:400:kworker.0
00000100:00100000:2.0:1767319848.922926:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379862528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319848.922967:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319848.923012:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379862656:0@lo:38:kworker.0
00000100:00100000:2.0:1767319848.923041:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319848.923079:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379863168:0@lo:38:kworker.0
00000100:00100000:2.0:1767319848.923109:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319848.923116:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862656
00000100:00100000:1.0:1767319848.923127:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862656
00000100:00100000:2.0:1767319848.923135:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379863424:0@lo:38:kworker.0
00000100:00100000:2.0:1767319848.923165:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319848.923198:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62
00000100:00100000:1.0:1767319848.923208:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379862656:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319848.923228:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379863040:0@lo:400:kworker.0
00010000:00020000:1.0:1767319848.923232:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319848.923264:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319848.923434:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379862912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319848.923475:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863296
00000100:00100000:3.0:1767319848.923481:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863296
00000100:00100000:3.0:1767319848.923527:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379862528
00000100:00100000:3.0:1767319848.923530:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379862528
00000100:00100000:3.0:1767319848.923538:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863168
00000100:00100000:3.0:1767319848.923542:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863168
00000100:00100000:3.0:1767319848.923548:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863424
00000100:00100000:3.0:1767319848.923550:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863424
00000100:00100000:3.0:1767319848.923557:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863040
00000100:00100000:3.0:1767319848.923559:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863040
00000100:00100000:3.0:1767319848.923574:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4491
00000100:00100000:3.0:1767319848.923581:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379863296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319848.924640:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4492
00000100:00100000:0.0:1767319848.924662:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379863040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319848.927153:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17290
00000100:00100000:2.0:1767319848.927169:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379862528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319848.927211:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319848.927312:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379862528:12345-0@lo:38:kworker.0 Request processed in 144us (4343us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319848.927319:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17290
00000100:00100000:2.0:1767319848.927358:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17291
00000100:00100000:2.0:1767319848.927363:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379863168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319848.927373:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319848.927404:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379863168:12345-0@lo:38:kworker.0 Request processed in 39us (4297us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319848.927411:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17291
00000100:00100000:2.0:1767319848.927423:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17292
00000100:00100000:2.0:1767319848.927428:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379863424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319848.927438:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319848.927463:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379863424:12345-0@lo:38:kworker.0 Request processed in 33us (4297us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319848.927468:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17292
00000100:00080000:2.0:1767319848.927517:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319848.927523:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319848.927528:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379862528:0@lo:38:kworker.0
00000100:00080000:2.0:1767319848.927540:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319848.927544:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319848.927547:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379863168:0@lo:38:kworker.0
00000100:00080000:2.0:1767319848.927556:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319848.927559:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319848.927563:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379863424:0@lo:38:kworker.0
00000100:00080000:2.0:1767319848.927654:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319848.930843:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379862656:12345-0@lo:38:kworker.0 Request processed in 7626us (7791us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319848.930885:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62
00000100:00080000:2.0:1767319848.931372:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319848.931378:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319848.931382:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379862656:0@lo:38:kworker.0
00000100:00100000:3.0:1767319848.931758:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379863296:12345-0@lo:400:kworker.0 Request processed in 8165us (10195us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319848.931776:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4491
00000100:00100000:2.0:1767319848.931790:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379863296:0@lo:400:kworker.0
00000100:00100000:0.0:1767319848.932165:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379863040:12345-0@lo:400:kworker.0 Request processed in 7510us (8898us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319848.932196:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379863040:0@lo:400:kworker.0
00000100:00100000:0.0:1767319848.932448:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4492
00010000:00010000:0.0:1767319849.431129:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319850.458891:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319850.459537:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379863552:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319850.459612:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319850.459746:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863552
00000100:00100000:3.0:1767319850.459755:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863552
00000100:00100000:3.0:1767319850.459833:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447
00000100:00100000:3.0:1767319850.459842:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379863552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767319850.459911:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319850.459973:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379863552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (360us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319850.459980:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447
00000100:00100000:1.0:1767319850.459998:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f046ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379863552:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319850.460253:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319851.480355:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319852.503190:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319853.527615:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319853.968106:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319853.968153:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319853.968429:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940992
00000100:00100000:0.0:1767319853.968440:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940992
00000100:00100000:3.0:1767319853.968513:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291940864
00000100:00100000:3.0:1767319853.968519:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291940864
00000100:00100000:0.0:1767319853.968524:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4493
00000100:00100000:0.0:1767319853.968537:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291940992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319853.968583:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17293
00000100:00100000:3.0:1767319853.968591:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291940864:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:0.0:1767319853.968610:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291940992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (512us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319853.968619:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4493
00010000:00020000:3.0:1767319853.968640:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319853.968670:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291940864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 78us (515us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319853.968676:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17293
00000100:00080000:2.0:1767319853.968705:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319854.039179:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319854.039187:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319854.039190:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767319854.039193:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:0.0:1767319854.039194:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319854.039200:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319854.039208:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4751
00000100:00100000:1.0:1767319854.039213:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379863680:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767319854.039214:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319854.039225:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319854.039251:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289500 x1853164379863808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319854.039265:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319854.039268:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319854.039270:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319854.039275:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4751
00000100:00080000:0.0:1767319854.039277:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319854.039282:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319854.039290:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319854.039296:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288700 x1853164379863936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319854.039342:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319854.039346:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319854.039348:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319854.039352:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4751
00000100:00080000:0.0:1767319854.039355:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319854.039359:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319854.039368:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379864064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.039374:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379864448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319854.039395:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319854.039399:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319854.039401:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319854.039405:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4751
00000100:00080000:0.0:1767319854.039407:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319854.039411:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319854.039422:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebc000 x1853164379864704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319854.039430:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319854.039456:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379864320:0@lo:400:kworker.0
00000100:00100000:1.0:1767319854.039459:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319854.039469:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379864576:0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.039508:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319854.039541:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319854.039548:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863680
00000100:00100000:0.0:1767319854.039549:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379864192:0@lo:400:kworker.0
00000100:00100000:1.0:1767319854.039557:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863680
00000100:00100000:0.0:1767319854.039578:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319854.039613:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864064
00000100:00100000:0.0:1767319854.039617:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864064
00000100:00100000:1.0:1767319854.039618:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448
00000100:00100000:1.0:1767319854.039631:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7018:x1853164379863680:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319854.039651:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864192
00000100:00100000:0.0:1767319854.039656:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864192
00002000:00000024:1.0:1767319854.039662:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319854.039682:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663
00000100:00100000:0.0:1767319854.039691:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:7018:x1853164379864064:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.039730:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:7018:x1853164379864064:12345-0@lo:400:kworker.0 Request processed in 40us (304us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319854.039737:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663
00000100:00100000:0.0:1767319854.039753:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664
00000100:00100000:0.0:1767319854.039773:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379864192:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.039801:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379864192:12345-0@lo:400:kworker.0 Request processed in 29us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319854.039807:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664
00000100:00100000:0.0:1767319854.039836:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864320
00000100:00100000:0.0:1767319854.039840:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864320
00000100:00100000:0.0:1767319854.039885:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4494
00000100:00100000:0.0:1767319854.039895:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379864320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319854.039903:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379863680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (417us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319854.039913:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448
00000100:00100000:0.0:1767319854.039928:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379864320:12345-0@lo:400:kworker.0 Request processed in 35us (419us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319854.039936:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4494
00000100:00080000:1.0:1767319854.039948:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319854.039955:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319854.039957:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319854.039996:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379864192:0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.040004:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379864320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.040024:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319854.040044:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379864064:0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.040056:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379863680:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319854.040072:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864576
00000100:00100000:0.0:1767319854.040075:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864576
00000100:00100000:0.0:1767319854.040103:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4495
00000100:00100000:0.0:1767319854.040109:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379864576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319854.040139:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379864576:12345-0@lo:400:kworker.0 Request processed in 30us (113us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319854.040145:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4495
00000100:00080000:1.0:1767319854.040162:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319854.040178:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379864576:0@lo:400:kworker.0
00000100:00100000:2.0:1767319854.040384:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379863808:0@lo:38:kworker.0
00000100:00100000:2.0:1767319854.040414:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319854.040442:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379863936:0@lo:38:kworker.0
00000100:00100000:2.0:1767319854.040465:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319854.040496:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379864448:0@lo:38:kworker.0
00000100:00100000:2.0:1767319854.040519:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319854.040523:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863936
00000100:00100000:1.0:1767319854.040529:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863936
00000100:00100000:2.0:1767319854.040545:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379864704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319854.040558:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63
00000100:00100000:1.0:1767319854.040566:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379863936:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319854.040574:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:1.0:1767319854.040587:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319854.040609:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379863808
00000100:00100000:2.0:1767319854.040614:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379863808
00000100:00100000:1.0:1767319854.040632:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379863936:12345-0@lo:38:kworker.0 Request processed in 65us (165us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319854.040640:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864448
00000100:00100000:1.0:1767319854.040643:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63
00000100:00100000:2.0:1767319854.040645:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864448
00000100:00100000:2.0:1767319854.040664:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864704
00000100:00100000:2.0:1767319854.040667:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864704
00000100:00080000:1.0:1767319854.040682:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767319854.040689:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17294
00000100:00080000:1.0:1767319854.040691:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319854.040697:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379863808:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767319854.040699:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379863936:0@lo:38:kworker.0
00010000:00020000:2.0:1767319854.040713:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319854.040740:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379863808:12345-0@lo:38:kworker.0 Request processed in 43us (325us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319854.040746:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17294
00000100:00100000:3.0:1767319854.040848:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17295
00000100:00100000:3.0:1767319854.040854:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379864448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319854.040863:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767319854.040913:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767319854.040920:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379864448:12345-0@lo:38:kworker.0 Request processed in 63us (398us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767319854.040921:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319854.040928:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379863808:0@lo:38:kworker.0
00000100:00100000:3.0:1767319854.040935:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17295
00000100:00080000:1.0:1767319854.040942:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319854.040948:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319854.040952:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17296
00000100:00100000:1.0:1767319854.040953:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379864448:0@lo:38:kworker.0
00000100:00100000:3.0:1767319854.040962:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379864704:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319854.040972:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319854.040995:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379864704:12345-0@lo:38:kworker.0 Request processed in 34us (426us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319854.040999:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17296
00000100:00080000:1.0:1767319854.041068:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319854.041074:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319854.041078:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379864704:0@lo:38:kworker.0
00010000:00010000:3.0:1767319854.551167:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319855.575216:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319855.575248:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379864832:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319855.575314:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319855.575666:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864832
00000100:00100000:1.0:1767319855.575675:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864832
00000100:00100000:1.0:1767319855.575727:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449
00000100:00100000:1.0:1767319855.575737:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379864832:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319855.575765:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319855.575847:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379864832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (532us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319855.575855:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449
00000100:00100000:2.0:1767319855.575925:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379864832:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319855.576528:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319856.599266:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319857.624020:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319858.648126:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319859.090564:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319859.090609:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319859.090734:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291941248
00000100:00100000:3.0:1767319859.090744:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291941248
00000100:00100000:3.0:1767319859.090822:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291941120
00000100:00100000:3.0:1767319859.090825:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291941120
00000100:00100000:3.0:1767319859.090841:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4496
00000100:00100000:3.0:1767319859.090851:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291941248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319859.090962:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291941248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 111us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319859.090971:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4496
00000100:00100000:3.0:1767319859.090990:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17297
00000100:00100000:3.0:1767319859.090995:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291941120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319859.091015:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319859.091041:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291941120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (431us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319859.091047:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17297
00000100:00080000:1.0:1767319859.091198:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319859.159081:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319859.159091:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319859.159094:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319859.159097:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319859.159101:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319859.159107:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4756
00000100:00080000:2.0:1767319859.159110:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319859.159117:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319859.159163:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819b800 x1853164379865088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319859.159188:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319859.159190:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319859.159192:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319859.159195:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4756
00000100:00080000:2.0:1767319859.159196:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319859.159198:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319859.159206:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198700 x1853164379865216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319859.159247:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319859.159249:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319859.159251:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319859.159254:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4756
00000100:00080000:2.0:1767319859.159256:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319859.159259:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319859.159269:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199180 x1853164379865728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319859.159284:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319859.159287:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319859.159289:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319859.159292:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4756
00000100:00080000:2.0:1767319859.159295:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319859.159298:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319859.159307:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819a300 x1853164379865984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319859.159342:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379865472:0@lo:400:kworker.0
00000100:00100000:2.0:1767319859.159394:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319859.159440:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319859.159444:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379865600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319859.159460:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319859.159483:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865472
00000100:00100000:2.0:1767319859.159489:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865472
00000100:00100000:2.0:1767319859.159533:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665
00000100:00100000:2.0:1767319859.159538:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379865472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319859.159572:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379865472:12345-0@lo:400:kworker.0 Request processed in 35us (178us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319859.159577:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665
00000100:00100000:2.0:1767319859.159594:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865600
00000100:00100000:2.0:1767319859.159596:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865600
00000100:00100000:2.0:1767319859.159613:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4497
00000100:00100000:2.0:1767319859.159616:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379865600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319859.159636:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379865600:12345-0@lo:400:kworker.0 Request processed in 20us (176us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319859.159643:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4497
00000100:00100000:3.0:1767319859.159689:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379864960:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319859.159696:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379865600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319859.159710:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379865472:0@lo:400:kworker.0
00000100:00100000:3.0:1767319859.159788:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319859.159845:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379865856:0@lo:400:kworker.0
00000100:00100000:3.0:1767319859.159908:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319859.159936:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319859.159943:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379865344:0@lo:400:kworker.0
00000100:00100000:3.0:1767319859.159972:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319859.159981:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319859.159988:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319859.160027:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865856
00000100:00100000:1.0:1767319859.160032:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865856
00000100:00100000:3.0:1767319859.160060:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865344
00000100:00100000:3.0:1767319859.160070:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865344
00000100:00100000:0.0:1767319859.160087:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379865088:0@lo:38:kworker.0
00000100:00100000:1.0:1767319859.160088:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4498
00000100:00100000:1.0:1767319859.160107:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379865856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319859.160142:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666
00000100:00100000:0.0:1767319859.160152:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319859.160162:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379865344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319859.160178:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379865856:12345-0@lo:400:kworker.0 Request processed in 73us (266us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319859.160185:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4498
00000100:00100000:0.0:1767319859.160195:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379865216:0@lo:38:kworker.0
00000100:00100000:1.0:1767319859.160204:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865088
00000100:00100000:1.0:1767319859.160209:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865088
00000100:00100000:3.0:1767319859.160232:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379865344:12345-0@lo:400:kworker.0 Request processed in 77us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319859.160250:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17298
00000100:00100000:1.0:1767319859.160259:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379865088:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319859.160260:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666
00000100:00100000:0.0:1767319859.160261:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:1.0:1767319859.160291:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319859.160313:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379865728:0@lo:38:kworker.0
00000100:00100000:1.0:1767319859.160352:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379865088:12345-0@lo:38:kworker.0 Request processed in 89us (199us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319859.160361:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17298
00000100:00100000:3.0:1767319859.160368:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379865344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319859.160374:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319859.160401:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379865984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319859.160423:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319859.160457:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379864960
00000100:00100000:2.0:1767319859.160464:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379864960
00000100:00100000:3.0:1767319859.160650:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379865856:0@lo:400:kworker.0
00000100:00100000:3.0:1767319859.160693:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865216
00000100:00100000:3.0:1767319859.160697:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865216
00000100:00100000:3.0:1767319859.160723:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64
00000100:00100000:3.0:1767319859.160729:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379865216:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319859.160867:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319859.160930:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379865216:12345-0@lo:38:kworker.0 Request processed in 198us (687us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319859.160937:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64
00000100:00100000:2.0:1767319859.161029:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450
00000100:00100000:2.0:1767319859.161038:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379864960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319859.161067:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319859.161112:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379864960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (1326us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319859.161118:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450
00000100:00100000:2.0:1767319859.161174:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379864960:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319859.161212:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319859.161217:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319859.163119:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865728
00000100:00100000:1.0:1767319859.163133:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865728
00000100:00100000:1.0:1767319859.163194:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17299
00000100:00100000:1.0:1767319859.163200:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379865728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319859.163221:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319859.163300:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379865728:12345-0@lo:38:kworker.0 Request processed in 99us (2933us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319859.163305:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17299
00000100:00100000:1.0:1767319859.164841:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379865984
00000100:00100000:1.0:1767319859.164854:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379865984
00000100:00100000:1.0:1767319859.164934:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17300
00000100:00100000:1.0:1767319859.164941:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379865984:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319859.164959:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319859.165026:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379865984:12345-0@lo:38:kworker.0 Request processed in 83us (4601us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319859.165034:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17300
00000100:00080000:0.0:1767319859.168179:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319859.168210:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319859.168221:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379865088:0@lo:38:kworker.0
00000100:00080000:0.0:1767319859.168293:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319859.168298:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319859.168301:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379865216:0@lo:38:kworker.0
00000100:00080000:0.0:1767319859.168316:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319859.168320:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319859.168324:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379865728:0@lo:38:kworker.0
00000100:00080000:0.0:1767319859.168336:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319859.168340:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319859.168343:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379865984:0@lo:38:kworker.0
00010000:00010000:2.0:1767319859.671816:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319860.695850:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379866112:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767319860.695983:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319860.696039:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379866112
00000100:00100000:2.0:1767319860.696050:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379866112
00000100:00100000:2.0:1767319860.696126:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451
00000100:00100000:2.0:1767319860.696137:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379866112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319860.696178:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319860.696232:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379866112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (248us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319860.696241:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451
00010000:00010000:3.0:1767319860.696255:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319860.696479:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379866112:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319861.719096:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319862.744218:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319863.767085:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319864.212351:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319864.212474:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319864.217146:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291941504
00000100:00100000:3.0:1767319864.217146:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291941376
00000100:00100000:2.0:1767319864.217171:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291941504
00000100:00100000:3.0:1767319864.217171:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291941376
00000100:00100000:3.0:1767319864.217245:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4499
00000100:00100000:2.0:1767319864.217256:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17301
00000100:00100000:3.0:1767319864.217264:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291941504:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319864.217266:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291941376:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319864.217300:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000400:00000100:1.0:1767319864.217347:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291941632 offset 0 length 520: 4
00000100:00080000:0.0:1767319864.217521:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319864.218733:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291941376:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1448us (6237us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319864.218749:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17301
00000100:00100000:3.0:1767319864.219100:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291941504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1841us (6764us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319864.219110:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4499
00000100:00080000:1.0:1767319864.279194:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319864.279203:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767319864.279208:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319864.279214:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319864.279219:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319864.279232:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4761
00000100:00080000:1.0:1767319864.279239:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319864.279248:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319864.279279:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a4a80 x1853164379866368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319864.279304:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319864.279308:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319864.279311:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319864.279316:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4761
00000100:00080000:1.0:1767319864.279319:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319864.279324:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319864.279328:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319864.279342:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a5500 x1853164379866496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319864.279351:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379866240:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319864.279396:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319864.279401:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319864.279403:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319864.279407:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4761
00000100:00080000:1.0:1767319864.279409:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767319864.279414:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319864.279427:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a4700 x1853164379867008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767319864.279451:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767319864.279456:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767319864.279459:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767319864.279464:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4761
00000100:00080000:1.0:1767319864.279467:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767319864.279473:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319864.279478:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767319864.279492:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a5f80 x1853164379867264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319864.279520:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379866880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319864.279564:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379866624:0@lo:400:kworker.0
00000100:00100000:1.0:1767319864.279569:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319864.279605:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319864.279605:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319864.279615:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379866752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319864.279647:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319864.279647:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319864.279657:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379867136:0@lo:400:kworker.0
00000100:00100000:1.0:1767319864.279687:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379866880
00000100:00100000:3.0:1767319864.279687:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319864.279698:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379866880
00000100:00100000:3.0:1767319864.279755:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379866624
00000100:00100000:3.0:1767319864.279761:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379866624
00000100:00100000:1.0:1767319864.279781:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379867136
00000100:00100000:1.0:1767319864.279786:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379867136
00000100:00100000:3.0:1767319864.279815:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379866752
00000100:00100000:1.0:1767319864.279820:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4500
00000100:00100000:3.0:1767319864.279822:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379866752
00000100:00100000:1.0:1767319864.279832:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379866880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319864.279858:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667
00000100:00100000:3.0:1767319864.279897:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379866624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319864.279917:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379866880:12345-0@lo:400:kworker.0 Request processed in 86us (349us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319864.279925:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4500
00000100:00100000:3.0:1767319864.279947:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379866624:12345-0@lo:400:kworker.0 Request processed in 80us (342us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319864.279953:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4501
00000100:00100000:3.0:1767319864.279960:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667
00000100:00100000:1.0:1767319864.279965:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379867136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319864.279982:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668
00000100:00100000:3.0:1767319864.279992:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379866752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319864.280001:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379867136:12345-0@lo:400:kworker.0 Request processed in 38us (312us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319864.280007:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4501
00000100:00100000:3.0:1767319864.280033:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379866752:12345-0@lo:400:kworker.0 Request processed in 42us (385us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319864.280040:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668
00000100:00100000:1.0:1767319864.280055:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379866752:0@lo:400:kworker.0
00000100:00100000:1.0:1767319864.280068:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379866880:0@lo:400:kworker.0
00000100:00100000:3.0:1767319864.280093:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379867136:0@lo:400:kworker.0
00000100:00100000:3.0:1767319864.280107:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379866624:0@lo:400:kworker.0
00000100:00080000:2.0:1767319864.280197:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319864.280203:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319864.280206:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319864.280214:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379866368:0@lo:38:kworker.0
00000100:00100000:2.0:1767319864.280222:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379866240
00000100:00100000:2.0:1767319864.280227:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379866240
00000100:00100000:0.0:1767319864.280255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319864.280267:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452
00000100:00100000:2.0:1767319864.280277:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379866240:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319864.280286:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379866496:0@lo:38:kworker.0
00002000:00000024:2.0:1767319864.280305:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319864.280316:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319864.280349:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379867008:0@lo:38:kworker.0
00000100:00100000:2.0:1767319864.280363:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379866240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (893us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319864.280371:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452
00000100:00100000:0.0:1767319864.280377:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319864.280396:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379866496
00000100:00100000:0.0:1767319864.280398:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379867264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319864.280401:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379866496
00000100:00100000:0.0:1767319864.280426:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319864.280435:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65
00000100:00100000:2.0:1767319864.280442:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379866496:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767319864.280457:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379866368
00000100:00100000:0.0:1767319864.280462:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379866368
00010000:00020000:2.0:1767319864.280466:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319864.280487:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379867008
00000100:00100000:0.0:1767319864.280491:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379867008
00000100:00100000:0.0:1767319864.280511:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379867264
00000100:00100000:2.0:1767319864.280511:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379866496:12345-0@lo:38:kworker.0 Request processed in 66us (193us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319864.280515:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379867264
00000100:00100000:2.0:1767319864.280522:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65
00000100:00100000:0.0:1767319864.280536:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17302
00000100:00100000:0.0:1767319864.280543:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379866368:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319864.280554:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17303
00010000:00020000:0.0:1767319864.280556:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319864.280563:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379867008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319864.280574:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319864.280589:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379866368:12345-0@lo:38:kworker.0 Request processed in 45us (334us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319864.280597:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17302
00000100:00100000:2.0:1767319864.280613:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379867008:12345-0@lo:38:kworker.0 Request processed in 48us (235us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319864.280618:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17304
00000100:00100000:0.0:1767319864.280640:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379867264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319864.280650:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319864.280676:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379867264:12345-0@lo:38:kworker.0 Request processed in 35us (250us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319864.280710:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379866240:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319864.282742:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319864.282756:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319864.282762:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379866368:0@lo:38:kworker.0
00000100:00080000:3.0:1767319864.282781:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319864.282785:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319864.282788:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379866496:0@lo:38:kworker.0
00000100:00080000:3.0:1767319864.282800:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319864.282816:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319864.282819:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379867008:0@lo:38:kworker.0
00000100:00080000:3.0:1767319864.282832:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319864.282836:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319864.282840:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379867264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319864.285199:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17303
00000100:00100000:0.0:1767319864.285475:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17304
00010000:00010000:3.0:1767319864.793690:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319865.815079:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319865.815959:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379867392:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319865.816076:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319865.816366:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379867392
00000100:00100000:1.0:1767319865.816378:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379867392
00000100:00100000:1.0:1767319865.816454:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453
00000100:00100000:1.0:1767319865.816464:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379867392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319865.816505:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319865.816739:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379867392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 276us (661us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319865.816747:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453
00000100:00100000:3.0:1767319865.821038:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379867392:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319866.839416:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319867.865444:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319868.376786:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319843/real 1767319843]  req@ffff8b0f2f288a80 x1853164379860992/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319868 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319868.376835:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f288a80 x1853164379860992/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319868 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767319868.376851:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319868.376920:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319868.376925:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379860992:0@lo:250:kworker.0
00000100:00080000:2.0:1767319868.376988:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319868.376995:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319868.376999:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319868.377005:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4746
00000100:00080000:2.0:1767319868.377011:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319868.377021:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319868.377069:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199f80 x1853164379867520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319868.377138:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379867520:0@lo:250:kworker.0
00000400:00000100:0.0:1767319868.377211:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379867520 offset 0 length 520: 4
00000100:00080000:2.0:1767319868.377283:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319868.377287:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319868.377289:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319868.377293:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4766
00000100:00080000:2.0:1767319868.377296:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319868.377300:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319868.377320:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198000 x1853164379867648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319868.377702:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379867648:0@lo:38:kworker.0
00000100:00100000:0.0:1767319868.377752:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319868.378017:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379867648
00000100:00100000:1.0:1767319868.378028:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379867648
00000100:00100000:1.0:1767319868.378103:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17305
00000100:00100000:1.0:1767319868.378114:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379867648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319868.378143:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319868.378207:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379867648:12345-0@lo:38:kworker.0 Request processed in 93us (454us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319868.378216:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17305
00000100:00080000:0.0:1767319868.378308:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319868.378315:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319868.378319:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379867648:0@lo:38:kworker.0
00000100:00080000:2.0:1767319868.378628:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319868.378633:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319868.378636:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319868.378642:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4766
00000100:00080000:2.0:1767319868.378646:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319868.378651:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319868.378814:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819a680 x1853164379867776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319868.379006:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379867776:0@lo:38:kworker.0
00000100:00100000:0.0:1767319868.379053:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319868.379181:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319868.379185:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319868.379187:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319868.379192:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4766
00000100:00080000:2.0:1767319868.379195:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319868.379201:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319868.379217:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198a80 x1853164379868288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319868.379269:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379868032:0@lo:400:kworker.0
00000100:00100000:1.0:1767319868.379303:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319868.379328:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319868.379333:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379867904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319868.379369:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319868.379635:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379867776
00000100:00100000:3.0:1767319868.379644:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379867776
00000100:00100000:3.0:1767319868.379711:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66
00000100:00100000:3.0:1767319868.379719:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379867776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319868.379738:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319868.379845:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868032
00000100:00100000:1.0:1767319868.379849:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868032
00000100:00100000:1.0:1767319868.379934:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669
00000100:00100000:1.0:1767319868.379944:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379868032:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319868.380000:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379868032:12345-0@lo:400:kworker.0 Request processed in 58us (695us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319868.380007:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669
00000100:00100000:1.0:1767319868.380026:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379867904
00000100:00100000:1.0:1767319868.380029:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379867904
00000100:00100000:1.0:1767319868.380055:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670
00000100:00100000:1.0:1767319868.380061:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379867904:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319868.380091:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379867904:12345-0@lo:400:kworker.0 Request processed in 30us (722us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319868.380096:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670
00000100:00100000:1.0:1767319868.380113:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319868.380123:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379868160:0@lo:400:kworker.0
00000100:00100000:1.0:1767319868.380167:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319868.380218:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379867904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319868.380227:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379868032:0@lo:400:kworker.0
00000100:00080000:1.0:1767319868.380286:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319868.380292:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319868.380315:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868160
00000100:00100000:1.0:1767319868.380319:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868160
00000100:00100000:1.0:1767319868.380367:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4502
00000100:00100000:1.0:1767319868.380374:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379868160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319868.380412:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379868160:12345-0@lo:400:kworker.0 Request processed in 39us (244us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319868.380418:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4502
00000100:00080000:1.0:1767319868.380435:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319868.380453:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379868160:0@lo:400:kworker.0
00000100:00100000:0.0:1767319868.381413:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379868288:0@lo:38:kworker.0
00000100:00100000:0.0:1767319868.381475:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319868.381619:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319868.381625:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319868.381630:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319868.381636:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4766
00000100:00080000:2.0:1767319868.381642:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319868.381650:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319868.381703:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198e00 x1853164379868544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319868.381746:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379868416:0@lo:400:kworker.0
00000100:00100000:2.0:1767319868.381779:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319868.381819:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868288
00000100:00100000:2.0:1767319868.381825:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868288
00000100:00100000:2.0:1767319868.381860:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868416
00000100:00100000:2.0:1767319868.381893:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868416
00000100:00100000:1.0:1767319868.381911:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17306
00000100:00100000:1.0:1767319868.381919:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379868288:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319868.381933:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4503
00000100:00100000:2.0:1767319868.381938:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379868416:12345-0@lo:400:kworker.0
00010000:00020000:1.0:1767319868.381940:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319868.381979:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379868288:12345-0@lo:38:kworker.0 Request processed in 59us (504us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319868.381980:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379868416:12345-0@lo:400:kworker.0 Request processed in 42us (201us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319868.381987:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4503
00000100:00100000:1.0:1767319868.381992:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17306
00000100:00080000:2.0:1767319868.382009:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319868.382039:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379868416:0@lo:400:kworker.0
00000100:00100000:3.0:1767319868.382513:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379867776:12345-0@lo:38:kworker.0 Request processed in 2787us (3453us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319868.382525:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66
00000100:00080000:0.0:1767319868.382631:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319868.382638:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319868.382642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379867776:0@lo:38:kworker.0
00000100:00100000:0.0:1767319868.382663:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379868544:0@lo:38:kworker.0
00000100:00100000:0.0:1767319868.382788:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319868.382914:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319868.382919:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319868.382922:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379868288:0@lo:38:kworker.0
00000100:00100000:1.0:1767319868.383038:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868544
00000100:00100000:1.0:1767319868.383045:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868544
00000100:00100000:1.0:1767319868.383085:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17307
00000100:00100000:1.0:1767319868.383090:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379868544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319868.383108:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319868.383294:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379868544:12345-0@lo:38:kworker.0 Request processed in 202us (505us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319868.383302:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17307
00000100:00080000:0.0:1767319868.383395:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319868.383400:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319868.383403:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379868544:0@lo:38:kworker.0
00010000:00010000:3.0:1767319868.887696:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319869.329182:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319869.329238:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319869.329491:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291941760
00000100:00100000:1.0:1767319869.329501:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291941760
00000100:00100000:1.0:1767319869.329548:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291941888
00000100:00100000:1.0:1767319869.329551:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291941888
00000100:00100000:1.0:1767319869.329590:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4504
00000100:00100000:1.0:1767319869.329601:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291941888:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319869.329703:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291941888:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 72us (431us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319869.329713:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4504
00000100:00100000:1.0:1767319869.329735:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17308
00000100:00100000:1.0:1767319869.329740:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291941760:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319869.329760:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319869.329787:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291941760:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (614us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319869.329793:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17308
00000100:00080000:2.0:1767319869.329937:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319869.400129:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379868672:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319869.400201:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319869.400327:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868672
00000100:00100000:2.0:1767319869.400345:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868672
00000100:00100000:2.0:1767319869.400431:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454
00000100:00100000:2.0:1767319869.400442:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379868672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319869.400484:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319869.405479:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379868672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5022us (5261us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319869.405501:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454
00000100:00100000:1.0:1767319869.408768:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379868672:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319869.913460:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319870.935475:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319870.935723:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319870.935753:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379868800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319870.935853:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319870.936035:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868800
00000100:00100000:1.0:1767319870.936045:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868800
00000100:00100000:1.0:1767319870.936122:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455
00000100:00100000:1.0:1767319870.936132:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379868800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319870.936178:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319870.936240:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379868800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (386us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319870.936248:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455
00000100:00100000:3.0:1767319870.936324:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379868800:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319870.936385:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319871.959195:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319872.983996:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319873.495120:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319873.495135:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319873.495138:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319873.495144:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319873.495150:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319873.495160:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4770
00000100:00080000:2.0:1767319873.495166:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319873.495175:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319873.495234:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198380 x1853164379868928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319873.495268:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319873.495272:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319873.495274:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319873.495278:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4770
00000100:00080000:2.0:1767319873.495281:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319873.495285:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319873.495302:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198000 x1853164379869056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319873.495402:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379869184:0@lo:400:kworker.0
00000100:00100000:1.0:1767319873.495511:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319873.495720:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869184
00000100:00100000:3.0:1767319873.495738:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869184
00000100:00100000:3.0:1767319873.495816:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671
00000100:00100000:3.0:1767319873.495825:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379869184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319873.496079:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379868928:0@lo:38:kworker.0
00000100:00100000:0.0:1767319873.496130:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319873.496163:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379869056:0@lo:38:kworker.0
00000100:00100000:0.0:1767319873.496190:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319873.496241:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379868928
00000100:00100000:0.0:1767319873.496249:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379868928
00000100:00100000:0.0:1767319873.496290:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17309
00000100:00100000:0.0:1767319873.496297:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379868928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319873.496324:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319873.496369:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379868928:12345-0@lo:38:kworker.0 Request processed in 70us (237us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319873.496378:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17309
00000100:00080000:0.0:1767319873.496461:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319873.496468:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319873.496472:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379868928:0@lo:38:kworker.0
00000100:00100000:0.0:1767319873.496531:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869056
00000100:00100000:0.0:1767319873.496535:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869056
00000100:00100000:0.0:1767319873.496558:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67
00000100:00100000:0.0:1767319873.496563:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379869056:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319873.496574:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319873.496603:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379869056:12345-0@lo:38:kworker.0 Request processed in 39us (411us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319873.496608:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67
00000100:00080000:0.0:1767319873.496633:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319873.496658:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319873.496662:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379869056:0@lo:38:kworker.0
00000100:00080000:0.0:1767319873.496692:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319873.501135:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379869184:12345-0@lo:400:kworker.0 Request processed in 5299us (5612us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319873.501154:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671
00000100:00100000:3.0:1767319873.501261:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379869312:0@lo:400:kworker.0
00000100:00100000:3.0:1767319873.501719:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319873.501778:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319873.501786:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319873.501791:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319873.501801:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4770
00000100:00100000:3.0:1767319873.501809:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379869440:0@lo:400:kworker.0
00000100:00080000:2.0:1767319873.501811:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319873.501826:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319873.501854:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319873.501861:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819b800 x1853164379869568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319873.501942:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319873.501942:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379869696:0@lo:400:kworker.0
00000100:00080000:2.0:1767319873.501961:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319873.501964:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319873.501971:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4770
00000100:00080000:2.0:1767319873.501975:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767319873.501987:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319873.501989:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319873.502013:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199880 x1853164379869824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319873.502051:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379869568:0@lo:38:kworker.0
00000100:00100000:3.0:1767319873.502088:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319873.502109:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379869824:0@lo:38:kworker.0
00000100:00100000:2.0:1767319873.502122:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869440
00000100:00100000:2.0:1767319873.502134:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869440
00000100:00100000:3.0:1767319873.502134:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319873.502195:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319873.502226:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869696
00000100:00100000:3.0:1767319873.502232:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869568
00000100:00100000:2.0:1767319873.502234:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869696
00000100:00100000:3.0:1767319873.502242:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869568
00000100:00100000:3.0:1767319873.502279:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869824
00000100:00100000:3.0:1767319873.502282:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869824
00000100:00100000:1.0:1767319873.503119:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379869184:0@lo:400:kworker.0
00000100:00100000:2.0:1767319873.507931:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4505
00000100:00100000:2.0:1767319873.507979:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379869440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319873.508147:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379869440:12345-0@lo:400:kworker.0 Request processed in 194us (6293us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319873.508156:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4505
00000100:00100000:2.0:1767319873.508185:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4506
00000100:00100000:2.0:1767319873.508194:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379869696:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319873.508243:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379869696:12345-0@lo:400:kworker.0 Request processed in 50us (6266us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319873.508249:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4506
00000100:00100000:2.0:1767319873.508265:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17310
00000100:00100000:2.0:1767319873.508270:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379869568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319873.508298:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319873.508341:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379869568:12345-0@lo:38:kworker.0 Request processed in 69us (6253us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319873.508348:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17310
00000100:00100000:2.0:1767319873.508363:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17311
00000100:00100000:2.0:1767319873.508369:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379869824:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319873.508380:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319873.508408:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379869824:12345-0@lo:38:kworker.0 Request processed in 38us (6274us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319873.508414:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17311
00000100:00080000:2.0:1767319873.508443:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319873.508509:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379869696:0@lo:400:kworker.0
00000100:00100000:2.0:1767319873.508573:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379869440:0@lo:400:kworker.0
00000100:00080000:2.0:1767319873.508608:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319873.508614:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319873.508617:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379869568:0@lo:38:kworker.0
00000100:00080000:2.0:1767319873.508628:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319873.508632:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319873.508646:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379869824:0@lo:38:kworker.0
00000100:00100000:3.0:1767319873.508849:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869312
00000100:00100000:3.0:1767319873.508982:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869312
00000100:00100000:3.0:1767319873.509067:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672
00000100:00100000:3.0:1767319873.509079:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379869312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319873.509190:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379869312:12345-0@lo:400:kworker.0 Request processed in 114us (7472us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319873.509197:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672
00000100:00100000:3.0:1767319873.509281:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379869312:0@lo:400:kworker.0
00000100:00080000:0.0:1767319873.509298:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767319874.009032:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319874.448402:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319874.448556:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291942144
00000100:00100000:3.0:1767319874.448571:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291942144
00000100:00100000:3.0:1767319874.448940:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4507
00000100:00100000:3.0:1767319874.448956:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291942144:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767319874.449200:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319874.449622:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291942144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 667us (1235us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319874.449642:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4507
00000100:00100000:0.0:1767319874.449952:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319874.450098:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291942016
00000100:00100000:3.0:1767319874.450108:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291942016
00000100:00100000:3.0:1767319874.450149:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17312
00000100:00100000:3.0:1767319874.450156:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291942016:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319874.450184:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319874.450243:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291942016:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 86us (292us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319874.450251:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17312
00000100:00100000:3.0:1767319874.521647:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319874.521679:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379869952:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319874.521916:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319874.522041:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379869952
00000100:00100000:3.0:1767319874.523071:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379869952
00000100:00100000:3.0:1767319874.523903:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456
00000100:00100000:3.0:1767319874.523922:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379869952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319874.523968:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319874.524074:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379869952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (2158us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319874.524081:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456
00000100:00100000:1.0:1767319874.524214:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379869952:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319875.031823:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319876.055439:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319876.055998:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319876.056030:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379870080:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319876.056132:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319876.056821:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870080
00000100:00100000:0.0:1767319876.056835:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870080
00000100:00100000:0.0:1767319876.056966:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457
00000100:00100000:0.0:1767319876.056981:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379870080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319876.057027:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319876.057106:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379870080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (973us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319876.057116:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457
00000100:00100000:3.0:1767319876.057284:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379870080:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319876.057365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319877.079711:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319878.103478:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319878.615321:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319878.615337:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319878.615341:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319878.615347:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319878.615354:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319878.615365:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4775
00000100:00080000:0.0:1767319878.615372:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319878.615381:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319878.615841:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288700 x1853164379870208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319878.615901:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319878.615906:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319878.615908:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319878.615913:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4775
00000100:00080000:0.0:1767319878.615916:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319878.615920:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319878.615941:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164379870336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319878.616042:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379870208:0@lo:38:kworker.0
00000100:00100000:3.0:1767319878.616146:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319878.616389:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870208
00000100:00100000:1.0:1767319878.616411:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870208
00000100:00100000:1.0:1767319878.616475:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17313
00000100:00100000:1.0:1767319878.616485:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379870208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319878.616511:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319878.616569:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379870208:12345-0@lo:38:kworker.0 Request processed in 84us (422us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319878.616577:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17313
00000100:00080000:0.0:1767319878.616854:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319878.616857:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319878.616860:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319878.616864:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4775
00000100:00080000:0.0:1767319878.616892:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319878.616899:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319878.616914:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164379870848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319878.616932:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319878.616935:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319878.616937:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319878.616940:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4775
00000100:00080000:0.0:1767319878.616943:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319878.617009:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319878.617024:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebe680 x1853164379871104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319878.617119:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379870464:0@lo:400:kworker.0
00000100:00100000:2.0:1767319878.617181:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319878.617228:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319878.617235:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379870592:0@lo:400:kworker.0
00000100:00100000:2.0:1767319878.617257:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319878.617395:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870464
00000100:00100000:0.0:1767319878.617448:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870464
00000100:00100000:3.0:1767319878.617585:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379870720:0@lo:400:kworker.0
00000100:00100000:3.0:1767319878.617630:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319878.617664:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319878.617670:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379870976:0@lo:400:kworker.0
00000100:00100000:3.0:1767319878.617695:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319878.617728:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379870336:0@lo:38:kworker.0
00000100:00100000:3.0:1767319878.617757:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319878.617786:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379870848:0@lo:38:kworker.0
00000100:00100000:3.0:1767319878.617811:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319878.617827:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379871104:0@lo:38:kworker.0
00000100:00100000:3.0:1767319878.617847:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319878.617932:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319878.617938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319878.617942:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379870208:0@lo:38:kworker.0
00000100:00100000:0.0:1767319878.618080:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870592
00000100:00100000:0.0:1767319878.618085:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870592
00000100:00100000:0.0:1767319878.618106:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673
00000100:00100000:0.0:1767319878.618113:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379870464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319878.618230:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870720
00000100:00100000:3.0:1767319878.618235:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870720
00000100:00100000:3.0:1767319878.618266:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870976
00000100:00100000:3.0:1767319878.618270:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870976
00000100:00100000:3.0:1767319878.618287:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870848
00000100:00100000:3.0:1767319878.618289:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870848
00000100:00100000:3.0:1767319878.618296:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379871104
00000100:00100000:3.0:1767319878.618298:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379871104
00000100:00100000:3.0:1767319878.618306:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4508
00000100:00100000:3.0:1767319878.618312:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379870720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319878.618365:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379870720:12345-0@lo:400:kworker.0 Request processed in 52us (733us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319878.618373:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4508
00000100:00100000:3.0:1767319878.618388:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4509
00000100:00100000:3.0:1767319878.618394:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379870976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319878.618598:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17314
00000100:00100000:1.0:1767319878.618605:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379870848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319878.618625:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319878.618669:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379870848:12345-0@lo:38:kworker.0 Request processed in 63us (857us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319878.618676:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17314
00000100:00100000:1.0:1767319878.618691:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17315
00000100:00100000:1.0:1767319878.618695:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379871104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319878.618704:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319878.618729:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379871104:12345-0@lo:38:kworker.0 Request processed in 32us (881us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319878.618734:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17315
00000100:00100000:1.0:1767319878.618756:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674
00000100:00100000:1.0:1767319878.618764:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379870592:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319878.618808:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379870592:12345-0@lo:400:kworker.0 Request processed in 45us (1548us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319878.618814:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674
00000100:00100000:1.0:1767319878.618860:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379870592:0@lo:400:kworker.0
00000100:00100000:1.0:1767319878.618933:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379870336
00000100:00100000:1.0:1767319878.618938:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379870336
00000100:00100000:0.0:1767319878.619065:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379870464:12345-0@lo:400:kworker.0 Request processed in 950us (1882us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319878.619072:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673
00000100:00100000:0.0:1767319878.619103:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379870464:0@lo:400:kworker.0
00000100:00080000:2.0:1767319878.619243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319878.619249:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319878.619252:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319878.619295:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379870720:0@lo:400:kworker.0
00000100:00080000:2.0:1767319878.619326:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319878.619331:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319878.619334:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379870848:0@lo:38:kworker.0
00000100:00080000:2.0:1767319878.619344:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319878.619347:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319878.619351:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379871104:0@lo:38:kworker.0
00000100:00100000:3.0:1767319878.619919:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379870976:12345-0@lo:400:kworker.0 Request processed in 1524us (2222us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319878.619927:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4509
00000100:00100000:1.0:1767319878.620252:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68
00000100:00100000:1.0:1767319878.620259:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379870336:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319878.620274:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319878.620313:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379870336:12345-0@lo:38:kworker.0 Request processed in 53us (2554us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319878.620320:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68
00000100:00100000:2.0:1767319878.621357:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379870976:0@lo:400:kworker.0
00000100:00080000:2.0:1767319878.621567:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319878.621573:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319878.621576:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379870336:0@lo:38:kworker.0
00010000:00010000:3.0:1767319879.127599:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319879.569558:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319879.569623:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319879.569801:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291942400
00000100:00100000:2.0:1767319879.569814:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291942400
00000100:00100000:2.0:1767319879.569953:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291942272
00000100:00100000:2.0:1767319879.569957:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291942272
00000100:00100000:2.0:1767319879.569981:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4510
00000100:00100000:2.0:1767319879.569993:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291942400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319879.570093:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291942400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (551us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319879.570103:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4510
00000100:00100000:2.0:1767319879.570210:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17316
00000100:00100000:2.0:1767319879.570215:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291942272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319879.570244:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319879.570277:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291942272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (653us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319879.570284:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17316
00000100:00080000:0.0:1767319879.570365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319879.639502:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319879.639537:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379871232:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319879.639645:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319879.640128:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379871232
00000100:00100000:0.0:1767319879.640140:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379871232
00000100:00100000:0.0:1767319879.640205:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458
00000100:00100000:0.0:1767319879.640217:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379871232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319879.640257:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319879.640323:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379871232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (678us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319879.640332:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458
00000100:00100000:3.0:1767319879.641979:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379871232:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319880.151608:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319881.175225:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379871360:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319881.175299:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319881.175483:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379871360
00000100:00100000:0.0:1767319881.175491:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379871360
00000100:00100000:0.0:1767319881.175562:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459
00000100:00080000:1.0:1767319881.175726:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319881.175758:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379871360:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319881.175790:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319881.175849:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379871360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 247us (549us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319881.175857:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459
00000100:00100000:1.0:1767319881.175968:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379871360:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319881.177017:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319882.199420:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319883.223388:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767319883.743098:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319883.743115:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319883.743119:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319883.743124:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319883.743130:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319883.743141:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4781
00000100:00080000:0.0:1767319883.743147:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319883.743156:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319883.743213:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebfb80 x1853164379871488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319883.743235:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319883.743239:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319883.743242:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319883.743246:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4781
00000100:00080000:0.0:1767319883.743248:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319883.743252:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319883.743274:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164379871616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319883.743365:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319883.743370:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319883.743372:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319883.743376:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4781
00000100:00080000:0.0:1767319883.743379:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319883.743383:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319883.743427:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fdc00 x1853164379872128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319883.743446:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319883.743449:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319883.743451:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319883.743454:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4781
00000100:00080000:0.0:1767319883.743457:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319883.743462:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319883.743473:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083ff800 x1853164379872384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319883.743524:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379871872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319883.743629:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319883.743719:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319883.743726:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379871744:0@lo:400:kworker.0
00000100:00100000:0.0:1767319883.743753:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319883.743792:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379871872
00000100:00100000:0.0:1767319883.743802:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379871872
00000100:00100000:0.0:1767319883.743911:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379871744
00000100:00100000:0.0:1767319883.743926:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379871744
00000100:00100000:0.0:1767319883.743956:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675
00000100:00100000:0.0:1767319883.743966:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379871872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319883.744028:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379871872:12345-0@lo:400:kworker.0 Request processed in 62us (398us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319883.744036:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675
00000100:00100000:0.0:1767319883.744058:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676
00000100:00100000:0.0:1767319883.744065:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379871744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319883.744092:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379871744:12345-0@lo:400:kworker.0 Request processed in 28us (339us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319883.744098:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676
00000100:00100000:0.0:1767319883.744146:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379871744:0@lo:400:kworker.0
00000100:00100000:0.0:1767319883.744157:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379871872:0@lo:400:kworker.0
00000100:00100000:2.0:1767319883.744637:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379872000:0@lo:400:kworker.0
00000100:00100000:2.0:1767319883.744685:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319883.744719:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319883.744724:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379872256:0@lo:400:kworker.0
00000100:00100000:2.0:1767319883.744747:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319883.744778:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872000
00000100:00100000:2.0:1767319883.744783:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872000
00000100:00100000:2.0:1767319883.744831:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872256
00000100:00100000:2.0:1767319883.744834:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872256
00000100:00100000:2.0:1767319883.744860:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4511
00000100:00100000:2.0:1767319883.744894:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379872000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319883.744952:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379872000:12345-0@lo:400:kworker.0 Request processed in 85us (267us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319883.744959:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4511
00000100:00100000:2.0:1767319883.744975:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4512
00000100:00100000:2.0:1767319883.744981:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379872256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319883.745009:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379872256:12345-0@lo:400:kworker.0 Request processed in 29us (262us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319883.745015:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4512
00000100:00100000:2.0:1767319883.745057:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379872256:0@lo:400:kworker.0
00000100:00100000:2.0:1767319883.745071:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379872000:0@lo:400:kworker.0
00000100:00080000:1.0:1767319883.745306:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767319883.745324:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319883.745328:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319883.756653:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379871488:0@lo:38:kworker.0
00000100:00100000:3.0:1767319883.756786:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319883.756888:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379871616:0@lo:38:kworker.0
00000100:00100000:3.0:1767319883.757000:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319883.757048:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379872128:0@lo:38:kworker.0
00000100:00100000:3.0:1767319883.757076:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319883.757104:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379872384:0@lo:38:kworker.0
00000100:00100000:3.0:1767319883.757128:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319883.757275:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379871488
00000100:00100000:1.0:1767319883.757287:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379871488
00000100:00100000:1.0:1767319883.757349:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872128
00000100:00100000:1.0:1767319883.757353:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872128
00000100:00100000:1.0:1767319883.757372:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872384
00000100:00100000:1.0:1767319883.757375:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872384
00000100:00100000:1.0:1767319883.757406:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17317
00000100:00100000:1.0:1767319883.757417:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379871488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319883.757445:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319883.757502:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379871488:12345-0@lo:38:kworker.0 Request processed in 85us (715us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319883.757511:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17317
00000100:00100000:1.0:1767319883.757536:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17318
00000100:00100000:1.0:1767319883.757550:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379872128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319883.757561:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319883.757584:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379872128:12345-0@lo:38:kworker.0 Request processed in 42us (507us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319883.757590:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17318
00000100:00100000:1.0:1767319883.757602:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17319
00000100:00100000:1.0:1767319883.757606:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379872384:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319883.757614:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319883.757636:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379872384:12345-0@lo:38:kworker.0 Request processed in 29us (508us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319883.757642:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17319
00000100:00080000:3.0:1767319883.758078:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319883.758087:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319883.758093:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379871488:0@lo:38:kworker.0
00000100:00080000:3.0:1767319883.758106:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319883.758109:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319883.758111:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379872128:0@lo:38:kworker.0
00000100:00080000:3.0:1767319883.758119:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319883.758122:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319883.758125:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379872384:0@lo:38:kworker.0
00000100:00100000:0.0:1767319883.759307:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379871616
00000100:00100000:0.0:1767319883.759323:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379871616
00000100:00100000:0.0:1767319883.759386:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69
00000100:00100000:0.0:1767319883.759396:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379871616:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319883.759419:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319883.759509:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379871616:12345-0@lo:38:kworker.0 Request processed in 114us (2508us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319883.759517:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69
00000100:00080000:3.0:1767319883.760556:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319883.760566:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319883.760571:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379871616:0@lo:38:kworker.0
00010000:00010000:1.0:1767319884.256200:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319884.688295:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319884.688344:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319884.688695:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291942656
00000100:00100000:3.0:1767319884.688709:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291942656
00000100:00100000:3.0:1767319884.688809:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291942528
00000100:00100000:3.0:1767319884.688813:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291942528
00000100:00100000:3.0:1767319884.688842:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4513
00000100:00100000:3.0:1767319884.688855:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291942656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319884.688991:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291942656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 137us (721us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319884.688999:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4513
00000100:00100000:3.0:1767319884.689019:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17320
00000100:00100000:3.0:1767319884.689038:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291942528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319884.689061:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319884.689088:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291942528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (743us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319884.689098:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17320
00000100:00080000:1.0:1767319884.689658:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319884.759287:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319884.759311:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379872512:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319884.759382:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319884.759657:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872512
00000100:00100000:3.0:1767319884.759664:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872512
00000100:00100000:3.0:1767319884.759706:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460
00000100:00100000:3.0:1767319884.759711:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379872512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319884.759739:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319884.759798:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379872512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (414us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319884.759806:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460
00000100:00100000:1.0:1767319884.761383:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379872512:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319885.278300:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319886.295415:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319886.295440:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379872640:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319886.295514:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319886.295960:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872640
00000100:00100000:1.0:1767319886.295969:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872640
00000100:00100000:1.0:1767319886.296047:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461
00000100:00100000:1.0:1767319886.296057:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379872640:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319886.296087:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319886.296135:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379872640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319886.296142:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461
00000100:00080000:3.0:1767319886.296485:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319886.296544:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379872640:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767319886.297173:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319887.319996:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319888.343150:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767319888.790634:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291942784 offset 0 length 520: 4
00000100:00100000:0.0:1767319888.790678:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319888.790720:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319888.794308:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291942912
00000100:00100000:3.0:1767319888.794324:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291942912
00000100:00100000:3.0:1767319888.794386:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943040
00000100:00100000:3.0:1767319888.794390:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943040
00000100:00100000:1.0:1767319888.794525:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17321
00000100:00100000:1.0:1767319888.794538:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291942912:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319888.794565:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319888.794641:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291942912:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 104us (3962us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319888.794648:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17321
00000100:00100000:3.0:1767319888.795297:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4514
00000100:00100000:3.0:1767319888.795307:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291943040:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319888.795363:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291943040:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 58us (4641us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319888.795370:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4514
00000100:00080000:0.0:1767319888.796333:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319888.856084:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319888.856095:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319888.856098:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319888.856102:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319888.856106:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319888.856115:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4786
00000100:00080000:2.0:1767319888.856119:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319888.856125:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319888.856170:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819a300 x1853164379872768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319888.856187:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319888.856191:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319888.856192:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319888.856196:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4786
00000100:00080000:2.0:1767319888.856199:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319888.856202:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319888.856213:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198000 x1853164379872896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319888.856264:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319888.856268:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319888.856269:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319888.856273:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4786
00000100:00080000:2.0:1767319888.856276:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319888.856279:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319888.856288:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819a680 x1853164379873408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319888.856317:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319888.856320:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319888.856322:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319888.856325:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4786
00000100:00080000:2.0:1767319888.856327:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319888.856331:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319888.856339:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379a680 x1853164379873664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319888.856365:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379873152:0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.856433:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319888.856507:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319888.856514:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379873024:0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.856537:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319888.856562:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379873536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.856592:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319888.856612:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319888.856617:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379873280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.856638:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319888.856670:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873152
00000100:00100000:2.0:1767319888.856677:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873152
00000100:00100000:2.0:1767319888.856734:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873024
00000100:00100000:2.0:1767319888.856738:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873024
00000100:00100000:2.0:1767319888.856764:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677
00000100:00100000:2.0:1767319888.856773:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379873152:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.856824:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379873152:12345-0@lo:400:kworker.0 Request processed in 52us (391us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319888.856832:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677
00000100:00100000:2.0:1767319888.856849:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678
00000100:00100000:2.0:1767319888.856856:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379873024:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.856919:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379873024:12345-0@lo:400:kworker.0 Request processed in 63us (380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319888.856925:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678
00000100:00100000:2.0:1767319888.856956:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873536
00000100:00100000:2.0:1767319888.856960:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873536
00000100:00100000:2.0:1767319888.856983:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873280
00000100:00100000:2.0:1767319888.856986:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873280
00000100:00100000:2.0:1767319888.857004:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4515
00000100:00100000:2.0:1767319888.857010:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379873536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.857044:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379873536:12345-0@lo:400:kworker.0 Request processed in 34us (450us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319888.857050:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4515
00000100:00100000:2.0:1767319888.858058:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4516
00000100:00100000:2.0:1767319888.858067:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379873280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.858106:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379873280:12345-0@lo:400:kworker.0 Request processed in 41us (1467us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319888.858112:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4516
00000100:00100000:2.0:1767319888.858154:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379873280:0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.858165:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379873536:0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.858195:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379873024:0@lo:400:kworker.0
00000100:00100000:2.0:1767319888.858203:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379873152:0@lo:400:kworker.0
00000100:00080000:0.0:1767319888.858470:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319888.858475:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319888.858478:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319888.858724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379872768:0@lo:38:kworker.0
00000100:00100000:3.0:1767319888.858763:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319888.858800:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379872896:0@lo:38:kworker.0
00000100:00100000:3.0:1767319888.858825:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319888.858856:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379873408:0@lo:38:kworker.0
00000100:00100000:3.0:1767319888.858902:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319888.858921:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379873664:0@lo:38:kworker.0
00000100:00100000:3.0:1767319888.858940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319888.858976:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872768
00000100:00100000:3.0:1767319888.858988:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872768
00000100:00100000:3.0:1767319888.859015:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873408
00000100:00100000:3.0:1767319888.859018:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873408
00000100:00100000:3.0:1767319888.859026:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873664
00000100:00100000:3.0:1767319888.859029:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873664
00000100:00100000:3.0:1767319888.859039:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17322
00000100:00100000:3.0:1767319888.859044:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379872768:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319888.859064:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319888.859103:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379872768:12345-0@lo:38:kworker.0 Request processed in 57us (338us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319888.859109:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17322
00000100:00100000:3.0:1767319888.859122:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17323
00000100:00100000:3.0:1767319888.859126:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379873408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319888.859135:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319888.859439:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379873408:12345-0@lo:38:kworker.0 Request processed in 309us (535us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319888.859447:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17323
00000100:00100000:3.0:1767319888.859460:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17324
00000100:00100000:3.0:1767319888.859464:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379873664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319888.859474:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319888.859512:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379873664:12345-0@lo:38:kworker.0 Request processed in 45us (569us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319888.859517:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17324
00000100:00100000:3.0:1767319888.859548:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379872896
00000100:00100000:3.0:1767319888.859551:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379872896
00000100:00100000:3.0:1767319888.859571:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70
00000100:00100000:3.0:1767319888.859578:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379872896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319888.859587:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319888.859616:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379872896:12345-0@lo:38:kworker.0 Request processed in 38us (791us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319888.859622:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70
00000100:00080000:3.0:1767319888.859660:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319888.859665:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319888.859669:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379872768:0@lo:38:kworker.0
00000100:00080000:3.0:1767319888.859678:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319888.859682:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319888.859684:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379872896:0@lo:38:kworker.0
00000100:00080000:3.0:1767319888.859692:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319888.859695:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319888.859697:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379873408:0@lo:38:kworker.0
00000100:00080000:3.0:1767319888.859705:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319888.859708:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319888.859711:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379873664:0@lo:38:kworker.0
00010000:00010000:3.0:1767319889.367862:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319889.884818:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379873792:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319889.884939:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319889.885184:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873792
00000100:00100000:1.0:1767319889.885194:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873792
00000100:00100000:1.0:1767319889.885252:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462
00000100:00100000:1.0:1767319889.885262:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379873792:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319889.885305:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319889.885368:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379873792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319889.885376:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462
00000100:00100000:3.0:1767319889.885741:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379873792:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767319890.391143:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319891.415967:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379873920:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319891.416063:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319891.416329:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379873920
00000100:00100000:1.0:1767319891.416337:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379873920
00000100:00100000:1.0:1767319891.416403:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463
00000100:00100000:1.0:1767319891.416413:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379873920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319891.416444:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319891.416516:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379873920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (453us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319891.416524:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463
00000100:00100000:1.0:1767319891.416572:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379873920:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319891.416732:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319891.416894:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319892.439684:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319893.463535:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319893.908781:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319893.908914:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319893.909057:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943296
00000100:00100000:2.0:1767319893.909071:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943296
00000100:00100000:2.0:1767319893.909178:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943168
00000100:00100000:2.0:1767319893.909182:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943168
00000100:00100000:2.0:1767319893.909211:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4517
00000100:00100000:2.0:1767319893.909224:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291943296:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319893.910446:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17325
00000100:00100000:1.0:1767319893.910471:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291943168:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319893.910547:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767319893.911285:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319893.918861:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291943168:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 8369us (9975us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319893.918895:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17325
00000100:00100000:2.0:1767319893.919987:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291943296:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 10759us (11222us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319893.919999:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4517
00000100:00080000:2.0:1767319893.975038:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319893.975051:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319893.975054:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319893.975059:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319893.975064:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319893.975074:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4791
00000100:00080000:2.0:1767319893.975081:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319893.975089:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319893.975141:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798a80 x1853164379874048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319893.975177:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319893.975182:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319893.975183:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319893.975188:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4791
00000100:00080000:2.0:1767319893.975190:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319893.975194:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319893.975210:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799500 x1853164379874176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319893.975295:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319893.975299:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319893.975301:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319893.975305:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4791
00000100:00080000:2.0:1767319893.975308:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319893.975312:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319893.975323:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798700 x1853164379874688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319893.975406:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319893.975410:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319893.975412:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319893.975426:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4791
00000100:00080000:2.0:1767319893.975429:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319893.975433:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319893.975445:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799f80 x1853164379874944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319893.975505:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379874560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319893.975580:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319893.975645:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319893.975651:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379874816:0@lo:400:kworker.0
00000100:00100000:2.0:1767319893.975674:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319893.975708:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874560
00000100:00100000:2.0:1767319893.975716:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874560
00000100:00100000:2.0:1767319893.975768:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874816
00000100:00100000:2.0:1767319893.975771:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874816
00000100:00100000:2.0:1767319893.975793:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4518
00000100:00100000:2.0:1767319893.975802:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379874560:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319893.975860:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379874560:12345-0@lo:400:kworker.0 Request processed in 59us (280us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319893.975893:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4518
00000100:00100000:2.0:1767319893.975934:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379874560:0@lo:400:kworker.0
00000100:00100000:2.0:1767319893.975956:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4519
00000100:00100000:2.0:1767319893.975961:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379874816:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319893.975991:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379874816:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319893.975997:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4519
00000100:00100000:2.0:1767319893.976018:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379874816:0@lo:400:kworker.0
00000100:00100000:0.0:1767319893.976126:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319868/real 1767319868]  req@ffff8b0f38199f80 x1853164379867520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319893 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319893.976144:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f38199f80 x1853164379867520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319893 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767319893.976156:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379874048:0@lo:38:kworker.0
00000100:00100000:0.0:1767319893.976182:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319893.976211:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379874176:0@lo:38:kworker.0
00000100:00100000:0.0:1767319893.976236:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319893.976257:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379874688:0@lo:38:kworker.0
00000100:00100000:0.0:1767319893.976276:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319893.976293:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379874944:0@lo:38:kworker.0
00000100:00100000:0.0:1767319893.976311:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319893.976327:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319893.976341:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767319893.976344:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379867520:0@lo:250:kworker.0
00000100:00080000:0.0:1767319893.976365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319893.976381:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874176
00000100:00100000:0.0:1767319893.976385:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874176
00000100:00100000:0.0:1767319893.976411:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71
00000100:00100000:0.0:1767319893.976416:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379874176:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319893.976437:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319893.976487:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379874176:12345-0@lo:38:kworker.0 Request processed in 69us (250us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319893.976493:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71
00000100:00100000:0.0:1767319893.976513:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874048
00000100:00100000:0.0:1767319893.976516:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874048
00000100:00100000:0.0:1767319893.976529:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874688
00000100:00100000:0.0:1767319893.976532:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874688
00000100:00100000:0.0:1767319893.976538:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874944
00000100:00100000:0.0:1767319893.976540:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874944
00000100:00100000:0.0:1767319893.976549:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17326
00000100:00100000:0.0:1767319893.976553:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379874048:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319893.976562:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319893.976584:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379874048:12345-0@lo:38:kworker.0 Request processed in 30us (402us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319893.976590:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17326
00000100:00100000:0.0:1767319893.976600:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17327
00000100:00100000:0.0:1767319893.976605:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379874688:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319893.976613:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319893.976632:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379874688:12345-0@lo:38:kworker.0 Request processed in 26us (355us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319893.976637:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17327
00000100:00100000:0.0:1767319893.976647:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17328
00000100:00100000:0.0:1767319893.976650:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379874944:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319893.976658:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319893.976678:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379874944:12345-0@lo:38:kworker.0 Request processed in 26us (366us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319893.976682:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17328
00000100:00080000:0.0:1767319893.976714:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319893.976717:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319893.976720:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379874048:0@lo:38:kworker.0
00000100:00080000:0.0:1767319893.976728:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319893.976731:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319893.976734:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379874176:0@lo:38:kworker.0
00000100:00080000:0.0:1767319893.976741:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319893.976745:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319893.976747:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379874688:0@lo:38:kworker.0
00000100:00080000:0.0:1767319893.976753:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319893.976756:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319893.976758:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379874944:0@lo:38:kworker.0
00000100:00080000:0.0:1767319893.976779:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319893.976783:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319893.976785:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319893.976789:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4770
00000100:00080000:0.0:1767319893.976792:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319893.976796:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319893.976814:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fd500 x1853164379875072/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319893.976841:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379875072:0@lo:250:kworker.0
00000400:00000100:0.0:1767319893.976861:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379875072 offset 0 length 520: 4
00000100:00100000:1.0:1767319893.976993:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379874432:0@lo:400:kworker.0
00000100:00100000:1.0:1767319893.977025:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319893.977056:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319893.977062:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379874304:0@lo:400:kworker.0
00000100:00100000:1.0:1767319893.977083:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319893.977111:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874432
00000100:00100000:1.0:1767319893.977115:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874432
00000100:00100000:1.0:1767319893.977177:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379874304
00000100:00100000:1.0:1767319893.977180:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379874304
00000100:00100000:1.0:1767319893.977217:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679
00000100:00100000:1.0:1767319893.977223:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379874432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319893.977262:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379874432:12345-0@lo:400:kworker.0 Request processed in 39us (236us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319893.977269:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679
00000100:00100000:1.0:1767319893.977286:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680
00000100:00100000:1.0:1767319893.977292:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379874304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319893.977320:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379874304:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319893.977326:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680
00000100:00080000:1.0:1767319893.977349:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319893.977352:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319893.977371:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379874304:0@lo:400:kworker.0
00000100:00100000:1.0:1767319893.977380:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379874432:0@lo:400:kworker.0
00010000:00010000:3.0:1767319894.487307:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319894.999210:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379875200:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319894.999279:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319894.999473:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379875200
00000100:00100000:2.0:1767319894.999486:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379875200
00000100:00100000:2.0:1767319894.999549:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464
00000100:00100000:2.0:1767319894.999564:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379875200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319894.999603:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319894.999676:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379875200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (396us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319894.999685:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464
00000100:00100000:0.0:1767319894.999735:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379875200:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319895.511659:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319896.535352:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319896.535990:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319896.538101:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379875328:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319896.538209:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319896.538358:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379875328
00000100:00100000:2.0:1767319896.538367:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379875328
00000100:00100000:2.0:1767319896.538448:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465
00000100:00100000:2.0:1767319896.538458:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379875328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319896.538490:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319896.538538:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379875328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (328us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319896.538546:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465
00000100:00100000:3.0:1767319896.538729:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379875328:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767319896.538895:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319897.560513:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319898.583330:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319899.031274:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319899.031363:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319899.031751:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943552
00000100:00100000:2.0:1767319899.031762:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943552
00000100:00100000:2.0:1767319899.031857:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943424
00000100:00100000:2.0:1767319899.031861:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943424
00000100:00100000:2.0:1767319899.031922:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4520
00000100:00100000:2.0:1767319899.031934:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291943552:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319899.032011:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291943552:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (748us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319899.032020:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4520
00000100:00100000:2.0:1767319899.032051:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17329
00000100:00100000:2.0:1767319899.032056:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291943424:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319899.032094:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319899.032123:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291943424:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 65us (759us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319899.032130:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17329
00000100:00080000:1.0:1767319899.032254:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319899.095199:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319899.095212:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319899.095216:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319899.095220:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319899.095225:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319899.095233:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4796
00000100:00080000:3.0:1767319899.095239:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319899.095246:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319899.095303:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448e00 x1853164379875456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319899.095384:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379875456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319899.095501:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319899.095795:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379875456
00000100:00100000:2.0:1767319899.095803:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379875456
00000100:00100000:2.0:1767319899.095847:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17330
00000100:00100000:2.0:1767319899.095853:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379875456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319899.095888:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319899.096229:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319899.096233:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319899.096235:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319899.096239:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4796
00000100:00080000:3.0:1767319899.096241:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319899.096244:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319899.096262:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448700 x1853164379875584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319899.096310:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379875584:0@lo:38:kworker.0
00000100:00100000:1.0:1767319899.096347:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319899.096419:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379875584
00000100:00100000:0.0:1767319899.096425:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379875584
00000100:00100000:0.0:1767319899.097691:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72
00000100:00100000:0.0:1767319899.097703:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379875584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319899.097722:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319899.097779:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379875584:12345-0@lo:38:kworker.0 Request processed in 77us (1432us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319899.097784:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72
00000100:00100000:2.0:1767319899.099016:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379875456:12345-0@lo:38:kworker.0 Request processed in 3157us (3510us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319899.099025:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17330
00000100:00080000:3.0:1767319899.099691:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319899.099695:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319899.099698:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319899.099702:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4796
00000100:00080000:3.0:1767319899.099706:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319899.099777:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319899.099797:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379876096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319899.099814:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319899.099817:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319899.099819:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319899.099822:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4796
00000100:00080000:3.0:1767319899.099825:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319899.099828:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319899.099839:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90e00 x1853164379876352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319899.099892:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379875968:0@lo:400:kworker.0
00000100:00100000:3.0:1767319899.099943:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319899.099975:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319899.099979:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379876224:0@lo:400:kworker.0
00000100:00100000:3.0:1767319899.099992:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319899.102459:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379875712:0@lo:400:kworker.0
00000100:00100000:2.0:1767319899.102539:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319899.102864:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379875968
00000100:00100000:3.0:1767319899.102887:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379875968
00000100:00100000:3.0:1767319899.102991:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876224
00000100:00100000:3.0:1767319899.102994:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876224
00000100:00100000:3.0:1767319899.103012:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4521
00000100:00100000:3.0:1767319899.103018:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379875968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319899.103086:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379875968:12345-0@lo:400:kworker.0 Request processed in 66us (3140us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319899.103093:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4521
00000100:00100000:3.0:1767319899.103109:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4522
00000100:00100000:3.0:1767319899.103116:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379876224:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319899.103145:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379876224:12345-0@lo:400:kworker.0 Request processed in 30us (3151us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319899.103150:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4522
00000100:00100000:2.0:1767319899.103437:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319899.103446:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379875840:0@lo:400:kworker.0
00000100:00100000:2.0:1767319899.103473:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319899.103509:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379875712
00000100:00100000:2.0:1767319899.103514:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379875712
00000100:00100000:2.0:1767319899.103908:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379875840
00000100:00100000:2.0:1767319899.103912:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379875840
00000100:00100000:2.0:1767319899.103933:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681
00000100:00100000:2.0:1767319899.103938:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379875712:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319899.103966:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379875712:12345-0@lo:400:kworker.0 Request processed in 28us (1428us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319899.103970:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681
00000100:00100000:2.0:1767319899.103979:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682
00000100:00100000:2.0:1767319899.103983:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379875840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319899.103998:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379875840:12345-0@lo:400:kworker.0 Request processed in 15us (526us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319899.104002:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682
00000100:00100000:2.0:1767319899.104036:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379875840:0@lo:400:kworker.0
00000100:00100000:2.0:1767319899.104047:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379875712:0@lo:400:kworker.0
00000100:00080000:2.0:1767319899.104098:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319899.104103:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319899.104105:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319899.104142:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379876224:0@lo:400:kworker.0
00000100:00100000:2.0:1767319899.104623:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379875968:0@lo:400:kworker.0
00000100:00080000:1.0:1767319899.104806:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319899.104811:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319899.104813:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379875456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319899.104832:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379876096:0@lo:38:kworker.0
00000100:00100000:1.0:1767319899.104858:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319899.104887:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379876352:0@lo:38:kworker.0
00000100:00100000:1.0:1767319899.104901:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319899.104952:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319899.104955:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319899.104957:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379875584:0@lo:38:kworker.0
00000100:00100000:3.0:1767319899.105687:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876096
00000100:00100000:3.0:1767319899.105692:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876096
00000100:00100000:0.0:1767319899.108291:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876352
00000100:00100000:0.0:1767319899.109667:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876352
00000100:00100000:0.0:1767319899.109741:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17331
00000100:00100000:0.0:1767319899.109748:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379876096:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319899.109770:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319899.109840:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379876096:12345-0@lo:38:kworker.0 Request processed in 93us (4981us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319899.109848:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17331
00000100:00100000:0.0:1767319899.109861:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17332
00000100:00100000:0.0:1767319899.109864:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379876352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319899.109882:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319899.109898:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379876352:12345-0@lo:38:kworker.0 Request processed in 33us (4997us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319899.109902:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17332
00000100:00080000:1.0:1767319899.111250:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319899.111259:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319899.111262:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379876096:0@lo:38:kworker.0
00000100:00080000:1.0:1767319899.111272:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319899.111274:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319899.111276:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379876352:0@lo:38:kworker.0
00010000:00010000:1.0:1767319899.611609:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319900.119221:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319900.119260:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379876480:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319900.119355:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319900.119629:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876480
00000100:00100000:0.0:1767319900.119638:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876480
00000100:00100000:0.0:1767319900.119721:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466
00000100:00100000:0.0:1767319900.119731:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379876480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319900.119773:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319900.119888:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379876480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 158us (533us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319900.119896:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466
00000100:00100000:1.0:1767319900.122061:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379876480:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319900.631343:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319901.657229:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379876608:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319901.657323:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319901.657735:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876608
00000100:00100000:1.0:1767319901.657744:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876608
00000100:00100000:1.0:1767319901.657810:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467
00000100:00100000:1.0:1767319901.657819:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379876608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319901.657908:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319901.657956:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379876608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (632us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319901.657963:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467
00000100:00100000:1.0:1767319901.658025:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379876608:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319901.658853:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319901.658981:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319902.679425:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319903.709937:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319904.145864:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319904.145988:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319904.146930:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943808
00000100:00100000:2.0:1767319904.146944:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943808
00000100:00100000:2.0:1767319904.147044:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943680
00000100:00100000:2.0:1767319904.147048:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943680
00000100:00100000:2.0:1767319904.147074:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4523
00000100:00100000:2.0:1767319904.147085:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291943808:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319904.147190:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291943808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (1346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319904.147198:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4523
00000100:00100000:2.0:1767319904.147238:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17333
00000100:00100000:2.0:1767319904.147243:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291943680:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319904.147263:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319904.147291:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291943680:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (1303us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319904.147297:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17333
00000100:00080000:3.0:1767319904.147772:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767319904.216804:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319904.216813:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319904.216816:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319904.216820:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319904.216824:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319904.216838:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4801
00000100:00080000:0.0:1767319904.216843:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319904.216849:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319904.216933:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fc000 x1853164379876736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319904.216961:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319904.216965:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319904.216967:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319904.216970:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4801
00000100:00080000:0.0:1767319904.216973:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319904.216976:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319904.216989:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083ff100 x1853164379876864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319904.217046:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319904.217049:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319904.217051:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319904.217055:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4801
00000100:00080000:0.0:1767319904.217057:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319904.217060:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319904.217070:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fdc00 x1853164379877376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319904.217083:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319904.217086:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319904.217088:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319904.217091:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4801
00000100:00080000:0.0:1767319904.217094:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319904.217110:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319904.217121:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fdf80 x1853164379877632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319904.217264:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379877504:0@lo:400:kworker.0
00000100:00100000:1.0:1767319904.217329:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319904.217418:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319904.217425:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379877248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319904.217454:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319904.217479:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379876736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319904.217518:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319904.217545:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379877504
00000100:00100000:1.0:1767319904.217554:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379877504
00000100:00100000:1.0:1767319904.217603:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379877248
00000100:00100000:1.0:1767319904.217606:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379877248
00000100:00100000:1.0:1767319904.217627:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876736
00000100:00100000:1.0:1767319904.217629:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876736
00000100:00100000:1.0:1767319904.217645:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4524
00000100:00100000:1.0:1767319904.217652:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379877504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319904.217699:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379877504:12345-0@lo:400:kworker.0 Request processed in 47us (369us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319904.217705:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4524
00000100:00100000:1.0:1767319904.217725:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4525
00000100:00100000:1.0:1767319904.217732:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379877248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319904.217757:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379877248:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319904.217762:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4525
00000100:00100000:1.0:1767319904.217775:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17334
00000100:00100000:1.0:1767319904.217779:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379876736:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319904.217797:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319904.217825:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379876736:12345-0@lo:38:kworker.0 Request processed in 44us (306us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319904.217830:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17334
00000100:00080000:0.0:1767319904.218025:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319904.218030:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319904.218034:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379876736:0@lo:38:kworker.0
00000100:00100000:0.0:1767319904.218041:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379876864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319904.218096:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319904.218133:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876864
00000100:00100000:0.0:1767319904.218137:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876864
00000100:00100000:0.0:1767319904.218171:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73
00000100:00100000:0.0:1767319904.218175:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379876864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319904.218187:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319904.218214:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379876864:12345-0@lo:38:kworker.0 Request processed in 38us (118us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319904.218220:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73
00000100:00080000:0.0:1767319904.218254:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319904.218258:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319904.218261:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379876864:0@lo:38:kworker.0
00000100:00100000:0.0:1767319904.218267:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379877376:0@lo:38:kworker.0
00000100:00100000:0.0:1767319904.218289:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319904.218309:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379877376
00000100:00100000:0.0:1767319904.218313:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379877376
00000100:00100000:0.0:1767319904.218331:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17335
00000100:00100000:0.0:1767319904.218336:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379877376:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319904.218346:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319904.218393:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379877376:12345-0@lo:38:kworker.0 Request processed in 56us (102us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319904.218399:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17335
00000100:00080000:0.0:1767319904.218420:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319904.218423:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319904.218426:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379877376:0@lo:38:kworker.0
00000100:00100000:0.0:1767319904.218432:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379877632:0@lo:38:kworker.0
00000100:00100000:0.0:1767319904.218453:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319904.218470:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379877632
00000100:00100000:0.0:1767319904.218474:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379877632
00000100:00100000:0.0:1767319904.218489:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17336
00000100:00100000:0.0:1767319904.218493:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379877632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319904.218502:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319904.218523:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379877632:12345-0@lo:38:kworker.0 Request processed in 28us (69us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319904.218528:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17336
00000100:00080000:0.0:1767319904.218548:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319904.218552:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319904.218554:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379877632:0@lo:38:kworker.0
00000100:00100000:3.0:1767319904.218772:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379877120:0@lo:400:kworker.0
00000100:00100000:3.0:1767319904.218821:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319904.218882:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319904.218901:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379876992:0@lo:400:kworker.0
00000100:00100000:3.0:1767319904.218924:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319904.218947:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319904.219069:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379877120
00000100:00100000:0.0:1767319904.219073:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379877120
00000100:00100000:0.0:1767319904.219116:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379876992
00000100:00100000:0.0:1767319904.219119:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379876992
00000100:00100000:0.0:1767319904.219137:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683
00000100:00100000:0.0:1767319904.219144:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379877120:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319904.219180:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379877120:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319904.219188:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683
00000100:00100000:0.0:1767319904.219200:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684
00000100:00100000:0.0:1767319904.219206:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379876992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319904.219229:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379876992:12345-0@lo:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319904.219234:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684
00000100:00100000:1.0:1767319904.221700:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379877248:0@lo:400:kworker.0
00000100:00100000:1.0:1767319904.221740:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379877504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319904.222035:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379876992:0@lo:400:kworker.0
00000100:00100000:3.0:1767319904.222050:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379877120:0@lo:400:kworker.0
00000100:00080000:3.0:1767319904.222071:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319904.222077:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319904.727459:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319905.241464:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379877760:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319905.241592:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319905.241813:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379877760
00000100:00100000:1.0:1767319905.241822:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379877760
00000100:00100000:1.0:1767319905.241901:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468
00000100:00100000:1.0:1767319905.241912:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379877760:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319905.241952:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319905.242027:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379877760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (436us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319905.242036:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468
00000100:00100000:3.0:1767319905.242496:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379877760:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319905.752296:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319906.775977:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319906.776001:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379877888:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319906.776075:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319906.776204:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379877888
00000100:00100000:0.0:1767319906.776212:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379877888
00000100:00100000:0.0:1767319906.776346:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469
00000100:00100000:0.0:1767319906.776356:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379877888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319906.776398:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319906.776450:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379877888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (374us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319906.776457:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469
00010000:00010000:3.0:1767319906.776757:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319906.776841:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319906.776895:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379877888:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319907.800468:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319908.823128:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319909.266867:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319909.266964:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291944064
00000100:00100000:0.0:1767319909.266990:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291944064
00000100:00100000:0.0:1767319909.267072:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4526
00000100:00100000:0.0:1767319909.267083:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291944064:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319909.267196:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291944064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319909.267205:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4526
00000100:00080000:2.0:1767319909.267353:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319909.269939:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319909.270034:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291943936
00000100:00100000:0.0:1767319909.270043:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291943936
00000100:00100000:0.0:1767319909.270091:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17337
00000100:00100000:0.0:1767319909.270099:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291943936:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319909.270124:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319909.277496:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291943936:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 7383us (7552us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319909.277514:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17337
00000100:00080000:0.0:1767319909.334966:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319909.334985:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319909.334988:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319909.334992:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319909.334997:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319909.335005:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4806
00000100:00080000:0.0:1767319909.335010:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319909.335018:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319909.335061:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebfb80 x1853164379878016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319909.335231:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319909.335235:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319909.335237:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319909.335241:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4806
00000100:00080000:0.0:1767319909.335244:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319909.335248:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319909.335263:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebc000 x1853164379878144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319909.335363:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319909.335368:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319909.335369:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319909.335373:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4806
00000100:00080000:0.0:1767319909.335376:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319909.335379:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319909.335391:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebed80 x1853164379878656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319909.335407:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319909.335421:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319909.335423:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319909.335426:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4806
00000100:00080000:0.0:1767319909.335428:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319909.335433:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319909.335443:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fe300 x1853164379878912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319909.335470:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379878528:0@lo:400:kworker.0
00000100:00100000:0.0:1767319909.335542:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319909.335609:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319909.335616:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379878784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319909.335636:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319909.335686:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878528
00000100:00100000:0.0:1767319909.335693:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878528
00000100:00100000:0.0:1767319909.335783:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878784
00000100:00100000:0.0:1767319909.335787:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878784
00000100:00100000:0.0:1767319909.335809:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4527
00000100:00100000:0.0:1767319909.335816:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379878528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319909.335863:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379878528:12345-0@lo:400:kworker.0 Request processed in 46us (321us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319909.335892:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4527
00000100:00100000:0.0:1767319909.335910:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4528
00000100:00100000:0.0:1767319909.335916:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379878784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319909.335945:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379878784:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319909.335951:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4528
00000100:00100000:0.0:1767319909.335992:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379878784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319909.336002:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379878528:0@lo:400:kworker.0
00000100:00080000:2.0:1767319909.336708:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319909.336729:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379878272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319909.336773:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319909.336826:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319909.336833:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379878400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319909.336856:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319909.336912:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878272
00000100:00100000:2.0:1767319909.336917:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878272
00000100:00100000:2.0:1767319909.336948:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878400
00000100:00100000:2.0:1767319909.336950:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878400
00000100:00100000:2.0:1767319909.336981:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685
00000100:00100000:2.0:1767319909.336987:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379878272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319909.337021:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379878272:12345-0@lo:400:kworker.0 Request processed in 34us (248us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319909.337027:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685
00000100:00100000:2.0:1767319909.337039:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686
00000100:00100000:2.0:1767319909.337044:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379878400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319909.337065:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379878400:12345-0@lo:400:kworker.0 Request processed in 20us (208us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319909.337070:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686
00000100:00080000:2.0:1767319909.337087:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319909.337090:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319909.337107:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379878400:0@lo:400:kworker.0
00000100:00100000:2.0:1767319909.337115:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379878272:0@lo:400:kworker.0
00000100:00100000:2.0:1767319909.343099:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379878016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319909.343940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319909.344343:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878016
00000100:00100000:0.0:1767319909.344353:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878016
00000100:00100000:0.0:1767319909.344405:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17338
00000100:00100000:2.0:1767319909.344612:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379878144:0@lo:38:kworker.0
00000100:00100000:2.0:1767319909.344659:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319909.344757:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379878656:0@lo:38:kworker.0
00000100:00100000:2.0:1767319909.344783:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319909.344813:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379878912:0@lo:38:kworker.0
00000100:00100000:2.0:1767319909.344837:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319909.344916:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878656
00000100:00100000:2.0:1767319909.344921:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878656
00000100:00100000:2.0:1767319909.344981:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878912
00000100:00100000:2.0:1767319909.344985:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878912
00000100:00100000:2.0:1767319909.345000:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17339
00000100:00100000:2.0:1767319909.345006:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379878656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319909.345027:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319909.345075:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379878656:12345-0@lo:38:kworker.0 Request processed in 67us (290us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319909.345082:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17339
00000100:00100000:2.0:1767319909.345099:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17340
00000100:00100000:2.0:1767319909.345103:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379878912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319909.345112:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319909.345134:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379878912:12345-0@lo:38:kworker.0 Request processed in 30us (296us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319909.345140:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17340
00000100:00080000:2.0:1767319909.345175:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319909.345180:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319909.345184:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379878656:0@lo:38:kworker.0
00000100:00080000:2.0:1767319909.345192:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319909.345195:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319909.345197:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379878912:0@lo:38:kworker.0
00000100:00100000:0.0:1767319909.345802:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379878016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319909.345815:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319909.345884:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379878016:12345-0@lo:38:kworker.0 Request processed in 69us (1930us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319909.345891:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17338
00000100:00080000:2.0:1767319909.347465:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319909.347484:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319909.347490:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379878016:0@lo:38:kworker.0
00000100:00100000:3.0:1767319909.348959:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379878144
00000100:00100000:3.0:1767319909.349097:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379878144
00000100:00100000:3.0:1767319909.349199:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74
00000100:00100000:3.0:1767319909.349217:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379878144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319909.349239:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319909.349338:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379878144:12345-0@lo:38:kworker.0 Request processed in 120us (4677us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319909.349345:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74
00000100:00080000:2.0:1767319909.349434:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319909.349440:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319909.349443:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379878144:0@lo:38:kworker.0
00010000:00010000:3.0:1767319909.847640:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319910.359282:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319910.359315:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379879040:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319910.359395:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319910.359739:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879040
00000100:00100000:0.0:1767319910.359749:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879040
00000100:00100000:0.0:1767319910.359806:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470
00000100:00100000:0.0:1767319910.359816:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379879040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319910.359845:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319910.359943:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379879040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (560us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319910.359954:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470
00000100:00100000:3.0:1767319910.360127:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379879040:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319910.871161:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319911.895298:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319911.895333:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379879168:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319911.895399:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319911.895483:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319911.897232:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879168
00000100:00100000:0.0:1767319911.897246:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879168
00000100:00100000:0.0:1767319911.897341:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471
00000100:00100000:0.0:1767319911.897353:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379879168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319911.897386:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319911.897457:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379879168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (2058us total) trans 0 rc 0/0
00000100:00080000:2.0:1767319911.897577:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767319911.897679:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471
00000100:00100000:1.0:1767319911.897744:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379879168:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319912.919105:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319913.943580:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319914.384684:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319914.384721:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291944192 offset 0 length 520: 4
00000100:00100000:3.0:1767319914.384747:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319914.385138:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291944448
00000100:00100000:2.0:1767319914.385148:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291944448
00000100:00100000:2.0:1767319914.385257:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291944320
00000100:00100000:2.0:1767319914.385270:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291944320
00000100:00100000:2.0:1767319914.385292:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4529
00000100:00100000:2.0:1767319914.385302:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291944448:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319914.385395:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291944448:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 94us (719us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319914.385404:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4529
00000100:00080000:3.0:1767319914.385553:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319914.392802:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17341
00000100:00100000:1.0:1767319914.392819:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291944320:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319914.392956:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319914.393311:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291944320:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 492us (8560us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319914.393320:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17341
00000100:00080000:3.0:1767319914.458159:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319914.458170:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319914.458173:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319914.458177:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319914.458181:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319914.458188:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4811
00000100:00080000:3.0:1767319914.458194:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319914.458201:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319914.458247:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91f80 x1853164379879296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319914.458440:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319914.458444:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319914.458446:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319914.458451:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4811
00000100:00080000:3.0:1767319914.458453:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319914.458457:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319914.458472:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90700 x1853164379879424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319914.458542:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319914.458545:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319914.458547:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319914.458551:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4811
00000100:00080000:3.0:1767319914.458553:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319914.458557:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319914.458568:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90e00 x1853164379879936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319914.458585:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319914.458588:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319914.458590:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319914.458593:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4811
00000100:00080000:3.0:1767319914.458595:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319914.458599:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319914.458606:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331500 x1853164379880192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319914.458639:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379880064:0@lo:400:kworker.0
00000100:00100000:3.0:1767319914.458702:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319914.458786:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319914.458791:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379879808:0@lo:400:kworker.0
00000100:00100000:3.0:1767319914.458813:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319914.459297:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379879680:0@lo:400:kworker.0
00000100:00100000:1.0:1767319914.459332:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319914.459453:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379879552:0@lo:400:kworker.0
00000100:00100000:0.0:1767319914.459482:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319914.462381:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379879296:0@lo:38:kworker.0
00000100:00100000:2.0:1767319914.462458:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319914.462556:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879680
00000100:00100000:1.0:1767319914.462565:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879680
00000100:00100000:1.0:1767319914.462631:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879552
00000100:00100000:1.0:1767319914.462634:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879552
00000100:00100000:1.0:1767319914.462658:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687
00000100:00100000:1.0:1767319914.462667:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379879680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319914.462729:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379879680:12345-0@lo:400:kworker.0 Request processed in 64us (3395us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319914.462737:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687
00000100:00100000:1.0:1767319914.462772:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688
00000100:00100000:1.0:1767319914.462778:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379879552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319914.462810:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379879552:12345-0@lo:400:kworker.0 Request processed in 32us (3328us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319914.462816:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688
00000100:00080000:1.0:1767319914.462854:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319914.462859:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319914.462953:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379880064
00000100:00100000:3.0:1767319914.462959:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379880064
00000100:00100000:3.0:1767319914.462995:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879808
00000100:00100000:3.0:1767319914.462998:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879808
00000100:00100000:3.0:1767319914.463030:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879296
00000100:00100000:3.0:1767319914.463034:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879296
00000100:00100000:3.0:1767319914.463052:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4530
00000100:00100000:3.0:1767319914.463059:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379880064:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319914.463104:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379880064:12345-0@lo:400:kworker.0 Request processed in 46us (4401us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319914.463110:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4530
00000100:00100000:3.0:1767319914.463122:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4531
00000100:00100000:3.0:1767319914.463129:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379879808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319914.463374:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379879808:12345-0@lo:400:kworker.0 Request processed in 244us (4558us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319914.463381:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4531
00000100:00100000:3.0:1767319914.463395:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17342
00000100:00100000:3.0:1767319914.463399:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379879296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319914.463419:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319914.463447:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379879296:12345-0@lo:38:kworker.0 Request processed in 47us (989us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319914.463453:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17342
00000100:00100000:3.0:1767319914.463496:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379879808:0@lo:400:kworker.0
00000100:00100000:3.0:1767319914.463508:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379880064:0@lo:400:kworker.0
00000100:00080000:3.0:1767319914.463577:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319914.469787:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379879680:0@lo:400:kworker.0
00000100:00100000:0.0:1767319914.472946:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379879552:0@lo:400:kworker.0
00000100:00080000:2.0:1767319914.476473:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319914.476488:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319914.476493:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379879296:0@lo:38:kworker.0
00000100:00100000:2.0:1767319914.476506:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379879424:0@lo:38:kworker.0
00000100:00100000:2.0:1767319914.476572:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319914.476660:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379879936:0@lo:38:kworker.0
00000100:00100000:2.0:1767319914.476689:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319914.476720:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379880192:0@lo:38:kworker.0
00000100:00100000:2.0:1767319914.476742:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319914.477024:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879936
00000100:00100000:0.0:1767319914.477033:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879936
00000100:00100000:0.0:1767319914.477074:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379880192
00000100:00100000:0.0:1767319914.477077:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379880192
00000100:00100000:0.0:1767319914.477102:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17343
00000100:00100000:0.0:1767319914.477109:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379879936:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319914.477131:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319914.477183:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379879936:12345-0@lo:38:kworker.0 Request processed in 73us (492us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319914.477190:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17343
00000100:00100000:0.0:1767319914.477206:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17344
00000100:00100000:0.0:1767319914.477209:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379880192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319914.477218:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319914.477240:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379880192:12345-0@lo:38:kworker.0 Request processed in 29us (497us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319914.477246:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17344
00000100:00080000:2.0:1767319914.477563:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319914.477580:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319914.477583:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379879936:0@lo:38:kworker.0
00000100:00080000:2.0:1767319914.477592:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319914.477595:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319914.477598:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379880192:0@lo:38:kworker.0
00000100:00100000:3.0:1767319914.482972:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379879424
00000100:00100000:3.0:1767319914.482988:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379879424
00000100:00100000:3.0:1767319914.483176:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75
00000100:00100000:3.0:1767319914.483185:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379879424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319914.483207:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319914.483384:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379879424:12345-0@lo:38:kworker.0 Request processed in 199us (6810us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319914.483392:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75
00000100:00080000:2.0:1767319914.497116:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319914.497133:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319914.497433:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379879424:0@lo:38:kworker.0
00010000:00010000:3.0:1767319914.967365:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319915.479644:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379880320:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319915.479732:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319915.479921:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379880320
00000100:00100000:0.0:1767319915.479931:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379880320
00000100:00100000:0.0:1767319915.479984:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472
00000100:00100000:0.0:1767319915.479994:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379880320:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319915.480025:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319915.480080:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379880320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (347us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319915.480097:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472
00000100:00100000:3.0:1767319915.480261:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379880320:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319915.992371:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319917.015688:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379880448:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319917.015768:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319917.015903:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379880448
00000100:00100000:2.0:1767319917.015911:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379880448
00000100:00100000:2.0:1767319917.015987:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473
00000100:00100000:2.0:1767319917.015996:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379880448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319917.016029:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767319917.016102:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319917.016899:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319917.032582:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379880448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 16577us (16804us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319917.032597:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473
00000100:00100000:1.0:1767319917.034832:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379880448:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319918.039548:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319918.614985:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319893/real 1767319893]  req@ffff8b0f083fd500 x1853164379875072/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319918 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319918.615020:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f083fd500 x1853164379875072/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319918 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319918.615039:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319918.615348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319918.615353:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379875072:0@lo:250:kworker.0
00000100:00080000:2.0:1767319918.615506:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319918.615512:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319918.615515:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319918.615520:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4796
00000100:00080000:2.0:1767319918.615523:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319918.615529:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319918.615558:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379880576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319918.615604:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379880576:0@lo:250:kworker.0
00000400:00000100:3.0:1767319918.615654:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379880576 offset 0 length 520: 4
00000100:00080000:2.0:1767319918.615707:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319918.615710:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319918.615712:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319918.615716:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4816
00000100:00080000:2.0:1767319918.615718:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319918.615722:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319918.615735:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44ad80 x1853164379880704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319918.615818:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379880704:0@lo:38:kworker.0
00000100:00100000:3.0:1767319918.615847:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319918.615942:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379880704
00000100:00100000:1.0:1767319918.615950:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379880704
00000100:00100000:1.0:1767319918.615992:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17345
00000100:00100000:1.0:1767319918.615999:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379880704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319918.616018:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319918.616073:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379880704:12345-0@lo:38:kworker.0 Request processed in 73us (224us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319918.616079:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17345
00000100:00080000:0.0:1767319918.616179:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319918.616184:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319918.616187:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379880704:0@lo:38:kworker.0
00000100:00080000:2.0:1767319918.616815:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319918.616820:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319918.616822:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319918.616827:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4816
00000100:00080000:2.0:1767319918.616830:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319918.616835:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319918.616855:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a680 x1853164379880832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319918.616904:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379880832:0@lo:38:kworker.0
00000100:00100000:0.0:1767319918.616943:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319918.617046:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319918.617049:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319918.617051:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319918.617055:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4816
00000100:00080000:2.0:1767319918.617057:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319918.617069:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319918.617080:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608700 x1853164379881344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319918.617142:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379880960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617169:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319918.617195:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319918.617200:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379881088:0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617219:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319918.617255:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379880960
00000100:00100000:3.0:1767319918.617260:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379880960
00000100:00100000:3.0:1767319918.617301:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881088
00000100:00100000:3.0:1767319918.617304:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881088
00000100:00100000:3.0:1767319918.617322:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689
00000100:00100000:3.0:1767319918.617340:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379880960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617383:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379880960:12345-0@lo:400:kworker.0 Request processed in 56us (213us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319918.617390:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689
00000100:00100000:3.0:1767319918.617402:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690
00000100:00100000:3.0:1767319918.617408:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379881088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617448:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379881088:12345-0@lo:400:kworker.0 Request processed in 40us (228us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319918.617454:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690
00000100:00080000:3.0:1767319918.617473:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319918.617496:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379881088:0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617504:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379880960:0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617540:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379881216:0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617566:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319918.617591:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881216
00000100:00100000:3.0:1767319918.617594:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881216
00000100:00100000:1.0:1767319918.617719:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379880832
00000100:00100000:1.0:1767319918.617724:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379880832
00000100:00100000:1.0:1767319918.617747:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76
00000100:00100000:1.0:1767319918.617752:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379880832:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319918.617768:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319918.617909:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4532
00000100:00100000:3.0:1767319918.617916:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379881216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319918.617947:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379881216:12345-0@lo:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319918.617952:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4532
00000100:00080000:3.0:1767319918.617964:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319918.617980:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379881216:0@lo:400:kworker.0
00000100:00100000:0.0:1767319918.618301:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379881344:0@lo:38:kworker.0
00000100:00100000:0.0:1767319918.618341:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319918.618529:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881344
00000100:00100000:3.0:1767319918.618534:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881344
00000100:00100000:3.0:1767319918.618556:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17346
00000100:00100000:3.0:1767319918.618560:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379881344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319918.618572:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319918.618601:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379881344:12345-0@lo:38:kworker.0 Request processed in 39us (271us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319918.618607:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17346
00000100:00080000:2.0:1767319918.621407:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319918.621415:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319918.621418:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319918.621425:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4816
00000100:00080000:2.0:1767319918.621431:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:2.0:1767319918.621439:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319918.621462:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609c00 x1853164379881600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319918.621500:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319918.621516:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379881472:0@lo:400:kworker.0
00000100:00100000:2.0:1767319918.621575:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319918.621632:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881472
00000100:00100000:2.0:1767319918.621638:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881472
00000100:00100000:2.0:1767319918.621686:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4533
00000100:00100000:2.0:1767319918.621693:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379881472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319918.621734:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379881472:12345-0@lo:400:kworker.0 Request processed in 41us (158us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319918.621741:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4533
00000100:00080000:2.0:1767319918.621762:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319918.621789:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379881472:0@lo:400:kworker.0
00000100:00100000:1.0:1767319918.626826:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379880832:12345-0@lo:38:kworker.0 Request processed in 9062us (9871us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319918.626841:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76
00000100:00080000:0.0:1767319918.634434:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319918.634448:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319918.634454:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379880832:0@lo:38:kworker.0
00000100:00100000:0.0:1767319918.634494:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379881600:0@lo:38:kworker.0
00000100:00100000:0.0:1767319918.634557:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319918.634603:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319918.634607:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319918.637694:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881600
00000100:00100000:2.0:1767319918.637710:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881600
00000100:00100000:2.0:1767319918.637777:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17347
00000100:00100000:2.0:1767319918.637786:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379881600:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319918.637810:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319918.637924:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379881600:12345-0@lo:38:kworker.0 Request processed in 139us (3366us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319918.637931:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17347
00000100:00100000:0.0:1767319918.638164:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379881344:0@lo:38:kworker.0
00000100:00080000:0.0:1767319918.638206:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319918.638210:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319918.638213:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379881600:0@lo:38:kworker.0
00010000:00010000:3.0:1767319919.063211:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319919.512920:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319919.513556:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291944576
00000100:00100000:3.0:1767319919.513567:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291944576
00000100:00100000:3.0:1767319919.513625:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17348
00000100:00100000:3.0:1767319919.513634:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291944576:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319919.513658:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319919.513730:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291944576:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (821us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319919.513740:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17348
00000100:00100000:1.0:1767319919.521842:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319919.522107:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291944704
00000100:00100000:2.0:1767319919.522118:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291944704
00000100:00100000:2.0:1767319919.522204:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4534
00000100:00100000:2.0:1767319919.522225:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291944704:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767319919.522301:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319919.526481:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291944704:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4253us (4635us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319919.526500:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4534
00010000:00010000:2.0:1767319920.087463:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319920.599589:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379881728:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319920.599665:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319920.600277:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881728
00000100:00100000:2.0:1767319920.600286:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881728
00000100:00100000:2.0:1767319920.601065:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474
00000100:00100000:2.0:1767319920.601079:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379881728:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319920.601479:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767319920.601530:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319920.601614:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379881728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 539us (1947us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319920.601622:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474
00000100:00100000:3.0:1767319920.602066:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379881728:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319921.111145:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319922.135735:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319922.136248:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319922.136269:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379881856:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319922.136352:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319922.136808:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881856
00000100:00100000:0.0:1767319922.136817:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881856
00000100:00100000:0.0:1767319922.136904:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475
00000100:00100000:0.0:1767319922.136927:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379881856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319922.136956:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319922.137010:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379881856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (656us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319922.137018:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475
00000100:00100000:0.0:1767319922.137065:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379881856:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319922.137680:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767319923.159419:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767319923.672102:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319923.672113:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319923.672116:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319923.672120:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319923.672124:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319923.672132:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4821
00000100:00080000:2.0:1767319923.672137:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319923.672143:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319923.672196:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164379881984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319923.672226:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319923.672230:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319923.672232:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319923.672236:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4821
00000100:00080000:2.0:1767319923.672238:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319923.672242:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319923.672255:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164379882112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319923.672348:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379882240:0@lo:400:kworker.0
00000100:00100000:1.0:1767319923.672422:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319923.672641:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379882368:0@lo:400:kworker.0
00000100:00100000:3.0:1767319923.672672:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319923.672712:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379882240
00000100:00100000:3.0:1767319923.672719:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379882240
00000100:00100000:3.0:1767319923.672768:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379882368
00000100:00100000:3.0:1767319923.672771:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379882368
00000100:00100000:3.0:1767319923.672790:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691
00000100:00100000:3.0:1767319923.672798:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379882240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319923.673496:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379881984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319923.673540:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319923.673565:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379882112:0@lo:38:kworker.0
00000100:00100000:0.0:1767319923.673588:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319923.673630:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379882112
00000100:00100000:0.0:1767319923.673634:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379882112
00000100:00100000:0.0:1767319923.673658:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77
00000100:00100000:0.0:1767319923.673664:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379882112:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319923.673686:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319923.673720:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379882112:12345-0@lo:38:kworker.0 Request processed in 55us (131us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319923.673728:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77
00000100:00080000:0.0:1767319923.673771:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319923.673777:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319923.673781:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379882112:0@lo:38:kworker.0
00000100:00100000:0.0:1767319923.673835:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692
00000100:00100000:0.0:1767319923.673844:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379882368:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319923.673920:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379882368:12345-0@lo:400:kworker.0 Request processed in 78us (1246us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319923.673926:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692
00000100:00100000:0.0:1767319923.673985:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379882368:0@lo:400:kworker.0
00000100:00080000:0.0:1767319923.674023:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319923.674042:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379881984
00000100:00100000:0.0:1767319923.674046:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379881984
00000100:00100000:0.0:1767319923.674069:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17349
00000100:00100000:0.0:1767319923.674073:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379881984:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319923.674084:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319923.674114:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379881984:12345-0@lo:38:kworker.0 Request processed in 39us (573us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319923.674120:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17349
00000100:00080000:0.0:1767319923.674157:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319923.674161:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319923.674164:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379881984:0@lo:38:kworker.0
00000100:00100000:3.0:1767319923.676557:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379882240:12345-0@lo:400:kworker.0 Request processed in 3502us (3877us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319923.676572:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691
00000100:00080000:2.0:1767319923.676671:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319923.676676:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319923.676679:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319923.676684:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4821
00000100:00080000:2.0:1767319923.676688:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319923.676693:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319923.676720:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164379882624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319923.676746:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319923.676750:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319923.676751:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319923.676754:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4821
00000100:00080000:2.0:1767319923.676757:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:2.0:1767319923.676761:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319923.676769:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164379882880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319923.676801:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379882624:0@lo:38:kworker.0
00000100:00100000:0.0:1767319923.677112:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379882752:0@lo:400:kworker.0
00000100:00100000:0.0:1767319923.677166:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319923.677217:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319923.677223:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379882496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319923.677242:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319923.677270:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379882752
00000100:00100000:0.0:1767319923.677277:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379882752
00000100:00100000:0.0:1767319923.677633:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379882496
00000100:00100000:0.0:1767319923.677637:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379882496
00000100:00100000:0.0:1767319923.677667:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4535
00000100:00100000:0.0:1767319923.677675:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379882752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319923.677729:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379882752:12345-0@lo:400:kworker.0 Request processed in 55us (562us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319923.677736:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4535
00000100:00100000:0.0:1767319923.677752:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4536
00000100:00100000:0.0:1767319923.677758:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379882496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319923.677784:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379882496:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319923.677789:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4536
00000100:00080000:0.0:1767319923.677830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319923.677898:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379882496:0@lo:400:kworker.0
00000100:00100000:0.0:1767319923.677910:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379882752:0@lo:400:kworker.0
00000100:00100000:2.0:1767319923.678639:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319923.678667:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379882880:0@lo:38:kworker.0
00000100:00100000:2.0:1767319923.678691:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319923.678730:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379882624
00000100:00100000:2.0:1767319923.678735:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379882624
00000100:00100000:2.0:1767319923.678759:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379882880
00000100:00100000:2.0:1767319923.678761:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379882880
00000100:00100000:2.0:1767319923.678778:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17350
00000100:00100000:2.0:1767319923.678782:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379882624:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319923.678800:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319923.679139:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379882624:12345-0@lo:38:kworker.0 Request processed in 354us (515us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319923.679146:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17350
00000100:00100000:2.0:1767319923.679162:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17351
00000100:00100000:2.0:1767319923.679166:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379882880:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319923.679186:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319923.679211:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379882880:12345-0@lo:38:kworker.0 Request processed in 43us (519us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319923.679217:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17351
00000100:00080000:2.0:1767319923.679254:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319923.679259:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319923.679262:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379882624:0@lo:38:kworker.0
00000100:00080000:2.0:1767319923.679269:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319923.679272:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319923.679274:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379882880:0@lo:38:kworker.0
00000100:00100000:1.0:1767319923.685301:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379882240:0@lo:400:kworker.0
00010000:00010000:1.0:1767319924.183459:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319924.623327:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319924.623422:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319924.623846:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291944960
00000100:00100000:1.0:1767319924.623848:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291944832
00000100:00100000:1.0:1767319924.623856:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291944832
00000100:00100000:2.0:1767319924.623857:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291944960
00000100:00080000:0.0:1767319924.623967:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319924.624015:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4537
00000100:00100000:1.0:1767319924.624027:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291944960:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319924.624115:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291944960:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (798us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319924.624123:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4537
00000100:00100000:1.0:1767319924.624143:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17352
00000100:00100000:1.0:1767319924.624147:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291944832:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319924.624179:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319924.624205:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291944832:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (783us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319924.624212:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17352
00010000:00010000:2.0:1767319925.207140:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319925.724098:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319925.724124:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379883008:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319925.724213:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319925.724276:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883008
00000100:00100000:2.0:1767319925.724286:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883008
00000100:00100000:2.0:1767319925.724406:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476
00000100:00100000:2.0:1767319925.724418:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379883008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319925.724450:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319925.724512:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379883008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319925.724519:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476
00000100:00080000:0.0:1767319925.724560:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319925.724608:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379883008:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319926.232914:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767319927.255118:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319927.255131:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319927.255158:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379883136:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319927.255230:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319927.255369:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883136
00000100:00100000:0.0:1767319927.255383:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883136
00000100:00100000:0.0:1767319927.255459:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477
00000100:00100000:0.0:1767319927.255469:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379883136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319927.255498:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319927.255545:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379883136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319927.255553:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477
00000100:00100000:0.0:1767319927.255607:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379883136:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319927.255725:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767319928.279358:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319928.791143:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319928.791153:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319928.791157:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319928.791161:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319928.791165:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319928.791173:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4826
00000100:00080000:3.0:1767319928.791178:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319928.791185:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319928.791225:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333800 x1853164379883264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319928.791270:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379883264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319928.791921:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319928.792011:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319928.792014:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319928.792016:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319928.792021:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4826
00000100:00080000:3.0:1767319928.792023:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319928.792028:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319928.792048:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331500 x1853164379883392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319928.792164:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883264
00000100:00100000:1.0:1767319928.792174:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883264
00000100:00100000:1.0:1767319928.792220:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17353
00000100:00100000:1.0:1767319928.792229:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379883264:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319928.792248:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319928.792556:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379883392:0@lo:38:kworker.0
00000100:00100000:2.0:1767319928.792581:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319928.792631:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883392
00000100:00100000:0.0:1767319928.792635:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883392
00000100:00100000:0.0:1767319928.792654:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78
00000100:00100000:0.0:1767319928.792657:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379883392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319928.792665:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319928.792687:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379883392:12345-0@lo:38:kworker.0 Request processed in 29us (105us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319928.792691:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78
00000100:00080000:3.0:1767319928.799125:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319928.799141:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319928.799145:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319928.799153:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4826
00000100:00080000:3.0:1767319928.799158:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319928.799165:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319928.799186:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90700 x1853164379883904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319928.799206:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319928.799209:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319928.799211:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319928.799215:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4826
00000100:00080000:3.0:1767319928.799218:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:3.0:1767319928.799222:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319928.799232:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91f80 x1853164379884160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319928.799356:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379883520:0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799422:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319928.799473:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319928.799479:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379883648:0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799502:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319928.799532:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883520
00000100:00100000:0.0:1767319928.799540:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883520
00000100:00100000:0.0:1767319928.799589:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883648
00000100:00100000:0.0:1767319928.799592:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883648
00000100:00100000:0.0:1767319928.799611:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693
00000100:00100000:0.0:1767319928.799619:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379883520:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799665:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379883520:12345-0@lo:400:kworker.0 Request processed in 47us (242us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319928.799671:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693
00000100:00100000:0.0:1767319928.799686:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694
00000100:00100000:0.0:1767319928.799692:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379883648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799717:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379883648:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319928.799722:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694
00000100:00080000:0.0:1767319928.799737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319928.799772:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379883648:0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799782:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379883520:0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799810:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379883776:0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799852:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319928.799911:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319928.799917:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379884032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.799937:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319928.799963:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883776
00000100:00100000:0.0:1767319928.799967:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883776
00000100:00100000:0.0:1767319928.800000:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884032
00000100:00100000:0.0:1767319928.800003:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884032
00000100:00100000:0.0:1767319928.800023:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4538
00000100:00100000:0.0:1767319928.800029:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379883776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.800061:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379883776:12345-0@lo:400:kworker.0 Request processed in 32us (208us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319928.800067:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4538
00000100:00100000:0.0:1767319928.800079:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4539
00000100:00100000:0.0:1767319928.800085:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379884032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.800110:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379884032:12345-0@lo:400:kworker.0 Request processed in 25us (173us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319928.800115:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4539
00000100:00080000:0.0:1767319928.800144:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319928.800187:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379884032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319928.800195:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379883776:0@lo:400:kworker.0
00000100:00100000:1.0:1767319928.800929:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379883264:12345-0@lo:38:kworker.0 Request processed in 8579us (8887us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319928.800940:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17353
00000100:00080000:2.0:1767319928.801107:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319928.801112:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319928.801116:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379883264:0@lo:38:kworker.0
00000100:00100000:2.0:1767319928.801149:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379883904:0@lo:38:kworker.0
00000100:00100000:2.0:1767319928.801185:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319928.801252:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379884160:0@lo:38:kworker.0
00000100:00100000:2.0:1767319928.801275:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319928.806120:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319928.806143:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319928.806149:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379883392:0@lo:38:kworker.0
00000100:00100000:1.0:1767319928.809031:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379883904
00000100:00100000:1.0:1767319928.809047:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379883904
00000100:00100000:1.0:1767319928.809105:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884160
00000100:00100000:1.0:1767319928.809108:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884160
00000100:00100000:1.0:1767319928.809140:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17354
00000100:00100000:1.0:1767319928.809150:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379883904:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319928.809173:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319928.809256:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379883904:12345-0@lo:38:kworker.0 Request processed in 106us (8069us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319928.809264:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17354
00000100:00100000:1.0:1767319928.809285:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17355
00000100:00100000:1.0:1767319928.809289:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379884160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319928.809299:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319928.809337:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379884160:12345-0@lo:38:kworker.0 Request processed in 47us (8062us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319928.809344:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17355
00000100:00080000:2.0:1767319928.809879:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319928.809884:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319928.809888:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379883904:0@lo:38:kworker.0
00000100:00080000:2.0:1767319928.809895:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319928.809898:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319928.809900:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379884160:0@lo:38:kworker.0
00010000:00010000:2.0:1767319929.303410:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319929.748462:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319929.748709:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319929.761148:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291945216
00000100:00100000:2.0:1767319929.761165:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291945216
00000100:00080000:0.0:1767319929.761364:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319929.763162:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291945088
00000100:00100000:1.0:1767319929.763177:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291945088
00000100:00100000:2.0:1767319929.763784:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4540
00000100:00100000:2.0:1767319929.763815:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291945216:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767319929.763924:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291945216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 129us (15473us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319929.763932:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4540
00000100:00100000:2.0:1767319929.763955:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17356
00000100:00100000:2.0:1767319929.763960:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291945088:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319929.763981:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319929.764007:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291945088:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (15299us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319929.764027:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17356
00010000:00010000:3.0:1767319930.327280:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319930.840814:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319930.840840:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379884288:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319930.840927:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319930.853488:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884288
00000100:00100000:0.0:1767319930.853514:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884288
00000100:00100000:0.0:1767319930.853688:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478
00000100:00100000:0.0:1767319930.853698:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379884288:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319930.853733:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319930.853825:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379884288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (12897us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319930.853832:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478
00000100:00100000:3.0:1767319930.854205:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379884288:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319930.860566:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767319931.351161:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319932.375221:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319932.375318:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319932.375339:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379884416:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319932.375418:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319932.375563:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884416
00000100:00100000:1.0:1767319932.375571:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884416
00000100:00100000:1.0:1767319932.375634:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479
00000100:00100000:1.0:1767319932.375643:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379884416:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319932.375671:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319932.375713:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379884416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319932.375720:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479
00000100:00080000:2.0:1767319932.375852:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319932.375900:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379884416:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319933.399248:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319933.911072:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319933.911091:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319933.911095:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319933.911099:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319933.911103:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319933.911112:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4831
00000100:00080000:3.0:1767319933.911117:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319933.911125:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319933.911166:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90a80 x1853164379884544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319933.911183:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319933.911186:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319933.911188:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319933.911192:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4831
00000100:00080000:3.0:1767319933.911194:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319933.911197:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319933.911208:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92a00 x1853164379884672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319933.911288:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319933.911354:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379884544:0@lo:38:kworker.0
00000100:00100000:2.0:1767319933.911419:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319933.911472:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379884672:0@lo:38:kworker.0
00000100:00100000:2.0:1767319933.911496:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319933.911530:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884544
00000100:00100000:2.0:1767319933.911536:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884544
00000100:00100000:2.0:1767319933.911565:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17357
00000100:00100000:2.0:1767319933.911572:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379884544:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319933.911689:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319933.911811:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379884544:12345-0@lo:38:kworker.0 Request processed in 237us (390us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319933.911818:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17357
00000100:00100000:2.0:1767319933.911840:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884672
00000100:00100000:2.0:1767319933.911843:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884672
00000100:00100000:2.0:1767319933.911859:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79
00000100:00100000:2.0:1767319933.911863:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379884672:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319933.911974:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319933.911998:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379884672:12345-0@lo:38:kworker.0 Request processed in 134us (502us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319933.912005:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79
00000100:00080000:2.0:1767319933.912040:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319933.912044:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319933.912047:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379884544:0@lo:38:kworker.0
00000100:00080000:2.0:1767319933.912055:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319933.912058:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319933.912061:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379884672:0@lo:38:kworker.0
00000100:00100000:1.0:1767319933.915695:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379884928:0@lo:400:kworker.0
00000100:00100000:1.0:1767319933.916179:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319933.916235:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379884800:0@lo:400:kworker.0
00000100:00100000:1.0:1767319933.916257:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319933.916352:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884928
00000100:00100000:0.0:1767319933.916360:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884928
00000100:00100000:0.0:1767319933.916408:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379884800
00000100:00100000:0.0:1767319933.916411:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379884800
00000100:00100000:0.0:1767319933.916444:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695
00000100:00100000:0.0:1767319933.916453:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379884928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319933.916502:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379884928:12345-0@lo:400:kworker.0 Request processed in 50us (324us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319933.916510:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695
00000100:00100000:0.0:1767319933.916527:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696
00000100:00100000:0.0:1767319933.916533:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379884800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319933.916559:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379884800:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319933.916565:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696
00000100:00080000:0.0:1767319933.916594:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319933.917008:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379884928:0@lo:400:kworker.0
00000100:00100000:1.0:1767319933.917020:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379884800:0@lo:400:kworker.0
00000100:00100000:2.0:1767319933.918195:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379885056:0@lo:400:kworker.0
00000100:00100000:2.0:1767319933.918245:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319933.918302:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319933.918307:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319933.918311:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319933.918316:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4831
00000100:00080000:3.0:1767319933.918320:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319933.918326:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319933.918348:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91f80 x1853164379885184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319933.918451:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379885312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319933.918481:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319933.918527:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885056
00000100:00100000:0.0:1767319933.918534:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885056
00000100:00100000:0.0:1767319933.918596:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885312
00000100:00100000:0.0:1767319933.918600:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885312
00000100:00100000:0.0:1767319933.918621:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4541
00000100:00100000:0.0:1767319933.918629:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379885056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319933.918903:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4542
00000100:00100000:1.0:1767319933.918914:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379885312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319933.918957:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379885312:12345-0@lo:400:kworker.0 Request processed in 47us (476us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319933.918965:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4542
00000100:00100000:1.0:1767319933.919015:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379885312:0@lo:400:kworker.0
00000100:00100000:1.0:1767319933.919054:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379885184:0@lo:38:kworker.0
00000100:00100000:1.0:1767319933.919080:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319933.919116:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885184
00000100:00100000:1.0:1767319933.919120:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885184
00000100:00100000:1.0:1767319933.919156:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17358
00000100:00100000:1.0:1767319933.919160:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379885184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319933.919178:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319933.919209:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379885184:12345-0@lo:38:kworker.0 Request processed in 47us (129us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319933.919214:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17358
00000100:00080000:1.0:1767319933.919241:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319933.919245:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319933.919249:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379885184:0@lo:38:kworker.0
00000100:00080000:1.0:1767319933.919274:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319933.919913:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319933.919919:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319933.919921:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319933.919927:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4831
00000100:00080000:3.0:1767319933.919930:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319933.919935:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319933.919959:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90e00 x1853164379885440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319933.920136:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379885440:0@lo:38:kworker.0
00000100:00100000:1.0:1767319933.920182:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319933.920215:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885440
00000100:00100000:1.0:1767319933.920220:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885440
00000100:00100000:1.0:1767319933.920242:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17359
00000100:00100000:1.0:1767319933.920246:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379885440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319933.920260:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319933.920292:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379885440:12345-0@lo:38:kworker.0 Request processed in 44us (109us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319933.920298:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17359
00000100:00080000:1.0:1767319933.920325:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319933.920328:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319933.920332:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379885440:0@lo:38:kworker.0
00000100:00100000:0.0:1767319933.920508:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379885056:12345-0@lo:400:kworker.0 Request processed in 1878us (2260us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319933.920515:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4541
00000100:00100000:2.0:1767319933.920677:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379885056:0@lo:400:kworker.0
00010000:00010000:3.0:1767319934.426911:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319934.865383:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319934.865543:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291945344
00000100:00100000:2.0:1767319934.865554:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291945344
00000100:00100000:2.0:1767319934.865607:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17360
00000100:00100000:2.0:1767319934.865615:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291945344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319934.865641:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319934.865712:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291945344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 96us (338us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319934.865720:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17360
00000100:00100000:0.0:1767319934.876899:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319934.877248:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291945472
00000100:00100000:1.0:1767319934.877258:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291945472
00000100:00100000:1.0:1767319934.877339:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4543
00000100:00100000:1.0:1767319934.877351:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291945472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319934.877445:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291945472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 96us (589us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319934.877453:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4543
00000100:00080000:0.0:1767319934.877519:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767319935.452339:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319935.959392:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319935.959410:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379885568:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319935.959484:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319935.959824:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885568
00000100:00100000:0.0:1767319935.959832:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885568
00000100:00100000:0.0:1767319935.959925:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480
00000100:00100000:0.0:1767319935.959935:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379885568:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319935.959964:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319935.960238:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379885568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 304us (753us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319935.960245:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480
00000100:00100000:3.0:1767319935.960333:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379885568:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319935.960440:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319936.471438:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319937.495566:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379885696:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319937.495642:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319937.495798:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885696
00000100:00100000:0.0:1767319937.495806:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885696
00000100:00100000:0.0:1767319937.495893:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481
00000100:00100000:0.0:1767319937.495904:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379885696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319937.495937:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319937.495980:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379885696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (338us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319937.495987:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481
00000100:00080000:1.0:1767319937.496184:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319937.496219:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379885696:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767319937.496294:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319938.519575:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319939.031249:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319939.031258:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319939.031261:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319939.031264:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319939.031268:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319939.031275:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4836
00000100:00080000:3.0:1767319939.031278:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319939.031284:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319939.031324:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90a80 x1853164379885824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319939.031350:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319939.031353:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319939.031355:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319939.031359:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4836
00000100:00080000:3.0:1767319939.031362:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319939.031366:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319939.031379:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90e00 x1853164379885952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319939.031459:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319939.031462:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319939.031464:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319939.031468:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4836
00000100:00080000:3.0:1767319939.031471:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319939.031474:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319939.031486:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92a00 x1853164379886464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319939.031501:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319939.031504:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319939.031506:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767319939.031507:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886080:0@lo:400:kworker.0
00000100:00080000:3.0:1767319939.031510:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4836
00000100:00080000:3.0:1767319939.031515:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319939.031518:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319939.031526:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162b800 x1853164379886720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319939.031548:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379886336:0@lo:400:kworker.0
00000100:00100000:3.0:1767319939.031585:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319939.031589:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319939.031690:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319939.031696:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379886592:0@lo:400:kworker.0
00000100:00100000:2.0:1767319939.031699:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319939.031709:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886208:0@lo:400:kworker.0
00000100:00100000:3.0:1767319939.031715:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319939.031740:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319939.031779:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886336
00000100:00100000:2.0:1767319939.031786:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886336
00000100:00100000:2.0:1767319939.031843:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886592
00000100:00100000:2.0:1767319939.031846:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886592
00000100:00100000:2.0:1767319939.031896:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4544
00000100:00100000:2.0:1767319939.031907:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379886336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319939.031910:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886080
00000100:00100000:3.0:1767319939.031915:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886080
00000100:00100000:3.0:1767319939.031937:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886208
00000100:00100000:3.0:1767319939.031940:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886208
00000100:00100000:3.0:1767319939.031962:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697
00000100:00100000:2.0:1767319939.031968:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379886336:12345-0@lo:400:kworker.0 Request processed in 61us (383us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319939.031974:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319939.031981:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4544
00000100:00100000:2.0:1767319939.032003:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4545
00000100:00100000:2.0:1767319939.032011:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379886592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319939.032020:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886080:12345-0@lo:400:kworker.0 Request processed in 49us (435us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319939.032028:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697
00000100:00100000:3.0:1767319939.032056:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698
00000100:00100000:2.0:1767319939.032058:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379886592:12345-0@lo:400:kworker.0 Request processed in 47us (340us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319939.032067:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319939.032068:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4545
00000100:00100000:2.0:1767319939.032111:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379886592:0@lo:400:kworker.0
00000100:00100000:2.0:1767319939.032122:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379886336:0@lo:400:kworker.0
00000100:00100000:2.0:1767319939.032150:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886080:0@lo:400:kworker.0
00000100:00100000:3.0:1767319939.032266:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886208:12345-0@lo:400:kworker.0 Request processed in 202us (526us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319939.032271:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698
00000100:00100000:2.0:1767319939.032312:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886208:0@lo:400:kworker.0
00000100:00080000:1.0:1767319939.032451:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319939.032456:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767319939.032458:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319939.032613:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379885824:0@lo:38:kworker.0
00000100:00100000:1.0:1767319939.032638:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319939.032654:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379885952:0@lo:38:kworker.0
00000100:00100000:1.0:1767319939.032668:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319939.032686:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379886464:0@lo:38:kworker.0
00000100:00100000:1.0:1767319939.032697:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319939.032705:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379886720:0@lo:38:kworker.0
00000100:00100000:1.0:1767319939.032715:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319939.032730:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885952
00000100:00100000:1.0:1767319939.032733:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885952
00000100:00100000:1.0:1767319939.032748:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80
00000100:00100000:1.0:1767319939.032751:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379885952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319939.032764:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319939.032785:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379885952:12345-0@lo:38:kworker.0 Request processed in 33us (115us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319939.032790:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80
00000100:00100000:1.0:1767319939.032811:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379885824
00000100:00100000:1.0:1767319939.032814:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379885824
00000100:00100000:1.0:1767319939.032828:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886464
00000100:00100000:1.0:1767319939.032830:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886464
00000100:00100000:1.0:1767319939.032840:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886720
00000100:00100000:1.0:1767319939.032842:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886720
00000100:00100000:1.0:1767319939.032852:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17361
00000100:00100000:1.0:1767319939.032856:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379885824:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319939.032865:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319939.032899:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379885824:12345-0@lo:38:kworker.0 Request processed in 42us (260us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319939.032903:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17361
00000100:00100000:1.0:1767319939.032911:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17362
00000100:00100000:1.0:1767319939.032914:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379886464:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319939.032920:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319939.032931:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379886464:12345-0@lo:38:kworker.0 Request processed in 17us (234us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319939.032934:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17362
00000100:00100000:1.0:1767319939.032941:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17363
00000100:00100000:1.0:1767319939.032944:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379886720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319939.032952:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319939.032972:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379886720:12345-0@lo:38:kworker.0 Request processed in 27us (255us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319939.032977:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17363
00000100:00080000:1.0:1767319939.033003:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319939.033007:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319939.033011:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379885824:0@lo:38:kworker.0
00000100:00080000:1.0:1767319939.033018:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319939.033021:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319939.033024:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379885952:0@lo:38:kworker.0
00000100:00080000:1.0:1767319939.033032:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319939.033035:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319939.033049:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379886464:0@lo:38:kworker.0
00000100:00080000:1.0:1767319939.033059:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319939.033061:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319939.033064:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379886720:0@lo:38:kworker.0
00010000:00010000:1.0:1767319939.544602:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319939.983991:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319939.984135:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291945600
00000100:00100000:0.0:1767319939.984149:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291945600
00000100:00100000:0.0:1767319939.984208:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17364
00000100:00100000:0.0:1767319939.984217:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291945600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319939.984241:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319939.984322:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291945600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 104us (352us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319939.984331:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17364
00000100:00100000:0.0:1767319939.988158:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767319939.988267:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291945856 offset 0 length 520: 4
00000100:00100000:3.0:1767319939.991638:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291945728
00000100:00100000:3.0:1767319939.991660:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291945728
00000100:00100000:3.0:1767319939.992282:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4546
00000100:00100000:3.0:1767319939.992296:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291945728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319939.992434:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291945728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 141us (4285us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319939.992442:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4546
00000100:00080000:1.0:1767319939.993282:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319940.567374:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319941.080167:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886848:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319941.080241:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319941.080429:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886848
00000100:00100000:3.0:1767319941.080438:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886848
00000100:00080000:1.0:1767319941.080588:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319941.080763:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482
00000100:00100000:3.0:1767319941.080774:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886848:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319941.080804:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319941.080901:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (660us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319941.080910:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482
00000100:00100000:2.0:1767319941.081848:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886848:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767319941.591593:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319942.615123:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319942.615362:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319942.615384:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886976:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319942.615455:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319942.615576:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379886976
00000100:00100000:0.0:1767319942.615586:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379886976
00000100:00100000:0.0:1767319942.615647:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483
00000100:00100000:0.0:1767319942.615656:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319942.615697:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319942.615741:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379886976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (285us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319942.615759:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483
00000100:00080000:2.0:1767319942.616083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319942.616289:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379886976:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767319943.126995:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319918/real 1767319918]  req@ffff8b0e0c44a300 x1853164379880576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767319943.127045:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c44a300 x1853164379880576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767319943.127067:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319943.127094:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767319943.127098:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379880576:0@lo:250:kworker.0
00000100:00080000:3.0:1767319943.127207:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319943.127214:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767319943.127218:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319943.127223:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4821
00000100:00080000:3.0:1767319943.127227:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319943.127232:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319943.127265:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629180 x1853164379887104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319943.127294:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319943.127298:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319943.127300:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319943.127304:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4841
00000100:00080000:3.0:1767319943.127306:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319943.127318:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319943.127333:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629880 x1853164379887232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319943.127342:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319943.127346:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319943.127348:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319943.127351:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4841
00000100:00080000:3.0:1767319943.127353:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319943.127357:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319943.127367:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162a680 x1853164379887360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319943.127430:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319943.127433:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319943.127435:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319943.127438:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4841
00000100:00080000:3.0:1767319943.127441:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319943.127444:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319943.127455:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628a80 x1853164379887744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319943.127480:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319943.127483:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319943.127485:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767319943.127489:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379887616:0@lo:400:kworker.0
00000100:00080000:3.0:1767319943.127501:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4841
00000100:00080000:3.0:1767319943.127503:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319943.127508:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319943.127524:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162b480 x1853164379888000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319943.127555:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379887872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319943.127563:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319943.127595:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319943.127630:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319943.127643:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379887488:0@lo:400:kworker.0
00000100:00100000:1.0:1767319943.127670:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379887104:0@lo:250:kworker.0
00000100:00100000:0.0:1767319943.127677:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000400:00000100:1.0:1767319943.127703:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379887104 offset 0 length 520: 4
00000100:00100000:0.0:1767319943.127729:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379887616
00000100:00100000:1.0:1767319943.127732:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379887232:0@lo:38:kworker.0
00000100:00100000:0.0:1767319943.127738:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379887616
00000100:00100000:1.0:1767319943.127754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319943.127773:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379887360:0@lo:38:kworker.0
00000100:00100000:1.0:1767319943.127792:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319943.127800:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379887872
00000100:00100000:0.0:1767319943.127805:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379887872
00000100:00100000:1.0:1767319943.127809:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379887744:0@lo:38:kworker.0
00000100:00100000:1.0:1767319943.127830:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319943.127949:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379888000:0@lo:38:kworker.0
00000100:00100000:1.0:1767319943.127968:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319943.128525:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379887360
00000100:00100000:3.0:1767319943.128530:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379887360
00000100:00100000:3.0:1767319943.128553:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81
00000100:00100000:3.0:1767319943.128559:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379887360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319943.128579:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319943.128618:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379887360:12345-0@lo:38:kworker.0 Request processed in 58us (824us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319943.128624:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81
00000100:00100000:0.0:1767319943.130167:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379887232
00000100:00100000:0.0:1767319943.130182:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379887232
00000100:00100000:0.0:1767319943.130225:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379887744
00000100:00100000:0.0:1767319943.130229:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379887744
00000100:00100000:0.0:1767319943.130248:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4547
00000100:00100000:0.0:1767319943.130268:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379887616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319943.130806:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379887616:12345-0@lo:400:kworker.0 Request processed in 547us (3245us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319943.130826:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4547
00000100:00100000:0.0:1767319943.130852:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4548
00000100:00100000:0.0:1767319943.130862:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379887872:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319943.130939:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379887872:12345-0@lo:400:kworker.0 Request processed in 79us (3344us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319943.130946:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4548
00000100:00100000:0.0:1767319943.130961:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17365
00000100:00100000:0.0:1767319943.130965:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379887232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319943.130985:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319943.131029:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379887232:12345-0@lo:38:kworker.0 Request processed in 61us (3274us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319943.131034:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17365
00000100:00100000:0.0:1767319943.131047:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17366
00000100:00100000:0.0:1767319943.131050:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379887744:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319943.131060:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319943.131083:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379887744:12345-0@lo:38:kworker.0 Request processed in 31us (3253us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319943.131088:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17366
00000100:00100000:0.0:1767319943.131115:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379887488
00000100:00100000:0.0:1767319943.131120:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379887488
00000100:00100000:0.0:1767319943.131163:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699
00000100:00100000:0.0:1767319943.131170:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379887488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319943.131202:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379887488:12345-0@lo:400:kworker.0 Request processed in 33us (3528us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319943.131207:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699
00000100:00080000:0.0:1767319943.131225:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767319943.131230:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319943.131286:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379887872:0@lo:400:kworker.0
00000100:00100000:0.0:1767319943.131329:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379887488:0@lo:400:kworker.0
00000100:00100000:0.0:1767319943.131339:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379887616:0@lo:400:kworker.0
00000100:00080000:1.0:1767319943.145027:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319943.145041:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319943.145046:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379887232:0@lo:38:kworker.0
00000100:00080000:1.0:1767319943.145059:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319943.145063:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319943.145066:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379887360:0@lo:38:kworker.0
00000100:00080000:1.0:1767319943.145076:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319943.145079:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319943.145082:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379887744:0@lo:38:kworker.0
00000100:00100000:3.0:1767319943.149640:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888000
00000100:00100000:3.0:1767319943.149663:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888000
00000100:00100000:3.0:1767319943.151048:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17367
00000100:00100000:3.0:1767319943.151061:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379888000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319943.151088:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319943.151932:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379888000:12345-0@lo:38:kworker.0 Request processed in 865us (23955us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319943.151945:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17367
00000100:00080000:1.0:1767319943.152675:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319943.152682:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319943.152688:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379888000:0@lo:38:kworker.0
00010000:00010000:1.0:1767319943.643933:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319944.663388:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319945.112070:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319945.112110:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319945.112258:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291945984
00000100:00100000:0.0:1767319945.112267:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291945984
00000100:00100000:0.0:1767319945.112310:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291946112
00000100:00100000:0.0:1767319945.112313:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291946112
00000100:00100000:0.0:1767319945.112365:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4549
00000100:00100000:0.0:1767319945.112374:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291946112:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319945.112446:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291946112:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (336us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319945.112453:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4549
00000100:00100000:0.0:1767319945.112470:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17368
00000100:00100000:0.0:1767319945.112473:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291945984:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319945.112492:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319945.112511:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291945984:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 37us (451us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319945.112517:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17368
00000100:00080000:1.0:1767319945.112723:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319945.687123:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319946.200286:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319946.200319:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379888128:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319946.200409:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319946.200630:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888128
00000100:00100000:0.0:1767319946.200639:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888128
00000100:00100000:0.0:1767319946.200711:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484
00000100:00100000:0.0:1767319946.200720:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379888128:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319946.200751:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319946.200800:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379888128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (391us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319946.200807:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484
00000100:00100000:0.0:1767319946.200853:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379888128:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319946.204472:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319946.711397:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319947.735361:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319947.735602:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379888256:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319947.735697:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319947.736110:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888256
00000100:00100000:1.0:1767319947.736130:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888256
00000100:00100000:1.0:1767319947.736200:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485
00000100:00100000:1.0:1767319947.736214:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379888256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319947.736248:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767319947.736595:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319947.737576:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379888256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1361us (1875us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319947.737589:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485
00000100:00100000:3.0:1767319947.739250:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379888256:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319948.247139:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319948.247152:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319948.247157:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319948.247161:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319948.247166:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319948.247174:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4845
00000100:00080000:3.0:1767319948.247179:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319948.247187:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319948.247229:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162a300 x1853164379888384/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319948.247311:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379888384:0@lo:38:kworker.0
00000100:00100000:1.0:1767319948.247384:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319948.247505:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888384
00000100:00100000:2.0:1767319948.247513:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888384
00000100:00100000:2.0:1767319948.247562:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17369
00000100:00100000:2.0:1767319948.247570:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379888384:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319948.247592:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319948.247830:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319948.247834:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319948.247836:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319948.247841:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4845
00000100:00080000:3.0:1767319948.247844:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319948.247849:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319948.247901:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162b480 x1853164379888512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319948.249321:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379888512:0@lo:38:kworker.0
00000100:00100000:1.0:1767319948.249374:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319948.249519:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319948.249523:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319948.249526:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319948.249530:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4845
00000100:00080000:3.0:1767319948.249533:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319948.249538:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319948.249553:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629880 x1853164379888896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319948.249575:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319948.249578:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319948.249580:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319948.249583:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4845
00000100:00080000:3.0:1767319948.249585:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319948.249589:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319948.249599:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628000 x1853164379889152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319948.249840:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888512
00000100:00100000:0.0:1767319948.249847:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888512
00000100:00100000:0.0:1767319948.249905:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82
00000100:00100000:0.0:1767319948.249912:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379888512:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319948.249931:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319948.249991:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379888512:12345-0@lo:38:kworker.0 Request processed in 79us (616us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319948.249998:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82
00000100:00100000:0.0:1767319948.250024:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379888640:0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250052:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319948.250094:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888640
00000100:00100000:0.0:1767319948.250098:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888640
00000100:00100000:0.0:1767319948.250145:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700
00000100:00100000:0.0:1767319948.250151:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379888640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250188:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379888640:12345-0@lo:400:kworker.0 Request processed in 36us (135us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319948.250194:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700
00000100:00080000:0.0:1767319948.250208:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767319948.250223:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379888768:0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250250:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319948.250272:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319948.250277:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379889024:0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250298:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319948.250321:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888768
00000100:00100000:0.0:1767319948.250325:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888768
00000100:00100000:0.0:1767319948.250352:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889024
00000100:00100000:0.0:1767319948.250355:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889024
00000100:00100000:0.0:1767319948.250374:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4550
00000100:00100000:0.0:1767319948.250380:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379888768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250410:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379888768:12345-0@lo:400:kworker.0 Request processed in 30us (160us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319948.250415:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4550
00000100:00100000:0.0:1767319948.250426:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4551
00000100:00100000:0.0:1767319948.250431:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379889024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250470:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379889024:12345-0@lo:400:kworker.0 Request processed in 38us (171us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319948.250476:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4551
00000100:00080000:0.0:1767319948.250495:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319948.250522:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379888640:0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250547:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379889024:0@lo:400:kworker.0
00000100:00100000:0.0:1767319948.250555:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379888768:0@lo:400:kworker.0
00000100:00100000:2.0:1767319948.251371:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379888384:12345-0@lo:38:kworker.0 Request processed in 3797us (3983us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319948.251379:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17369
00000100:00080000:1.0:1767319948.251773:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319948.251779:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319948.251783:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379888384:0@lo:38:kworker.0
00000100:00100000:1.0:1767319948.251812:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379888896:0@lo:38:kworker.0
00000100:00100000:1.0:1767319948.251849:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319948.252264:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379889152:0@lo:38:kworker.0
00000100:00100000:1.0:1767319948.252290:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767319948.252368:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319948.252373:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319948.252376:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379888512:0@lo:38:kworker.0
00000100:00100000:2.0:1767319948.252538:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379888896
00000100:00100000:2.0:1767319948.252545:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379888896
00000100:00100000:2.0:1767319948.252583:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889152
00000100:00100000:2.0:1767319948.252587:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889152
00000100:00100000:2.0:1767319948.252613:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17370
00000100:00100000:2.0:1767319948.252827:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379888896:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319948.252846:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319948.252922:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379888896:12345-0@lo:38:kworker.0 Request processed in 95us (1072us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319948.253250:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17371
00000100:00100000:3.0:1767319948.253257:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379889152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319948.253269:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319948.253303:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379889152:12345-0@lo:38:kworker.0 Request processed in 46us (1013us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319948.253310:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17371
00000100:00080000:3.0:1767319948.253358:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319948.253363:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319948.253367:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379888896:0@lo:38:kworker.0
00000100:00080000:3.0:1767319948.253376:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319948.253380:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319948.253383:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379889152:0@lo:38:kworker.0
00000100:00100000:2.0:1767319948.253554:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17370
00010000:00010000:3.0:1767319948.759606:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319949.783225:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319950.223538:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319950.223688:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291946240
00000100:00100000:0.0:1767319950.223698:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291946240
00000100:00100000:0.0:1767319950.223746:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17372
00000100:00100000:0.0:1767319950.223755:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291946240:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319950.223779:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319950.223993:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291946240:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 237us (463us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319950.224002:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17372
00000100:00100000:0.0:1767319950.226075:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319950.226567:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291946368
00000100:00100000:3.0:1767319950.226576:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291946368
00000100:00100000:3.0:1767319950.226685:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4552
00000100:00100000:3.0:1767319950.226694:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291946368:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319950.226774:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291946368:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (706us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319950.226783:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4552
00000100:00080000:0.0:1767319950.227718:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319950.809368:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319951.319486:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319951.319506:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379889280:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319951.319579:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319951.319746:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889280
00000100:00100000:0.0:1767319951.319755:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889280
00000100:00100000:0.0:1767319951.319893:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486
00000100:00100000:0.0:1767319951.319914:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379889280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767319951.319954:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319951.319998:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379889280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (418us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319951.320005:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486
00000100:00080000:1.0:1767319951.320056:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319951.320092:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379889280:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319951.833058:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319952.856959:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319952.857209:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319952.857228:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379889408:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319952.857291:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319952.857427:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889408
00000100:00100000:0.0:1767319952.857435:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889408
00000100:00100000:0.0:1767319952.857501:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487
00000100:00100000:0.0:1767319952.857510:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379889408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319952.857540:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319952.857581:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379889408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (285us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319952.857587:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487
00000100:00080000:2.0:1767319952.857751:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767319952.859131:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379889408:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319953.366994:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319953.367006:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319953.367009:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319953.367013:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319953.367017:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319953.367025:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4850
00000100:00080000:0.0:1767319953.367030:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319953.367036:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319953.367080:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ad500 x1853164379889536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319953.367130:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319953.367132:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379889536:0@lo:38:kworker.0
00000100:00080000:0.0:1767319953.367134:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319953.367136:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319953.367140:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4850
00000100:00080000:0.0:1767319953.367142:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319953.367146:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319953.367159:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ac380 x1853164379889664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319953.367205:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767319953.367205:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767319953.367208:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319953.367210:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319953.367214:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4850
00000100:00080000:0.0:1767319953.367216:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319953.367220:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319953.367229:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ad880 x1853164379890048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319953.367254:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319953.367258:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319953.367260:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319953.367263:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4850
00000100:00080000:0.0:1767319953.367265:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767319953.367268:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379889664:0@lo:38:kworker.0
00000100:00080000:0.0:1767319953.367269:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319953.367280:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a7480 x1853164379890304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319953.367296:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319953.367302:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319953.367302:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379889920:0@lo:400:kworker.0
00000100:00100000:0.0:1767319953.367313:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379890176:0@lo:400:kworker.0
00000100:00100000:3.0:1767319953.367321:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379890048:0@lo:38:kworker.0
00000100:00100000:1.0:1767319953.367345:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319953.367371:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889664
00000100:00100000:0.0:1767319953.367379:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889664
00000100:00100000:1.0:1767319953.367387:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319953.367394:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379889792:0@lo:400:kworker.0
00000100:00100000:0.0:1767319953.367415:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83
00000100:00100000:1.0:1767319953.367421:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319953.367426:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379889664:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319953.367447:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319953.367462:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319953.372505:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889536
00000100:00100000:3.0:1767319953.372524:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889536
00000100:00100000:3.0:1767319953.372593:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889920
00000100:00100000:3.0:1767319953.372597:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889920
00000100:00100000:3.0:1767319953.372652:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890176
00000100:00100000:3.0:1767319953.372655:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890176
00000100:00100000:3.0:1767319953.372688:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4553
00000100:00100000:3.0:1767319953.372697:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379889920:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319953.372790:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379889920:12345-0@lo:400:kworker.0 Request processed in 94us (5445us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319953.372792:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4554
00000100:00100000:3.0:1767319953.372803:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4553
00000100:00100000:1.0:1767319953.372809:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379890176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319953.372824:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17373
00000100:00100000:3.0:1767319953.372829:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379889536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319953.372848:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319953.372855:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379890176:12345-0@lo:400:kworker.0 Request processed in 51us (5392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319953.372864:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4554
00000100:00100000:3.0:1767319953.372901:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379889536:12345-0@lo:38:kworker.0 Request processed in 69us (5694us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319953.372919:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17373
00000100:00100000:3.0:1767319953.372944:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767319953.372979:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319953.372984:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319953.372987:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379889536:0@lo:38:kworker.0
00000100:00100000:3.0:1767319953.373114:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379890304:0@lo:38:kworker.0
00000100:00100000:3.0:1767319953.373147:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319953.373176:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890048
00000100:00100000:3.0:1767319953.373180:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890048
00000100:00100000:3.0:1767319953.373192:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890304
00000100:00100000:3.0:1767319953.373194:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890304
00000100:00100000:3.0:1767319953.373202:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17374
00000100:00100000:3.0:1767319953.373206:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379890048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319953.373216:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319953.373246:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379890048:12345-0@lo:38:kworker.0 Request processed in 38us (302us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319953.373253:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17374
00000100:00100000:3.0:1767319953.373266:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17375
00000100:00100000:3.0:1767319953.373271:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379890304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319953.373281:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319953.373303:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379890304:12345-0@lo:38:kworker.0 Request processed in 31us (155us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319953.373308:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17375
00000100:00080000:3.0:1767319953.373843:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319953.373849:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319953.373852:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379890304:0@lo:38:kworker.0
00000100:00080000:3.0:1767319953.376231:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767319953.376237:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379889920:0@lo:400:kworker.0
00000100:00080000:3.0:1767319953.376241:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319953.376247:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379890048:0@lo:38:kworker.0
00000100:00080000:3.0:1767319953.376319:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319953.376392:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379890176:0@lo:400:kworker.0
00000100:00100000:1.0:1767319953.376445:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379889792
00000100:00100000:1.0:1767319953.376452:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379889792
00000100:00080000:3.0:1767319953.376506:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319953.376517:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701
00000100:00100000:1.0:1767319953.376527:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379889792:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319953.377601:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379889792:12345-0@lo:400:kworker.0 Request processed in 1071us (10176us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319953.377612:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701
00000100:00100000:2.0:1767319953.378977:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379889792:0@lo:400:kworker.0
00000100:00100000:0.0:1767319953.405443:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379889664:12345-0@lo:38:kworker.0 Request processed in 38008us (38136us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319953.405461:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83
00000100:00080000:3.0:1767319953.406207:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319953.406215:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319953.406219:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379889664:0@lo:38:kworker.0
00010000:00010000:3.0:1767319953.879306:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319954.903031:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319955.345843:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319955.345936:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319955.346145:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291946624
00000100:00100000:2.0:1767319955.346150:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291946496
00000100:00100000:0.0:1767319955.346157:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291946624
00000100:00100000:2.0:1767319955.346158:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291946496
00000100:00100000:2.0:1767319955.346229:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4555
00000100:00100000:2.0:1767319955.346240:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291946624:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767319955.346314:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319955.346329:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291946624:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (496us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319955.349585:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17376
00000100:00100000:0.0:1767319955.349604:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291946496:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319955.349650:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319955.349742:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291946496:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 130us (3793us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319955.349751:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17376
00000100:00100000:2.0:1767319955.357230:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4555
00010000:00010000:1.0:1767319955.927140:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319956.439151:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379890432:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767319956.439222:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319956.439290:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890432
00000100:00100000:3.0:1767319956.439298:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890432
00000100:00100000:3.0:1767319956.439366:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488
00000100:00100000:3.0:1767319956.439375:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379890432:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319956.439404:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319956.439461:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379890432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (237us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319956.439468:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488
00000100:00080000:3.0:1767319956.439490:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319956.439522:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379890432:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319956.951047:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319957.975012:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379890560:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319957.975086:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319957.975278:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319957.975359:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890560
00000100:00100000:0.0:1767319957.975368:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890560
00000100:00100000:0.0:1767319957.975447:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489
00000100:00100000:0.0:1767319957.975457:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379890560:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319957.975486:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319957.975542:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379890560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (455us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319957.975549:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489
00000100:00100000:2.0:1767319957.975813:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379890560:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319957.975899:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319958.424574:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319958.427217:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291946752
00000100:00100000:2.0:1767319958.427232:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291946752
00000100:00100000:2.0:1767319958.427342:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17377
00000100:00100000:2.0:1767319958.427354:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291946752:12345-192.168.202.33@tcp:17:kworker.0
00000100:00100000:2.0:1767319958.427477:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291946752:12345-192.168.202.33@tcp:17:kworker.0 Request processed in 124us (2910us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319958.427489:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17377
00000100:00080000:3.0:1767319958.428139:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767319958.487064:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319958.487075:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319958.487079:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319958.487082:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319958.487087:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319958.487097:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4855
00000100:00080000:2.0:1767319958.487104:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:2.0:1767319958.487111:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319958.487153:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90700 x1853164379890688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319958.487178:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319958.487181:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319958.487183:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319958.487187:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4855
00000100:00080000:2.0:1767319958.487189:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:2.0:1767319958.487192:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319958.487205:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91f80 x1853164379890816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319958.487289:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319958.487292:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319958.487294:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319958.487297:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4855
00000100:00080000:2.0:1767319958.487300:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:2.0:1767319958.487303:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319958.487316:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93800 x1853164379891200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319958.487330:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319958.487333:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319958.487335:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319958.487338:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4855
00000100:00080000:2.0:1767319958.487340:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319958.487344:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319958.487354:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92a00 x1853164379891456/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319958.487384:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379891072:0@lo:400:kworker.0
00000100:00100000:2.0:1767319958.487512:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319958.487575:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319958.487582:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379891328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319958.487605:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319958.487640:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891072
00000100:00100000:2.0:1767319958.487648:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891072
00000100:00100000:2.0:1767319958.487699:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891328
00000100:00100000:2.0:1767319958.487703:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891328
00000100:00100000:2.0:1767319958.487726:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4556
00000100:00100000:2.0:1767319958.487734:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379891072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319958.487785:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379891072:12345-0@lo:400:kworker.0 Request processed in 52us (272us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319958.487793:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4556
00000100:00100000:2.0:1767319958.487817:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4557
00000100:00100000:2.0:1767319958.487824:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379891328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319958.487855:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379891328:12345-0@lo:400:kworker.0 Request processed in 32us (249us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319958.487920:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4557
00000100:00080000:2.0:1767319958.487940:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319958.487973:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379891328:0@lo:400:kworker.0
00000100:00100000:2.0:1767319958.487984:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379891072:0@lo:400:kworker.0
00000100:00100000:0.0:1767319958.488062:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319958.488072:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379890944:0@lo:400:kworker.0
00000100:00100000:0.0:1767319958.488105:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319958.488559:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379890688:0@lo:38:kworker.0
00000100:00100000:1.0:1767319958.488592:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319958.488622:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379890816:0@lo:38:kworker.0
00000100:00100000:1.0:1767319958.488644:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319958.488665:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379891200:0@lo:38:kworker.0
00000100:00100000:1.0:1767319958.488687:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319958.488701:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379891456:0@lo:38:kworker.0
00000100:00100000:1.0:1767319958.488720:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319958.488752:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890688
00000100:00100000:1.0:1767319958.488758:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890688
00000100:00100000:1.0:1767319958.488782:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891200
00000100:00100000:1.0:1767319958.488785:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891200
00000100:00100000:1.0:1767319958.488797:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891456
00000100:00100000:1.0:1767319958.488799:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891456
00000100:00100000:1.0:1767319958.488813:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17378
00000100:00100000:1.0:1767319958.488818:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379890688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319958.488837:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319958.488904:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379890688:12345-0@lo:38:kworker.0 Request processed in 83us (311us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319958.488910:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17378
00000100:00100000:1.0:1767319958.488928:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17379
00000100:00100000:1.0:1767319958.488932:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379891200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319958.488941:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319958.488966:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379891200:12345-0@lo:38:kworker.0 Request processed in 32us (278us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319958.488971:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17379
00000100:00100000:1.0:1767319958.488984:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17380
00000100:00100000:1.0:1767319958.488988:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379891456:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319958.488997:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319958.489018:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379891456:12345-0@lo:38:kworker.0 Request processed in 28us (297us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319958.489023:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17380
00000100:00080000:1.0:1767319958.489054:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319958.489059:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319958.489062:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379890688:0@lo:38:kworker.0
00000100:00080000:1.0:1767319958.489070:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319958.489073:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319958.489075:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379891200:0@lo:38:kworker.0
00000100:00080000:1.0:1767319958.489081:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319958.489084:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319958.489087:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379891456:0@lo:38:kworker.0
00000100:00100000:0.0:1767319958.489179:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890816
00000100:00100000:0.0:1767319958.489184:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890816
00000100:00100000:0.0:1767319958.489213:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84
00000100:00100000:0.0:1767319958.489217:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379890816:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319958.489227:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319958.489261:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379890816:12345-0@lo:38:kworker.0 Request processed in 42us (615us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319958.489266:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84
00000100:00080000:0.0:1767319958.489288:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319958.489292:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319958.489295:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379890816:0@lo:38:kworker.0
00000100:00100000:2.0:1767319958.489692:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379890944
00000100:00100000:2.0:1767319958.489698:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379890944
00000100:00100000:2.0:1767319958.489781:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702
00000100:00100000:2.0:1767319958.489789:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379890944:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319958.489845:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379890944:12345-0@lo:400:kworker.0 Request processed in 57us (1738us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319958.489851:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702
00000100:00100000:0.0:1767319958.490080:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379890944:0@lo:400:kworker.0
00000100:00080000:3.0:1767319958.490601:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319959.000280:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319960.023933:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319960.463776:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319960.463819:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319960.463946:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291947008
00000100:00100000:3.0:1767319960.463956:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291947008
00000100:00100000:3.0:1767319960.464015:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291946880
00000100:00100000:3.0:1767319960.464019:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291946880
00000100:00100000:3.0:1767319960.464036:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4558
00000100:00100000:3.0:1767319960.464047:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291947008:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767319960.464142:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291947008:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (376us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319960.464150:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4558
00000100:00100000:3.0:1767319960.464168:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17381
00000100:00100000:3.0:1767319960.464173:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291946880:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767319960.464192:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319960.464217:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291946880:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (398us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319960.464224:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17381
00000100:00080000:3.0:1767319960.464240:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319961.047346:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319961.559376:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319961.559405:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379891584:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319961.559479:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319961.559794:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891584
00000100:00100000:3.0:1767319961.559803:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891584
00000100:00100000:3.0:1767319961.559902:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490
00000100:00100000:3.0:1767319961.559913:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379891584:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319961.559940:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319961.559988:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379891584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (508us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319961.559995:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490
00000100:00100000:1.0:1767319961.560095:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379891584:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767319961.560221:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767319962.071173:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319963.095162:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319963.095678:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319963.095699:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379891712:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319963.095771:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319963.095992:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891712
00000100:00100000:1.0:1767319963.096002:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891712
00000100:00100000:1.0:1767319963.096078:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491
00000100:00100000:1.0:1767319963.096088:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379891712:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319963.096123:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319963.096188:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379891712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (415us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319963.096195:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491
00000100:00100000:3.0:1767319963.096367:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379891712:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319963.096487:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319963.608043:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319963.608053:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319963.608056:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319963.608059:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319963.608064:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319963.608075:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4860
00000100:00080000:0.0:1767319963.608081:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767319963.608089:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319963.608134:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b100 x1853164379891840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319963.608163:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319963.608168:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319963.608170:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319963.608174:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4860
00000100:00080000:0.0:1767319963.608177:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767319963.608180:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319963.608199:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379bb80 x1853164379891968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319963.608284:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319963.608287:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319963.608289:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319963.608293:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4860
00000100:00080000:0.0:1767319963.608296:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767319963.608300:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319963.608312:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44bb80 x1853164379892480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319963.608328:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319963.608331:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319963.608332:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767319963.608540:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379891840:0@lo:38:kworker.0
00000100:00100000:1.0:1767319963.608622:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319963.608694:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379891968:0@lo:38:kworker.0
00000100:00100000:1.0:1767319963.608726:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319963.608754:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379892480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319963.608774:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319963.608834:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891968
00000100:00100000:1.0:1767319963.608843:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891968
00000100:00100000:1.0:1767319963.608909:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85
00000100:00100000:1.0:1767319963.608917:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379891968:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319963.608938:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319963.608980:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379891968:12345-0@lo:38:kworker.0 Request processed in 63us (252us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319963.608987:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85
00000100:00100000:1.0:1767319963.609014:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379891840
00000100:00100000:1.0:1767319963.609018:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379891840
00000100:00100000:1.0:1767319963.609038:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892480
00000100:00100000:1.0:1767319963.609041:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892480
00000100:00100000:1.0:1767319963.609054:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17382
00000100:00100000:1.0:1767319963.609058:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379891840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319963.609070:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319963.609095:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379891840:12345-0@lo:38:kworker.0 Request processed in 36us (474us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319963.609102:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17382
00000100:00100000:1.0:1767319963.609113:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17383
00000100:00100000:1.0:1767319963.609117:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379892480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319963.609126:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319963.609149:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379892480:12345-0@lo:38:kworker.0 Request processed in 29us (373us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319963.609154:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17383
00000100:00080000:1.0:1767319963.609194:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319963.609199:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319963.609203:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379891840:0@lo:38:kworker.0
00000100:00080000:1.0:1767319963.609213:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319963.609217:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319963.609219:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379891968:0@lo:38:kworker.0
00000100:00080000:1.0:1767319963.609227:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319963.609230:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319963.609232:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379892480:0@lo:38:kworker.0
00000100:00100000:1.0:1767319963.609290:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379892352:0@lo:400:kworker.0
00000100:00100000:1.0:1767319963.609315:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319963.609704:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767319963.609714:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379892608:0@lo:400:kworker.0
00000100:00100000:1.0:1767319963.609742:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319963.609770:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892352
00000100:00100000:1.0:1767319963.609774:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892352
00000100:00100000:1.0:1767319963.609835:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892608
00000100:00100000:1.0:1767319963.609838:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892608
00000100:00100000:1.0:1767319963.609859:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4559
00000100:00100000:1.0:1767319963.609865:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379892352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319963.609946:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379892352:12345-0@lo:400:kworker.0 Request processed in 80us (629us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319963.609953:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4559
00000100:00100000:1.0:1767319963.609968:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4560
00000100:00100000:1.0:1767319963.609974:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379892608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319963.610005:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379892608:12345-0@lo:400:kworker.0 Request processed in 31us (261us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319963.610010:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4560
00000100:00100000:1.0:1767319963.610049:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379892608:0@lo:400:kworker.0
00000100:00100000:1.0:1767319963.610058:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379892352:0@lo:400:kworker.0
00000100:00100000:3.0:1767319963.610174:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379892224:0@lo:400:kworker.0
00000100:00100000:3.0:1767319963.610210:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319963.610244:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767319963.610251:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379892096:0@lo:400:kworker.0
00000100:00100000:3.0:1767319963.610273:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319963.610503:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892224
00000100:00100000:2.0:1767319963.610508:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892224
00000100:00100000:2.0:1767319963.610548:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892096
00000100:00100000:2.0:1767319963.610551:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892096
00000100:00100000:2.0:1767319963.610577:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703
00000100:00100000:2.0:1767319963.610584:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379892224:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319963.610628:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379892224:12345-0@lo:400:kworker.0 Request processed in 44us (417us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319963.610635:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703
00000100:00100000:2.0:1767319963.610665:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704
00000100:00100000:2.0:1767319963.610672:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379892096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319963.610701:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379892096:12345-0@lo:400:kworker.0 Request processed in 30us (427us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319963.610707:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704
00000100:00080000:2.0:1767319963.610727:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767319963.610732:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319963.610755:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379892096:0@lo:400:kworker.0
00000100:00100000:2.0:1767319963.610765:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379892224:0@lo:400:kworker.0
00000100:00080000:0.0:1767319963.611397:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4860
00000100:00080000:0.0:1767319963.611402:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319963.611408:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319963.611435:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448e00 x1853164379892736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319963.611787:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379892736:0@lo:38:kworker.0
00000100:00100000:1.0:1767319963.611852:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319963.611965:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892736
00000100:00100000:3.0:1767319963.611972:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892736
00000100:00100000:3.0:1767319963.612009:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17384
00000100:00100000:3.0:1767319963.612015:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379892736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319963.612033:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319963.612082:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379892736:12345-0@lo:38:kworker.0 Request processed in 65us (230us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319963.612089:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17384
00000100:00080000:1.0:1767319963.612361:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319963.612366:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319963.612370:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379892736:0@lo:38:kworker.0
00010000:00010000:1.0:1767319964.119112:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319964.562034:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319964.562116:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291947136 offset 0 length 520: 4
00000100:00100000:3.0:1767319964.562137:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319964.593224:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291947392
00000100:00100000:0.0:1767319964.593243:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291947392
00000100:00100000:0.0:1767319964.593347:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291947264
00000100:00100000:0.0:1767319964.593350:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291947264
00000100:00100000:0.0:1767319964.593383:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4561
00000100:00100000:0.0:1767319964.593394:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291947392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319964.593494:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291947392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (31470us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319964.593501:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4561
00000100:00100000:0.0:1767319964.593520:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17385
00000100:00100000:0.0:1767319964.593525:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291947264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319964.593544:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319964.593577:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291947264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (31429us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319964.593582:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17385
00000100:00080000:3.0:1767319964.595001:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319965.145302:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319966.167783:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319966.679155:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767319966.679176:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379892864:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319966.679248:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319966.679388:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892864
00000100:00100000:1.0:1767319966.679396:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892864
00000100:00100000:1.0:1767319966.679537:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492
00000100:00100000:1.0:1767319966.679547:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379892864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319966.679576:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767319966.679837:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319966.687492:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379892864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7938us (8234us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319966.687508:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492
00000100:00100000:0.0:1767319966.687791:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379892864:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319967.204140:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319968.216049:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767319968.216082:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379892992:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319968.216159:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:1.0:1767319968.216257:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319968.216548:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379892992
00000100:00100000:0.0:1767319968.216556:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379892992
00000100:00100000:0.0:1767319968.216649:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493
00000100:00100000:0.0:1767319968.216667:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379892992:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319968.216701:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319968.216762:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379892992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (602us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319968.216782:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493
00000100:00100000:2.0:1767319968.216947:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379892992:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319968.217216:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319968.727233:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319968.727242:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319968.727245:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319968.727248:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319968.727251:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319968.727269:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4866
00000100:00080000:0.0:1767319968.727276:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767319968.727283:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319968.727333:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164379893120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319968.727360:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319968.727363:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319968.727365:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319968.727369:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4866
00000100:00080000:0.0:1767319968.727372:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767319968.727376:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319968.727386:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448a80 x1853164379893248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319968.727443:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319968.727445:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319968.727447:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319968.727450:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4866
00000100:00080000:0.0:1767319968.727453:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:0.0:1767319968.727456:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319968.727466:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333100 x1853164379893760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319968.727479:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319968.727482:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319968.727484:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319968.727486:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4866
00000100:00080000:0.0:1767319968.727489:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319968.727492:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319968.727503:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332680 x1853164379894016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319968.727723:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379893504:0@lo:400:kworker.0
00000100:00100000:3.0:1767319968.727820:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319968.727920:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767319968.727927:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379893376:0@lo:400:kworker.0
00000100:00100000:3.0:1767319968.727949:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319968.727997:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379893504
00000100:00100000:3.0:1767319968.728005:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379893504
00000100:00100000:3.0:1767319968.728062:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379893376
00000100:00100000:3.0:1767319968.728066:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379893376
00000100:00100000:3.0:1767319968.728098:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705
00000100:00100000:3.0:1767319968.728106:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379893504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319968.728160:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379893504:12345-0@lo:400:kworker.0 Request processed in 54us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319968.728168:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705
00000100:00100000:3.0:1767319968.728185:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706
00000100:00100000:3.0:1767319968.728191:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379893376:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319968.728217:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379893376:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319968.728222:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706
00000100:00080000:3.0:1767319968.728243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767319968.728285:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379893376:0@lo:400:kworker.0
00000100:00100000:3.0:1767319968.728297:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379893504:0@lo:400:kworker.0
00000100:00100000:2.0:1767319968.730424:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319943/real 1767319943]  req@ffff8b0e01629180 x1853164379887104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319968 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319968.730447:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e01629180 x1853164379887104/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319968 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767319968.730463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379893120:0@lo:38:kworker.0
00000100:00100000:2.0:1767319968.730505:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319968.730613:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379893248:0@lo:38:kworker.0
00000100:00100000:2.0:1767319968.730636:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319968.730668:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379893760:0@lo:38:kworker.0
00000100:00100000:2.0:1767319968.730691:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319968.730775:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379893248
00000100:00100000:1.0:1767319968.730782:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379893248
00000100:00100000:1.0:1767319968.730817:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86
00000100:00100000:1.0:1767319968.730825:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379893248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319968.730848:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319968.730896:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379893248:12345-0@lo:38:kworker.0 Request processed in 71us (259us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319968.730901:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86
00000100:00100000:1.0:1767319968.730934:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379893632:0@lo:400:kworker.0
00000100:00100000:2.0:1767319968.732062:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379894016:0@lo:38:kworker.0
00000100:00100000:2.0:1767319968.732090:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319968.738274:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319968.738304:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767319968.738310:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379887104:0@lo:250:kworker.0
00000100:00080000:2.0:1767319968.738360:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319968.738364:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319968.738367:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379893248:0@lo:38:kworker.0
00000100:00100000:2.0:1767319968.738400:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379893888:0@lo:400:kworker.0
00000100:00100000:2.0:1767319968.738454:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319968.742517:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379893120
00000100:00100000:0.0:1767319968.742541:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379893120
00000100:00100000:0.0:1767319968.742603:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379893760
00000100:00100000:0.0:1767319968.742606:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379893760
00000100:00100000:0.0:1767319968.742622:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379894016
00000100:00100000:0.0:1767319968.742624:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379894016
00000100:00100000:0.0:1767319968.742665:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17386
00000100:00100000:0.0:1767319968.742679:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379893120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319968.742705:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319968.742802:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379893120:12345-0@lo:38:kworker.0 Request processed in 123us (12294us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319968.742810:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17386
00000100:00100000:0.0:1767319968.742830:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17387
00000100:00100000:0.0:1767319968.742834:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379893760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319968.742847:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319968.742887:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379893760:12345-0@lo:38:kworker.0 Request processed in 51us (12194us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319968.742893:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17387
00000100:00100000:0.0:1767319968.742904:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17388
00000100:00100000:0.0:1767319968.742908:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379894016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767319968.742917:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319968.742941:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379894016:12345-0@lo:38:kworker.0 Request processed in 32us (10849us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319968.742946:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17388
00000100:00080000:0.0:1767319968.742986:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319968.742991:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767319968.742995:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319968.743001:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4845
00000100:00080000:0.0:1767319968.743005:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319968.743009:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319968.743041:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332300 x1853164379894144/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319968.743084:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379894144:0@lo:250:kworker.0
00000400:00000100:0.0:1767319968.743115:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379894144 offset 0 length 520: 4
00000100:00080000:0.0:1767319968.743161:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319968.743166:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319968.743169:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379893120:0@lo:38:kworker.0
00000100:00080000:0.0:1767319968.743179:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319968.743183:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319968.743186:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379893760:0@lo:38:kworker.0
00000100:00080000:0.0:1767319968.743194:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767319968.743197:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767319968.743200:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379894016:0@lo:38:kworker.0
00000100:00100000:0.0:1767319968.748694:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379893888
00000100:00100000:0.0:1767319968.748711:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379893888
00000100:00100000:0.0:1767319968.748788:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4562
00000100:00100000:0.0:1767319968.748801:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379893888:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319968.750265:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379893888:12345-0@lo:400:kworker.0 Request processed in 1462us (11803us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319968.750277:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4562
00000100:00080000:0.0:1767319968.750317:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319968.751025:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379893888:0@lo:400:kworker.0
00000100:00100000:1.0:1767319968.751243:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319968.751358:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379893632
00000100:00100000:0.0:1767319968.751366:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379893632
00000100:00100000:0.0:1767319968.751476:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4563
00000100:00100000:0.0:1767319968.751485:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379893632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319968.751623:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379893632:12345-0@lo:400:kworker.0 Request processed in 138us (379us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319968.751784:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4563
00000100:00100000:0.0:1767319968.751829:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379893632:0@lo:400:kworker.0
00000100:00080000:1.0:1767319968.755249:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319969.239742:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319969.679085:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319969.679283:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319969.679425:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291947520
00000100:00100000:2.0:1767319969.679445:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291947520
00000100:00100000:2.0:1767319969.679511:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291947648
00000100:00100000:2.0:1767319969.679515:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291947648
00000100:00100000:2.0:1767319969.679594:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4564
00000100:00100000:2.0:1767319969.679605:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291947648:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319969.679961:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17389
00000100:00100000:1.0:1767319969.679969:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291947520:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319969.679996:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319969.680068:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319969.681358:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291947648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1747us (2067us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319969.681371:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4564
00000100:00100000:1.0:1767319969.681476:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291947520:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1504us (2407us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319969.681485:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17389
00010000:00010000:1.0:1767319970.263247:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319971.292938:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319971.802098:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767319971.802126:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379894272:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319971.802211:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319971.802283:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379894272
00000100:00100000:1.0:1767319971.802295:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379894272
00000100:00080000:3.0:1767319971.802378:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319971.802383:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494
00000100:00100000:1.0:1767319971.802395:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379894272:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319971.802431:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319971.802493:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379894272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (281us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319971.802500:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494
00000100:00100000:3.0:1767319971.802607:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379894272:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319972.314303:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319973.335260:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319973.335886:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379894400:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319973.335962:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319973.338855:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379894400
00000100:00100000:1.0:1767319973.338920:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379894400
00000100:00100000:1.0:1767319973.339015:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495
00000100:00100000:1.0:1767319973.339025:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379894400:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767319973.339060:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767319973.339172:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767319973.345783:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379894400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6748us (9809us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319973.345800:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495
00000100:00100000:3.0:1767319973.345964:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379894400:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767319973.847116:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319973.847128:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319973.847132:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319973.847136:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319973.847140:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319973.847149:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4871
00000100:00080000:2.0:1767319973.847155:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319973.847163:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319973.847221:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafea00 x1853164379894528/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319973.847249:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319973.847253:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319973.847254:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319973.847259:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4871
00000100:00080000:2.0:1767319973.847261:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319973.847265:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319973.847276:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd180 x1853164379894656/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319973.847344:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319973.847349:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319973.847351:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319973.847356:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4871
00000100:00080000:2.0:1767319973.847358:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319973.847362:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319973.847375:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd880 x1853164379895168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319973.847417:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379894784:0@lo:400:kworker.0
00000100:00080000:2.0:1767319973.847418:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319973.847440:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319973.847443:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319973.847448:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4871
00000100:00080000:2.0:1767319973.847451:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319973.847456:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319973.847472:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92680 x1853164379895424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319973.847509:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379895040:0@lo:400:kworker.0
00000100:00100000:1.0:1767319973.847546:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319973.847644:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379894912:0@lo:400:kworker.0
00000100:00100000:0.0:1767319973.847734:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379894528:0@lo:38:kworker.0
00000100:00100000:2.0:1767319973.848364:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319973.848458:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767319973.848466:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379895296:0@lo:400:kworker.0
00000100:00100000:2.0:1767319973.848494:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319973.848528:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379894784
00000100:00100000:2.0:1767319973.848535:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379894784
00000100:00100000:2.0:1767319973.848592:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707
00000100:00100000:2.0:1767319973.848600:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379894784:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319973.848659:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379894784:12345-0@lo:400:kworker.0 Request processed in 60us (1115us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319973.848667:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707
00000100:00100000:2.0:1767319973.848704:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895040
00000100:00100000:2.0:1767319973.848708:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895040
00000100:00100000:2.0:1767319973.848753:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895296
00000100:00100000:2.0:1767319973.848757:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895296
00000100:00100000:2.0:1767319973.848790:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4565
00000100:00100000:2.0:1767319973.848798:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379895040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319973.848814:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319973.848941:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379894912
00000100:00100000:3.0:1767319973.848949:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379894912
00000100:00100000:3.0:1767319973.848996:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708
00000100:00100000:3.0:1767319973.849004:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379894912:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319973.849065:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379894912:12345-0@lo:400:kworker.0 Request processed in 62us (256us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319973.849071:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708
00000100:00100000:3.0:1767319973.849129:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379894912:0@lo:400:kworker.0
00000100:00100000:3.0:1767319973.849187:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4566
00000100:00100000:3.0:1767319973.849198:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379895296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319973.849222:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379895040:12345-0@lo:400:kworker.0 Request processed in 418us (853us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319973.849233:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4565
00000100:00100000:3.0:1767319973.849258:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379895296:12345-0@lo:400:kworker.0 Request processed in 57us (757us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319973.849269:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4566
00000100:00100000:2.0:1767319973.849306:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379895296:0@lo:400:kworker.0
00000100:00080000:3.0:1767319973.849325:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319973.849329:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379895040:0@lo:400:kworker.0
00000100:00080000:3.0:1767319973.849336:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319973.849786:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379894784:0@lo:400:kworker.0
00000100:00100000:0.0:1767319973.853053:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319973.853101:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379894656:0@lo:38:kworker.0
00000100:00100000:0.0:1767319973.853143:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319973.853181:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379895168:0@lo:38:kworker.0
00000100:00100000:0.0:1767319973.853213:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319973.853227:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379895424:0@lo:38:kworker.0
00000100:00100000:0.0:1767319973.853245:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319973.853786:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379894656
00000100:00100000:2.0:1767319973.853797:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379894656
00000100:00100000:2.0:1767319973.853843:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87
00000100:00100000:2.0:1767319973.853851:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379894656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319973.853908:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319973.853953:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379894656:12345-0@lo:38:kworker.0 Request processed in 102us (809us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319973.853961:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87
00000100:00100000:2.0:1767319973.853984:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379894528
00000100:00100000:2.0:1767319973.853988:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379894528
00000100:00100000:2.0:1767319973.854011:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895168
00000100:00100000:2.0:1767319973.854015:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895168
00000100:00100000:3.0:1767319973.854032:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895424
00000100:00100000:2.0:1767319973.854039:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17390
00000100:00100000:2.0:1767319973.854046:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379894528:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319973.854048:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895424
00010000:00020000:2.0:1767319973.854063:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319973.854098:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379894528:12345-0@lo:38:kworker.0 Request processed in 47us (1049us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319973.854106:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17390
00000100:00080000:1.0:1767319973.854524:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319973.854536:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319973.854542:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379894528:0@lo:38:kworker.0
00000100:00080000:1.0:1767319973.854559:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767319973.854563:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767319973.854566:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379894656:0@lo:38:kworker.0
00000100:00100000:3.0:1767319973.856359:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17391
00000100:00100000:3.0:1767319973.856379:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379895168:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319973.856411:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319973.856551:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379895168:12345-0@lo:38:kworker.0 Request processed in 174us (3334us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319973.856560:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17391
00000100:00100000:3.0:1767319973.856604:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17392
00000100:00100000:3.0:1767319973.856609:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379895424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319973.856619:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319973.856646:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379895424:12345-0@lo:38:kworker.0 Request processed in 36us (3399us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319973.856653:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17392
00000100:00080000:3.0:1767319973.856787:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319973.856794:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319973.856799:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379895168:0@lo:38:kworker.0
00000100:00080000:3.0:1767319973.856820:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319973.856823:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319973.856826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379895424:0@lo:38:kworker.0
00010000:00010000:1.0:1767319974.359855:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319974.810596:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319974.810661:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319974.810792:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291947904
00000100:00100000:2.0:1767319974.810792:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291947776
00000100:00100000:0.0:1767319974.810808:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291947904
00000100:00100000:2.0:1767319974.810808:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291947776
00000100:00100000:2.0:1767319974.810924:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4567
00000100:00100000:0.0:1767319974.810939:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17393
00000100:00100000:2.0:1767319974.810941:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291947904:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319974.810952:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291947776:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319974.810982:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767319974.811050:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319974.811052:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291947776:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 100us (468us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319974.811063:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17393
00000100:00100000:2.0:1767319974.817729:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291947904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 6760us (7034us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319974.817753:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4567
00010000:00010000:2.0:1767319975.386043:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319976.407858:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319976.919183:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319976.919231:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379895552:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767319976.919712:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319976.919802:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895552
00000100:00100000:1.0:1767319976.919823:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895552
00000100:00100000:1.0:1767319976.919925:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496
00000100:00100000:1.0:1767319976.919936:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379895552:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767319976.919967:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767319976.920064:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379895552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (353us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319976.920071:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496
00000100:00100000:0.0:1767319976.920233:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379895552:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767319976.920305:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319977.434321:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319978.455666:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319978.456207:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379895680:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319978.456277:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319978.456500:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895680
00000100:00100000:0.0:1767319978.456508:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895680
00000100:00100000:0.0:1767319978.456569:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497
00000100:00100000:0.0:1767319978.456579:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379895680:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319978.456608:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319978.456667:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379895680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319978.456674:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497
00000100:00100000:2.0:1767319978.456840:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379895680:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319978.457080:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767319978.967349:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319978.967357:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319978.967359:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319978.967362:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319978.967366:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319978.967372:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4876
00000100:00080000:0.0:1767319978.967376:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319978.967382:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319978.967423:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608000 x1853164379895808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319978.967445:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319978.967447:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319978.967449:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319978.967452:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4876
00000100:00080000:0.0:1767319978.967453:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319978.967455:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319978.967462:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609500 x1853164379895936/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319978.967521:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379896064:0@lo:400:kworker.0
00000100:00080000:0.0:1767319978.967526:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319978.967529:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319978.967531:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319978.967534:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4876
00000100:00080000:0.0:1767319978.967537:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319978.967540:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319978.967549:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05880 x1853164379896448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319978.967563:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319978.967567:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319978.967569:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319978.967571:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4876
00000100:00080000:0.0:1767319978.967573:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319978.967577:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319978.967587:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05180 x1853164379896704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319978.967610:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319978.967622:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379896320:0@lo:400:kworker.0
00000100:00100000:0.0:1767319978.967654:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319978.967720:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319978.967727:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379896576:0@lo:400:kworker.0
00000100:00100000:0.0:1767319978.967748:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319978.967780:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896320
00000100:00100000:0.0:1767319978.967788:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896320
00000100:00100000:0.0:1767319978.967846:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896576
00000100:00100000:0.0:1767319978.967849:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896576
00000100:00100000:0.0:1767319978.967909:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4568
00000100:00100000:1.0:1767319978.967916:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319978.967919:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379896320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319978.967922:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379896192:0@lo:400:kworker.0
00000100:00100000:0.0:1767319978.967978:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379896320:12345-0@lo:400:kworker.0 Request processed in 61us (322us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319978.967986:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4568
00000100:00100000:1.0:1767319978.968072:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319978.968103:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896064
00000100:00100000:1.0:1767319978.968107:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896064
00000100:00100000:1.0:1767319978.968147:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896192
00000100:00100000:1.0:1767319978.968151:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896192
00000100:00100000:1.0:1767319978.968170:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709
00000100:00100000:1.0:1767319978.968177:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379896064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319978.968211:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379896064:12345-0@lo:400:kworker.0 Request processed in 34us (600us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319978.968216:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709
00000100:00100000:1.0:1767319978.968232:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710
00000100:00100000:1.0:1767319978.968238:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379896192:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319978.968262:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379896192:12345-0@lo:400:kworker.0 Request processed in 25us (191us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319978.968262:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4569
00000100:00100000:1.0:1767319978.968268:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710
00000100:00100000:2.0:1767319978.968270:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379896576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319978.968311:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379896192:0@lo:400:kworker.0
00000100:00080000:3.0:1767319978.968339:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319978.968345:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319978.968365:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379895808:0@lo:38:kworker.0
00000100:00100000:2.0:1767319978.972693:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379896576:12345-0@lo:400:kworker.0 Request processed in 4402us (4921us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319978.972708:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4569
00000100:00100000:1.0:1767319978.973333:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379896064:0@lo:400:kworker.0
00000100:00100000:3.0:1767319978.977085:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319978.977136:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379895936:0@lo:38:kworker.0
00000100:00100000:3.0:1767319978.977160:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319978.977188:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379896448:0@lo:38:kworker.0
00000100:00100000:3.0:1767319978.977209:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319978.977237:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895936
00000100:00100000:3.0:1767319978.977240:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379896704:0@lo:38:kworker.0
00000100:00100000:1.0:1767319978.977246:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895936
00000100:00100000:3.0:1767319978.977266:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319978.977286:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88
00000100:00100000:1.0:1767319978.977295:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379895936:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767319978.977300:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379895808
00000100:00100000:3.0:1767319978.977303:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379895808
00000100:00100000:3.0:1767319978.977322:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896448
00010000:00020000:1.0:1767319978.977324:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319978.977324:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896448
00000100:00100000:3.0:1767319978.977335:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896704
00000100:00100000:3.0:1767319978.977337:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896704
00000100:00100000:3.0:1767319978.977353:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17394
00000100:00100000:3.0:1767319978.977357:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379895808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319978.977366:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319978.977389:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379895936:12345-0@lo:38:kworker.0 Request processed in 95us (227us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319978.977394:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379895808:12345-0@lo:38:kworker.0 Request processed in 36us (317us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319978.977397:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88
00000100:00100000:3.0:1767319978.977400:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17394
00000100:00100000:3.0:1767319978.977415:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17395
00000100:00100000:3.0:1767319978.977419:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379896448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319978.977427:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319978.977449:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379896448:12345-0@lo:38:kworker.0 Request processed in 29us (239us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319978.977456:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17396
00000100:00100000:1.0:1767319978.977461:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379896704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319978.977470:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319978.977496:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379896704:12345-0@lo:38:kworker.0 Request processed in 34us (230us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767319978.977552:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319978.977559:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319978.977563:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379895808:0@lo:38:kworker.0
00000100:00080000:2.0:1767319978.977573:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319978.977576:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319978.977580:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379895936:0@lo:38:kworker.0
00000100:00080000:2.0:1767319978.977586:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319978.977589:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319978.977593:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379896448:0@lo:38:kworker.0
00000100:00080000:2.0:1767319978.977601:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319978.977604:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319978.977606:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379896704:0@lo:38:kworker.0
00000100:00100000:3.0:1767319978.977810:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17395
00000100:00100000:1.0:1767319978.978485:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17396
00000100:00100000:0.0:1767319978.978518:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379896576:0@lo:400:kworker.0
00000100:00100000:0.0:1767319978.978532:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379896320:0@lo:400:kworker.0
00010000:00010000:2.0:1767319979.479825:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319979.923757:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319979.923806:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319979.923914:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291948160
00000100:00100000:1.0:1767319979.923925:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291948160
00000100:00100000:1.0:1767319979.923998:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291948032
00000100:00100000:1.0:1767319979.924003:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291948032
00000100:00100000:1.0:1767319979.924023:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4570
00000100:00100000:1.0:1767319979.924033:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291948160:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319979.924104:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291948160:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 72us (357us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319979.924112:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4570
00000100:00100000:1.0:1767319979.924135:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17397
00000100:00100000:1.0:1767319979.924139:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291948032:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767319979.924170:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767319979.924196:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291948032:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (389us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319979.924202:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17397
00000100:00080000:3.0:1767319979.924450:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767319980.504503:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767319981.527047:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319982.041003:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379896832:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319982.041121:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319982.041468:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896832
00000100:00100000:2.0:1767319982.041478:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896832
00000100:00100000:2.0:1767319982.041553:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498
00000100:00100000:2.0:1767319982.041563:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379896832:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319982.041595:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319982.041654:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379896832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (523us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319982.041663:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498
00000100:00080000:1.0:1767319982.042798:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767319982.042862:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379896832:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767319982.551434:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319983.579110:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319983.581104:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379896960:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319983.581175:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319983.581411:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379896960
00000100:00100000:0.0:1767319983.581419:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379896960
00000100:00100000:0.0:1767319983.581488:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499
00000100:00100000:0.0:1767319983.581497:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379896960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319983.581527:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319983.581586:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379896960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (409us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319983.581593:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499
00000100:00100000:2.0:1767319983.581759:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379896960:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767319983.581907:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767319984.087486:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319984.087497:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767319984.087500:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319984.087504:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319984.087508:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319984.087517:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4881
00000100:00080000:2.0:1767319984.087521:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319984.087528:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319984.087570:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93b80 x1853164379897088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319984.087603:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319984.087606:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319984.087608:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319984.087612:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4881
00000100:00080000:2.0:1767319984.087615:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319984.087619:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319984.087644:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92680 x1853164379897216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319984.087721:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319984.087725:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319984.087727:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319984.087730:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4881
00000100:00080000:2.0:1767319984.087733:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319984.087736:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319984.087747:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28df80 x1853164379897728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319984.087762:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319984.087765:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319984.087766:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319984.087769:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4881
00000100:00080000:2.0:1767319984.087771:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319984.087775:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319984.087786:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28d500 x1853164379897984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767319984.087823:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379897856:0@lo:400:kworker.0
00000100:00100000:2.0:1767319984.087909:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319984.087976:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767319984.087993:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379897600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319984.088016:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319984.088053:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897856
00000100:00100000:2.0:1767319984.088061:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897856
00000100:00100000:2.0:1767319984.088117:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897600
00000100:00100000:2.0:1767319984.088121:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897600
00000100:00100000:2.0:1767319984.088146:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4571
00000100:00100000:2.0:1767319984.088154:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379897856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319984.088206:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379897856:12345-0@lo:400:kworker.0 Request processed in 53us (297us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319984.088214:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4571
00000100:00100000:2.0:1767319984.088233:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4572
00000100:00100000:2.0:1767319984.088240:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379897600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319984.088266:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379897600:12345-0@lo:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319984.088272:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4572
00000100:00100000:2.0:1767319984.088318:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379897600:0@lo:400:kworker.0
00000100:00100000:2.0:1767319984.088329:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379897856:0@lo:400:kworker.0
00000100:00100000:0.0:1767319984.088917:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379897344:0@lo:400:kworker.0
00000100:00100000:0.0:1767319984.088962:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319984.089018:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319984.089024:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379897472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319984.089046:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319984.089154:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897344
00000100:00100000:2.0:1767319984.089161:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897344
00000100:00100000:2.0:1767319984.089201:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897472
00000100:00100000:2.0:1767319984.089204:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897472
00000100:00100000:2.0:1767319984.089224:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711
00000100:00100000:2.0:1767319984.089230:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379897344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319984.089269:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379897344:12345-0@lo:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319984.089275:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711
00000100:00100000:2.0:1767319984.089287:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712
00000100:00100000:2.0:1767319984.089293:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379897472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319984.089322:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379897472:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319984.089328:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712
00000100:00100000:3.0:1767319984.089415:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379897088:0@lo:38:kworker.0
00000100:00100000:3.0:1767319984.089448:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319984.089477:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379897216:0@lo:38:kworker.0
00000100:00100000:3.0:1767319984.089499:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319984.089524:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379897728:0@lo:38:kworker.0
00000100:00100000:3.0:1767319984.089543:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319984.089560:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379897984:0@lo:38:kworker.0
00000100:00100000:3.0:1767319984.089579:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319984.089609:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897216
00000100:00100000:3.0:1767319984.089612:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897216
00000100:00100000:3.0:1767319984.089643:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89
00000100:00100000:3.0:1767319984.089649:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379897216:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319984.089666:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319984.089713:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379897216:12345-0@lo:38:kworker.0 Request processed in 63us (212us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319984.089719:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89
00000100:00100000:3.0:1767319984.089736:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897088
00000100:00100000:3.0:1767319984.089740:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897088
00000100:00100000:3.0:1767319984.089757:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897728
00000100:00100000:3.0:1767319984.089760:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897728
00000100:00100000:3.0:1767319984.089770:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379897984
00000100:00100000:3.0:1767319984.089772:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379897984
00000100:00100000:3.0:1767319984.089781:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17398
00000100:00100000:3.0:1767319984.089785:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379897088:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319984.089971:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319984.090089:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379897088:12345-0@lo:38:kworker.0 Request processed in 301us (639us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319984.090096:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17398
00000100:00100000:3.0:1767319984.090109:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17399
00000100:00100000:3.0:1767319984.090112:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379897728:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319984.090120:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319984.090142:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379897728:12345-0@lo:38:kworker.0 Request processed in 28us (598us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319984.090147:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17399
00000100:00100000:3.0:1767319984.090156:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17400
00000100:00100000:3.0:1767319984.090160:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379897984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319984.090167:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319984.090186:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379897984:12345-0@lo:38:kworker.0 Request processed in 25us (606us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319984.090191:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17400
00000100:00080000:3.0:1767319984.090215:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767319984.090221:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767319984.090246:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319984.090251:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319984.090255:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379897088:0@lo:38:kworker.0
00000100:00080000:3.0:1767319984.090263:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319984.090266:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319984.090269:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379897216:0@lo:38:kworker.0
00000100:00080000:3.0:1767319984.090275:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319984.090278:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319984.090281:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379897728:0@lo:38:kworker.0
00000100:00080000:3.0:1767319984.090288:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319984.090291:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319984.090293:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379897984:0@lo:38:kworker.0
00000100:00100000:0.0:1767319984.092637:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379897472:0@lo:400:kworker.0
00000100:00100000:0.0:1767319984.092658:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379897344:0@lo:400:kworker.0
00010000:00010000:2.0:1767319984.600532:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319985.042015:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767319985.042544:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291948288
00000100:00100000:2.0:1767319985.042555:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291948288
00000100:00100000:2.0:1767319985.042613:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17401
00000100:00100000:2.0:1767319985.042630:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291948288:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767319985.042654:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319985.042751:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291948288:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 120us (745us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319985.042759:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17401
00000100:00100000:3.0:1767319985.049561:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767319985.049939:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291948416
00000100:00100000:1.0:1767319985.049951:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291948416
00000100:00100000:1.0:1767319985.050025:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4573
00000100:00100000:1.0:1767319985.050034:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291948416:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767319985.050115:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291948416:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (564us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319985.050123:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4573
00000100:00080000:3.0:1767319985.050411:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767319985.624066:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767319986.647738:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319987.159386:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767319987.159405:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379898112:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319987.159480:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319987.159621:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379898112
00000100:00100000:2.0:1767319987.159631:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379898112
00000100:00100000:2.0:1767319987.159705:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500
00000100:00100000:2.0:1767319987.159714:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379898112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319987.159743:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767319987.159751:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767319987.159805:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379898112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319987.159813:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500
00000100:00100000:3.0:1767319987.159897:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379898112:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767319987.682658:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319988.696400:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319988.696553:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767319988.696576:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379898240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319988.696679:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319988.697060:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379898240
00000100:00100000:0.0:1767319988.697073:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379898240
00000100:00100000:0.0:1767319988.697140:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501
00000100:00100000:0.0:1767319988.697150:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379898240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319988.697190:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319988.697237:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379898240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (558us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319988.697245:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501
00000100:00080000:3.0:1767319988.697357:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767319988.697698:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379898240:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767319989.207155:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319989.207164:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767319989.207168:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319989.207172:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319989.207177:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319989.207186:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4886
00000100:00080000:0.0:1767319989.207190:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319989.207198:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319989.207236:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05c00 x1853164379898368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319989.207254:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319989.207257:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319989.207259:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319989.207263:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4886
00000100:00080000:0.0:1767319989.207266:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319989.207270:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319989.207281:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06d80 x1853164379898496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319989.207318:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319989.207322:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319989.207324:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319989.207327:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4886
00000100:00080000:0.0:1767319989.207330:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319989.207333:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319989.207345:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164379898880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767319989.207369:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767319989.207373:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767319989.207375:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767319989.207378:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4886
00000100:00080000:0.0:1767319989.207381:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767319989.207385:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767319989.207397:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164379899136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319989.207696:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379898368:0@lo:38:kworker.0
00000100:00100000:3.0:1767319989.207765:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319989.207823:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379898496:0@lo:38:kworker.0
00000100:00100000:3.0:1767319989.207850:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319989.207895:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379898880:0@lo:38:kworker.0
00000100:00100000:3.0:1767319989.207916:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319989.207929:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379899136:0@lo:38:kworker.0
00000100:00100000:3.0:1767319989.207945:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319989.207975:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379898368
00000100:00100000:3.0:1767319989.207982:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379898368
00000100:00100000:3.0:1767319989.208011:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379898880
00000100:00100000:3.0:1767319989.208014:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379898880
00000100:00100000:3.0:1767319989.208025:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379899136
00000100:00100000:3.0:1767319989.208028:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379899136
00000100:00100000:3.0:1767319989.208045:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17402
00000100:00100000:3.0:1767319989.208051:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379898368:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319989.208072:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319989.208113:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379898368:12345-0@lo:38:kworker.0 Request processed in 60us (346us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319989.208120:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17402
00000100:00100000:3.0:1767319989.208135:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17403
00000100:00100000:3.0:1767319989.208138:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379898880:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319989.208147:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319989.208166:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379898880:12345-0@lo:38:kworker.0 Request processed in 26us (248us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319989.208171:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17403
00000100:00100000:3.0:1767319989.208179:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17404
00000100:00100000:3.0:1767319989.208182:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379899136:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319989.208189:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319989.208206:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379899136:12345-0@lo:38:kworker.0 Request processed in 22us (260us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319989.208211:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17404
00000100:00080000:3.0:1767319989.208252:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319989.208257:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319989.208259:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379898368:0@lo:38:kworker.0
00000100:00080000:3.0:1767319989.208269:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319989.208273:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319989.208275:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379898880:0@lo:38:kworker.0
00000100:00080000:3.0:1767319989.208281:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319989.208284:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319989.208287:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379899136:0@lo:38:kworker.0
00000100:00100000:3.0:1767319989.208337:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379898624:0@lo:400:kworker.0
00000100:00100000:3.0:1767319989.208363:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319989.208386:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767319989.208392:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379898752:0@lo:400:kworker.0
00000100:00100000:3.0:1767319989.208413:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319989.208824:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379898752
00000100:00100000:2.0:1767319989.208829:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379898752
00000100:00100000:2.0:1767319989.208883:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4574
00000100:00100000:2.0:1767319989.208890:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379898752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319989.208898:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379898496
00000100:00100000:1.0:1767319989.208902:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379898496
00000100:00100000:1.0:1767319989.208924:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90
00000100:00100000:1.0:1767319989.208930:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379898496:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767319989.208936:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379898752:12345-0@lo:400:kworker.0 Request processed in 48us (523us total) trans 0 rc 0/0
00010000:00020000:1.0:1767319989.208941:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319989.208942:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4574
00000100:00080000:2.0:1767319989.208961:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767319989.208972:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379898496:12345-0@lo:38:kworker.0 Request processed in 41us (1121us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319989.208984:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379898752:0@lo:400:kworker.0
00000100:00100000:2.0:1767319989.209002:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379899008:0@lo:400:kworker.0
00000100:00100000:2.0:1767319989.209026:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319989.209053:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379899008
00000100:00100000:2.0:1767319989.209057:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379899008
00000100:00100000:1.0:1767319989.209064:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90
00000100:00100000:2.0:1767319989.209081:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4575
00000100:00100000:2.0:1767319989.209087:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379899008:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767319989.209117:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379899008:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319989.209126:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4575
00000100:00080000:2.0:1767319989.209138:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767319989.209179:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379899008:0@lo:400:kworker.0
00000100:00080000:2.0:1767319989.209217:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767319989.209221:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767319989.209224:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379898496:0@lo:38:kworker.0
00000100:00100000:3.0:1767319989.210396:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379898624
00000100:00100000:3.0:1767319989.210405:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379898624
00000100:00100000:3.0:1767319989.210560:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713
00000100:00100000:3.0:1767319989.210570:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379898624:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319989.210642:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379898624:12345-0@lo:400:kworker.0 Request processed in 74us (2277us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319989.210648:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713
00000100:00100000:3.0:1767319989.210825:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379898624:0@lo:400:kworker.0
00000100:00080000:1.0:1767319989.210968:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319989.719248:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319990.159722:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767319990.161298:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767319990.166563:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291948800 offset 0 length 520: 4
00000100:00100000:2.0:1767319990.167978:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291948672
00000100:00100000:2.0:1767319990.167994:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291948672
00000100:00080000:1.0:1767319990.168109:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319990.168438:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291948544
00000100:00100000:0.0:1767319990.168444:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291948544
00000100:00100000:0.0:1767319990.168493:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4576
00000100:00100000:0.0:1767319990.168505:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291948672:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319990.168601:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291948672:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 98us (8889us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319990.168608:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4576
00000100:00100000:0.0:1767319990.168629:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17405
00000100:00100000:0.0:1767319990.168634:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291948544:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319990.168655:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319990.168681:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291948544:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (7390us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319990.168687:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17405
00010000:00010000:1.0:1767319990.744864:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319991.767072:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767319992.279195:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379899264:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767319992.279268:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319992.279596:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379899264
00000100:00100000:3.0:1767319992.279605:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379899264
00000100:00100000:3.0:1767319992.279672:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502
00000100:00100000:3.0:1767319992.279683:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379899264:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767319992.279713:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767319992.279773:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379899264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (505us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319992.279782:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502
00000100:00100000:2.0:1767319992.279822:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379899264:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319992.280679:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767319992.792143:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319993.303839:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319968/real 1767319968]  req@ffff8b0e07332300 x1853164379894144/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319993 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767319993.303895:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e07332300 x1853164379894144/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767319993 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767319993.303917:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319993.303938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767319993.303942:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379894144:0@lo:250:kworker.0
00000100:00080000:2.0:1767319993.304012:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319993.304018:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767319993.304021:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319993.304026:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4871
00000100:00080000:2.0:1767319993.304029:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319993.304035:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319993.304066:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ca80 x1853164379899392/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319993.304091:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319993.304095:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319993.304096:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319993.304100:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4891
00000100:00080000:2.0:1767319993.304102:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319993.304105:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319993.304123:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28c380 x1853164379899520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319993.304131:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319993.304134:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319993.304136:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319993.304139:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4891
00000100:00080000:2.0:1767319993.304141:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319993.304144:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319993.304155:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f480 x1853164379899648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767319993.304300:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379899392:0@lo:250:kworker.0
00000400:00000100:3.0:1767319993.304346:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379899392 offset 0 length 520: 4
00000100:00100000:3.0:1767319993.304387:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379899520:0@lo:38:kworker.0
00000100:00100000:3.0:1767319993.304416:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319993.304439:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379899648:0@lo:38:kworker.0
00000100:00100000:3.0:1767319993.304465:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319993.304498:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379899648
00000100:00100000:3.0:1767319993.304504:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379899648
00000100:00100000:3.0:1767319993.304556:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91
00000100:00100000:3.0:1767319993.304564:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3919dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379899648:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319993.304585:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319993.304628:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3919dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379899648:12345-0@lo:38:kworker.0 Request processed in 63us (161us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319993.304635:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91
00000100:00080000:3.0:1767319993.304900:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319993.304904:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319993.304907:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379899648:0@lo:38:kworker.0
00000100:00100000:3.0:1767319993.304948:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379899520
00000100:00100000:3.0:1767319993.304951:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379899520
00000100:00100000:3.0:1767319993.304975:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17406
00000100:00100000:3.0:1767319993.304980:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379899520:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319993.304991:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319993.305023:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379899520:12345-0@lo:38:kworker.0 Request processed in 42us (606us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319993.305029:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17406
00000100:00080000:3.0:1767319993.305055:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319993.305060:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319993.305064:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379899520:0@lo:38:kworker.0
00000100:00100000:1.0:1767319993.305085:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379899904:0@lo:400:kworker.0
00000100:00100000:1.0:1767319993.305123:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319993.305160:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319993.305166:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379899776:0@lo:400:kworker.0
00000100:00100000:1.0:1767319993.305197:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767319993.305301:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319993.305305:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319993.305307:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319993.305311:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4891
00000100:00080000:2.0:1767319993.305314:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319993.305319:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319993.305336:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28fb80 x1853164379900160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767319993.305359:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767319993.305362:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767319993.305364:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767319993.305367:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4891
00000100:00080000:2.0:1767319993.305369:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767319993.305374:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767319993.305384:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28e300 x1853164379900416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767319993.305478:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379900032:0@lo:400:kworker.0
00000100:00100000:0.0:1767319993.305576:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319993.305609:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767319993.305615:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379900288:0@lo:400:kworker.0
00000100:00100000:0.0:1767319993.305636:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319993.305659:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900032
00000100:00100000:0.0:1767319993.305663:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900032
00000100:00100000:0.0:1767319993.305698:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900288
00000100:00100000:0.0:1767319993.305701:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900288
00000100:00100000:0.0:1767319993.305718:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4577
00000100:00100000:0.0:1767319993.305724:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379900032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319993.305763:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379900032:12345-0@lo:400:kworker.0 Request processed in 39us (188us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319993.305769:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4577
00000100:00100000:0.0:1767319993.305784:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4578
00000100:00100000:0.0:1767319993.305790:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379900288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319993.305814:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379900288:12345-0@lo:400:kworker.0 Request processed in 24us (176us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319993.305820:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4578
00000100:00100000:0.0:1767319993.305847:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379900288:0@lo:400:kworker.0
00000100:00100000:0.0:1767319993.305856:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379900032:0@lo:400:kworker.0
00000100:00080000:1.0:1767319993.305945:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319993.306186:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379899904
00000100:00100000:3.0:1767319993.306192:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379899904
00000100:00100000:3.0:1767319993.306243:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379899776
00000100:00100000:3.0:1767319993.306256:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379899776
00000100:00100000:3.0:1767319993.306282:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714
00000100:00100000:3.0:1767319993.306290:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379899904:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319993.306343:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379899904:12345-0@lo:400:kworker.0 Request processed in 54us (1220us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319993.306350:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714
00000100:00100000:3.0:1767319993.306364:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715
00000100:00100000:3.0:1767319993.306370:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379899776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767319993.306399:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379899776:12345-0@lo:400:kworker.0 Request processed in 29us (1201us total) trans 0 rc 0/0
00000100:00100000:3.0:1767319993.306405:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715
00000100:00100000:3.0:1767319993.306433:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379900160:0@lo:38:kworker.0
00000100:00100000:3.0:1767319993.306651:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319993.306681:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379900416:0@lo:38:kworker.0
00000100:00100000:3.0:1767319993.306703:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319993.307024:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900160
00000100:00100000:2.0:1767319993.307029:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900160
00000100:00100000:2.0:1767319993.307063:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900416
00000100:00100000:2.0:1767319993.307066:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900416
00000100:00100000:2.0:1767319993.307082:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17407
00000100:00100000:2.0:1767319993.307087:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379900160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319993.307103:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319993.307142:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379900160:12345-0@lo:38:kworker.0 Request processed in 55us (683us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319993.307148:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17407
00000100:00100000:2.0:1767319993.307160:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17408
00000100:00100000:2.0:1767319993.307164:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379900416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767319993.307172:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767319993.307194:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379900416:12345-0@lo:38:kworker.0 Request processed in 29us (490us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767319993.307199:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17408
00000100:00080000:3.0:1767319993.307361:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319993.307367:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319993.307370:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379900160:0@lo:38:kworker.0
00000100:00080000:3.0:1767319993.307378:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319993.307380:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319993.307382:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379900416:0@lo:38:kworker.0
00000100:00100000:1.0:1767319993.308262:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379899776:0@lo:400:kworker.0
00000100:00100000:1.0:1767319993.308278:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379899904:0@lo:400:kworker.0
00000100:00080000:1.0:1767319993.308319:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767319993.815159:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319993.816090:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379900544:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767319993.816167:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319993.816659:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900544
00000100:00100000:2.0:1767319993.816668:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900544
00000100:00100000:2.0:1767319993.816760:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503
00000100:00100000:2.0:1767319993.816771:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379900544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767319993.816803:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319993.816859:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379900544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (693us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319993.816898:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503
00000100:00100000:3.0:1767319993.817067:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379900544:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767319994.839642:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767319995.280190:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319995.280647:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291949056
00000100:00100000:0.0:1767319995.280662:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291949056
00000100:00100000:0.0:1767319995.280788:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4579
00000100:00100000:0.0:1767319995.280801:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291949056:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767319995.280968:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291949056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 169us (794us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319995.280977:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4579
00000100:00080000:1.0:1767319995.281073:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767319995.281688:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767319995.281734:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291948928
00000100:00100000:0.0:1767319995.281741:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291948928
00000100:00100000:0.0:1767319995.282423:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17409
00000100:00100000:0.0:1767319995.282431:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291948928:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767319995.282460:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767319995.282555:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291948928:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 92us (837us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767319995.282564:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17409
00010000:00010000:2.0:1767319995.863279:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767319996.887481:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767319997.399267:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767319997.402649:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379900672:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767319997.402734:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767319997.403038:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900672
00000100:00100000:2.0:1767319997.403121:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900672
00000100:00100000:2.0:1767319997.403247:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504
00000100:00100000:2.0:1767319997.403257:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379900672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767319997.403289:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767319997.403698:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379900672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 441us (963us total) trans 0 rc 0/0
00000100:00100000:2.0:1767319997.403705:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504
00000100:00100000:0.0:1767319997.403796:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379900672:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767319997.403845:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767319997.911006:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767319998.423667:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319998.423680:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767319998.423684:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319998.423688:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319998.423693:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319998.423703:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4895
00000100:00080000:3.0:1767319998.423709:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319998.423717:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319998.423760:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae680 x1853164379900800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319998.423787:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319998.423790:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319998.423793:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319998.423797:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4895
00000100:00080000:3.0:1767319998.423799:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319998.423802:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319998.423816:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b100 x1853164379900928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319998.423895:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319998.423899:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319998.423901:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319998.423905:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4895
00000100:00080000:3.0:1767319998.423907:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319998.423911:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319998.423923:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083ff480 x1853164379901440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767319998.423942:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767319998.423945:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767319998.423946:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767319998.423950:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4895
00000100:00080000:3.0:1767319998.423952:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767319998.423955:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767319998.423965:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fd180 x1853164379901696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767319998.424054:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379901056:0@lo:400:kworker.0
00000100:00100000:1.0:1767319998.424125:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319998.424196:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767319998.424203:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379901184:0@lo:400:kworker.0
00000100:00100000:1.0:1767319998.424224:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319998.424254:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379901568:0@lo:400:kworker.0
00000100:00100000:1.0:1767319998.424280:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319998.424305:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901568
00000100:00100000:1.0:1767319998.424305:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767319998.424313:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379901312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319998.424315:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901568
00000100:00100000:1.0:1767319998.424341:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319998.424383:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901312
00000100:00100000:1.0:1767319998.424387:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901056
00000100:00100000:0.0:1767319998.424388:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901312
00000100:00100000:1.0:1767319998.424395:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901056
00000100:00100000:0.0:1767319998.424419:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4580
00000100:00100000:0.0:1767319998.424430:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379901568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319998.424441:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901184
00000100:00100000:1.0:1767319998.424446:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901184
00000100:00100000:1.0:1767319998.424474:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716
00000100:00100000:1.0:1767319998.424483:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379901056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319998.424493:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379901568:12345-0@lo:400:kworker.0 Request processed in 65us (211us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319998.424511:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4580
00000100:00100000:0.0:1767319998.424534:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4581
00000100:00100000:1.0:1767319998.424539:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379901056:12345-0@lo:400:kworker.0 Request processed in 56us (413us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319998.424545:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379901312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767319998.424552:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716
00000100:00100000:1.0:1767319998.424575:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717
00000100:00100000:0.0:1767319998.424588:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379901312:12345-0@lo:400:kworker.0 Request processed in 44us (242us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319998.424588:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379901184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767319998.424602:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4581
00000100:00100000:1.0:1767319998.424631:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379901184:12345-0@lo:400:kworker.0 Request processed in 47us (403us total) trans 0 rc 0/0
00000100:00100000:1.0:1767319998.424637:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717
00000100:00100000:0.0:1767319998.424644:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379900800:0@lo:38:kworker.0
00000100:00080000:1.0:1767319998.424659:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767319998.424666:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767319998.424676:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319998.424699:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379900928:0@lo:38:kworker.0
00000100:00100000:1.0:1767319998.424702:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379901184:0@lo:400:kworker.0
00000100:00100000:1.0:1767319998.424718:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379901056:0@lo:400:kworker.0
00000100:00100000:0.0:1767319998.424728:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319998.424754:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379901440:0@lo:38:kworker.0
00000100:00100000:1.0:1767319998.424772:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379901312:0@lo:400:kworker.0
00000100:00100000:0.0:1767319998.424782:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767319998.424786:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379901568:0@lo:400:kworker.0
00000100:00100000:0.0:1767319998.424806:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379901696:0@lo:38:kworker.0
00000100:00100000:1.0:1767319998.424821:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900800
00000100:00100000:1.0:1767319998.424826:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900800
00000100:00100000:0.0:1767319998.424831:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767319998.424913:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379900928
00000100:00100000:3.0:1767319998.424917:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379900928
00000100:00100000:3.0:1767319998.424939:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92
00000100:00100000:3.0:1767319998.424944:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379900928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319998.424960:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319998.424999:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379900928:12345-0@lo:38:kworker.0 Request processed in 54us (272us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319998.425006:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92
00000100:00100000:1.0:1767319998.427975:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901440
00000100:00100000:1.0:1767319998.427988:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901440
00000100:00100000:1.0:1767319998.428015:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901696
00000100:00100000:1.0:1767319998.428017:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901696
00000100:00100000:1.0:1767319998.428028:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17410
00000100:00100000:1.0:1767319998.428035:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379900800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767319998.428055:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319998.428136:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17411
00000100:00100000:3.0:1767319998.428140:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379901440:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319998.428268:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319998.428327:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379901440:12345-0@lo:38:kworker.0 Request processed in 186us (3547us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319998.428333:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17411
00000100:00100000:3.0:1767319998.428351:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17412
00000100:00100000:3.0:1767319998.428353:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379901696:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767319998.428367:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767319998.428385:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379901696:12345-0@lo:38:kworker.0 Request processed in 30us (3556us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767319998.428389:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17412
00000100:00100000:1.0:1767319998.428659:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379900800:12345-0@lo:38:kworker.0 Request processed in 623us (3982us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767319998.428665:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17410
00000100:00080000:3.0:1767319998.428706:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319998.428712:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319998.428716:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379900800:0@lo:38:kworker.0
00000100:00080000:3.0:1767319998.428728:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319998.428732:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319998.428735:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379900928:0@lo:38:kworker.0
00000100:00080000:3.0:1767319998.428744:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319998.434197:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319998.434211:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379901440:0@lo:38:kworker.0
00000100:00080000:3.0:1767319998.434269:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767319998.434274:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767319998.434277:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379901696:0@lo:38:kworker.0
00000100:00100000:2.0:1767319998.938080:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767319998.938111:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379901824:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767319998.938192:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767319998.938478:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901824
00000100:00100000:0.0:1767319998.938488:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901824
00000100:00100000:0.0:1767319998.938560:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505
00000100:00100000:0.0:1767319998.938570:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379901824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767319998.938603:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767319998.938658:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379901824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (464us total) trans 0 rc 0/0
00000100:00100000:0.0:1767319998.938665:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505
00010000:00010000:3.0:1767319998.938768:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767319998.939451:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379901824:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767319999.959125:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320000.404514:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320000.404560:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320000.404602:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291949312
00000100:00100000:2.0:1767320000.404614:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291949312
00000100:00100000:2.0:1767320000.404690:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291949184
00000100:00100000:2.0:1767320000.404694:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291949184
00000100:00100000:2.0:1767320000.404712:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4582
00000100:00100000:2.0:1767320000.404723:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291949312:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320000.404810:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291949312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (337us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320000.404819:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4582
00000100:00100000:2.0:1767320000.404850:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17413
00000100:00100000:2.0:1767320000.404855:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291949184:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320000.404910:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320000.404942:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291949184:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 85us (381us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320000.404959:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17413
00000100:00080000:3.0:1767320000.405171:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320000.983061:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320002.007699:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320002.519544:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320002.519564:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379901952:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320002.519644:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320002.519856:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379901952
00000100:00100000:3.0:1767320002.519865:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379901952
00000100:00080000:1.0:1767320002.519985:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320002.520149:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506
00000100:00100000:3.0:1767320002.520160:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379901952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320002.520189:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320002.520242:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379901952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (598us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320002.520250:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506
00000100:00100000:1.0:1767320002.520316:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379901952:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320003.035830:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320003.544711:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320003.544719:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320003.544723:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320003.544726:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320003.544731:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320003.544740:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4900
00000100:00080000:1.0:1767320003.544745:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320003.544751:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320003.544788:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609500 x1853164379902080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320003.544818:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320003.544823:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320003.544824:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320003.544830:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4900
00000100:00080000:1.0:1767320003.544832:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320003.544836:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320003.544851:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608000 x1853164379902208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320003.544928:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320003.544932:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320003.544934:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320003.544938:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4900
00000100:00080000:1.0:1767320003.544940:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320003.544944:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320003.544955:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449c00 x1853164379902720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320003.544972:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320003.544975:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320003.544977:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320003.544980:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4900
00000100:00080000:1.0:1767320003.544983:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320003.544998:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320003.545010:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799f80 x1853164379902976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320003.545039:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379902336:0@lo:400:kworker.0
00000100:00100000:1.0:1767320003.545106:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320003.545407:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379902592:0@lo:400:kworker.0
00000100:00100000:0.0:1767320003.545417:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379902080:0@lo:38:kworker.0
00000100:00100000:2.0:1767320003.545460:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320003.545474:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379902848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320003.545498:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320003.545500:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379902464:0@lo:400:kworker.0
00000100:00100000:2.0:1767320003.545523:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320003.545542:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902592
00000100:00100000:0.0:1767320003.545551:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902592
00000100:00100000:0.0:1767320003.545611:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902848
00000100:00100000:0.0:1767320003.545614:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902848
00000100:00100000:0.0:1767320003.545637:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4583
00000100:00100000:0.0:1767320003.545644:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379902592:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320003.545699:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379902592:12345-0@lo:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320003.545707:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4583
00000100:00100000:0.0:1767320003.545727:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4584
00000100:00100000:0.0:1767320003.545732:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379902848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320003.545763:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379902848:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320003.545768:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4584
00000100:00100000:0.0:1767320003.545810:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379902848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320003.545832:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320003.545848:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379902208:0@lo:38:kworker.0
00000100:00100000:0.0:1767320003.545894:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320003.545916:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379902720:0@lo:38:kworker.0
00000100:00100000:0.0:1767320003.545936:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320003.545950:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379902976:0@lo:38:kworker.0
00000100:00100000:0.0:1767320003.545967:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320003.545985:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902336
00000100:00100000:0.0:1767320003.545989:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902080
00000100:00100000:3.0:1767320003.545990:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902336
00000100:00100000:0.0:1767320003.545991:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902080
00000100:00100000:0.0:1767320003.546008:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902720
00000100:00100000:0.0:1767320003.546011:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902720
00000100:00100000:3.0:1767320003.546014:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902464
00000100:00100000:3.0:1767320003.546016:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902464
00000100:00100000:0.0:1767320003.546018:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902976
00000100:00100000:0.0:1767320003.546020:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902976
00000100:00100000:0.0:1767320003.546028:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17414
00000100:00100000:0.0:1767320003.546033:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379902080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320003.546052:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320003.546079:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718
00000100:00100000:0.0:1767320003.546084:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379902080:12345-0@lo:38:kworker.0 Request processed in 50us (250us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320003.546086:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379902336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320003.546093:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17414
00000100:00100000:0.0:1767320003.546104:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17415
00000100:00100000:0.0:1767320003.546108:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379902720:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320003.546117:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320003.546121:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379902336:12345-0@lo:400:kworker.0 Request processed in 36us (1016us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320003.546127:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718
00000100:00100000:0.0:1767320003.546135:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379902720:12345-0@lo:38:kworker.0 Request processed in 26us (198us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320003.546139:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719
00000100:00100000:0.0:1767320003.546140:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17415
00000100:00100000:3.0:1767320003.546144:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379902464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320003.546148:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17416
00000100:00100000:0.0:1767320003.546151:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379902976:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320003.546175:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379902464:12345-0@lo:400:kworker.0 Request processed in 30us (650us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320003.546181:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719
00010000:00020000:0.0:1767320003.546507:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320003.546513:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379902208
00000100:00100000:3.0:1767320003.546517:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379902208
00000100:00100000:3.0:1767320003.546538:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93
00000100:00100000:3.0:1767320003.546542:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379902208:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320003.546552:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320003.546727:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379902336:0@lo:400:kworker.0
00000100:00100000:1.0:1767320003.546779:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379902592:0@lo:400:kworker.0
00000100:00080000:1.0:1767320003.546813:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320003.546818:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320003.546822:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379902080:0@lo:38:kworker.0
00000100:00080000:1.0:1767320003.546830:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320003.546833:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320003.546837:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379902720:0@lo:38:kworker.0
00000100:00080000:1.0:1767320003.546844:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320003.546847:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320003.546850:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379902976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320003.546935:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379902464:0@lo:400:kworker.0
00000100:00100000:3.0:1767320003.547035:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379902208:12345-0@lo:38:kworker.0 Request processed in 491us (1139us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320003.547045:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93
00000100:00080000:2.0:1767320003.547118:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320003.547123:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320003.547795:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320003.547801:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320003.547805:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379902208:0@lo:38:kworker.0
00000100:00100000:0.0:1767320003.554100:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379902976:12345-0@lo:38:kworker.0 Request processed in 7930us (8114us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320003.554120:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17416
00010000:00010000:2.0:1767320004.055293:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320004.055600:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320004.055622:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379903104:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320004.055695:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320004.055898:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379903104
00000100:00100000:1.0:1767320004.055907:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379903104
00000100:00100000:1.0:1767320004.055964:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507
00000100:00100000:1.0:1767320004.055973:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379903104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320004.056002:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320004.056057:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379903104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (362us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320004.056065:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507
00000100:00100000:3.0:1767320004.056200:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379903104:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320005.079191:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320005.524673:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320005.524857:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320005.534586:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291949568
00000100:00100000:0.0:1767320005.534604:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291949568
00000100:00100000:0.0:1767320005.534768:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291949440
00000100:00100000:0.0:1767320005.534774:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291949440
00000100:00080000:1.0:1767320005.534840:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320005.535149:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4585
00000100:00100000:2.0:1767320005.535163:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291949568:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320005.535262:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291949568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (10599us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320005.535270:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4585
00000100:00100000:2.0:1767320005.535295:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17417
00000100:00100000:2.0:1767320005.535312:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291949440:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320005.535343:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320005.535371:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291949440:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (10514us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320005.535378:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17417
00010000:00010000:3.0:1767320006.104594:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320007.128810:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320007.639671:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379903232:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320007.639751:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320007.639898:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379903232
00000100:00100000:0.0:1767320007.639906:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379903232
00000100:00100000:0.0:1767320007.639974:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508
00000100:00100000:0.0:1767320007.639985:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379903232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320007.640015:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320007.640062:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379903232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (310us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320007.640069:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508
00000100:00100000:0.0:1767320007.640128:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379903232:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320007.640531:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320008.151834:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320008.663900:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320008.663914:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320008.663918:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320008.663922:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320008.663927:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320008.663935:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4905
00000100:00080000:1.0:1767320008.663940:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320008.663947:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320008.663989:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449c00 x1853164379903360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320008.664018:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320008.664022:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320008.664024:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320008.664028:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4905
00000100:00080000:1.0:1767320008.664030:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320008.664034:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320008.664049:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b100 x1853164379903488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320008.664104:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320008.664107:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320008.664109:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320008.664113:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4905
00000100:00080000:1.0:1767320008.664115:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320008.664501:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379903744:0@lo:400:kworker.0
00000100:00100000:0.0:1767320008.664597:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320008.664674:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320008.664681:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379903616:0@lo:400:kworker.0
00000100:00100000:0.0:1767320008.664706:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320008.664735:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320008.664745:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379903872:0@lo:400:kworker.0
00000100:00100000:0.0:1767320008.664776:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320008.664809:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379903744
00000100:00100000:0.0:1767320008.664816:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379903744
00000100:00100000:0.0:1767320008.664890:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379903616
00000100:00100000:0.0:1767320008.664893:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379903616
00000100:00100000:0.0:1767320008.664917:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720
00000100:00100000:0.0:1767320008.664925:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379903744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320008.664974:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379903744:12345-0@lo:400:kworker.0 Request processed in 49us (376us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320008.664981:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720
00000100:00100000:0.0:1767320008.664999:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721
00000100:00100000:0.0:1767320008.665005:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379903616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320008.665033:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379903616:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320008.665038:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721
00000100:00080000:0.0:1767320008.665056:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320008.665077:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379903360:0@lo:38:kworker.0
00000100:00100000:0.0:1767320008.665102:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320008.665392:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320008.665447:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b480 x1853164379904000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320008.665476:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320008.665479:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320008.665482:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320008.665486:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4905
00000100:00080000:1.0:1767320008.665488:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320008.665491:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320008.665502:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570380 x1853164379904256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320008.665549:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379903872
00000100:00100000:1.0:1767320008.665553:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379903872
00000100:00100000:1.0:1767320008.665590:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379903360
00000100:00100000:1.0:1767320008.665593:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379903360
00000100:00100000:1.0:1767320008.665609:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4586
00000100:00100000:1.0:1767320008.665615:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379903872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320008.665655:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379903872:12345-0@lo:400:kworker.0 Request processed in 40us (878us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320008.665660:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4586
00000100:00100000:1.0:1767320008.665681:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17418
00000100:00100000:1.0:1767320008.665685:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379903360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320008.665706:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320008.665737:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379903360:12345-0@lo:38:kworker.0 Request processed in 50us (634us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320008.665742:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17418
00000100:00080000:1.0:1767320008.665761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320008.665792:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379903616:0@lo:400:kworker.0
00000100:00100000:1.0:1767320008.665821:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379903744:0@lo:400:kworker.0
00000100:00100000:1.0:1767320008.665860:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379904128:0@lo:400:kworker.0
00000100:00100000:1.0:1767320008.665910:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320008.665936:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379903872:0@lo:400:kworker.0
00000100:00100000:1.0:1767320008.665956:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904128
00000100:00100000:1.0:1767320008.665960:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904128
00000100:00100000:1.0:1767320008.665988:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4587
00000100:00100000:1.0:1767320008.665993:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379904128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320008.666026:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379904128:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320008.666032:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4587
00000100:00080000:1.0:1767320008.666050:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320008.666066:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379904128:0@lo:400:kworker.0
00000100:00080000:0.0:1767320008.666515:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320008.666521:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320008.666524:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379903360:0@lo:38:kworker.0
00000100:00100000:0.0:1767320008.666532:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379903488:0@lo:38:kworker.0
00000100:00100000:0.0:1767320008.666562:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320008.666613:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379904000:0@lo:38:kworker.0
00000100:00100000:0.0:1767320008.666635:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320008.666658:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379904256:0@lo:38:kworker.0
00000100:00100000:0.0:1767320008.666678:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320008.666888:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904000
00000100:00100000:2.0:1767320008.666894:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904000
00000100:00100000:2.0:1767320008.666922:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904256
00000100:00100000:2.0:1767320008.666926:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904256
00000100:00100000:2.0:1767320008.666941:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17419
00000100:00100000:2.0:1767320008.666945:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379904000:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320008.666958:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320008.666993:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379904000:12345-0@lo:38:kworker.0 Request processed in 46us (357us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320008.667000:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17419
00000100:00100000:2.0:1767320008.667014:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17420
00000100:00100000:2.0:1767320008.667018:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379904256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320008.667027:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320008.667051:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379904256:12345-0@lo:38:kworker.0 Request processed in 31us (371us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320008.667056:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17420
00000100:00100000:3.0:1767320008.667736:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379903488
00000100:00100000:3.0:1767320008.667744:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379903488
00000100:00100000:3.0:1767320008.667779:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94
00000100:00100000:3.0:1767320008.667784:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379903488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320008.667796:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320008.667834:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379903488:12345-0@lo:38:kworker.0 Request processed in 49us (1272us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320008.667840:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94
00000100:00080000:0.0:1767320008.668088:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320008.668094:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320008.668097:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379904000:0@lo:38:kworker.0
00000100:00080000:0.0:1767320008.668106:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320008.668109:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320008.668112:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379904256:0@lo:38:kworker.0
00000100:00080000:0.0:1767320008.668534:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320008.668540:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320008.668543:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379903488:0@lo:38:kworker.0
00010000:00010000:2.0:1767320009.176216:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320009.177512:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379904384:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320009.177584:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320009.177893:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904384
00000100:00100000:2.0:1767320009.177903:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904384
00000100:00100000:2.0:1767320009.177964:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509
00000100:00100000:2.0:1767320009.177974:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379904384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320009.178014:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320009.178073:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379904384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (487us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320009.178081:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509
00000100:00100000:3.0:1767320009.178675:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379904384:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320010.199138:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320010.642340:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320010.642406:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320010.642786:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291949696
00000100:00100000:1.0:1767320010.642797:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291949696
00000100:00100000:1.0:1767320010.642842:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291949824
00000100:00100000:1.0:1767320010.642846:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291949824
00000100:00100000:1.0:1767320010.642937:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4588
00000100:00100000:1.0:1767320010.642949:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291949824:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767320010.643208:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320010.643226:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17421
00000100:00100000:2.0:1767320010.643232:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291949696:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320010.643253:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320010.643435:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291949824:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 488us (1027us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320010.643445:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4588
00000100:00100000:2.0:1767320010.658088:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291949696:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 14842us (15746us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320010.658102:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17421
00010000:00010000:3.0:1767320011.223242:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320012.247014:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320012.759067:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320012.759088:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379904512:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320012.759165:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320012.759312:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904512
00000100:00100000:1.0:1767320012.759322:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904512
00000100:00100000:1.0:1767320012.759412:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510
00000100:00100000:1.0:1767320012.759422:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379904512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320012.759452:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320012.759496:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379904512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (330us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320012.759503:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510
00000100:00080000:1.0:1767320012.759541:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320012.759605:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379904512:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320013.271811:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320013.785094:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320013.785108:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320013.785111:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320013.785116:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320013.785121:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320013.785131:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4911
00000100:00080000:0.0:1767320013.785137:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320013.785145:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320013.785198:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964f480 x1853164379904640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320013.785219:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320013.785222:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320013.785224:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320013.785240:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4911
00000100:00100000:2.0:1767320013.785243:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379904640:0@lo:38:kworker.0
00000100:00080000:0.0:1767320013.785244:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320013.785252:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320013.785267:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964c380 x1853164379904768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320013.785338:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320013.785371:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320013.785376:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320013.785378:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320013.785382:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4911
00000100:00080000:0.0:1767320013.785385:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320013.785389:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320013.785402:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ea00 x1853164379905280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320013.785422:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320013.785426:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767320013.785428:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379904768:0@lo:38:kworker.0
00000100:00080000:0.0:1767320013.785429:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320013.785438:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4911
00000100:00080000:0.0:1767320013.785441:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320013.785446:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320013.785460:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964c000 x1853164379905536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320013.785470:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320013.785500:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379905152:0@lo:400:kworker.0
00000100:00100000:2.0:1767320013.785503:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379905280:0@lo:38:kworker.0
00000100:00100000:0.0:1767320013.785545:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320013.785558:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904640
00000100:00100000:2.0:1767320013.785567:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904640
00000100:00100000:0.0:1767320013.785578:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320013.785587:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379905408:0@lo:400:kworker.0
00000100:00100000:2.0:1767320013.785601:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905152
00000100:00100000:2.0:1767320013.785606:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905152
00000100:00100000:0.0:1767320013.785616:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320013.785650:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905408
00000100:00100000:2.0:1767320013.785654:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905408
00000100:00100000:0.0:1767320013.785674:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4589
00000100:00100000:2.0:1767320013.785682:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4590
00000100:00100000:0.0:1767320013.785688:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379905152:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320013.785695:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379905408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320013.785806:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379905024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320013.785862:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17422
00000100:00100000:1.0:1767320013.785888:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379904640:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320013.785909:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320013.786005:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379905152:12345-0@lo:400:kworker.0 Request processed in 322us (458us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320013.786013:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4589
00000100:00100000:0.0:1767320013.786061:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379905152:0@lo:400:kworker.0
00000100:00100000:0.0:1767320013.786090:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320013.786113:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379905536:0@lo:38:kworker.0
00000100:00100000:0.0:1767320013.786136:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320013.786156:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905280
00000100:00100000:0.0:1767320013.786160:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905280
00000100:00100000:0.0:1767320013.786173:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905536
00000100:00100000:0.0:1767320013.786175:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905536
00000100:00100000:0.0:1767320013.786186:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17423
00000100:00100000:0.0:1767320013.786191:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379905280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320013.786202:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320013.786236:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379905280:12345-0@lo:38:kworker.0 Request processed in 43us (144us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320013.786242:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17423
00000100:00100000:0.0:1767320013.786255:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17424
00000100:00100000:0.0:1767320013.786259:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379905536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320013.786269:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320013.786293:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379905536:12345-0@lo:38:kworker.0 Request processed in 32us (155us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320013.786298:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17424
00000100:00080000:0.0:1767320013.786323:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320013.786328:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320013.786331:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379905536:0@lo:38:kworker.0
00000100:00080000:0.0:1767320013.786340:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320013.786343:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320013.786345:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379905280:0@lo:38:kworker.0
00000100:00100000:0.0:1767320013.786398:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379904896:0@lo:400:kworker.0
00000100:00100000:0.0:1767320013.786428:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320013.786469:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320013.786494:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904896
00000100:00100000:0.0:1767320013.786497:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904896
00000100:00100000:0.0:1767320013.786527:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722
00000100:00100000:0.0:1767320013.786534:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379904896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320013.786575:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379904896:12345-0@lo:400:kworker.0 Request processed in 41us (146us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320013.786581:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722
00000100:00100000:0.0:1767320013.786618:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379904896:0@lo:400:kworker.0
00000100:00100000:0.0:1767320013.786647:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379904768
00000100:00100000:0.0:1767320013.786651:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379904768
00000100:00100000:0.0:1767320013.786671:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95
00000100:00100000:0.0:1767320013.786677:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379904768:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320013.786687:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320013.786721:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379904768:12345-0@lo:38:kworker.0 Request processed in 43us (1255us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320013.786727:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95
00000100:00080000:0.0:1767320013.786750:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320013.786755:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320013.786758:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379904768:0@lo:38:kworker.0
00000100:00100000:2.0:1767320013.797014:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379905408:12345-0@lo:400:kworker.0 Request processed in 11313us (11387us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320013.797032:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4590
00000100:00100000:0.0:1767320013.797209:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379905408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320013.799725:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320013.800862:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379904640:12345-0@lo:38:kworker.0 Request processed in 14985us (15517us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320013.800892:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17422
00000100:00080000:2.0:1767320013.801124:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320013.801131:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320013.801135:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379904640:0@lo:38:kworker.0
00000100:00100000:0.0:1767320013.806571:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905024
00000100:00100000:0.0:1767320013.806586:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905024
00000100:00100000:0.0:1767320013.806681:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723
00000100:00100000:0.0:1767320013.806691:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379905024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320013.806801:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379905024:12345-0@lo:400:kworker.0 Request processed in 111us (7086us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320013.806811:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723
00000100:00080000:1.0:1767320013.807367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320013.808192:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379905024:0@lo:400:kworker.0
00000100:00100000:3.0:1767320014.295407:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320014.295431:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379905664:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320014.295506:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320014.295906:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905664
00000100:00100000:0.0:1767320014.295915:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905664
00000100:00100000:0.0:1767320014.295968:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511
00000100:00100000:0.0:1767320014.295978:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379905664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320014.296010:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320014.297364:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379905664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1370us (1839us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320014.297376:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511
00010000:00010000:1.0:1767320014.297490:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320014.303831:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379905664:0@lo:13:osp-pre-0-1.0
00000400:00000100:3.0:1767320014.744759:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291949952 offset 0 length 520: 4
00000100:00100000:3.0:1767320014.744806:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320014.744935:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320014.764137:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950080
00000100:00100000:1.0:1767320014.764154:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950080
00000100:00100000:1.0:1767320014.764222:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950208
00000100:00100000:1.0:1767320014.764226:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950208
00000100:00100000:1.0:1767320014.764306:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4591
00000100:00100000:1.0:1767320014.764318:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291950208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320014.764429:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291950208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (19492us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320014.764441:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4591
00000100:00100000:1.0:1767320014.764467:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17425
00000100:00100000:1.0:1767320014.764472:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291950080:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320014.764495:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320014.764525:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291950080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (19718us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320014.764532:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17425
00000100:00080000:3.0:1767320014.768823:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320015.319752:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320016.343529:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320017.369611:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320017.881042:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379905792:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320017.881116:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320017.881410:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905792
00000100:00100000:0.0:1767320017.881418:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905792
00000100:00100000:0.0:1767320017.881487:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512
00000100:00100000:0.0:1767320017.881498:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379905792:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320017.881536:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320017.881581:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379905792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (463us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320017.881588:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512
00000100:00080000:3.0:1767320017.881922:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320017.882001:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379905792:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320018.391763:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320018.904431:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320018.904442:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320018.904445:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320018.904449:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320018.904453:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320018.904461:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4916
00000100:00080000:2.0:1767320018.904468:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320018.904476:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320018.904509:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767319993/real 1767319993]  req@ffff8b0f2f28ca80 x1853164379899392/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320018.904531:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f100 x1853164379905920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320018.904549:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f28ca80 x1853164379899392/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320018.904564:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320018.904568:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320018.904571:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320018.904577:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4916
00000100:00080000:2.0:1767320018.904579:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767320018.904583:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379905920:0@lo:38:kworker.0
00000100:00080000:2.0:1767320018.904585:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320018.904605:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28c380 x1853164379906048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320018.904662:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320018.904678:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320018.904682:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320018.904685:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320018.904689:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4916
00000100:00080000:2.0:1767320018.904692:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320018.904696:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320018.904709:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28d500 x1853164379906560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320018.904726:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320018.904730:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320018.904731:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320018.904733:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320018.904740:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4916
00000100:00080000:2.0:1767320018.904743:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320018.904747:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00080000:3.0:1767320018.904751:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320018.904757:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379899392:0@lo:250:kworker.0
00000100:00100000:2.0:1767320018.904762:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6a00 x1853164379906816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320018.904778:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320018.904781:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320018.904783:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767320018.904785:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379906048:0@lo:38:kworker.0
00000100:00080000:2.0:1767320018.904789:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4895
00000100:00080000:2.0:1767320018.904794:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320018.904798:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320018.904813:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4000 x1853164379906944/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320018.904827:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320018.904842:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379906304:0@lo:400:kworker.0
00000100:00100000:3.0:1767320018.904855:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379906560:0@lo:38:kworker.0
00000100:00100000:1.0:1767320018.904956:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379906176:0@lo:400:kworker.0
00000100:00100000:0.0:1767320018.905184:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379905920
00000100:00100000:0.0:1767320018.905192:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379905920
00000100:00100000:0.0:1767320018.905229:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17426
00000100:00100000:0.0:1767320018.905237:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379905920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320018.905257:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320018.906456:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320018.906497:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379906816:0@lo:38:kworker.0
00000100:00100000:3.0:1767320018.906529:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320018.906560:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379906944:0@lo:250:kworker.0
00000400:00000100:3.0:1767320018.906580:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379906944 offset 0 length 520: 4
00000100:00100000:3.0:1767320018.906636:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379906688:0@lo:400:kworker.0
00000100:00100000:3.0:1767320018.906659:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320018.906680:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320018.906684:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379906432:0@lo:400:kworker.0
00000100:00100000:3.0:1767320018.906698:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320018.906722:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379906560
00000100:00100000:3.0:1767320018.906726:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379906560
00000100:00100000:3.0:1767320018.906743:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379906816
00000100:00100000:3.0:1767320018.906744:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379906816
00000100:00100000:3.0:1767320018.906748:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379906688
00000100:00100000:3.0:1767320018.906749:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379906688
00000100:00100000:3.0:1767320018.906772:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379906432
00000100:00100000:3.0:1767320018.906774:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379906432
00000100:00100000:3.0:1767320018.906785:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4592
00000100:00100000:3.0:1767320018.906789:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379906688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320018.906826:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379906688:12345-0@lo:400:kworker.0 Request processed in 37us (167us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320018.906831:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4592
00000100:00100000:3.0:1767320018.906842:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4593
00000100:00100000:3.0:1767320018.906846:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379906432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320018.906861:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379906432:12345-0@lo:400:kworker.0 Request processed in 15us (163us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320018.906865:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4593
00000100:00100000:3.0:1767320018.906891:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17427
00000100:00100000:3.0:1767320018.906896:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379906560:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320018.906912:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320018.906944:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379906560:12345-0@lo:38:kworker.0 Request processed in 46us (492us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320018.906951:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17427
00000100:00100000:3.0:1767320018.906962:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17428
00000100:00100000:3.0:1767320018.906966:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379906816:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320018.906988:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320018.907013:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379906816:12345-0@lo:38:kworker.0 Request processed in 45us (482us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320018.907019:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17428
00000100:00080000:3.0:1767320018.907036:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320018.907067:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379906432:0@lo:400:kworker.0
00000100:00100000:3.0:1767320018.907077:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379906688:0@lo:400:kworker.0
00000100:00080000:3.0:1767320018.907105:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320018.907110:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320018.907113:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379906560:0@lo:38:kworker.0
00000100:00080000:3.0:1767320018.907121:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320018.907124:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320018.907126:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379906816:0@lo:38:kworker.0
00000100:00100000:3.0:1767320018.907170:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379906048
00000100:00100000:3.0:1767320018.907174:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379906048
00000100:00100000:3.0:1767320018.907195:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96
00000100:00100000:3.0:1767320018.907200:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379906048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320018.907210:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320018.907244:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379906048:12345-0@lo:38:kworker.0 Request processed in 42us (2418us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320018.907253:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96
00000100:00080000:3.0:1767320018.907294:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320018.907299:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320018.907301:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379906048:0@lo:38:kworker.0
00000100:00100000:1.0:1767320018.913989:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320018.915373:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379906176
00000100:00100000:3.0:1767320018.915387:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379906176
00000100:00100000:3.0:1767320018.915459:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724
00000100:00100000:3.0:1767320018.915470:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379906176:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320018.915735:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379906176:12345-0@lo:400:kworker.0 Request processed in 267us (1753us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320018.915743:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724
00000100:00100000:2.0:1767320018.917519:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320018.918101:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379906304
00000100:00100000:1.0:1767320018.918110:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379906304
00000100:00100000:1.0:1767320018.918187:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725
00000100:00100000:1.0:1767320018.918196:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379906304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320018.918275:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379906304:12345-0@lo:400:kworker.0 Request processed in 80us (760us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320018.918282:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725
00000100:00100000:1.0:1767320018.919208:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379906176:0@lo:400:kworker.0
00000100:00080000:2.0:1767320018.919834:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320018.919903:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379906304:0@lo:400:kworker.0
00000100:00100000:0.0:1767320018.920098:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379905920:12345-0@lo:38:kworker.0 Request processed in 14858us (15436us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320018.920107:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17426
00000100:00080000:3.0:1767320018.920192:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320018.920198:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320018.920201:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379905920:0@lo:38:kworker.0
00010000:00010000:3.0:1767320019.415194:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320019.415220:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320019.415243:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379907072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320019.415330:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320019.415433:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907072
00000100:00100000:3.0:1767320019.415443:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907072
00000100:00100000:3.0:1767320019.415513:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513
00000100:00100000:3.0:1767320019.415524:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379907072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320019.415558:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320019.415705:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379907072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (373us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320019.415712:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513
00000100:00100000:0.0:1767320019.415936:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379907072:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320019.856090:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320019.856138:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320019.856351:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950464
00000100:00100000:0.0:1767320019.856361:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950464
00000100:00100000:0.0:1767320019.856490:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950336
00000100:00100000:0.0:1767320019.856494:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950336
00000100:00100000:0.0:1767320019.856514:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4594
00000100:00100000:0.0:1767320019.856525:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291950464:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320019.856610:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291950464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (531us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320019.856618:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4594
00000100:00100000:0.0:1767320019.856637:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17429
00000100:00100000:0.0:1767320019.856642:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291950336:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320019.856663:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320019.856688:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291950336:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (550us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320019.856695:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17429
00000100:00080000:2.0:1767320019.857070:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320020.439663:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320021.464276:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320022.487213:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320023.000681:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379907200:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320023.000759:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320023.001521:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907200
00000100:00100000:3.0:1767320023.001531:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907200
00000100:00100000:3.0:1767320023.001705:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514
00000100:00100000:3.0:1767320023.001717:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379907200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320023.001749:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320023.001812:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379907200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (1053us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320023.001820:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514
00000100:00100000:1.0:1767320023.001920:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379907200:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320023.002164:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320023.514067:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320024.030420:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320024.030431:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320024.030435:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320024.030439:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320024.030443:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320024.030451:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4921
00000100:00080000:3.0:1767320024.030456:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320024.030463:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320024.030503:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f480 x1853164379907328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320024.030541:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320024.030546:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320024.030547:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320024.030552:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4921
00000100:00080000:3.0:1767320024.030554:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320024.030559:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320024.030573:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28d180 x1853164379907456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320024.030644:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320024.030648:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320024.030650:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320024.030653:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4921
00000100:00080000:3.0:1767320024.030655:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320024.030659:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320024.030669:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28e680 x1853164379907968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320024.030685:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320024.030688:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320024.030690:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320024.030693:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4921
00000100:00080000:3.0:1767320024.030695:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320024.030699:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320024.030710:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07330380 x1853164379908224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320024.030812:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379907584:0@lo:400:kworker.0
00000100:00100000:2.0:1767320024.030920:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320024.030985:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320024.030992:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379907712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320024.031017:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320024.031043:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379907840:0@lo:400:kworker.0
00000100:00100000:2.0:1767320024.031068:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320024.031086:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320024.031091:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379908096:0@lo:400:kworker.0
00000100:00100000:2.0:1767320024.031108:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320024.031138:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907840
00000100:00100000:2.0:1767320024.031146:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907840
00000100:00100000:2.0:1767320024.031196:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908096
00000100:00100000:2.0:1767320024.031200:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908096
00000100:00100000:2.0:1767320024.031226:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4595
00000100:00100000:2.0:1767320024.031233:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379907840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320024.031297:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379907840:12345-0@lo:400:kworker.0 Request processed in 64us (227us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320024.031305:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4595
00000100:00100000:2.0:1767320024.031321:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4596
00000100:00100000:2.0:1767320024.031327:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379908096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320024.031353:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379908096:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320024.031359:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4596
00000100:00080000:2.0:1767320024.031384:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320024.031415:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379908096:0@lo:400:kworker.0
00000100:00100000:2.0:1767320024.031424:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379907840:0@lo:400:kworker.0
00000100:00100000:1.0:1767320024.035395:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907584
00000100:00100000:1.0:1767320024.035413:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907584
00000100:00100000:1.0:1767320024.035490:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907712
00000100:00100000:1.0:1767320024.035494:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907712
00000100:00100000:1.0:1767320024.035534:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726
00000100:00100000:1.0:1767320024.035543:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379907584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320024.035638:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379907584:12345-0@lo:400:kworker.0 Request processed in 96us (4717us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320024.035645:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726
00000100:00100000:1.0:1767320024.035665:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727
00000100:00100000:1.0:1767320024.035671:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379907712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320024.035698:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379907712:12345-0@lo:400:kworker.0 Request processed in 27us (4679us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320024.035703:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727
00000100:00080000:1.0:1767320024.035723:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320024.035757:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379907712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320024.035765:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379907584:0@lo:400:kworker.0
00000100:00100000:0.0:1767320024.036008:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379907328:0@lo:38:kworker.0
00000100:00100000:0.0:1767320024.036048:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320024.036081:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379907456:0@lo:38:kworker.0
00000100:00100000:0.0:1767320024.036104:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320024.036130:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379907968:0@lo:38:kworker.0
00000100:00100000:0.0:1767320024.036143:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320024.036153:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379908224:0@lo:38:kworker.0
00000100:00100000:0.0:1767320024.036164:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320024.036216:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907456
00000100:00100000:3.0:1767320024.036220:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907456
00000100:00100000:3.0:1767320024.036243:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97
00000100:00100000:3.0:1767320024.036247:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379907456:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320024.036271:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320024.036316:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379907456:12345-0@lo:38:kworker.0 Request processed in 68us (209us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320024.036323:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97
00000100:00100000:2.0:1767320024.036355:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907328
00000100:00100000:3.0:1767320024.036360:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379907968
00000100:00100000:2.0:1767320024.036361:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907328
00000100:00100000:3.0:1767320024.036362:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379907968
00000100:00100000:3.0:1767320024.036428:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908224
00000100:00100000:3.0:1767320024.036432:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908224
00000100:00080000:0.0:1767320024.036484:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320024.036490:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320024.036493:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379907456:0@lo:38:kworker.0
00000100:00100000:2.0:1767320024.037887:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17430
00000100:00100000:2.0:1767320024.037898:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379907968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320024.037918:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320024.037974:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17431
00000100:00100000:1.0:1767320024.037981:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379907328:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320024.037983:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379907968:12345-0@lo:38:kworker.0 Request processed in 85us (1837us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320024.037990:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17430
00010000:00020000:1.0:1767320024.037991:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320024.038007:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17432
00000100:00100000:2.0:1767320024.038011:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379908224:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320024.038019:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379907328:12345-0@lo:38:kworker.0 Request processed in 38us (1972us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767320024.038021:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320024.038025:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17431
00000100:00100000:2.0:1767320024.038041:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379908224:12345-0@lo:38:kworker.0 Request processed in 28us (1875us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320024.038047:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17432
00000100:00080000:1.0:1767320024.038079:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320024.038083:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320024.038087:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379907328:0@lo:38:kworker.0
00000100:00080000:1.0:1767320024.038097:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320024.038100:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320024.038103:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379907968:0@lo:38:kworker.0
00000100:00080000:1.0:1767320024.038111:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320024.038114:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320024.038117:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379908224:0@lo:38:kworker.0
00010000:00010000:0.0:1767320024.535172:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320024.535382:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379908352:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320024.535457:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320024.535616:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908352
00000100:00100000:0.0:1767320024.535624:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908352
00000100:00100000:0.0:1767320024.535676:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515
00000100:00100000:0.0:1767320024.535685:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379908352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320024.535713:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320024.535765:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379908352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320024.535772:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515
00000100:00100000:1.0:1767320024.535859:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379908352:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320024.977740:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320024.977837:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320024.977922:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950720
00000100:00100000:0.0:1767320024.977934:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950720
00000100:00100000:0.0:1767320024.978005:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950592
00000100:00100000:0.0:1767320024.978008:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950592
00000100:00080000:1.0:1767320024.978590:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320024.980651:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4597
00000100:00100000:2.0:1767320024.980680:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291950720:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320024.980787:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291950720:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (3059us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320024.980795:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4597
00000100:00100000:2.0:1767320024.980836:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17433
00000100:00100000:2.0:1767320024.980842:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291950592:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320024.980864:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320024.985641:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291950592:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 4788us (7795us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320024.985656:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17433
00010000:00010000:2.0:1767320025.560024:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320026.589853:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320027.613533:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320028.119467:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379908480:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320028.119553:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320028.119751:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908480
00000100:00100000:2.0:1767320028.119759:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908480
00000100:00100000:2.0:1767320028.119819:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516
00000100:00100000:2.0:1767320028.119827:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379908480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320028.119854:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320028.119942:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379908480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (388us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320028.119949:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516
00000100:00080000:1.0:1767320028.120446:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320028.120485:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379908480:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767320028.631035:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320029.143350:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320029.143360:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320029.143364:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320029.143367:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320029.143372:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320029.143379:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4926
00000100:00080000:0.0:1767320029.143383:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320029.143390:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320029.143431:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964f800 x1853164379908608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320029.143465:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320029.143469:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320029.143471:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320029.143475:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4926
00000100:00080000:0.0:1767320029.143477:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320029.143480:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320029.143494:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379908736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320029.143567:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379908864:0@lo:400:kworker.0
00000100:00100000:2.0:1767320029.143637:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320029.143751:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908864
00000100:00100000:3.0:1767320029.143759:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908864
00000100:00100000:3.0:1767320029.143810:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728
00000100:00100000:3.0:1767320029.143819:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379908864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.143970:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379908992:0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.144000:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320029.144037:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908992
00000100:00100000:1.0:1767320029.144041:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908992
00000100:00100000:1.0:1767320029.144077:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729
00000100:00100000:1.0:1767320029.144084:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379908992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.144136:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379908992:12345-0@lo:400:kworker.0 Request processed in 52us (134us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320029.144143:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729
00000100:00080000:1.0:1767320029.144167:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320029.144210:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379908992:0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.144262:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379908608:0@lo:38:kworker.0
00000100:00100000:1.0:1767320029.144287:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320029.144305:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379908736:0@lo:38:kworker.0
00000100:00100000:1.0:1767320029.144328:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320029.144362:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908736
00000100:00100000:1.0:1767320029.144366:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908736
00000100:00100000:1.0:1767320029.144387:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98
00000100:00100000:1.0:1767320029.144391:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379908736:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320029.144409:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320029.144442:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379908736:12345-0@lo:38:kworker.0 Request processed in 49us (113us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320029.144448:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98
00000100:00100000:1.0:1767320029.144467:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379908608
00000100:00100000:1.0:1767320029.144470:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379908608
00000100:00100000:1.0:1767320029.144492:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17434
00000100:00100000:1.0:1767320029.144496:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379908608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320029.144506:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320029.144530:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379908608:12345-0@lo:38:kworker.0 Request processed in 33us (242us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320029.144536:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17434
00000100:00080000:1.0:1767320029.144560:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320029.144566:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320029.144569:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379908608:0@lo:38:kworker.0
00000100:00080000:1.0:1767320029.144577:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320029.144580:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320029.144583:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379908736:0@lo:38:kworker.0
00000100:00100000:3.0:1767320029.156511:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379908864:12345-0@lo:400:kworker.0 Request processed in 12682us (12862us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320029.156526:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728
00000100:00080000:0.0:1767320029.157003:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320029.157008:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320029.157012:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320029.157017:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4926
00000100:00080000:0.0:1767320029.157020:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320029.157026:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320029.157045:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964f800 x1853164379909248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320029.157071:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320029.157074:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320029.157076:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320029.157079:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4926
00000100:00080000:0.0:1767320029.157082:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320029.157085:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320029.157096:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fed80 x1853164379909504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320029.157127:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379909248:0@lo:38:kworker.0
00000100:00100000:0.0:1767320029.157178:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320029.157201:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379909504:0@lo:38:kworker.0
00000100:00100000:0.0:1767320029.157229:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320029.157259:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379909248
00000100:00100000:0.0:1767320029.157266:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379909248
00000100:00100000:0.0:1767320029.157288:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379909504
00000100:00100000:0.0:1767320029.157290:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379909504
00000100:00100000:0.0:1767320029.157311:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17435
00000100:00100000:0.0:1767320029.157317:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379909248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320029.157336:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320029.157367:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379909248:12345-0@lo:38:kworker.0 Request processed in 50us (189us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320029.157374:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17435
00000100:00100000:0.0:1767320029.157386:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17436
00000100:00100000:0.0:1767320029.157389:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379909504:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320029.157540:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379909376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.157567:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320029.157585:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320029.157590:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379909120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.157605:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320029.157625:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379909376
00000100:00100000:1.0:1767320029.157627:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379909376
00000100:00100000:1.0:1767320029.157658:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379909120
00000100:00100000:1.0:1767320029.157660:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379909120
00000100:00100000:1.0:1767320029.157671:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4598
00000100:00100000:1.0:1767320029.157676:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379909376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.157728:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379909376:12345-0@lo:400:kworker.0 Request processed in 51us (160us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320029.157733:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4598
00000100:00100000:1.0:1767320029.157747:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4599
00000100:00100000:1.0:1767320029.157752:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379909120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.157781:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379909120:12345-0@lo:400:kworker.0 Request processed in 29us (175us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320029.157786:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4599
00000100:00080000:1.0:1767320029.157801:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320029.157833:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379909120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320029.157841:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379909376:0@lo:400:kworker.0
00000100:00080000:1.0:1767320029.157915:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320029.157920:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320029.157923:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379909248:0@lo:38:kworker.0
00010000:00020000:0.0:1767320029.158333:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320029.158588:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320029.158593:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320029.158596:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379909504:0@lo:38:kworker.0
00000100:00100000:2.0:1767320029.158910:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379908864:0@lo:400:kworker.0
00000100:00100000:0.0:1767320029.159039:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379909504:12345-0@lo:38:kworker.0 Request processed in 1647us (1808us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320029.159047:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17436
00010000:00010000:2.0:1767320029.655511:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320029.655937:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379909632:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320029.656322:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320029.656488:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379909632
00000100:00100000:0.0:1767320029.656497:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379909632
00000100:00100000:0.0:1767320029.656691:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517
00000100:00100000:0.0:1767320029.656704:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379909632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320029.656736:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320029.656798:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379909632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (478us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320029.656807:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517
00000100:00100000:3.0:1767320029.657332:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379909632:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320030.095187:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320030.095306:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950976
00000100:00100000:0.0:1767320030.095318:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950976
00000100:00100000:0.0:1767320030.095405:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4600
00000100:00100000:0.0:1767320030.095418:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291950976:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320030.095517:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291950976:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (341us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320030.095527:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4600
00000100:00080000:1.0:1767320030.095685:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320030.099504:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320030.099601:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291950848
00000100:00100000:0.0:1767320030.099612:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291950848
00000100:00100000:0.0:1767320030.099667:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17437
00000100:00100000:0.0:1767320030.099674:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291950848:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320030.099698:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320030.099778:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291950848:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 103us (286us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320030.099785:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17437
00010000:00010000:2.0:1767320030.679326:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320031.703613:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320032.727640:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320033.239675:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320033.239696:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379909760:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320033.239786:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320033.239931:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379909760
00000100:00100000:0.0:1767320033.239941:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379909760
00000100:00100000:0.0:1767320033.240023:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518
00000100:00100000:0.0:1767320033.240034:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379909760:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320033.240069:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320033.240130:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379909760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (343us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320033.240140:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518
00000100:00080000:2.0:1767320033.240424:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320033.240471:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379909760:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320033.762378:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320034.263204:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320034.263215:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320034.263217:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320034.263221:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320034.263226:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320034.263235:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4931
00000100:00080000:1.0:1767320034.263239:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320034.263247:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320034.263289:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572d80 x1853164379909888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320034.263316:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320034.263320:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320034.263322:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320034.263325:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4931
00000100:00080000:1.0:1767320034.263328:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320034.263331:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320034.263344:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570e00 x1853164379910016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320034.263408:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320034.263411:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320034.263414:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320034.263417:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4931
00000100:00080000:1.0:1767320034.263420:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320034.263423:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320034.263434:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964f800 x1853164379910528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320034.263449:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320034.263452:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320034.263454:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320034.263457:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4931
00000100:00080000:1.0:1767320034.263459:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320034.263463:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320034.263472:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379910784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320034.263501:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379910656:0@lo:400:kworker.0
00000100:00100000:1.0:1767320034.263577:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320034.263633:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320034.263640:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379910400:0@lo:400:kworker.0
00000100:00100000:1.0:1767320034.263663:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320034.263748:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910656
00000100:00100000:0.0:1767320034.263756:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910656
00000100:00100000:0.0:1767320034.263816:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910400
00000100:00100000:0.0:1767320034.263820:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910400
00000100:00100000:0.0:1767320034.263846:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4601
00000100:00100000:0.0:1767320034.263854:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379910656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320034.263937:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379910656:12345-0@lo:400:kworker.0 Request processed in 83us (360us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320034.263944:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4601
00000100:00100000:0.0:1767320034.263963:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4602
00000100:00100000:0.0:1767320034.263969:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379910400:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320034.263994:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379910400:12345-0@lo:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320034.264000:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4602
00000100:00100000:0.0:1767320034.264027:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379909888:0@lo:38:kworker.0
00000100:00100000:0.0:1767320034.264050:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320034.264070:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379910016:0@lo:38:kworker.0
00000100:00100000:0.0:1767320034.264095:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320034.264117:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379910528:0@lo:38:kworker.0
00000100:00100000:0.0:1767320034.264137:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320034.264151:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379910784:0@lo:38:kworker.0
00000100:00100000:0.0:1767320034.264180:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320034.264209:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910016
00000100:00100000:0.0:1767320034.264213:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910016
00000100:00100000:0.0:1767320034.264235:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99
00000100:00100000:0.0:1767320034.264240:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379910016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320034.264259:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320034.264292:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379910016:12345-0@lo:38:kworker.0 Request processed in 50us (196us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320034.264298:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99
00000100:00100000:0.0:1767320034.264318:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379909888
00000100:00100000:0.0:1767320034.264322:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379909888
00000100:00100000:0.0:1767320034.264337:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910528
00000100:00100000:0.0:1767320034.264339:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910528
00000100:00100000:0.0:1767320034.264348:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910784
00000100:00100000:0.0:1767320034.264350:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910784
00000100:00100000:0.0:1767320034.264359:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17438
00000100:00100000:0.0:1767320034.264363:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379909888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320034.264372:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320034.264397:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379909888:12345-0@lo:38:kworker.0 Request processed in 32us (345us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320034.264402:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17438
00000100:00100000:0.0:1767320034.264413:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17439
00000100:00100000:0.0:1767320034.264417:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379910528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320034.264427:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320034.264448:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379910528:12345-0@lo:38:kworker.0 Request processed in 29us (311us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320034.264453:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17439
00000100:00100000:0.0:1767320034.264463:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440
00000100:00100000:0.0:1767320034.264467:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379910784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320034.264478:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320034.264500:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379910784:12345-0@lo:38:kworker.0 Request processed in 31us (329us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320034.264506:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440
00000100:00100000:0.0:1767320034.264548:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379910400:0@lo:400:kworker.0
00000100:00100000:0.0:1767320034.264560:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379910656:0@lo:400:kworker.0
00000100:00080000:0.0:1767320034.264590:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320034.264595:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320034.264598:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379909888:0@lo:38:kworker.0
00000100:00080000:0.0:1767320034.264623:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320034.264627:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320034.264629:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379910016:0@lo:38:kworker.0
00000100:00080000:0.0:1767320034.264636:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320034.264639:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320034.264642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379910528:0@lo:38:kworker.0
00000100:00080000:0.0:1767320034.264648:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320034.264651:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320034.264654:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379910784:0@lo:38:kworker.0
00000100:00080000:1.0:1767320034.264741:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320034.264767:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379910272:0@lo:400:kworker.0
00000100:00100000:1.0:1767320034.264801:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320034.264826:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320034.264832:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379910144:0@lo:400:kworker.0
00000100:00100000:3.0:1767320034.264860:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910272
00000100:00100000:1.0:1767320034.264863:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320034.264881:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910272
00000100:00100000:1.0:1767320034.264920:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910144
00000100:00100000:1.0:1767320034.264925:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910144
00000100:00100000:3.0:1767320034.264933:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730
00000100:00100000:3.0:1767320034.264944:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379910272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320034.264959:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731
00000100:00100000:1.0:1767320034.264969:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379910144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320034.265001:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379910272:12345-0@lo:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320034.265011:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730
00000100:00100000:1.0:1767320034.265012:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379910144:12345-0@lo:400:kworker.0 Request processed in 42us (146us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320034.265021:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731
00000100:00080000:1.0:1767320034.265056:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320034.265074:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379910144:0@lo:400:kworker.0
00000100:00100000:1.0:1767320034.265083:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379910272:0@lo:400:kworker.0
00000100:00100000:0.0:1767320034.775749:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320034.775775:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379910912:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320034.775855:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00010000:2.0:1767320034.776247:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320034.776267:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379910912
00000100:00100000:3.0:1767320034.776277:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379910912
00000100:00100000:3.0:1767320034.776342:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519
00000100:00100000:3.0:1767320034.776353:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379910912:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320034.776385:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320034.776441:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379910912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (585us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320034.776449:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519
00000100:00100000:0.0:1767320034.776607:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379910912:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320035.215640:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320035.215913:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291951232
00000100:00100000:1.0:1767320035.215925:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291951232
00000100:00100000:1.0:1767320035.215998:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4603
00000100:00100000:1.0:1767320035.216009:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291951232:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320035.216102:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291951232:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 95us (470us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320035.216110:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4603
00000100:00080000:2.0:1767320035.216344:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320035.227414:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320035.227903:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291951104
00000100:00100000:3.0:1767320035.227913:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291951104
00000100:00100000:3.0:1767320035.227968:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17441
00000100:00100000:3.0:1767320035.227977:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291951104:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320035.228002:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320035.228383:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291951104:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 403us (977us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320035.228392:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17441
00010000:00010000:3.0:1767320035.799260:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320036.823188:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320037.847166:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320038.360903:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379911040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320038.361000:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320038.362551:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911040
00000100:00100000:2.0:1767320038.362563:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911040
00000100:00100000:2.0:1767320038.362641:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520
00000100:00100000:2.0:1767320038.362652:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379911040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320038.362683:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320038.362769:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379911040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (1756us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320038.362777:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520
00000100:00080000:1.0:1767320038.363154:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320038.363260:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379911040:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320038.871720:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320039.384816:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320039.384827:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320039.384830:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320039.384834:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320039.384838:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320039.384845:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4936
00000100:00080000:0.0:1767320039.384850:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320039.384856:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320039.384924:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd180 x1853164379911168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320039.384949:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320039.384953:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320039.384955:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320039.384959:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4936
00000100:00080000:0.0:1767320039.384962:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320039.384965:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320039.384978:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ffb80 x1853164379911296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320039.385060:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320039.385064:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320039.385066:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320039.385069:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4936
00000100:00080000:0.0:1767320039.385071:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320039.385074:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320039.385084:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fdc00 x1853164379911808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320039.385100:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320039.385103:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320039.385105:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320039.385108:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4936
00000100:00080000:0.0:1767320039.385110:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320039.385114:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320039.385135:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570380 x1853164379912064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320039.385174:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379911680:0@lo:400:kworker.0
00000100:00100000:0.0:1767320039.385260:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320039.385335:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320039.385341:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379911936:0@lo:400:kworker.0
00000100:00100000:0.0:1767320039.385364:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320039.385399:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911680
00000100:00100000:0.0:1767320039.385406:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911680
00000100:00100000:0.0:1767320039.385461:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911936
00000100:00100000:0.0:1767320039.385465:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911936
00000100:00100000:0.0:1767320039.385491:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4604
00000100:00100000:0.0:1767320039.385500:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379911680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320039.385553:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379911680:12345-0@lo:400:kworker.0 Request processed in 53us (291us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320039.385560:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4604
00000100:00100000:3.0:1767320039.385701:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379911424:0@lo:400:kworker.0
00000100:00100000:3.0:1767320039.385736:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320039.385767:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320039.385773:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379911552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320039.385795:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320039.385842:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4605
00000100:00100000:3.0:1767320039.385851:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379911936:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320039.385903:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379911936:12345-0@lo:400:kworker.0 Request processed in 54us (537us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320039.385910:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4605
00000100:00080000:3.0:1767320039.385934:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320039.385972:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379911936:0@lo:400:kworker.0
00000100:00100000:3.0:1767320039.385982:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379911680:0@lo:400:kworker.0
00000100:00100000:1.0:1767320039.386431:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911424
00000100:00100000:1.0:1767320039.386437:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911424
00000100:00100000:1.0:1767320039.386475:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911552
00000100:00100000:1.0:1767320039.386478:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911552
00000100:00100000:1.0:1767320039.386505:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732
00000100:00100000:1.0:1767320039.386511:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379911424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320039.386555:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379911424:12345-0@lo:400:kworker.0 Request processed in 45us (819us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320039.386561:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732
00000100:00100000:1.0:1767320039.386590:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733
00000100:00100000:1.0:1767320039.386596:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379911552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320039.386622:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379911552:12345-0@lo:400:kworker.0 Request processed in 27us (826us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320039.386627:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733
00000100:00100000:1.0:1767320039.386665:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379911552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320039.386676:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379911424:0@lo:400:kworker.0
00000100:00100000:2.0:1767320039.387037:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379911168:0@lo:38:kworker.0
00000100:00100000:2.0:1767320039.387074:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320039.387104:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379911296:0@lo:38:kworker.0
00000100:00100000:2.0:1767320039.387139:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320039.387167:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379911808:0@lo:38:kworker.0
00000100:00100000:2.0:1767320039.387200:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320039.387219:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379912064:0@lo:38:kworker.0
00000100:00100000:2.0:1767320039.387238:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320039.387302:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911168
00000100:00100000:2.0:1767320039.387306:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911168
00000100:00100000:2.0:1767320039.387325:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911808
00000100:00100000:2.0:1767320039.387328:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911808
00000100:00100000:2.0:1767320039.387340:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379912064
00000100:00100000:2.0:1767320039.387342:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379912064
00000100:00100000:2.0:1767320039.387355:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17442
00000100:00100000:2.0:1767320039.387360:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379911168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320039.387378:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320039.387413:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379911168:12345-0@lo:38:kworker.0 Request processed in 51us (338us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320039.387419:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17442
00000100:00100000:2.0:1767320039.387432:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17443
00000100:00100000:2.0:1767320039.387436:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379911808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320039.387445:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320039.387466:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379911808:12345-0@lo:38:kworker.0 Request processed in 29us (266us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320039.387472:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17443
00000100:00100000:2.0:1767320039.387483:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17444
00000100:00100000:2.0:1767320039.387486:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379912064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320039.387495:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320039.387516:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379912064:12345-0@lo:38:kworker.0 Request processed in 28us (277us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320039.387523:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17444
00000100:00080000:2.0:1767320039.387856:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320039.387862:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320039.387866:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379911168:0@lo:38:kworker.0
00000100:00080000:2.0:1767320039.387907:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320039.387910:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320039.387913:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379911808:0@lo:38:kworker.0
00000100:00080000:2.0:1767320039.387920:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320039.387924:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320039.387926:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379912064:0@lo:38:kworker.0
00000100:00100000:0.0:1767320039.388426:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379911296
00000100:00100000:0.0:1767320039.388433:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379911296
00000100:00100000:0.0:1767320039.388471:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100
00000100:00100000:0.0:1767320039.388478:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379911296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320039.388491:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320039.388547:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379911296:12345-0@lo:38:kworker.0 Request processed in 68us (1406us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320039.388553:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100
00000100:00080000:3.0:1767320039.389013:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320039.392087:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320039.392100:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320039.392104:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379911296:0@lo:38:kworker.0
00000100:00100000:3.0:1767320039.895509:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320039.895529:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379912192:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320039.895588:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320039.895857:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379912192
00000100:00100000:0.0:1767320039.895864:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379912192
00000100:00100000:0.0:1767320039.895928:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521
00000100:00100000:0.0:1767320039.895937:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379912192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320039.895966:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320039.896013:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379912192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (423us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320039.896019:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521
00000100:00100000:0.0:1767320039.896067:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379912192:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320039.896757:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320040.335367:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767320040.335412:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291951360 offset 0 length 520: 4
00000100:00100000:2.0:1767320040.335464:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320040.338321:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291951616
00000100:00100000:3.0:1767320040.338337:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291951616
00000100:00100000:3.0:1767320040.338808:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291951488
00000100:00100000:3.0:1767320040.338813:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291951488
00000100:00100000:3.0:1767320040.338844:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4606
00000100:00100000:3.0:1767320040.338856:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291951616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320040.338983:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291951616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 129us (3626us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320040.338990:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4606
00000100:00100000:3.0:1767320040.339010:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17445
00000100:00100000:3.0:1767320040.339015:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291951488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320040.339035:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320040.339060:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291951488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (3606us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320040.339067:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17445
00000100:00080000:0.0:1767320040.339676:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767320040.919164:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320041.943268:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320042.968494:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320043.479433:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379912320:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320043.479527:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320043.480342:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320018/real 1767320018]  req@ffff8b0e0bef4000 x1853164379906944/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320043 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320043.480373:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bef4000 x1853164379906944/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320043 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320043.480389:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767320043.480395:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379912320
00000100:00100000:3.0:1767320043.480404:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379912320
00000100:00080000:2.0:1767320043.480415:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320043.480419:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379906944:0@lo:250:kworker.0
00000100:00100000:3.0:1767320043.480488:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522
00000100:00100000:3.0:1767320043.480498:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379912320:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320043.480530:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320043.480590:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379912320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (1062us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320043.480598:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522
00000100:00080000:1.0:1767320043.480663:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320043.480833:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320043.480839:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320043.480843:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320043.480848:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4921
00000100:00080000:0.0:1767320043.480852:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320043.480856:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320043.480914:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570380 x1853164379912448/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320043.480937:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320043.480941:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320043.480943:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320043.480947:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4941
00000100:00080000:0.0:1767320043.480950:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320043.480953:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320043.480970:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379912576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320043.480978:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320043.480981:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320043.480983:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320043.480986:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4941
00000100:00080000:0.0:1767320043.480988:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320043.480992:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320043.481002:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964f800 x1853164379912704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320043.481044:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320043.481047:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320043.481048:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320043.481052:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4941
00000100:00080000:0.0:1767320043.481054:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320043.481057:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320043.481069:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680380 x1853164379913088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320043.481098:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320043.481101:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320043.481103:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320043.481106:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4941
00000100:00080000:0.0:1767320043.481109:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320043.481113:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320043.481123:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682300 x1853164379913344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320043.481173:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379912320:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320043.481190:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320043.481198:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379913216:0@lo:400:kworker.0
00000100:00100000:0.0:1767320043.481232:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320043.481310:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379912448:0@lo:250:kworker.0
00000400:00000100:2.0:1767320043.481336:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379912448 offset 0 length 520: 4
00000100:00100000:2.0:1767320043.481368:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379912576:0@lo:38:kworker.0
00000100:00100000:2.0:1767320043.481389:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320043.481410:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379912704:0@lo:38:kworker.0
00000100:00100000:2.0:1767320043.481435:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320043.481452:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379913088:0@lo:38:kworker.0
00000100:00100000:2.0:1767320043.481470:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320043.481486:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379913344:0@lo:38:kworker.0
00000100:00100000:2.0:1767320043.481504:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320043.481533:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379912704
00000100:00100000:2.0:1767320043.481539:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379912704
00000100:00100000:2.0:1767320043.481565:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101
00000100:00100000:2.0:1767320043.481570:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379912704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320043.481588:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320043.481624:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379912704:12345-0@lo:38:kworker.0 Request processed in 52us (188us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320043.481631:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101
00000100:00100000:2.0:1767320043.481650:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913216
00000100:00100000:2.0:1767320043.481654:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913216
00000100:00100000:2.0:1767320043.481686:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379912576
00000100:00100000:2.0:1767320043.481689:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379912576
00000100:00100000:2.0:1767320043.481702:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4607
00000100:00100000:2.0:1767320043.481707:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379913216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320043.481744:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379913216:12345-0@lo:400:kworker.0 Request processed in 37us (511us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320043.481750:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4607
00000100:00100000:2.0:1767320043.481761:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913088
00000100:00100000:2.0:1767320043.481764:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913088
00000100:00100000:2.0:1767320043.481772:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913344
00000100:00100000:2.0:1767320043.481774:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913344
00000100:00100000:2.0:1767320043.481784:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17446
00000100:00100000:2.0:1767320043.481787:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379912576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320043.481798:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320043.481820:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379912576:12345-0@lo:38:kworker.0 Request processed in 31us (430us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320043.481826:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17446
00000100:00100000:3.0:1767320043.481828:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379912832:0@lo:400:kworker.0
00000100:00100000:2.0:1767320043.481837:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17447
00000100:00100000:2.0:1767320043.481840:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379913088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320043.481850:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320043.481856:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320043.481901:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379913088:12345-0@lo:38:kworker.0 Request processed in 25us (396us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320043.481902:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320043.481908:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17447
00000100:00100000:3.0:1767320043.481908:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379912960:0@lo:400:kworker.0
00000100:00100000:2.0:1767320043.481919:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17448
00000100:00100000:2.0:1767320043.481923:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379913344:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320043.481928:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767320043.481932:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320043.481948:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379912832
00000100:00100000:2.0:1767320043.481952:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379913344:12345-0@lo:38:kworker.0 Request processed in 28us (448us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320043.481952:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379912832
00000100:00100000:2.0:1767320043.481957:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17448
00000100:00100000:2.0:1767320043.481965:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379912960
00000100:00100000:2.0:1767320043.481968:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379912960
00000100:00100000:3.0:1767320043.481976:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734
00000100:00100000:2.0:1767320043.481982:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4608
00000100:00100000:3.0:1767320043.481983:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379912832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320043.481986:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379912960:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320043.482014:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379912960:12345-0@lo:400:kworker.0 Request processed in 26us (84us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320043.482019:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4608
00000100:00100000:3.0:1767320043.482025:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379912832:12345-0@lo:400:kworker.0 Request processed in 44us (169us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320043.482031:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734
00000100:00080000:1.0:1767320043.482116:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320043.482121:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320043.482369:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379912960:0@lo:400:kworker.0
00000100:00100000:3.0:1767320043.482380:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379912832:0@lo:400:kworker.0
00000100:00080000:3.0:1767320043.482405:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320043.482409:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320043.482412:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379912576:0@lo:38:kworker.0
00000100:00080000:3.0:1767320043.482420:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320043.482422:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320043.482425:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379912704:0@lo:38:kworker.0
00000100:00080000:3.0:1767320043.482432:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320043.482435:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320043.482437:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379913088:0@lo:38:kworker.0
00000100:00080000:3.0:1767320043.482444:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320043.482447:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320043.482450:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379913344:0@lo:38:kworker.0
00000100:00100000:0.0:1767320043.482707:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379913216:0@lo:400:kworker.0
00010000:00010000:2.0:1767320043.991669:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320045.017915:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379913472:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320045.018015:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320045.018201:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913472
00000100:00100000:3.0:1767320045.018209:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913472
00000100:00100000:3.0:1767320045.018269:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523
00000100:00100000:3.0:1767320045.018277:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379913472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320045.018303:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320045.018362:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379913472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (347us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320045.018369:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523
00000100:00080000:0.0:1767320045.019148:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320045.019195:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379913472:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320045.021830:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320045.467039:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320045.467092:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320045.467255:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291951744
00000100:00100000:2.0:1767320045.467265:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291951744
00000100:00100000:2.0:1767320045.467309:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17449
00000100:00100000:2.0:1767320045.467318:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291951744:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320045.467341:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320045.467417:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291951744:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (382us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320045.467426:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17449
00000100:00100000:2.0:1767320045.467442:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291951872
00000100:00100000:2.0:1767320045.467445:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291951872
00000100:00100000:2.0:1767320045.467491:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4609
00000100:00100000:2.0:1767320045.467498:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291951872:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320045.467536:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291951872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 38us (443us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320045.467543:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4609
00000100:00080000:2.0:1767320045.467580:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320046.043214:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320047.063067:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320048.087201:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320048.600206:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320048.600217:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320048.600220:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320048.600224:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320048.600228:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320048.600236:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4945
00000100:00080000:0.0:1767320048.600241:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320048.600248:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320048.600289:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681500 x1853164379913600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320048.600317:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320048.600321:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320048.600323:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320048.600327:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4945
00000100:00080000:0.0:1767320048.600329:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320048.600333:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320048.600345:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680700 x1853164379913728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320048.600393:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320048.600396:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320048.600398:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767320048.600505:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379914112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320048.600573:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320048.600655:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379914112
00000100:00100000:2.0:1767320048.600662:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379914112
00000100:00100000:2.0:1767320048.600707:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4610
00000100:00100000:2.0:1767320048.600715:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379914112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320048.600757:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379914112:12345-0@lo:400:kworker.0 Request processed in 43us (184us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320048.600763:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4610
00000100:00080000:2.0:1767320048.600782:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320048.600796:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379913600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320048.600824:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320048.600844:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379913728:0@lo:38:kworker.0
00000100:00100000:2.0:1767320048.600892:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320048.601150:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913728
00000100:00100000:2.0:1767320048.601155:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913728
00000100:00100000:2.0:1767320048.601176:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102
00000100:00100000:2.0:1767320048.601181:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379913728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320048.601199:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320048.601236:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379913728:12345-0@lo:38:kworker.0 Request processed in 54us (367us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320048.601243:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102
00000100:00100000:2.0:1767320048.601262:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913600
00000100:00100000:2.0:1767320048.601266:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913600
00000100:00100000:2.0:1767320048.601282:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17450
00000100:00100000:2.0:1767320048.601287:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379913600:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320048.601563:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379913856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320048.601609:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320048.601632:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320048.601637:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379913984:0@lo:400:kworker.0
00000100:00100000:1.0:1767320048.601655:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320048.601677:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913856
00000100:00100000:1.0:1767320048.601681:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913856
00000100:00100000:1.0:1767320048.601712:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379913984
00000100:00100000:1.0:1767320048.601715:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379913984
00000100:00100000:1.0:1767320048.601731:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735
00000100:00100000:1.0:1767320048.601736:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379913856:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320048.601769:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379913856:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320048.601775:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735
00000100:00100000:1.0:1767320048.601788:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736
00000100:00100000:1.0:1767320048.601793:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379913984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320048.601818:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379913984:12345-0@lo:400:kworker.0 Request processed in 25us (162us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320048.601823:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736
00000100:00100000:1.0:1767320048.601862:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379913984:0@lo:400:kworker.0
00000100:00100000:1.0:1767320048.601893:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379913856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320048.602230:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379914112:0@lo:400:kworker.0
00000100:00080000:1.0:1767320048.602254:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320048.602258:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320048.602260:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379913728:0@lo:38:kworker.0
00000100:00080000:0.0:1767320048.602428:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4945
00000100:00080000:0.0:1767320048.602432:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320048.602436:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320048.602465:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680e00 x1853164379914240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320048.602511:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320048.602515:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320048.602517:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320048.602520:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4945
00000100:00080000:0.0:1767320048.602523:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320048.602526:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320048.602536:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02682680 x1853164379914496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320048.602559:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379914368:0@lo:400:kworker.0
00000100:00100000:0.0:1767320048.602604:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320048.602633:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379914368
00000100:00100000:0.0:1767320048.602638:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379914368
00000100:00100000:0.0:1767320048.602670:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4611
00000100:00100000:0.0:1767320048.602676:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379914368:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320048.602709:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379914368:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320048.602715:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4611
00000100:00100000:0.0:1767320048.602742:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379914368:0@lo:400:kworker.0
00000100:00080000:0.0:1767320048.602767:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320048.602773:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320048.602775:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320048.603675:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320048.603689:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379914624:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320048.603736:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320048.603781:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379914624
00000100:00100000:3.0:1767320048.603786:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379914624
00000100:00100000:3.0:1767320048.603822:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524
00000100:00100000:3.0:1767320048.603829:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379914624:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320048.603852:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320048.604074:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379914624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 244us (336us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320048.604082:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524
00000100:00100000:3.0:1767320048.604134:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379914624:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320048.604527:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379914240:0@lo:38:kworker.0
00000100:00100000:1.0:1767320048.604564:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320048.604584:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379914496:0@lo:38:kworker.0
00000100:00100000:1.0:1767320048.604604:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320048.604636:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379914240
00000100:00100000:1.0:1767320048.604642:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379914240
00000100:00100000:1.0:1767320048.604665:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379914496
00000100:00100000:1.0:1767320048.604668:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379914496
00000100:00100000:1.0:1767320048.604684:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17451
00000100:00100000:1.0:1767320048.604689:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379914240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320048.604706:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320048.604740:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379914240:12345-0@lo:38:kworker.0 Request processed in 50us (175us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320048.604746:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17451
00000100:00100000:1.0:1767320048.604761:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17452
00000100:00100000:1.0:1767320048.604765:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379914496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320048.604773:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320048.604793:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379914496:12345-0@lo:38:kworker.0 Request processed in 26us (188us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320048.604798:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17452
00000100:00080000:1.0:1767320048.604823:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320048.604828:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320048.604831:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379914240:0@lo:38:kworker.0
00000100:00080000:1.0:1767320048.604838:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320048.604841:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320048.604844:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379914496:0@lo:38:kworker.0
00010000:00020000:2.0:1767320048.605117:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320048.605156:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379913600:12345-0@lo:38:kworker.0 Request processed in 3866us (4329us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320048.605162:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17450
00000100:00080000:1.0:1767320048.606122:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320048.606129:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320048.606133:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379913600:0@lo:38:kworker.0
00010000:00010000:1.0:1767320049.111159:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320050.135185:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320050.135569:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320050.135592:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379914752:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320050.135672:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320050.135796:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379914752
00000100:00100000:3.0:1767320050.135806:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379914752
00000100:00100000:3.0:1767320050.135887:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525
00000100:00100000:3.0:1767320050.135898:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379914752:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320050.135928:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320050.135978:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379914752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (305us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320050.135986:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525
00000100:00080000:1.0:1767320050.136051:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320050.136093:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379914752:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320050.581914:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320050.582090:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320050.582865:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291952000
00000100:00100000:3.0:1767320050.582910:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291952000
00000100:00100000:2.0:1767320050.582999:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291952128
00000100:00100000:2.0:1767320050.583004:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291952128
00000100:00100000:2.0:1767320050.583078:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4612
00000100:00100000:2.0:1767320050.583090:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291952128:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320050.583181:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291952128:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (1090us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320050.583189:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4612
00000100:00100000:2.0:1767320050.583209:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17453
00000100:00100000:2.0:1767320050.583214:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291952000:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320050.583238:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320050.583265:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291952000:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (1364us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320050.583271:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17453
00000100:00080000:1.0:1767320050.583438:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320051.159864:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320052.183456:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320053.207552:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320053.719362:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379914880:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320053.719399:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320053.719405:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320053.719408:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320053.719411:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320053.719415:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320053.719420:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767320053.719424:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320053.719430:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320053.719437:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320053.719455:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ce00 x1853164379915008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320053.719472:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320053.719475:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320053.719477:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320053.719480:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767320053.719483:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320053.719486:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320053.719498:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379915136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320053.719523:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320053.719529:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379915264:0@lo:400:kworker.0
00000100:00080000:2.0:1767320053.719532:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320053.719534:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320053.719536:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320053.719539:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767320053.719542:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320053.719546:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320053.719556:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320053.719557:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164379915520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320053.719572:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320053.719575:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320053.719577:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767320053.719579:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379915648:0@lo:400:kworker.0
00000100:00080000:2.0:1767320053.719580:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4951
00000100:00080000:2.0:1767320053.719583:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320053.719586:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320053.719595:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379915776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320053.719602:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320053.719618:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379915392:0@lo:400:kworker.0
00000100:00100000:0.0:1767320053.719632:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915264
00000100:00100000:0.0:1767320053.719640:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915264
00000100:00100000:2.0:1767320053.719642:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320053.719689:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737
00000100:00100000:0.0:1767320053.719698:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379915264:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320053.719909:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320053.720218:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379915264:12345-0@lo:400:kworker.0 Request processed in 521us (660us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320053.720227:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737
00000100:00100000:0.0:1767320053.720251:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915648
00000100:00100000:0.0:1767320053.720255:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915648
00000100:00100000:0.0:1767320053.720285:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915392
00000100:00100000:0.0:1767320053.720288:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915392
00000100:00100000:0.0:1767320053.720310:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4613
00000100:00100000:0.0:1767320053.720317:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379915648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320053.720353:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379915648:12345-0@lo:400:kworker.0 Request processed in 37us (749us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320053.720360:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4613
00000100:00100000:0.0:1767320053.720372:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4614
00000100:00100000:0.0:1767320053.720378:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379915392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320053.720403:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379915392:12345-0@lo:400:kworker.0 Request processed in 25us (759us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320053.720408:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4614
00000100:00100000:0.0:1767320053.720450:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379915648:0@lo:400:kworker.0
00000100:00100000:0.0:1767320053.720564:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379915264:0@lo:400:kworker.0
00000100:00100000:0.0:1767320053.720602:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379915008:0@lo:38:kworker.0
00000100:00100000:0.0:1767320053.720630:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320053.720645:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379915136:0@lo:38:kworker.0
00000100:00100000:0.0:1767320053.720666:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320053.720689:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379915520:0@lo:38:kworker.0
00000100:00100000:0.0:1767320053.720709:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320053.720722:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379915776:0@lo:38:kworker.0
00000100:00100000:0.0:1767320053.720742:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320053.720765:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915008
00000100:00100000:0.0:1767320053.720768:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915008
00000100:00100000:0.0:1767320053.720785:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915520
00000100:00100000:0.0:1767320053.720788:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915520
00000100:00100000:0.0:1767320053.720800:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915776
00000100:00100000:0.0:1767320053.720802:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915776
00000100:00100000:0.0:1767320053.720811:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17454
00000100:00100000:0.0:1767320053.720815:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379915008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320053.720832:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320053.720957:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379914880
00000100:00100000:3.0:1767320053.720961:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379914880
00000100:00100000:3.0:1767320053.721012:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526
00000100:00100000:3.0:1767320053.721019:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379914880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320053.721040:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320053.721083:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379914880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1645us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320053.721090:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526
00000100:00100000:3.0:1767320053.721128:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379914880:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320053.721163:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17455
00000100:00100000:3.0:1767320053.721168:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379915520:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320053.721178:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320053.721205:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379915520:12345-0@lo:38:kworker.0 Request processed in 35us (494us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320053.721211:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17455
00000100:00100000:3.0:1767320053.721224:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17456
00000100:00100000:3.0:1767320053.721228:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379915776:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320053.721236:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320053.721260:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379915776:12345-0@lo:38:kworker.0 Request processed in 31us (517us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320053.721265:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17456
00000100:00100000:3.0:1767320053.721426:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915136
00000100:00100000:3.0:1767320053.721430:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915136
00000100:00100000:3.0:1767320053.721448:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103
00000100:00100000:3.0:1767320053.721452:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379915136:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320053.721631:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320053.721732:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379915136:12345-0@lo:38:kworker.0 Request processed in 277us (1064us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320053.721739:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103
00000100:00080000:3.0:1767320053.721799:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320053.721948:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320053.721952:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379915008:0@lo:38:kworker.0
00000100:00080000:3.0:1767320053.721965:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320053.721969:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00080000:1.0:1767320053.722307:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320053.722313:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320053.722674:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379915136:0@lo:38:kworker.0
00000100:00080000:3.0:1767320053.722694:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320053.722698:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320053.722701:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379915520:0@lo:38:kworker.0
00000100:00080000:3.0:1767320053.722710:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320053.722713:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320053.722716:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379915776:0@lo:38:kworker.0
00000100:00100000:0.0:1767320053.723389:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379915008:12345-0@lo:38:kworker.0 Request processed in 47us (233us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320053.723399:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17454
00000100:00100000:2.0:1767320053.725549:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379915392:0@lo:400:kworker.0
00010000:00010000:3.0:1767320054.233972:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320055.256637:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320055.256670:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379915904:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320055.256745:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320055.256913:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379915904
00000100:00100000:3.0:1767320055.256923:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379915904
00000100:00100000:3.0:1767320055.257004:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527
00000100:00100000:3.0:1767320055.257014:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379915904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320055.257048:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320055.257101:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379915904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (354us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320055.257109:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527
00000100:00100000:3.0:1767320055.257161:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379915904:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320055.257380:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320055.257489:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320055.702503:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320055.702557:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320055.703832:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291952384
00000100:00100000:1.0:1767320055.703845:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291952384
00000100:00100000:1.0:1767320055.704157:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291952256
00000100:00100000:1.0:1767320055.704163:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291952256
00000100:00100000:1.0:1767320055.704191:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4615
00000100:00100000:1.0:1767320055.704203:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291952384:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767320055.704237:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320055.704286:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291952384:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (1795us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320055.704294:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4615
00000100:00100000:1.0:1767320055.704322:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17457
00000100:00100000:1.0:1767320055.704327:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291952256:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320055.704348:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320055.704374:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291952256:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (1816us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320055.704380:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17457
00010000:00010000:2.0:1767320056.282110:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320057.305244:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320058.327591:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320058.839220:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379916032:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320058.839292:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320058.839442:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320058.839447:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320058.839450:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320058.839454:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320058.839458:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320058.839468:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767320058.839472:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320058.839478:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320058.839501:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ce00 x1853164379916160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320058.839504:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916032
00000100:00100000:0.0:1767320058.839511:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916032
00000100:00080000:3.0:1767320058.839527:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320058.839530:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320058.839532:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320058.839536:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767320058.839538:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320058.839542:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320058.839555:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333800 x1853164379916288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320058.839566:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528
00000100:00100000:0.0:1767320058.839575:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379916032:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320058.839584:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320058.839588:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320058.839589:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320058.839592:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767320058.839594:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320058.839597:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00002000:00000024:0.0:1767320058.839602:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320058.839606:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd180 x1853164379916672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320058.839624:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320058.839628:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320058.839629:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320058.839633:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4956
00000100:00080000:3.0:1767320058.839635:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320058.839638:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320058.839643:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379916032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (351us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320058.839648:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd880 x1853164379916928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320058.839650:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528
00000100:00100000:1.0:1767320058.839710:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379916160:0@lo:38:kworker.0
00000100:00100000:1.0:1767320058.839740:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320058.839761:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379916288:0@lo:38:kworker.0
00000100:00100000:1.0:1767320058.839797:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320058.839820:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379916672:0@lo:38:kworker.0
00000100:00100000:1.0:1767320058.839840:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320058.839856:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379916928:0@lo:38:kworker.0
00000100:00100000:1.0:1767320058.839902:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320058.839931:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916160
00000100:00100000:1.0:1767320058.839935:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916160
00000100:00100000:1.0:1767320058.839965:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916672
00000100:00100000:1.0:1767320058.839968:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916672
00000100:00100000:1.0:1767320058.839981:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916928
00000100:00100000:1.0:1767320058.839984:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916928
00000100:00100000:1.0:1767320058.839998:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17458
00000100:00100000:1.0:1767320058.840003:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379916160:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320058.840021:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320058.840054:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379916160:12345-0@lo:38:kworker.0 Request processed in 50us (314us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320058.840063:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17458
00000100:00100000:1.0:1767320058.840078:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17459
00000100:00100000:1.0:1767320058.840082:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379916672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320058.840090:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320058.840109:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379916672:12345-0@lo:38:kworker.0 Request processed in 26us (267us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320058.840114:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17459
00000100:00100000:1.0:1767320058.840123:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17460
00000100:00100000:1.0:1767320058.840127:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379916928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320058.840135:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320058.840152:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379916928:12345-0@lo:38:kworker.0 Request processed in 24us (249us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320058.840156:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17460
00000100:00100000:1.0:1767320058.840193:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379916032:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320058.840209:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320058.840214:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379916800:0@lo:400:kworker.0
00000100:00100000:1.0:1767320058.840234:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320058.840260:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320058.840265:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320058.840267:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379916160:0@lo:38:kworker.0
00000100:00080000:1.0:1767320058.840274:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320058.840277:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320058.840279:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379916672:0@lo:38:kworker.0
00000100:00080000:1.0:1767320058.840287:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320058.840289:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320058.840291:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379916928:0@lo:38:kworker.0
00000100:00100000:1.0:1767320058.840307:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916800
00000100:00100000:1.0:1767320058.840310:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916800
00000100:00100000:1.0:1767320058.840329:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4616
00000100:00100000:1.0:1767320058.840334:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379916800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320058.840611:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379916544:0@lo:400:kworker.0
00000100:00100000:3.0:1767320058.840638:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320058.840657:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320058.840674:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379916416:0@lo:400:kworker.0
00000100:00100000:3.0:1767320058.840697:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320058.840726:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916288
00000100:00100000:3.0:1767320058.840730:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916288
00000100:00100000:3.0:1767320058.840752:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104
00000100:00100000:3.0:1767320058.840757:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379916288:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320058.840769:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320058.840812:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379916288:12345-0@lo:38:kworker.0 Request processed in 53us (1015us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320058.840818:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104
00000100:00100000:3.0:1767320058.840834:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916544
00000100:00100000:3.0:1767320058.840837:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916544
00000100:00100000:3.0:1767320058.840857:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4617
00000100:00100000:3.0:1767320058.840862:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379916544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320058.840911:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379916544:12345-0@lo:400:kworker.0 Request processed in 49us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320058.840917:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4617
00000100:00100000:3.0:1767320058.840940:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379916416
00000100:00100000:3.0:1767320058.840954:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379916416
00000100:00100000:3.0:1767320058.840982:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738
00000100:00100000:3.0:1767320058.840988:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379916416:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320058.841015:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379916416:12345-0@lo:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320058.841020:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738
00000100:00100000:3.0:1767320058.841050:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379916416:0@lo:400:kworker.0
00000100:00100000:3.0:1767320058.841060:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379916544:0@lo:400:kworker.0
00000100:00080000:3.0:1767320058.841094:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320058.841098:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320058.841101:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379916288:0@lo:38:kworker.0
00000100:00080000:2.0:1767320058.841324:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320058.841330:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320058.841332:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320058.841500:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379916800:12345-0@lo:400:kworker.0 Request processed in 1164us (1263us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320058.841508:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4616
00000100:00100000:2.0:1767320058.841757:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379916800:0@lo:400:kworker.0
00010000:00010000:2.0:1767320059.354858:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320060.375233:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379917056:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320060.375233:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320060.375305:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320060.375588:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917056
00000100:00100000:0.0:1767320060.375598:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917056
00000100:00100000:0.0:1767320060.375659:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529
00000100:00100000:0.0:1767320060.375669:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379917056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320060.375698:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320060.375751:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379917056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (446us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320060.375759:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529
00000100:00080000:2.0:1767320060.375820:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320060.375915:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379917056:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320060.815907:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320060.815986:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320060.816094:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291952640
00000100:00100000:3.0:1767320060.816096:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291952512
00000100:00100000:1.0:1767320060.816106:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291952640
00000100:00100000:3.0:1767320060.816111:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291952512
00000100:00100000:3.0:1767320060.816197:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4618
00000100:00100000:3.0:1767320060.816216:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291952640:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767320060.816235:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320060.816410:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291952640:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 202us (542us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320060.821684:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17461
00000100:00100000:1.0:1767320060.821701:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291952512:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320060.821730:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320060.821811:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291952512:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 112us (5824us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320060.821819:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17461
00000100:00100000:3.0:1767320060.830174:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4618
00010000:00010000:2.0:1767320061.400018:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320062.423249:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320063.447255:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320063.959158:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320063.959165:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320063.959168:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320063.959172:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320063.959176:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320063.959183:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4961
00000100:00080000:1.0:1767320063.959188:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320063.959194:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320063.959214:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379917312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320063.959237:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320063.959241:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320063.959242:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320063.959246:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4961
00000100:00080000:1.0:1767320063.959255:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320063.959259:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320063.959270:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164379917440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320063.959307:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320063.959310:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320063.959312:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320063.959315:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4961
00000100:00080000:1.0:1767320063.959317:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320063.959320:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320063.959327:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164379917952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320063.959340:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320063.959343:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320063.959345:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320063.959348:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4961
00000100:00080000:1.0:1767320063.959351:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320063.959354:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320063.959360:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce300 x1853164379918208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320063.959386:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379917696:0@lo:400:kworker.0
00000100:00100000:1.0:1767320063.959444:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320063.959497:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320063.959502:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379917824:0@lo:400:kworker.0
00000100:00100000:1.0:1767320063.959522:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320063.959590:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917696
00000100:00100000:3.0:1767320063.959597:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917696
00000100:00100000:3.0:1767320063.959654:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739
00000100:00100000:3.0:1767320063.959662:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379917696:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320063.959721:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379917696:12345-0@lo:400:kworker.0 Request processed in 59us (276us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320063.959728:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739
00000100:00100000:3.0:1767320063.959748:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917824
00000100:00100000:3.0:1767320063.959751:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917824
00000100:00100000:3.0:1767320063.959771:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4619
00000100:00100000:3.0:1767320063.959777:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379917824:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320063.959801:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379917824:12345-0@lo:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320063.959806:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4619
00000100:00100000:3.0:1767320063.959828:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379917312:0@lo:38:kworker.0
00000100:00100000:3.0:1767320063.959848:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320063.959860:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379917440:0@lo:38:kworker.0
00000100:00100000:3.0:1767320063.959896:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320063.959931:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379917952:0@lo:38:kworker.0
00000100:00100000:3.0:1767320063.959950:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320063.959964:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379918208:0@lo:38:kworker.0
00000100:00100000:3.0:1767320063.959981:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320063.960007:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917440
00000100:00100000:3.0:1767320063.960011:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917440
00000100:00100000:3.0:1767320063.960029:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105
00000100:00100000:3.0:1767320063.960033:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379917440:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320063.960049:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320063.960079:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379917440:12345-0@lo:38:kworker.0 Request processed in 45us (182us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320063.960085:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105
00000100:00100000:3.0:1767320063.960103:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917312
00000100:00100000:3.0:1767320063.960107:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917312
00000100:00100000:3.0:1767320063.960120:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917952
00000100:00100000:3.0:1767320063.960122:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917952
00000100:00100000:3.0:1767320063.960133:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379918208
00000100:00100000:3.0:1767320063.960135:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379918208
00000100:00100000:3.0:1767320063.960144:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17462
00000100:00100000:3.0:1767320063.960148:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379917312:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320063.960149:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379917184:0@lo:13:osp-pre-1-1.0
00010000:00020000:3.0:1767320063.960158:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320063.960178:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320063.960179:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379917312:12345-0@lo:38:kworker.0 Request processed in 30us (331us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320063.960188:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17462
00000100:00100000:0.0:1767320063.960196:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379918080:0@lo:400:kworker.0
00000100:00100000:3.0:1767320063.960198:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17463
00000100:00100000:3.0:1767320063.960202:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379917952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320063.960210:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320063.960213:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320063.960226:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320063.960231:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379917568:0@lo:400:kworker.0
00000100:00100000:3.0:1767320063.960231:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379917952:12345-0@lo:38:kworker.0 Request processed in 28us (280us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320063.960237:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17463
00000100:00100000:3.0:1767320063.960245:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379918080
00000100:00100000:0.0:1767320063.960248:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320063.960248:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379918080
00000100:00100000:3.0:1767320063.960265:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4620
00000100:00100000:3.0:1767320063.960270:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379918080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320063.960273:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17464
00000100:00100000:0.0:1767320063.960277:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379918208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320063.960286:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320063.960302:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379918080:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320063.960305:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379918208:12345-0@lo:38:kworker.0 Request processed in 28us (324us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320063.960308:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4620
00000100:00100000:0.0:1767320063.960310:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17464
00000100:00100000:0.0:1767320063.960326:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917184
00000100:00100000:0.0:1767320063.960329:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917184
00000100:00080000:3.0:1767320063.960343:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320063.960348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320063.960351:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379917312:0@lo:38:kworker.0
00000100:00100000:0.0:1767320063.960353:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530
00000100:00100000:0.0:1767320063.960358:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379917184:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320063.960360:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320063.960363:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320063.960365:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379917440:0@lo:38:kworker.0
00000100:00080000:3.0:1767320063.960372:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320063.960374:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320063.960376:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379917952:0@lo:38:kworker.0
00002000:00000024:0.0:1767320063.960378:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767320063.960383:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320063.960385:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320063.960387:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379918208:0@lo:38:kworker.0
00000100:00100000:0.0:1767320063.960405:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379917184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (227us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320063.960410:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530
00000100:00100000:3.0:1767320063.960430:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379917568
00000100:00100000:3.0:1767320063.960432:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379917568
00000100:00100000:0.0:1767320063.960439:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379917184:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320063.960448:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379918080:0@lo:400:kworker.0
00000100:00100000:3.0:1767320063.960451:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740
00000100:00100000:3.0:1767320063.960456:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379917568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320063.960487:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379917568:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320063.960493:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740
00000100:00100000:0.0:1767320063.960501:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379917568:0@lo:400:kworker.0
00000100:00080000:1.0:1767320063.960558:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320063.960562:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320063.960564:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320063.960582:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379917824:0@lo:400:kworker.0
00000100:00100000:1.0:1767320063.960591:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379917696:0@lo:400:kworker.0
00010000:00010000:2.0:1767320064.471232:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320064.914274:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767320064.914360:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291952768 offset 0 length 520: 4
00000100:00100000:2.0:1767320064.914386:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320064.914516:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953024
00000100:00100000:0.0:1767320064.914525:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953024
00000100:00100000:1.0:1767320064.914636:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291952896
00000100:00100000:1.0:1767320064.914642:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291952896
00000100:00100000:1.0:1767320064.914679:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4621
00000100:00100000:1.0:1767320064.914698:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291953024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320064.914794:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291953024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 98us (529us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320064.914802:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4621
00000100:00100000:1.0:1767320064.914834:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17465
00000100:00100000:1.0:1767320064.914840:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291952896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320064.914861:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320064.914958:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291952896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 115us (570us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320064.914964:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17465
00000100:00080000:2.0:1767320064.915394:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320065.495200:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320065.495922:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379918336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320065.495990:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320065.496107:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379918336
00000100:00100000:3.0:1767320065.496116:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379918336
00000100:00100000:3.0:1767320065.496183:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531
00000100:00100000:3.0:1767320065.496192:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379918336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320065.496220:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320065.496288:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379918336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (297us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320065.496296:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531
00000100:00080000:2.0:1767320065.496357:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320065.496781:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379918336:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320066.520825:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320067.544604:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320068.056199:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320043/real 1767320043]  req@ffff8b0e0c570380 x1853164379912448/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320068 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320068.056230:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c570380 x1853164379912448/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320068 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320068.056245:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320068.056272:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320068.056276:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379912448:0@lo:250:kworker.0
00000100:00080000:3.0:1767320068.056499:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320068.056505:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320068.056507:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320068.056512:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4945
00000100:00080000:3.0:1767320068.056515:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320068.056521:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320068.056548:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ffb80 x1853164379918464/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320068.056577:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320068.056580:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320068.056582:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320068.056585:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4966
00000100:00080000:3.0:1767320068.056587:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320068.056590:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320068.056604:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164379918592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320068.056613:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320068.056616:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320068.056618:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320068.056621:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4966
00000100:00080000:3.0:1767320068.056632:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320068.056635:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320068.056646:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379918720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320068.056695:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320068.056699:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320068.056700:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320068.056703:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4966
00000100:00080000:3.0:1767320068.056706:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320068.056709:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320068.056720:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92680 x1853164379919232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320068.056735:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320068.056738:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320068.056740:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320068.056743:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4966
00000100:00080000:3.0:1767320068.056745:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320068.056748:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320068.056759:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164379919488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320068.056830:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379918848:0@lo:400:kworker.0
00000100:00100000:1.0:1767320068.056933:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320068.056988:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320068.056994:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379918976:0@lo:400:kworker.0
00000100:00100000:1.0:1767320068.057015:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320068.057169:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379919360:0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.057202:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320068.057234:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320068.057240:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379919104:0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.057271:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320068.057303:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379918848
00000100:00100000:0.0:1767320068.057310:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379918848
00000100:00100000:0.0:1767320068.057377:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379918976
00000100:00100000:0.0:1767320068.057381:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379918976
00000100:00100000:0.0:1767320068.057404:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741
00000100:00100000:0.0:1767320068.057413:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379918848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.057464:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379918848:12345-0@lo:400:kworker.0 Request processed in 51us (531us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320068.057470:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741
00000100:00100000:0.0:1767320068.057488:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742
00000100:00100000:0.0:1767320068.057494:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379918976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.057520:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379918976:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320068.057525:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742
00000100:00080000:0.0:1767320068.057540:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320068.057543:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320068.057568:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379918464:0@lo:250:kworker.0
00000400:00000100:0.0:1767320068.057587:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379918464 offset 0 length 520: 4
00000100:00100000:0.0:1767320068.057606:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379918592:0@lo:38:kworker.0
00000100:00100000:0.0:1767320068.057637:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320068.057653:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379918720:0@lo:38:kworker.0
00000100:00100000:0.0:1767320068.057676:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320068.057690:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379919232:0@lo:38:kworker.0
00000100:00100000:0.0:1767320068.057709:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320068.057721:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379919488:0@lo:38:kworker.0
00000100:00100000:0.0:1767320068.057739:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320068.057769:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379919360
00000100:00100000:0.0:1767320068.057773:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379919360
00000100:00100000:0.0:1767320068.057802:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379919104
00000100:00100000:0.0:1767320068.057804:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379919104
00000100:00100000:0.0:1767320068.057816:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379918592
00000100:00100000:0.0:1767320068.057818:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379918592
00000100:00100000:0.0:1767320068.057826:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379919232
00000100:00100000:0.0:1767320068.057828:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379919232
00000100:00100000:0.0:1767320068.057834:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379919488
00000100:00100000:0.0:1767320068.057836:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379919488
00000100:00100000:0.0:1767320068.057844:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4622
00000100:00100000:0.0:1767320068.057850:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379919360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.057923:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379919360:12345-0@lo:400:kworker.0 Request processed in 73us (719us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320068.057929:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4622
00000100:00100000:0.0:1767320068.057941:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4623
00000100:00100000:0.0:1767320068.057947:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379919104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.057971:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379919104:12345-0@lo:400:kworker.0 Request processed in 24us (699us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320068.057975:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4623
00000100:00100000:0.0:1767320068.057984:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17466
00000100:00100000:0.0:1767320068.057988:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379918592:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320068.058005:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320068.058030:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379918592:12345-0@lo:38:kworker.0 Request processed in 40us (392us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320068.058036:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17466
00000100:00100000:0.0:1767320068.058047:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17467
00000100:00100000:0.0:1767320068.058050:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379919232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320068.058059:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320068.058079:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379919232:12345-0@lo:38:kworker.0 Request processed in 27us (370us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320068.058084:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17467
00000100:00100000:0.0:1767320068.058094:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17468
00000100:00100000:0.0:1767320068.058097:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379919488:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320068.058105:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320068.058123:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379919488:12345-0@lo:38:kworker.0 Request processed in 25us (384us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320068.058128:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17468
00000100:00080000:0.0:1767320068.058141:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320068.058166:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379919104:0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.058177:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379919360:0@lo:400:kworker.0
00000100:00080000:0.0:1767320068.058203:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320068.058208:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320068.058211:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379918592:0@lo:38:kworker.0
00000100:00080000:0.0:1767320068.058218:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320068.058221:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320068.058224:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379919232:0@lo:38:kworker.0
00000100:00080000:0.0:1767320068.058231:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320068.058233:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320068.058236:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379919488:0@lo:38:kworker.0
00000100:00100000:0.0:1767320068.058263:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379918976:0@lo:400:kworker.0
00000100:00100000:0.0:1767320068.058274:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379918848:0@lo:400:kworker.0
00000100:00100000:3.0:1767320068.059163:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379918720
00000100:00100000:3.0:1767320068.059172:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379918720
00000100:00100000:3.0:1767320068.059210:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106
00000100:00100000:3.0:1767320068.059217:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379918720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320068.059231:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320068.060168:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379918720:12345-0@lo:38:kworker.0 Request processed in 947us (2486us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320068.060178:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106
00000100:00080000:1.0:1767320068.069438:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320068.069450:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320068.069454:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379918720:0@lo:38:kworker.0
00010000:00010000:2.0:1767320068.567229:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320069.080627:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320069.080662:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379919616:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320069.080738:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320069.085953:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379919616
00000100:00100000:3.0:1767320069.085973:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379919616
00000100:00100000:3.0:1767320069.086046:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532
00000100:00100000:3.0:1767320069.086057:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379919616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320069.086093:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320069.086186:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379919616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (5446us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320069.086194:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532
00000100:00100000:1.0:1767320069.086345:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379919616:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320069.592339:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320070.032469:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320070.032904:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953280
00000100:00100000:2.0:1767320070.032915:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953280
00000100:00100000:2.0:1767320070.032995:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4624
00000100:00100000:2.0:1767320070.033006:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291953280:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320070.033085:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291953280:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (626us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320070.033095:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4624
00000100:00080000:0.0:1767320070.033185:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320070.036273:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320070.036468:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953152
00000100:00100000:2.0:1767320070.036476:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953152
00000100:00100000:2.0:1767320070.036523:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17469
00000100:00100000:2.0:1767320070.036531:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291953152:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320070.036555:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320070.036632:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291953152:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 99us (367us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320070.036641:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17469
00010000:00010000:1.0:1767320070.615206:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320070.615690:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379919744:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320070.615769:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320070.619359:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379919744
00000100:00100000:0.0:1767320070.619379:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379919744
00000100:00100000:0.0:1767320070.619486:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533
00000100:00100000:0.0:1767320070.619496:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379919744:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320070.619530:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320070.619617:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379919744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (3848us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320070.619625:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533
00000100:00080000:2.0:1767320070.619807:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320070.619918:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379919744:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320071.639209:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320072.666148:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320073.175542:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320073.175553:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320073.175556:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320073.175560:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320073.175564:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320073.175572:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4970
00000100:00080000:1.0:1767320073.175578:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320073.175584:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320073.175624:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164379919872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320073.175652:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320073.175656:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320073.175658:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320073.175662:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4970
00000100:00080000:1.0:1767320073.175664:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320073.175669:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320073.175683:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379920000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320073.175749:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320073.175752:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320073.175754:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320073.175758:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4970
00000100:00080000:1.0:1767320073.175761:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320073.175764:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320073.175775:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b800 x1853164379920512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320073.175790:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320073.175793:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320073.175795:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320073.175798:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4970
00000100:00080000:1.0:1767320073.175800:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320073.175804:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320073.175846:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379aa00 x1853164379920768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320073.175859:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379920128:0@lo:400:kworker.0
00000100:00100000:1.0:1767320073.175884:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379920640:0@lo:400:kworker.0
00000100:00100000:3.0:1767320073.175932:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379920256:0@lo:400:kworker.0
00000100:00100000:0.0:1767320073.175978:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379920384:0@lo:400:kworker.0
00000100:00100000:2.0:1767320073.180689:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320073.180790:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920128
00000100:00100000:2.0:1767320073.180800:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920128
00000100:00100000:3.0:1767320073.180859:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320073.180881:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920256
00000100:00100000:2.0:1767320073.180884:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920256
00000100:00100000:2.0:1767320073.180909:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743
00000100:00100000:3.0:1767320073.180914:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744
00000100:00100000:2.0:1767320073.180918:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379920128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320073.180923:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379920256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320073.180969:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379920128:12345-0@lo:400:kworker.0 Request processed in 52us (286us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320073.180969:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379920256:12345-0@lo:400:kworker.0 Request processed in 48us (110us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320073.180977:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743
00000100:00080000:2.0:1767320073.180999:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320073.181003:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320073.181037:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379920128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320073.181054:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320073.181084:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379920256:0@lo:400:kworker.0
00000100:00100000:0.0:1767320073.181095:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379919872:0@lo:38:kworker.0
00000100:00100000:2.0:1767320073.181099:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920384
00000100:00100000:2.0:1767320073.181102:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920384
00000100:00100000:0.0:1767320073.181123:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320073.181130:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379919872
00000100:00100000:2.0:1767320073.181132:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379919872
00000100:00100000:0.0:1767320073.181140:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379920000:0@lo:38:kworker.0
00000100:00100000:2.0:1767320073.181148:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4625
00000100:00100000:2.0:1767320073.181154:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379920384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320073.181160:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320073.181180:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379920512:0@lo:38:kworker.0
00000100:00100000:2.0:1767320073.181183:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379920384:12345-0@lo:400:kworker.0 Request processed in 30us (130us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320073.181189:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4625
00000100:00100000:0.0:1767320073.181199:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320073.181201:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17470
00000100:00100000:2.0:1767320073.181205:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379919872:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320073.181215:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379920768:0@lo:38:kworker.0
00010000:00020000:2.0:1767320073.181223:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320073.181232:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320073.181246:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379919872:12345-0@lo:38:kworker.0 Request processed in 39us (121us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320073.181251:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17470
00000100:00080000:0.0:1767320073.181256:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320073.181260:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320073.181260:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920512
00000100:00100000:0.0:1767320073.181263:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379919872:0@lo:38:kworker.0
00000100:00100000:2.0:1767320073.181263:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920512
00000100:00100000:2.0:1767320073.181270:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920768
00000100:00100000:2.0:1767320073.181272:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920768
00000100:00100000:2.0:1767320073.181280:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17471
00000100:00100000:0.0:1767320073.181284:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920000
00000100:00100000:2.0:1767320073.181284:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379920512:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320073.181287:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920000
00010000:00020000:2.0:1767320073.181293:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320073.181321:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379920512:12345-0@lo:38:kworker.0 Request processed in 36us (121us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320073.181326:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17471
00000100:00100000:2.0:1767320073.181337:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17472
00000100:00100000:2.0:1767320073.181340:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379920768:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320073.181348:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320073.181370:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379920768:12345-0@lo:38:kworker.0 Request processed in 28us (136us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320073.181375:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17472
00000100:00080000:2.0:1767320073.181389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320073.181685:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744
00000100:00100000:0.0:1767320073.181726:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107
00000100:00100000:0.0:1767320073.181731:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379920000:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320073.181741:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320073.181770:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379920000:12345-0@lo:38:kworker.0 Request processed in 38us (607us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320073.181774:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107
00000100:00100000:0.0:1767320073.181812:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379920384:0@lo:400:kworker.0
00000100:00080000:0.0:1767320073.181849:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320073.181853:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320073.181856:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379920000:0@lo:38:kworker.0
00000100:00080000:0.0:1767320073.181863:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320073.181866:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320073.181888:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379920512:0@lo:38:kworker.0
00000100:00080000:0.0:1767320073.181897:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320073.181900:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320073.181902:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379920768:0@lo:38:kworker.0
00000100:00100000:1.0:1767320073.182070:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320073.185248:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920640
00000100:00100000:3.0:1767320073.185263:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920640
00000100:00080000:2.0:1767320073.185311:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320073.185344:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4626
00000100:00100000:3.0:1767320073.185353:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379920640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320073.185851:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379920640:12345-0@lo:400:kworker.0 Request processed in 499us (3779us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320073.185860:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4626
00000100:00100000:1.0:1767320073.186051:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379920640:0@lo:400:kworker.0
00010000:00010000:3.0:1767320073.687397:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320074.199839:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379920896:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320074.204295:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320074.205086:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379920896
00000100:00100000:3.0:1767320074.205100:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379920896
00000100:00100000:3.0:1767320074.205174:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534
00000100:00100000:3.0:1767320074.205184:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379920896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320074.205225:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320074.205297:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379920896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (1008us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320074.205304:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534
00000100:00100000:2.0:1767320074.205664:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379920896:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320074.711537:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320075.160157:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320075.160265:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320075.160695:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953536
00000100:00100000:0.0:1767320075.160705:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953536
00000100:00100000:0.0:1767320075.160844:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953408
00000100:00100000:0.0:1767320075.160848:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953408
00000100:00100000:0.0:1767320075.160904:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4627
00000100:00100000:0.0:1767320075.160915:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291953536:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320075.160999:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291953536:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (853us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320075.161007:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4627
00000100:00100000:0.0:1767320075.161027:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17473
00000100:00100000:0.0:1767320075.161032:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291953408:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320075.161053:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320075.161074:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291953408:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (809us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320075.161080:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17473
00000100:00080000:2.0:1767320075.162128:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320075.735701:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320075.735723:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379921024:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320075.735801:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320075.735920:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921024
00000100:00100000:3.0:1767320075.735931:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921024
00000100:00100000:3.0:1767320075.735991:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535
00000100:00100000:3.0:1767320075.736002:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379921024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320075.736034:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320075.736082:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379921024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (280us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320075.736089:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535
00000100:00080000:1.0:1767320075.736428:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320075.736706:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379921024:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320075.737755:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320076.759441:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320077.785428:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320078.295070:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320078.295082:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320078.295087:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320078.295091:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320078.295095:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320078.295104:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767320078.295108:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320078.295116:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320078.295158:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907b80 x1853164379921152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320078.295223:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379921152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320078.295288:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320078.295370:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320078.295374:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320078.295376:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320078.295380:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767320078.295382:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320078.295387:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320078.295401:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907100 x1853164379921280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320078.295462:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921152
00000100:00100000:3.0:1767320078.295471:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921152
00000100:00100000:3.0:1767320078.295517:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17474
00000100:00100000:3.0:1767320078.295524:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379921152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320078.295545:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320078.295651:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379921280:0@lo:38:kworker.0
00000100:00100000:1.0:1767320078.295807:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320078.295898:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921280
00000100:00100000:0.0:1767320078.295903:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921280
00000100:00100000:0.0:1767320078.295925:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108
00000100:00100000:0.0:1767320078.295931:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379921280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320078.295942:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320078.295982:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379921280:12345-0@lo:38:kworker.0 Request processed in 50us (174us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320078.295988:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108
00000100:00080000:2.0:1767320078.296309:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320078.296312:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320078.296314:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320078.296318:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767320078.296321:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320078.296325:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320078.296339:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379921792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320078.296360:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320078.296363:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320078.296365:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320078.296368:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4975
00000100:00080000:2.0:1767320078.296371:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320078.296375:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320078.296385:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379922048/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320078.296413:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379921664:0@lo:400:kworker.0
00000100:00100000:2.0:1767320078.296442:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320078.296463:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320078.296469:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379921920:0@lo:400:kworker.0
00000100:00100000:2.0:1767320078.296488:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320078.296567:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379921408:0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.296593:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320078.296622:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320078.296627:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379921536:0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.296646:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320078.296690:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921664
00000100:00100000:0.0:1767320078.296693:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921664
00000100:00100000:0.0:1767320078.296732:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921920
00000100:00100000:0.0:1767320078.296735:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921920
00000100:00100000:0.0:1767320078.296762:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4628
00000100:00100000:0.0:1767320078.296778:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379921664:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.296821:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379921664:12345-0@lo:400:kworker.0 Request processed in 52us (378us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320078.296828:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4628
00000100:00100000:0.0:1767320078.296843:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4629
00000100:00100000:0.0:1767320078.296848:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379921920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.296894:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379921920:12345-0@lo:400:kworker.0 Request processed in 46us (405us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320078.296900:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4629
00000100:00100000:0.0:1767320078.296917:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921408
00000100:00100000:0.0:1767320078.296921:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921408
00000100:00100000:0.0:1767320078.296944:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921536
00000100:00100000:0.0:1767320078.296947:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921536
00000100:00100000:0.0:1767320078.296967:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745
00000100:00100000:0.0:1767320078.296973:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379921408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.297004:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379921408:12345-0@lo:400:kworker.0 Request processed in 31us (409us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320078.297010:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745
00000100:00100000:0.0:1767320078.297020:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746
00000100:00100000:0.0:1767320078.297026:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379921536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.297049:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379921536:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320078.297055:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746
00000100:00080000:0.0:1767320078.297079:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320078.297083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320078.297086:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320078.297112:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379921920:0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.297123:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379921664:0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.297150:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379921536:0@lo:400:kworker.0
00000100:00100000:0.0:1767320078.297165:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379921408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320078.297918:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379921152:12345-0@lo:38:kworker.0 Request processed in 2390us (2626us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320078.297928:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17474
00000100:00080000:1.0:1767320078.298075:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320078.298080:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320078.298084:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379921152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320078.298104:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379921792:0@lo:38:kworker.0
00000100:00100000:1.0:1767320078.298137:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320078.298198:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379922048:0@lo:38:kworker.0
00000100:00100000:1.0:1767320078.298219:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320078.298348:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320078.298353:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320078.298356:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379921280:0@lo:38:kworker.0
00000100:00100000:3.0:1767320078.298396:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379921792
00000100:00100000:3.0:1767320078.298402:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379921792
00000100:00100000:2.0:1767320078.298444:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922048
00000100:00100000:2.0:1767320078.298447:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922048
00000100:00100000:2.0:1767320078.298473:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17475
00000100:00100000:2.0:1767320078.298479:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379921792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320078.298495:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320078.298537:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379921792:12345-0@lo:38:kworker.0 Request processed in 58us (399us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320078.298543:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17475
00000100:00100000:2.0:1767320078.298553:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17476
00000100:00100000:2.0:1767320078.298556:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379922048:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320078.298564:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320078.299098:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320078.299103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320078.299106:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379921792:0@lo:38:kworker.0
00000100:00100000:2.0:1767320078.300738:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379922048:12345-0@lo:38:kworker.0 Request processed in 2175us (2513us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320078.300749:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17476
00000100:00080000:1.0:1767320078.301101:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320078.301108:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320078.301111:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379922048:0@lo:38:kworker.0
00010000:00010000:1.0:1767320078.807336:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320079.320066:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320079.320094:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379922176:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320079.320160:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320079.320499:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922176
00000100:00100000:3.0:1767320079.320507:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922176
00000100:00100000:3.0:1767320079.320566:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536
00000100:00100000:3.0:1767320079.320576:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379922176:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320079.320743:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320079.320815:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379922176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 241us (654us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320079.320824:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536
00000100:00100000:1.0:1767320079.320919:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379922176:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320079.833345:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320080.272164:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320080.272252:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953792
00000100:00100000:2.0:1767320080.272266:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953792
00000100:00100000:2.0:1767320080.272361:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4630
00000100:00100000:2.0:1767320080.272372:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291953792:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320080.272456:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291953792:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320080.272464:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4630
00000100:00080000:0.0:1767320080.273603:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320080.274250:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320080.274320:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953664
00000100:00100000:3.0:1767320080.274329:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953664
00000100:00100000:3.0:1767320080.274370:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17477
00000100:00100000:3.0:1767320080.274378:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291953664:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320080.274403:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320080.274460:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291953664:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 81us (214us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320080.274467:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17477
00000100:00100000:3.0:1767320080.855530:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320080.855551:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379922304:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320080.855620:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320080.855689:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922304
00000100:00100000:3.0:1767320080.855695:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922304
00000100:00100000:3.0:1767320080.855761:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537
00000100:00100000:3.0:1767320080.855770:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379922304:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320080.855797:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320080.855834:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379922304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (214us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320080.855840:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537
00000100:00080000:3.0:1767320080.855859:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320080.855909:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379922304:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320080.856077:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320081.879205:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320082.903783:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320083.415071:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320083.415088:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320083.415092:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320083.415097:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320083.415102:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320083.415113:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767320083.415119:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320083.415127:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320083.415171:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164379922432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320083.415189:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320083.415192:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320083.415194:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320083.415199:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767320083.415201:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320083.415205:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320083.415218:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379922560/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320083.415296:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320083.415300:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320083.415302:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320083.415306:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767320083.415308:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320083.415311:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320083.415325:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904e00 x1853164379923072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320083.415355:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320083.415358:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320083.415359:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320083.415363:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4980
00000100:00080000:2.0:1767320083.415365:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320083.415369:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320083.415378:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164379923328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320083.415534:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379922432:0@lo:38:kworker.0
00000100:00100000:0.0:1767320083.415627:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320083.415681:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379922560:0@lo:38:kworker.0
00000100:00100000:0.0:1767320083.415707:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320083.415743:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379923072:0@lo:38:kworker.0
00000100:00100000:0.0:1767320083.415768:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320083.415777:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379922688:0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.415785:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379923328:0@lo:38:kworker.0
00000100:00100000:1.0:1767320083.415828:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320083.415829:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320083.415900:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379922816:0@lo:400:kworker.0
00000100:00100000:2.0:1767320083.415902:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922432
00000100:00100000:2.0:1767320083.415910:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922432
00000100:00100000:2.0:1767320083.415947:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923072
00000100:00100000:2.0:1767320083.415950:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923072
00000100:00100000:2.0:1767320083.415965:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923328
00000100:00100000:2.0:1767320083.415968:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923328
00000100:00100000:2.0:1767320083.415984:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17478
00000100:00100000:2.0:1767320083.416003:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379922432:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320083.416021:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320083.420518:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379923200:0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.420593:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320083.420729:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320083.420739:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379922944:0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.420768:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320083.420843:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922560
00000100:00100000:0.0:1767320083.420851:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922560
00000100:00100000:0.0:1767320083.420991:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109
00000100:00100000:0.0:1767320083.420999:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379922560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320083.421021:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320083.421066:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379922560:12345-0@lo:38:kworker.0 Request processed in 65us (5357us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320083.421073:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109
00000100:00100000:0.0:1767320083.421099:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923200
00000100:00100000:0.0:1767320083.421103:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923200
00000100:00100000:0.0:1767320083.421139:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922944
00000100:00100000:0.0:1767320083.421142:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922944
00000100:00100000:0.0:1767320083.421158:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4631
00000100:00100000:0.0:1767320083.421165:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379923200:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.421209:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379923200:12345-0@lo:400:kworker.0 Request processed in 45us (616us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320083.421215:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4631
00000100:00100000:0.0:1767320083.421229:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4632
00000100:00100000:0.0:1767320083.421235:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379922944:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.421262:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379922944:12345-0@lo:400:kworker.0 Request processed in 28us (493us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320083.421267:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4632
00000100:00100000:0.0:1767320083.421506:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17479
00000100:00100000:0.0:1767320083.421512:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379923072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320083.421524:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320083.421553:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379923072:12345-0@lo:38:kworker.0 Request processed in 40us (5785us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320083.421559:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17479
00000100:00100000:0.0:1767320083.421573:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17480
00000100:00100000:0.0:1767320083.421578:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379923328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320083.421588:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320083.421625:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379923328:12345-0@lo:38:kworker.0 Request processed in 33us (5787us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320083.421631:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17480
00000100:00080000:0.0:1767320083.421654:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320083.421687:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379922944:0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.421700:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379923200:0@lo:400:kworker.0
00000100:00080000:0.0:1767320083.421747:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320083.421753:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320083.421756:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379922560:0@lo:38:kworker.0
00000100:00080000:0.0:1767320083.421766:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320083.421770:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320083.421773:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379923072:0@lo:38:kworker.0
00000100:00080000:0.0:1767320083.421782:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320083.421785:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320083.421788:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379923328:0@lo:38:kworker.0
00000100:00100000:0.0:1767320083.421831:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922688
00000100:00100000:0.0:1767320083.421836:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922688
00000100:00100000:0.0:1767320083.421902:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747
00000100:00100000:0.0:1767320083.421911:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379922688:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.421945:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379922688:12345-0@lo:400:kworker.0 Request processed in 36us (6121us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320083.421951:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747
00000100:00080000:0.0:1767320083.421969:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320083.423342:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379922688:0@lo:400:kworker.0
00000100:00100000:3.0:1767320083.428409:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320083.432586:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379922816
00000100:00100000:0.0:1767320083.432610:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379922816
00000100:00100000:0.0:1767320083.432707:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748
00000100:00100000:0.0:1767320083.432718:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379922816:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320083.432822:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379922816:12345-0@lo:400:kworker.0 Request processed in 106us (4423us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320083.432829:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748
00000100:00100000:3.0:1767320083.432956:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379922816:0@lo:400:kworker.0
00000100:00080000:1.0:1767320083.434660:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320083.435919:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379922432:12345-0@lo:38:kworker.0 Request processed in 19907us (20284us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320083.435933:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17478
00000100:00080000:0.0:1767320083.435958:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320083.435967:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320083.435971:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379922432:0@lo:38:kworker.0
00010000:00010000:2.0:1767320083.929338:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320084.439272:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379923456:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320084.439350:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320084.441562:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923456
00000100:00100000:2.0:1767320084.441577:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923456
00000100:00100000:2.0:1767320084.441684:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538
00000100:00100000:2.0:1767320084.441696:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379923456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320084.441742:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320084.441839:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379923456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (2488us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320084.441847:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538
00000100:00100000:0.0:1767320084.441946:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379923456:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320084.952542:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320085.395728:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320085.395833:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320085.395967:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291954048
00000100:00100000:0.0:1767320085.395977:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291954048
00000100:00100000:0.0:1767320085.396051:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291953920
00000100:00100000:0.0:1767320085.396055:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291953920
00000100:00100000:0.0:1767320085.396076:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4633
00000100:00100000:0.0:1767320085.396087:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291954048:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320085.396164:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291954048:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (459us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320085.396173:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4633
00000100:00100000:0.0:1767320085.396201:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17481
00000100:00100000:0.0:1767320085.396205:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291953920:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320085.396227:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320085.396253:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291953920:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (420us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320085.396261:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17481
00000100:00080000:2.0:1767320085.396466:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320085.979899:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320085.979997:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320085.982102:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379923584:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320085.982182:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320085.982976:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923584
00000100:00100000:3.0:1767320085.982985:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923584
00000100:00100000:3.0:1767320085.983056:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539
00000100:00100000:3.0:1767320085.983066:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379923584:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320085.983095:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320085.983164:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379923584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (982us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320085.983172:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539
00000100:00100000:1.0:1767320085.983762:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379923584:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320085.984139:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320086.999357:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320088.023135:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320088.535009:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320088.535020:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320088.535022:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320088.535027:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320088.535031:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320088.535039:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767320088.535044:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320088.535051:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320088.535092:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164379923712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320088.535109:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320088.535112:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320088.535114:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320088.535117:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767320088.535120:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320088.535124:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320088.535136:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904e00 x1853164379923840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320088.535159:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379923712:0@lo:38:kworker.0
00000100:00080000:2.0:1767320088.535209:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320088.535212:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320088.535214:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320088.535218:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767320088.535220:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320088.535224:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320088.535240:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729e680 x1853164379924352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320088.535254:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320088.535300:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320088.535302:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320088.535305:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4985
00000100:00080000:2.0:1767320088.535308:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320088.535312:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320088.535313:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379924096:0@lo:400:kworker.0
00000100:00100000:2.0:1767320088.535325:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729e300 x1853164379924608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320088.535334:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320088.535382:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379924224:0@lo:400:kworker.0
00000100:00100000:3.0:1767320088.535440:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379923968:0@lo:400:kworker.0
00000100:00100000:0.0:1767320088.535751:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320088.535824:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379924480:0@lo:400:kworker.0
00000100:00100000:0.0:1767320088.535860:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320088.535918:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923712
00000100:00100000:0.0:1767320088.535926:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923712
00000100:00100000:0.0:1767320088.535953:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924480
00000100:00100000:0.0:1767320088.535955:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924480
00000100:00100000:0.0:1767320088.535993:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4634
00000100:00100000:0.0:1767320088.536002:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379924480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320088.536063:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379924480:12345-0@lo:400:kworker.0 Request processed in 62us (202us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320088.536069:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4634
00000100:00100000:0.0:1767320088.536087:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17482
00000100:00100000:0.0:1767320088.536091:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379923712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320088.536108:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320088.536136:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379923712:12345-0@lo:38:kworker.0 Request processed in 43us (807us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320088.536142:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17482
00000100:00100000:0.0:1767320088.536184:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379924480:0@lo:400:kworker.0
00000100:00080000:0.0:1767320088.536226:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320088.536246:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924096
00000100:00100000:0.0:1767320088.536249:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924096
00000100:00100000:0.0:1767320088.536278:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749
00000100:00100000:0.0:1767320088.536285:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379924096:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320088.536321:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379924096:12345-0@lo:400:kworker.0 Request processed in 36us (588us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320088.536326:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749
00000100:00080000:0.0:1767320088.536808:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320088.536839:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379924096:0@lo:400:kworker.0
00000100:00080000:1.0:1767320088.539377:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320088.539392:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320088.539398:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379923712:0@lo:38:kworker.0
00000100:00100000:1.0:1767320088.539460:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379923840:0@lo:38:kworker.0
00000100:00100000:1.0:1767320088.539521:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320088.539588:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379924352:0@lo:38:kworker.0
00000100:00100000:1.0:1767320088.539614:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320088.539637:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379924608:0@lo:38:kworker.0
00000100:00100000:1.0:1767320088.539657:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320088.539724:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924352
00000100:00100000:1.0:1767320088.539730:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924352
00000100:00100000:1.0:1767320088.539762:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924608
00000100:00100000:1.0:1767320088.539765:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924608
00000100:00100000:2.0:1767320088.539776:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320088.539830:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923840
00000100:00100000:0.0:1767320088.539834:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923840
00000100:00100000:0.0:1767320088.539866:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110
00000100:00100000:0.0:1767320088.539887:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379923840:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320088.539909:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320088.539955:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379923840:12345-0@lo:38:kworker.0 Request processed in 67us (432us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320088.539962:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110
00000100:00100000:3.0:1767320088.540043:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320088.540085:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379923968
00000100:00100000:3.0:1767320088.540089:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379923968
00000100:00100000:3.0:1767320088.540126:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750
00000100:00100000:3.0:1767320088.540134:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379923968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320088.540173:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379923968:12345-0@lo:400:kworker.0 Request processed in 41us (130us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320088.540180:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750
00000100:00080000:3.0:1767320088.540196:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320088.540221:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379923968:0@lo:400:kworker.0
00000100:00100000:1.0:1767320088.543710:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924224
00000100:00100000:1.0:1767320088.543725:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924224
00000100:00100000:1.0:1767320088.543817:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4635
00000100:00100000:1.0:1767320088.543826:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379924224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320088.543929:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379924224:12345-0@lo:400:kworker.0 Request processed in 104us (4153us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320088.543936:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4635
00000100:00100000:1.0:1767320088.543960:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17483
00000100:00100000:1.0:1767320088.543965:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379924352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320088.543985:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320088.544015:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379924352:12345-0@lo:38:kworker.0 Request processed in 49us (4400us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320088.544021:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17483
00000100:00100000:1.0:1767320088.544035:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17484
00000100:00100000:1.0:1767320088.544040:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379924608:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320088.544049:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320088.544090:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379924608:12345-0@lo:38:kworker.0 Request processed in 48us (4431us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320088.544096:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17484
00000100:00080000:1.0:1767320088.544124:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320088.544158:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320088.544175:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320088.544179:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379924352:0@lo:38:kworker.0
00000100:00080000:1.0:1767320088.544192:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320088.544196:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320088.544199:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379924608:0@lo:38:kworker.0
00000100:00080000:1.0:1767320088.544209:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320088.544213:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320088.544216:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379923840:0@lo:38:kworker.0
00000100:00100000:1.0:1767320088.544283:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379924224:0@lo:400:kworker.0
00010000:00010000:2.0:1767320089.048161:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320089.488386:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767320089.488424:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291954176 offset 0 length 520: 4
00000100:00100000:0.0:1767320089.488502:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320089.488566:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291954432
00000100:00100000:1.0:1767320089.488576:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291954432
00000100:00100000:1.0:1767320089.488660:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291954304
00000100:00100000:1.0:1767320089.488672:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291954304
00000100:00100000:1.0:1767320089.488695:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4636
00000100:00100000:1.0:1767320089.488705:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291954432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320089.488769:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17485
00000100:00100000:3.0:1767320089.488776:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291954304:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:1.0:1767320089.488783:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291954432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (406us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320089.488795:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4636
00010000:00020000:3.0:1767320089.488799:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320089.488829:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291954304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (326us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320089.488834:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17485
00000100:00080000:0.0:1767320089.489080:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320089.561438:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379924736:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320089.561502:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320089.562843:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924736
00000100:00100000:3.0:1767320089.562856:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924736
00000100:00100000:3.0:1767320089.562970:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540
00000100:00100000:3.0:1767320089.562981:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379924736:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320089.563018:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320089.563280:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379924736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 299us (1775us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320089.563289:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540
00000100:00100000:0.0:1767320089.563534:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379924736:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320090.074604:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320091.095396:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320091.095434:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379924864:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320091.095765:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320091.095844:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924864
00000100:00100000:2.0:1767320091.095852:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924864
00000100:00100000:2.0:1767320091.095921:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541
00000100:00100000:2.0:1767320091.095930:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379924864:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320091.095957:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320091.096002:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379924864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (238us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320091.096009:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541
00000100:00100000:0.0:1767320091.096025:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379924864:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320091.097065:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320091.097080:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320092.119079:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320093.147045:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320093.655038:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320093.655049:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320093.655053:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320093.655057:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320093.655062:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320093.655070:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4990
00000100:00080000:0.0:1767320093.655074:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320093.655081:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320093.655142:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379924992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320093.655159:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320093.655162:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320093.655171:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320093.655176:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4990
00000100:00080000:0.0:1767320093.655178:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320093.655182:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320093.655198:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164379925120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320093.655274:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320093.655278:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320093.655280:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320093.655284:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4990
00000100:00080000:0.0:1767320093.655286:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320093.655290:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320093.655302:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b480 x1853164379925632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320093.655311:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320093.655327:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379925504:0@lo:400:kworker.0
00000100:00080000:0.0:1767320093.655361:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320093.655365:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320093.655367:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320093.655371:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4990
00000100:00080000:0.0:1767320093.655374:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320093.655378:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320093.655390:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859c00 x1853164379925888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320093.655408:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320093.655422:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320093.655434:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379925760:0@lo:400:kworker.0
00000100:00100000:0.0:1767320093.655487:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320093.655508:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379925248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320093.655546:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379925504
00000100:00100000:0.0:1767320093.655555:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379925504
00000100:00100000:2.0:1767320093.655562:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320093.655597:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320093.655605:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379925376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320093.655638:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320068/real 1767320068]  req@ffff8b0e035ffb80 x1853164379918464/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320093 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320093.655642:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379925760
00000100:00100000:2.0:1767320093.655649:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320093.655654:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379925760
00000100:00100000:0.0:1767320093.655696:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4637
00000100:00100000:0.0:1767320093.655706:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379925504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320093.655725:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379925248
00000100:00100000:3.0:1767320093.655732:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379925248
00000100:00100000:1.0:1767320093.655781:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e035ffb80 x1853164379918464/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320093 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320093.655797:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379924992:0@lo:38:kworker.0
00000100:00100000:3.0:1767320093.655834:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379925376
00000100:00100000:3.0:1767320093.655838:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379925376
00000100:00100000:3.0:1767320093.655863:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751
00000100:00100000:3.0:1767320093.655894:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379925248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320093.656058:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752
00000100:00100000:2.0:1767320093.656067:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379925376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320093.656112:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379925504:12345-0@lo:400:kworker.0 Request processed in 407us (704us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320093.656119:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379925376:12345-0@lo:400:kworker.0 Request processed in 52us (472us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320093.656126:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752
00000100:00100000:0.0:1767320093.656138:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4637
00000100:00100000:2.0:1767320093.656155:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4638
00000100:00100000:2.0:1767320093.656166:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379925760:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320093.656173:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320093.656180:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320093.656183:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320093.656247:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379925504:0@lo:400:kworker.0
00000100:00100000:0.0:1767320093.656293:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379925760:0@lo:400:kworker.0
00000100:00100000:2.0:1767320093.656336:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379925760:12345-0@lo:400:kworker.0 Request processed in 172us (847us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320093.656344:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4638
00000100:00100000:1.0:1767320093.656350:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320093.656382:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379925120:0@lo:38:kworker.0
00000100:00100000:1.0:1767320093.656406:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320093.656427:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379924992
00000100:00100000:2.0:1767320093.656433:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379924992
00000100:00100000:1.0:1767320093.656435:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379925632:0@lo:38:kworker.0
00000100:00100000:1.0:1767320093.656458:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320093.656470:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379925632
00000100:00100000:2.0:1767320093.656475:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379925632
00000100:00100000:1.0:1767320093.656480:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379925888:0@lo:38:kworker.0
00000100:00100000:2.0:1767320093.656500:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17486
00000100:00100000:1.0:1767320093.656506:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320093.656510:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379924992:12345-0@lo:38:kworker.0
00000100:00080000:1.0:1767320093.656526:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320093.656541:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320093.656545:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379918464:0@lo:250:kworker.0
00010000:00020000:2.0:1767320093.656549:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320093.656670:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379925248:12345-0@lo:400:kworker.0 Request processed in 800us (1108us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320093.656678:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751
00000100:00100000:3.0:1767320093.656706:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379925888
00000100:00100000:3.0:1767320093.656710:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379925888
00000100:00100000:3.0:1767320093.656725:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17487
00000100:00100000:3.0:1767320093.656730:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379925632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320093.656741:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320093.657319:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17488
00000100:00100000:0.0:1767320093.657327:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379925888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320093.657340:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320093.658126:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379925120
00000100:00100000:1.0:1767320093.658134:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379925120
00000100:00100000:1.0:1767320093.658167:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111
00000100:00100000:1.0:1767320093.658173:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379925120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320093.658186:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320093.661985:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379924992:12345-0@lo:38:kworker.0 Request processed in 5464us (5625us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320093.662000:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379925888:12345-0@lo:38:kworker.0 Request processed in 4670us (5493us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320093.662001:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17486
00000100:00100000:0.0:1767320093.662012:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17488
00000100:00080000:0.0:1767320093.662101:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320093.662108:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320093.662109:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320093.662111:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320093.662117:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320093.662121:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379924992:0@lo:38:kworker.0
00000100:00080000:2.0:1767320093.662133:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320093.662135:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320093.662138:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379925888:0@lo:38:kworker.0
00000100:00100000:2.0:1767320093.662192:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379925376:0@lo:400:kworker.0
00000100:00100000:2.0:1767320093.662212:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379925248:0@lo:400:kworker.0
00000100:00080000:0.0:1767320093.664665:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4970
00000100:00080000:0.0:1767320093.664671:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320093.664679:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320093.665073:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379925120:12345-0@lo:38:kworker.0 Request processed in 6894us (8661us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320093.665089:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111
00000100:00080000:2.0:1767320093.665133:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320093.665142:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320093.665146:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379925120:0@lo:38:kworker.0
00000100:00100000:3.0:1767320093.665260:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379925632:12345-0@lo:38:kworker.0 Request processed in 8527us (8799us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320093.665270:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17487
00000100:00080000:2.0:1767320093.665394:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320093.665399:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320093.665402:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379925632:0@lo:38:kworker.0
00000100:00100000:0.0:1767320093.666935:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859880 x1853164379926016/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320093.667030:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379926016:0@lo:250:kworker.0
00000400:00000100:2.0:1767320093.667085:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379926016 offset 0 length 520: 4
00010000:00010000:3.0:1767320094.167838:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320094.610585:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320094.610817:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320094.613763:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291954688
00000100:00100000:0.0:1767320094.613783:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291954688
00000100:00100000:0.0:1767320094.613918:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291954560
00000100:00100000:0.0:1767320094.613923:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291954560
00000100:00100000:0.0:1767320094.613967:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4639
00000100:00100000:0.0:1767320094.613980:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291954688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320094.614118:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291954688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 130us (3538us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320094.614129:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4639
00000100:00100000:0.0:1767320094.614157:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17489
00000100:00100000:0.0:1767320094.614162:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291954560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320094.614190:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320094.614222:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291954560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (3405us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320094.614230:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17489
00000100:00080000:3.0:1767320094.615946:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320094.679975:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320094.680003:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379926144:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320094.680102:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320094.682519:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379926144
00000100:00100000:3.0:1767320094.682540:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379926144
00000100:00100000:3.0:1767320094.682647:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542
00000100:00100000:3.0:1767320094.682660:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379926144:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320094.682705:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320094.682814:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379926144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 158us (2712us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320094.682820:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542
00000100:00100000:1.0:1767320094.683996:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379926144:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320095.191321:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320096.223438:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320096.228087:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320096.236905:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379926272:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320096.237014:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320096.238802:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379926272
00000100:00100000:0.0:1767320096.238822:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379926272
00000100:00100000:0.0:1767320096.238970:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543
00000100:00100000:0.0:1767320096.238985:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379926272:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320096.239034:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320096.239142:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379926272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (2128us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320096.239151:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543
00000100:00100000:1.0:1767320096.239321:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379926272:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320096.239475:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320097.241342:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320098.264298:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320098.775234:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320098.775249:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320098.775252:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320098.775258:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320098.775264:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320098.775273:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 4996
00000100:00080000:0.0:1767320098.775279:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320098.775289:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320098.775348:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85bb80 x1853164379926400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320098.775389:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320098.775393:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320098.775395:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320098.775399:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 4996
00000100:00080000:0.0:1767320098.775402:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320098.775406:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320098.775421:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858000 x1853164379926528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320098.775518:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320098.775522:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320098.775524:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320098.775528:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 4996
00000100:00080000:0.0:1767320098.775531:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320098.775536:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320098.775549:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85a300 x1853164379927040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320098.775565:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320098.775568:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320098.775570:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320098.775573:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 4996
00000100:00080000:0.0:1767320098.775575:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320098.775593:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320098.775605:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859f80 x1853164379927296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320098.775977:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379926912:0@lo:400:kworker.0
00000100:00100000:0.0:1767320098.776067:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320098.776220:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379926784:0@lo:400:kworker.0
00000100:00100000:3.0:1767320098.776260:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320098.776346:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320098.776352:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379926656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320098.776375:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320098.776411:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379926784
00000100:00100000:3.0:1767320098.776419:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379926784
00000100:00100000:3.0:1767320098.776482:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379926656
00000100:00100000:3.0:1767320098.776484:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379926656
00000100:00100000:3.0:1767320098.776513:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753
00000100:00100000:3.0:1767320098.776522:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379926784:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320098.776576:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379926784:12345-0@lo:400:kworker.0 Request processed in 55us (315us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320098.776597:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753
00000100:00100000:3.0:1767320098.776614:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754
00000100:00100000:3.0:1767320098.776621:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379926656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320098.776734:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320098.776741:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379927168:0@lo:400:kworker.0
00000100:00100000:0.0:1767320098.776764:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320098.776800:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379926912
00000100:00100000:0.0:1767320098.776804:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379926912
00000100:00100000:0.0:1767320098.776833:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927168
00000100:00100000:0.0:1767320098.776835:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927168
00000100:00100000:0.0:1767320098.776852:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4640
00000100:00100000:0.0:1767320098.776858:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379926912:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320098.777033:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379926656:12345-0@lo:400:kworker.0 Request processed in 413us (656us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320098.777040:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754
00000100:00080000:3.0:1767320098.777059:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320098.777065:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320098.777067:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320098.777288:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4641
00000100:00100000:1.0:1767320098.777299:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379927168:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320098.777343:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379927168:12345-0@lo:400:kworker.0 Request processed in 48us (577us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320098.777349:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4641
00000100:00100000:1.0:1767320098.777403:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379927168:0@lo:400:kworker.0
00000100:00100000:3.0:1767320098.777594:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379926656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320098.777610:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379926784:0@lo:400:kworker.0
00000100:00100000:0.0:1767320098.777747:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379926912:12345-0@lo:400:kworker.0 Request processed in 888us (1679us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320098.777754:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4640
00000100:00100000:1.0:1767320098.777816:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379926912:0@lo:400:kworker.0
00000100:00100000:2.0:1767320098.777943:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379926400:0@lo:38:kworker.0
00000100:00100000:2.0:1767320098.777984:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320098.785021:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379926528:0@lo:38:kworker.0
00000100:00100000:2.0:1767320098.785131:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320098.785173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379927040:0@lo:38:kworker.0
00000100:00100000:2.0:1767320098.785201:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320098.790309:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379927296:0@lo:38:kworker.0
00000100:00100000:2.0:1767320098.790397:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320098.790836:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379926400
00000100:00100000:0.0:1767320098.790848:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379926400
00000100:00100000:0.0:1767320098.790944:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927040
00000100:00100000:0.0:1767320098.790949:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927040
00000100:00100000:0.0:1767320098.790973:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17490
00000100:00100000:0.0:1767320098.790983:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379926400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320098.791013:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320098.791078:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379926400:12345-0@lo:38:kworker.0 Request processed in 94us (13091us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320098.792064:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17490
00000100:00100000:0.0:1767320098.792121:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17491
00000100:00100000:0.0:1767320098.792129:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379927040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320098.792148:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320098.792212:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379927040:12345-0@lo:38:kworker.0 Request processed in 83us (7009us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320098.792219:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17491
00000100:00100000:0.0:1767320098.792313:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379926528
00000100:00100000:0.0:1767320098.792321:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379926528
00000100:00100000:0.0:1767320098.792354:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112
00000100:00100000:0.0:1767320098.792359:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379926528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320098.792370:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320098.792402:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379926528:12345-0@lo:38:kworker.0 Request processed in 42us (7272us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320098.792408:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112
00000100:00080000:2.0:1767320098.793564:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320098.793575:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320098.793590:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379926400:0@lo:38:kworker.0
00000100:00080000:2.0:1767320098.793606:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320098.793611:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320098.793614:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379926528:0@lo:38:kworker.0
00000100:00080000:2.0:1767320098.793625:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320098.793629:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320098.793642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379927040:0@lo:38:kworker.0
00000100:00100000:1.0:1767320098.793806:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927296
00000100:00100000:1.0:1767320098.793815:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927296
00000100:00100000:1.0:1767320098.793857:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17492
00000100:00100000:1.0:1767320098.793864:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379927296:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320098.793918:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320098.793979:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379927296:12345-0@lo:38:kworker.0 Request processed in 114us (3581us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320098.793986:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17492
00000100:00080000:2.0:1767320098.794255:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320098.794260:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320098.794264:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379927296:0@lo:38:kworker.0
00010000:00010000:3.0:1767320099.289627:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320099.726955:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320099.728332:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320099.729435:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291954816
00000100:00100000:2.0:1767320099.729449:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291954816
00000100:00100000:2.0:1767320099.729539:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291954944
00000100:00100000:2.0:1767320099.729544:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291954944
00000100:00080000:3.0:1767320099.729619:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320099.729663:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4642
00000100:00100000:1.0:1767320099.729679:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291954944:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320099.730159:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17493
00000100:00100000:0.0:1767320099.730167:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291954816:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:1.0:1767320099.730188:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291954944:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 512us (1861us total) trans 0 rc 0/0
00010000:00020000:0.0:1767320099.730191:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320099.730202:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4642
00000100:00100000:0.0:1767320099.730252:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291954816:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 84us (3309us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320099.730260:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17493
00000100:00100000:1.0:1767320099.801142:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379927424:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320099.801238:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320099.801409:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927424
00000100:00100000:2.0:1767320099.801420:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927424
00000100:00100000:2.0:1767320099.801484:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544
00000100:00100000:2.0:1767320099.801494:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379927424:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320099.801532:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320099.801718:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379927424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 224us (479us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320099.801727:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544
00000100:00100000:3.0:1767320099.801827:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379927424:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320100.312763:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320101.335990:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379927552:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320101.336381:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320101.336525:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320101.336828:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927552
00000100:00100000:0.0:1767320101.336840:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927552
00000100:00100000:0.0:1767320101.337331:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545
00000100:00100000:0.0:1767320101.337344:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379927552:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320101.337409:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320101.337503:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379927552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (978us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320101.337516:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545
00000100:00100000:3.0:1767320101.338147:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379927552:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320101.338761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320102.360045:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320103.383723:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320103.895096:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320103.895111:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320103.895115:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320103.895130:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320103.895137:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320103.895157:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5001
00000100:00080000:2.0:1767320103.895164:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320103.895176:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320103.895239:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c700 x1853164379927680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320103.895263:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320103.895266:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320103.895268:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320103.895273:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5001
00000100:00080000:2.0:1767320103.895275:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320103.895280:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320103.895295:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d180 x1853164379927808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320103.895362:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320103.895366:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320103.895368:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320103.895372:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5001
00000100:00080000:2.0:1767320103.895375:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320103.895379:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320103.895392:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570380 x1853164379928320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320103.895408:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320103.895412:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320103.895414:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320103.895417:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5001
00000100:00080000:2.0:1767320103.895419:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320103.895423:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320103.895435:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904380 x1853164379928576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320103.895685:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379927936:0@lo:400:kworker.0
00000100:00100000:2.0:1767320103.895785:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320103.896124:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320103.896133:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379928064:0@lo:400:kworker.0
00000100:00100000:2.0:1767320103.896235:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320103.896269:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379928192:0@lo:400:kworker.0
00000100:00100000:2.0:1767320103.896297:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320103.896317:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320103.896321:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379928448:0@lo:400:kworker.0
00000100:00100000:2.0:1767320103.896340:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320103.896372:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928192
00000100:00100000:2.0:1767320103.896381:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928192
00000100:00100000:2.0:1767320103.896440:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928448
00000100:00100000:2.0:1767320103.896443:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928448
00000100:00100000:2.0:1767320103.896474:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4643
00000100:00100000:2.0:1767320103.896484:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379928192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320103.896561:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379928192:12345-0@lo:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320103.896569:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4643
00000100:00100000:2.0:1767320103.896589:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4644
00000100:00100000:2.0:1767320103.896595:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379928448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320103.896619:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379928448:12345-0@lo:400:kworker.0 Request processed in 25us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320103.896624:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4644
00000100:00100000:2.0:1767320103.896665:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379928448:0@lo:400:kworker.0
00000100:00100000:2.0:1767320103.896676:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379928192:0@lo:400:kworker.0
00000100:00100000:0.0:1767320103.897512:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927936
00000100:00100000:0.0:1767320103.897531:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927936
00000100:00100000:3.0:1767320103.897976:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928064
00000100:00100000:3.0:1767320103.897981:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928064
00000100:00100000:3.0:1767320103.898034:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755
00000100:00100000:3.0:1767320103.898044:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379928064:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320103.898136:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379928064:12345-0@lo:400:kworker.0 Request processed in 94us (1900us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320103.898144:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755
00000100:00100000:0.0:1767320103.898865:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756
00000100:00100000:0.0:1767320103.898889:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379927936:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320103.898930:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379927936:12345-0@lo:400:kworker.0 Request processed in 42us (3144us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320103.898936:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756
00000100:00080000:1.0:1767320103.899051:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320103.899056:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320103.899059:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320103.899100:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379927680:0@lo:38:kworker.0
00000100:00100000:1.0:1767320103.899145:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320103.899179:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379927808:0@lo:38:kworker.0
00000100:00100000:1.0:1767320103.899203:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320103.899233:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379928320:0@lo:38:kworker.0
00000100:00100000:1.0:1767320103.899271:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320103.899417:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379928576:0@lo:38:kworker.0
00000100:00100000:2.0:1767320103.899480:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379928064:0@lo:400:kworker.0
00000100:00100000:0.0:1767320103.899560:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927680
00000100:00100000:0.0:1767320103.899567:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927680
00000100:00100000:0.0:1767320103.899590:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928320
00000100:00100000:0.0:1767320103.899593:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928320
00000100:00100000:0.0:1767320103.899612:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17494
00000100:00100000:0.0:1767320103.899618:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379927680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320103.899641:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320103.900426:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17495
00000100:00100000:3.0:1767320103.900433:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379928320:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320103.900446:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320103.902071:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320103.902164:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379927808
00000100:00100000:1.0:1767320103.902172:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379927808
00000100:00100000:1.0:1767320103.902207:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113
00000100:00100000:1.0:1767320103.902214:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379927808:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320103.902233:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320103.902445:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379927808:12345-0@lo:38:kworker.0 Request processed in 230us (3240us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320103.902454:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113
00000100:00100000:1.0:1767320103.902483:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928576
00000100:00100000:1.0:1767320103.902487:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928576
00000100:00100000:1.0:1767320103.902508:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17496
00000100:00100000:1.0:1767320103.902512:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379928576:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320103.902522:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320103.902567:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379928576:12345-0@lo:38:kworker.0 Request processed in 54us (502us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320103.902574:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17496
00000100:00080000:1.0:1767320103.902626:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320103.902631:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320103.902635:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379927808:0@lo:38:kworker.0
00000100:00080000:1.0:1767320103.902644:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320103.902647:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320103.902649:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379928576:0@lo:38:kworker.0
00000100:00100000:2.0:1767320103.903013:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379927936:0@lo:400:kworker.0
00000100:00100000:0.0:1767320103.905806:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379927680:12345-0@lo:38:kworker.0 Request processed in 6177us (6650us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320103.905821:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17494
00000100:00100000:3.0:1767320103.905987:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379928320:12345-0@lo:38:kworker.0 Request processed in 5551us (6714us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320103.905995:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17495
00000100:00080000:1.0:1767320103.906140:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320103.906146:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320103.906150:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379927680:0@lo:38:kworker.0
00000100:00080000:1.0:1767320103.906161:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320103.906164:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320103.906167:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379928320:0@lo:38:kworker.0
00010000:00010000:2.0:1767320104.408520:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320104.850446:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320104.850514:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320104.850777:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291955200
00000100:00100000:2.0:1767320104.850791:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291955200
00000100:00100000:2.0:1767320104.850914:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291955072
00000100:00100000:2.0:1767320104.850918:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291955072
00000100:00100000:2.0:1767320104.850941:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4645
00000100:00100000:2.0:1767320104.850952:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291955200:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320104.851042:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291955200:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (613us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320104.851051:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4645
00000100:00100000:2.0:1767320104.851072:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17497
00000100:00100000:2.0:1767320104.851078:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291955072:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320104.851102:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320104.851144:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291955072:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 65us (630us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320104.851151:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17497
00000100:00080000:1.0:1767320104.854044:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320104.919916:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379928704:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320104.920027:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320104.920408:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928704
00000100:00100000:3.0:1767320104.920419:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928704
00000100:00100000:3.0:1767320104.920497:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546
00000100:00100000:3.0:1767320104.920687:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379928704:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320104.920794:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320104.921139:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379928704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 455us (1112us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320104.921150:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546
00000100:00100000:2.0:1767320104.921323:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379928704:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320105.432359:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320106.455603:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320106.458519:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320106.458552:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379928832:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320106.458650:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320106.460021:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928832
00000100:00100000:1.0:1767320106.460037:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928832
00000100:00100000:1.0:1767320106.460140:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547
00000100:00100000:1.0:1767320106.460153:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379928832:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320106.460383:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:1.0:1767320106.460500:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320106.460650:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379928832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 499us (1999us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320106.460661:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547
00000100:00100000:3.0:1767320106.469191:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379928832:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320107.481130:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320108.503358:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320109.015229:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320109.015241:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320109.015245:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320109.015248:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320109.015254:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320109.015262:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5006
00000100:00080000:3.0:1767320109.015266:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320109.015273:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320109.015319:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7a680 x1853164379928960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320109.015342:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320109.015345:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320109.015346:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320109.015349:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5006
00000100:00080000:3.0:1767320109.015351:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320109.015353:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320109.015368:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79500 x1853164379929088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320109.015444:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320109.015447:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320109.015448:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320109.015451:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5006
00000100:00080000:3.0:1767320109.015453:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320109.015457:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320109.015468:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d78000 x1853164379929600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320109.015484:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320109.015497:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320109.015499:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320109.015503:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5006
00000100:00080000:3.0:1767320109.015506:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320109.015510:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320109.015521:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7ad80 x1853164379929856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320109.015552:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379929472:0@lo:400:kworker.0
00000100:00100000:3.0:1767320109.015638:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320109.015723:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320109.015730:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379929728:0@lo:400:kworker.0
00000100:00100000:3.0:1767320109.015756:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320109.015786:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929472
00000100:00100000:3.0:1767320109.015793:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929472
00000100:00100000:3.0:1767320109.015853:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929728
00000100:00100000:3.0:1767320109.015855:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929728
00000100:00100000:3.0:1767320109.015902:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4646
00000100:00100000:3.0:1767320109.015909:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379929472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320109.015963:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379929472:12345-0@lo:400:kworker.0 Request processed in 45us (316us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320109.015969:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4646
00000100:00100000:3.0:1767320109.015983:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4647
00000100:00100000:3.0:1767320109.015987:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379929728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320109.016006:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379929728:12345-0@lo:400:kworker.0 Request processed in 19us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320109.016010:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4647
00000100:00100000:3.0:1767320109.016036:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379929728:0@lo:400:kworker.0
00000100:00100000:3.0:1767320109.016043:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379929472:0@lo:400:kworker.0
00000100:00100000:0.0:1767320109.016323:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379929344:0@lo:400:kworker.0
00000100:00100000:0.0:1767320109.016365:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320109.016392:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320109.016395:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379929216:0@lo:400:kworker.0
00000100:00100000:0.0:1767320109.016410:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320109.016435:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929344
00000100:00100000:0.0:1767320109.016437:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929344
00000100:00100000:0.0:1767320109.016461:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929216
00000100:00100000:0.0:1767320109.016463:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929216
00000100:00100000:0.0:1767320109.016497:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757
00000100:00100000:0.0:1767320109.016503:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379929344:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320109.016540:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379929344:12345-0@lo:400:kworker.0 Request processed in 37us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320109.016546:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757
00000100:00100000:0.0:1767320109.016559:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758
00000100:00100000:0.0:1767320109.016563:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379929216:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320109.016584:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379929216:12345-0@lo:400:kworker.0 Request processed in 21us (172us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320109.016590:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758
00000100:00100000:0.0:1767320109.016620:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379929216:0@lo:400:kworker.0
00000100:00100000:0.0:1767320109.016630:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379929344:0@lo:400:kworker.0
00000100:00080000:2.0:1767320109.016793:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320109.016798:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320109.016808:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320109.017230:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379928960:0@lo:38:kworker.0
00000100:00100000:1.0:1767320109.017274:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320109.017307:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379929088:0@lo:38:kworker.0
00000100:00100000:1.0:1767320109.017327:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320109.017352:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379929600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320109.017451:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379928960
00000100:00100000:2.0:1767320109.017457:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379928960
00000100:00100000:2.0:1767320109.017506:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17498
00000100:00100000:2.0:1767320109.017511:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379928960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320109.017534:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320109.017576:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379928960:12345-0@lo:38:kworker.0 Request processed in 63us (301us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320109.017583:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17498
00000100:00100000:1.0:1767320109.017646:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320109.017769:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379929856:0@lo:38:kworker.0
00000100:00100000:1.0:1767320109.017794:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320109.018074:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929600
00000100:00100000:3.0:1767320109.018080:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929600
00000100:00100000:3.0:1767320109.018106:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929856
00000100:00100000:3.0:1767320109.018108:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929856
00000100:00100000:3.0:1767320109.018126:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17499
00000100:00100000:3.0:1767320109.018132:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379929600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320109.018143:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320109.018173:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379929600:12345-0@lo:38:kworker.0 Request processed in 42us (528us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320109.018177:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17499
00000100:00100000:3.0:1767320109.018186:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17500
00000100:00100000:3.0:1767320109.018189:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379929856:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320109.018195:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320109.018207:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379929856:12345-0@lo:38:kworker.0 Request processed in 17us (414us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320109.018210:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17500
00000100:00080000:1.0:1767320109.018271:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320109.018275:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320109.018278:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379928960:0@lo:38:kworker.0
00000100:00080000:1.0:1767320109.018287:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320109.018290:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320109.018292:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379929600:0@lo:38:kworker.0
00000100:00080000:1.0:1767320109.018296:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320109.018298:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320109.018299:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379929856:0@lo:38:kworker.0
00000100:00100000:0.0:1767320109.018464:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929088
00000100:00100000:0.0:1767320109.018469:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929088
00000100:00100000:0.0:1767320109.018508:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114
00000100:00100000:0.0:1767320109.018513:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379929088:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320109.018524:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320109.018567:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379929088:12345-0@lo:38:kworker.0 Request processed in 53us (1238us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320109.018574:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114
00000100:00080000:2.0:1767320109.018641:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320109.018647:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320109.018650:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379929088:0@lo:38:kworker.0
00010000:00010000:2.0:1767320109.527800:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320109.973781:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320109.974362:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291955328
00000100:00100000:2.0:1767320109.974372:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291955328
00000100:00100000:2.0:1767320109.974423:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17501
00000100:00100000:2.0:1767320109.974431:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291955328:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320109.974455:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320109.974595:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291955328:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 162us (822us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320109.974604:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17501
00000100:00100000:1.0:1767320109.986557:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320109.986907:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291955456
00000100:00100000:2.0:1767320109.986917:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291955456
00000100:00100000:2.0:1767320109.987380:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4648
00000100:00100000:2.0:1767320109.987391:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291955456:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320109.987473:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291955456:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (926us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320109.987492:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4648
00000100:00080000:0.0:1767320109.997024:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320110.039843:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379929984:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320110.039944:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320110.040671:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379929984
00000100:00100000:1.0:1767320110.040679:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379929984
00000100:00100000:1.0:1767320110.040731:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548
00000100:00100000:1.0:1767320110.040740:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379929984:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320110.040776:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320110.040836:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379929984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (891us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320110.040843:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548
00000100:00100000:2.0:1767320110.041580:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379929984:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320110.552512:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320111.576044:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320111.576901:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320111.576924:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379930112:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320111.576994:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320111.577103:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379930112
00000100:00100000:1.0:1767320111.577114:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379930112
00000100:00100000:1.0:1767320111.577191:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549
00000100:00100000:1.0:1767320111.577202:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379930112:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320111.577235:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320111.577293:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379930112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (299us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320111.577301:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549
00000100:00080000:0.0:1767320111.577354:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320111.577607:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379930112:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320112.601793:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320113.630092:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320114.135292:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320114.135304:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320114.135307:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320114.135311:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320114.135315:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320114.135323:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5011
00000100:00080000:0.0:1767320114.135329:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320114.135335:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320114.135379:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858000 x1853164379930240/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320114.135403:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320114.135407:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320114.135409:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320114.135422:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5011
00000100:00080000:0.0:1767320114.135425:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320114.135428:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320114.135452:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85bb80 x1853164379930368/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320114.135523:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320114.135527:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320114.135529:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320114.135533:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5011
00000100:00080000:0.0:1767320114.135535:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320114.135539:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320114.135550:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b800 x1853164379930880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320114.135573:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320114.135576:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320114.135578:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320114.135580:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5011
00000100:00080000:0.0:1767320114.135583:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320114.135586:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320114.135595:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ed80 x1853164379931136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320114.135622:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379930752:0@lo:400:kworker.0
00000100:00100000:0.0:1767320114.135687:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320114.135746:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320114.135752:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379931008:0@lo:400:kworker.0
00000100:00100000:0.0:1767320114.136391:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320114.136516:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379930624:0@lo:400:kworker.0
00000100:00100000:2.0:1767320114.136552:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320114.136592:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320114.136599:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379930496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320114.136619:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320114.136646:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379930752
00000100:00100000:2.0:1767320114.136653:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379930752
00000100:00100000:2.0:1767320114.136702:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379931008
00000100:00100000:2.0:1767320114.136705:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379931008
00000100:00100000:2.0:1767320114.136727:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4649
00000100:00100000:2.0:1767320114.136735:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379930752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320114.136786:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379930752:12345-0@lo:400:kworker.0 Request processed in 51us (1099us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320114.136794:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4649
00000100:00100000:2.0:1767320114.136811:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4650
00000100:00100000:2.0:1767320114.136817:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379931008:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320114.136856:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379931008:12345-0@lo:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320114.136863:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4650
00000100:00080000:2.0:1767320114.136902:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320114.137338:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379930624
00000100:00100000:0.0:1767320114.137343:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379930624
00000100:00100000:0.0:1767320114.137389:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379930496
00000100:00100000:0.0:1767320114.137393:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379930496
00000100:00100000:0.0:1767320114.137415:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759
00000100:00100000:0.0:1767320114.137421:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379930624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320114.137474:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379930624:12345-0@lo:400:kworker.0 Request processed in 53us (921us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320114.137480:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759
00000100:00100000:0.0:1767320114.137494:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760
00000100:00100000:0.0:1767320114.137510:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379930496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320114.137538:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379930496:12345-0@lo:400:kworker.0 Request processed in 39us (917us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320114.137544:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760
00000100:00100000:0.0:1767320114.137591:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379931008:0@lo:400:kworker.0
00000100:00100000:0.0:1767320114.137603:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379930752:0@lo:400:kworker.0
00000100:00100000:1.0:1767320114.139790:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379930240:0@lo:38:kworker.0
00000100:00100000:1.0:1767320114.139843:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320114.139892:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379930368:0@lo:38:kworker.0
00000100:00100000:1.0:1767320114.139909:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320114.139937:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379930880:0@lo:38:kworker.0
00000100:00100000:1.0:1767320114.139951:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320114.139961:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379931136:0@lo:38:kworker.0
00000100:00100000:1.0:1767320114.139971:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320114.140235:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379930240
00000100:00100000:1.0:1767320114.140244:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379930240
00000100:00100000:1.0:1767320114.140276:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379930880
00000100:00100000:1.0:1767320114.140279:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379930880
00000100:00100000:1.0:1767320114.140293:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379931136
00000100:00100000:1.0:1767320114.140295:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379931136
00000100:00100000:1.0:1767320114.140308:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17502
00000100:00100000:1.0:1767320114.140314:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379930240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320114.140335:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320114.140377:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379930240:12345-0@lo:38:kworker.0 Request processed in 62us (532us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320114.140383:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17502
00000100:00100000:1.0:1767320114.140402:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17503
00000100:00100000:1.0:1767320114.140406:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379930880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320114.140415:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320114.140435:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379930880:12345-0@lo:38:kworker.0 Request processed in 28us (482us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320114.140451:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17503
00000100:00100000:1.0:1767320114.140464:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17504
00000100:00100000:1.0:1767320114.140468:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379931136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320114.140477:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320114.140511:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379931136:12345-0@lo:38:kworker.0 Request processed in 32us (528us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320114.140517:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17504
00000100:00080000:1.0:1767320114.140555:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320114.140560:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320114.140564:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379930240:0@lo:38:kworker.0
00000100:00080000:1.0:1767320114.140573:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320114.140576:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320114.140579:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379930880:0@lo:38:kworker.0
00000100:00080000:1.0:1767320114.140589:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320114.140592:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320114.140594:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379931136:0@lo:38:kworker.0
00000100:00080000:2.0:1767320114.140682:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320114.140687:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320114.140712:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379930496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320114.140724:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379930624:0@lo:400:kworker.0
00000100:00100000:0.0:1767320114.143842:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379930368
00000100:00100000:0.0:1767320114.143862:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379930368
00000100:00100000:0.0:1767320114.143940:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115
00000100:00100000:0.0:1767320114.143947:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379930368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320114.143966:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320114.144066:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379930368:12345-0@lo:38:kworker.0 Request processed in 118us (4154us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320114.144071:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115
00000100:00080000:2.0:1767320114.144255:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320114.144261:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320114.144265:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379930368:0@lo:38:kworker.0
00010000:00010000:3.0:1767320114.647691:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320115.088290:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320115.088350:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767320115.088383:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291955840 offset 0 length 520: 4
00000100:00100000:1.0:1767320115.088555:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291955712
00000100:00100000:1.0:1767320115.088564:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291955712
00000100:00100000:1.0:1767320115.088641:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291955584
00000100:00100000:1.0:1767320115.088644:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291955584
00000100:00100000:1.0:1767320115.088664:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4651
00000100:00100000:1.0:1767320115.088674:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291955712:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320115.088744:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291955712:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 72us (464us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320115.088752:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4651
00000100:00100000:1.0:1767320115.088771:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17505
00000100:00100000:1.0:1767320115.088775:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291955584:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320115.088796:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320115.088820:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291955584:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (469us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320115.088825:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17505
00000100:00080000:2.0:1767320115.089159:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320115.159672:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320115.159703:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379931264:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320115.159783:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320115.161409:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379931264
00000100:00100000:1.0:1767320115.161422:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379931264
00000100:00100000:1.0:1767320115.161503:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550
00000100:00100000:1.0:1767320115.161513:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379931264:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320115.161559:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320115.161645:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379931264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (1862us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320115.161656:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550
00000100:00100000:3.0:1767320115.161753:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379931264:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320115.671701:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320116.695437:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320116.695458:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379931392:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320116.695523:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320116.695624:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379931392
00000100:00100000:2.0:1767320116.695633:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379931392
00000100:00100000:2.0:1767320116.695691:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551
00000100:00100000:2.0:1767320116.695701:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379931392:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320116.695731:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320116.695778:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379931392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (254us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320116.695786:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551
00000100:00080000:2.0:1767320116.695809:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320116.695982:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379931392:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320116.720005:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320117.783934:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320118.233809:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320093/real 1767320093]  req@ffff8b0e0c859880 x1853164379926016/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320118 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320118.233839:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c859880 x1853164379926016/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320118 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320118.233859:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320118.233909:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320118.233913:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379926016:0@lo:250:kworker.0
00000100:00080000:2.0:1767320118.234105:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320118.234110:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320118.234113:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320118.234126:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 4996
00000100:00080000:2.0:1767320118.234130:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320118.234136:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320118.234365:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef800 x1853164379931520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320118.234389:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320118.234392:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320118.234394:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320118.234397:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767320118.234400:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320118.234413:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320118.234428:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef100 x1853164379931648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320118.234437:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320118.234440:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320118.234441:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320118.234445:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767320118.234447:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320118.234450:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320118.234460:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edf80 x1853164379931776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320118.234528:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379932032:0@lo:400:kworker.0
00000100:00100000:3.0:1767320118.234602:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320118.234607:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379931904:0@lo:400:kworker.0
00000100:00100000:3.0:1767320118.234674:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932032
00000100:00100000:3.0:1767320118.234682:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932032
00000100:00100000:3.0:1767320118.234746:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761
00000100:00100000:3.0:1767320118.234755:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379932032:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320118.242747:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320118.243137:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379931904
00000100:00100000:1.0:1767320118.243148:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379931904
00000100:00080000:2.0:1767320118.244029:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320118.244041:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320118.244044:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320118.244050:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767320118.244054:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320118.244059:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320118.244090:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec380 x1853164379932288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320118.244111:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320118.244114:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320118.244116:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320118.244126:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5016
00000100:00080000:2.0:1767320118.244128:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320118.244132:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320118.244143:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c700 x1853164379932544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320118.244180:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379932416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320118.244223:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320118.244251:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762
00000100:00100000:2.0:1767320118.244254:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320118.244269:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379931904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320118.244273:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379932160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320118.244295:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320118.244329:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320118.244333:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320118.244342:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379931520:0@lo:250:kworker.0
00000400:00000100:2.0:1767320118.244359:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379931520 offset 0 length 520: 4
00000100:00100000:2.0:1767320118.244374:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379931648:0@lo:38:kworker.0
00000100:00100000:2.0:1767320118.244391:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320118.244416:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379931776:0@lo:38:kworker.0
00000100:00100000:2.0:1767320118.244436:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320118.244449:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379932288:0@lo:38:kworker.0
00000100:00100000:2.0:1767320118.244463:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320118.244474:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379932544:0@lo:38:kworker.0
00000100:00100000:2.0:1767320118.244488:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320118.244515:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932416
00000100:00100000:2.0:1767320118.244519:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932416
00000100:00100000:2.0:1767320118.244545:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932160
00000100:00100000:2.0:1767320118.244547:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932160
00000100:00100000:2.0:1767320118.244557:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379931648
00000100:00100000:2.0:1767320118.244559:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379931648
00000100:00100000:2.0:1767320118.244566:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932288
00000100:00100000:2.0:1767320118.244568:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932288
00000100:00100000:2.0:1767320118.244574:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932544
00000100:00100000:2.0:1767320118.244575:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932544
00000100:00100000:2.0:1767320118.244586:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4652
00000100:00100000:2.0:1767320118.244593:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379932416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320118.244628:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379932416:12345-0@lo:400:kworker.0 Request processed in 36us (404us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320118.244635:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4652
00000100:00100000:2.0:1767320118.244650:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4653
00000100:00100000:2.0:1767320118.244655:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379932160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320118.244675:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379932160:12345-0@lo:400:kworker.0 Request processed in 20us (379us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320118.244680:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4653
00000100:00100000:2.0:1767320118.244688:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17506
00000100:00100000:2.0:1767320118.244692:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379931648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320118.244708:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320118.244732:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379931648:12345-0@lo:38:kworker.0 Request processed in 38us (339us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320118.244737:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17506
00000100:00100000:2.0:1767320118.244745:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17507
00000100:00100000:2.0:1767320118.244748:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379932288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320118.244757:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320118.244772:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379932288:12345-0@lo:38:kworker.0 Request processed in 22us (308us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320118.244777:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17507
00000100:00100000:2.0:1767320118.244785:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17508
00000100:00100000:2.0:1767320118.244788:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379932544:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320118.244796:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320118.244810:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379932544:12345-0@lo:38:kworker.0 Request processed in 20us (321us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320118.244815:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17508
00000100:00080000:2.0:1767320118.244824:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320118.244846:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379932160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320118.244854:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379932416:0@lo:400:kworker.0
00000100:00080000:2.0:1767320118.244904:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320118.244908:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320118.244911:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379931648:0@lo:38:kworker.0
00000100:00080000:2.0:1767320118.244918:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320118.244921:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320118.244923:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379932288:0@lo:38:kworker.0
00000100:00080000:2.0:1767320118.244929:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320118.244932:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320118.244935:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379932544:0@lo:38:kworker.0
00000100:00100000:2.0:1767320118.244975:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379931776
00000100:00100000:2.0:1767320118.244978:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379931776
00000100:00100000:2.0:1767320118.244994:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116
00000100:00100000:2.0:1767320118.244998:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379931776:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320118.245007:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320118.245031:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379931776:12345-0@lo:38:kworker.0 Request processed in 32us (594us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320118.245037:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116
00000100:00080000:2.0:1767320118.245062:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320118.245066:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320118.245069:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379931776:0@lo:38:kworker.0
00000100:00100000:3.0:1767320118.245428:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379932032:12345-0@lo:400:kworker.0 Request processed in 10673us (10824us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320118.245574:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379932032:0@lo:400:kworker.0
00000100:00100000:1.0:1767320118.247102:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379931904:12345-0@lo:400:kworker.0 Request processed in 2836us (4723us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320118.247114:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762
00000100:00100000:1.0:1767320118.247163:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379931904:0@lo:400:kworker.0
00000100:00100000:3.0:1767320118.249592:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761
00010000:00010000:3.0:1767320118.807426:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320119.833800:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320120.210360:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320120.210427:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320120.210517:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291956096
00000100:00100000:0.0:1767320120.210527:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291956096
00000100:00100000:0.0:1767320120.210611:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291955968
00000100:00100000:0.0:1767320120.210615:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291955968
00000100:00100000:0.0:1767320120.210641:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4654
00000100:00100000:0.0:1767320120.210655:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291956096:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320120.210738:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291956096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (388us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320120.210746:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4654
00000100:00100000:0.0:1767320120.210766:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17509
00000100:00100000:0.0:1767320120.210771:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291955968:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320120.210791:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320120.210817:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291955968:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (390us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320120.210823:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17509
00000100:00080000:2.0:1767320120.211029:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320120.279086:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320120.283192:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379932672:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320120.283275:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320120.283494:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932672
00000100:00100000:1.0:1767320120.283503:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932672
00000100:00100000:1.0:1767320120.283566:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552
00000100:00100000:1.0:1767320120.283576:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379932672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320120.283607:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320120.283663:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379932672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (387us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320120.283671:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552
00000100:00100000:0.0:1767320120.283994:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379932672:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320120.284231:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320120.856431:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320121.816051:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320121.816077:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379932800:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320121.816157:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320121.816351:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932800
00000100:00100000:1.0:1767320121.816361:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932800
00000100:00100000:1.0:1767320121.816435:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553
00000100:00100000:1.0:1767320121.816444:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379932800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320121.816474:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320121.816517:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379932800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (360us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320121.816524:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553
00000100:00080000:3.0:1767320121.816697:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320121.816735:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379932800:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767320121.884036:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320122.903237:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320123.351236:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320123.351251:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320123.351254:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320123.351259:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320123.351264:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320123.351274:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5020
00000100:00080000:0.0:1767320123.351281:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320123.351300:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320123.351366:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ca80 x1853164379932928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320123.351401:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320123.351405:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320123.351407:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320123.351412:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5020
00000100:00080000:0.0:1767320123.351414:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320123.351419:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320123.351434:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85fb80 x1853164379933056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320123.351514:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320123.351517:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320123.351519:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320123.351523:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5020
00000100:00080000:0.0:1767320123.351526:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320123.351529:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320123.351541:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85dc00 x1853164379933568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320123.351561:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320123.351564:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320123.351567:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320123.351570:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5020
00000100:00080000:0.0:1767320123.351573:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320123.351578:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320123.351588:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d500 x1853164379933824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320123.351622:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379933696:0@lo:400:kworker.0
00000100:00100000:0.0:1767320123.351714:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320123.351799:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320123.351807:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379933440:0@lo:400:kworker.0
00000100:00100000:0.0:1767320123.351829:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320123.351916:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933696
00000100:00100000:0.0:1767320123.351925:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933696
00000100:00100000:0.0:1767320123.351986:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933440
00000100:00100000:0.0:1767320123.351990:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933440
00000100:00100000:0.0:1767320123.352018:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4655
00000100:00100000:0.0:1767320123.352027:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379933696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320123.352083:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379933696:12345-0@lo:400:kworker.0 Request processed in 56us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320123.352092:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4655
00000100:00100000:0.0:1767320123.352112:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4656
00000100:00100000:0.0:1767320123.352119:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379933440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320123.352145:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379933440:12345-0@lo:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320123.352150:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4656
00000100:00100000:0.0:1767320123.352205:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379933440:0@lo:400:kworker.0
00000100:00100000:0.0:1767320123.352217:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379933696:0@lo:400:kworker.0
00000100:00100000:2.0:1767320123.352512:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379932928:0@lo:38:kworker.0
00000100:00100000:2.0:1767320123.352552:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320123.352587:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379933056:0@lo:38:kworker.0
00000100:00100000:2.0:1767320123.352615:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320123.352642:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379933568:0@lo:38:kworker.0
00000100:00100000:2.0:1767320123.352665:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320123.352683:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379933824:0@lo:38:kworker.0
00000100:00100000:2.0:1767320123.352703:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320123.352735:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933056
00000100:00100000:2.0:1767320123.352740:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933056
00000100:00100000:2.0:1767320123.352767:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117
00000100:00100000:2.0:1767320123.352773:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379933056:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320123.352797:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320123.352835:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379933056:12345-0@lo:38:kworker.0 Request processed in 61us (219us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320123.352842:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117
00000100:00100000:2.0:1767320123.352893:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379932928
00000100:00100000:2.0:1767320123.352897:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379932928
00000100:00100000:2.0:1767320123.352916:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933568
00000100:00100000:2.0:1767320123.352920:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933568
00000100:00100000:2.0:1767320123.352933:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933824
00000100:00100000:2.0:1767320123.352936:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933824
00000100:00100000:2.0:1767320123.352946:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17510
00000100:00100000:2.0:1767320123.352951:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379932928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320123.352961:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320123.352987:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379932928:12345-0@lo:38:kworker.0 Request processed in 35us (434us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320123.352993:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17510
00000100:00100000:2.0:1767320123.353004:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17511
00000100:00100000:2.0:1767320123.353008:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379933568:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320123.353015:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320123.353036:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379933568:12345-0@lo:38:kworker.0 Request processed in 26us (371us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320123.353040:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17511
00000100:00100000:2.0:1767320123.353050:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17512
00000100:00100000:2.0:1767320123.353055:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379933824:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320123.353072:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320123.353103:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379933824:12345-0@lo:38:kworker.0 Request processed in 46us (399us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320123.353111:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17512
00000100:00100000:1.0:1767320123.353164:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379933184:0@lo:400:kworker.0
00000100:00080000:2.0:1767320123.353167:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320123.353183:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320123.353190:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379932928:0@lo:38:kworker.0
00000100:00080000:2.0:1767320123.353199:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320123.353203:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320123.353206:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379933056:0@lo:38:kworker.0
00000100:00080000:2.0:1767320123.353215:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320123.353219:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320123.353222:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379933568:0@lo:38:kworker.0
00000100:00080000:2.0:1767320123.353233:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320123.353238:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320123.353241:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379933824:0@lo:38:kworker.0
00000100:00100000:1.0:1767320123.353280:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320123.353338:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320123.353345:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379933312:0@lo:400:kworker.0
00000100:00100000:1.0:1767320123.353380:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320123.353419:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933184
00000100:00100000:1.0:1767320123.353427:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933184
00000100:00100000:1.0:1767320123.353474:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933312
00000100:00100000:1.0:1767320123.353477:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933312
00000100:00100000:1.0:1767320123.353506:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763
00000100:00100000:1.0:1767320123.353515:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379933184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320123.353574:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379933184:12345-0@lo:400:kworker.0 Request processed in 59us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320123.353583:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763
00000100:00100000:2.0:1767320123.353607:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764
00000100:00100000:2.0:1767320123.353622:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379933312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320123.353662:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379933184:0@lo:400:kworker.0
00000100:00100000:2.0:1767320123.353687:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379933312:12345-0@lo:400:kworker.0 Request processed in 68us (303us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320123.353697:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764
00000100:00100000:1.0:1767320123.353702:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379933312:0@lo:400:kworker.0
00000100:00080000:3.0:1767320123.358338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320123.358350:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320123.358354:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320123.928346:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320124.951926:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320125.327756:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320125.327802:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320125.327912:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291956224
00000100:00100000:2.0:1767320125.327924:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291956224
00000100:00100000:2.0:1767320125.327969:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291956352
00000100:00100000:2.0:1767320125.327973:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291956352
00000100:00100000:2.0:1767320125.328018:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4657
00000100:00100000:2.0:1767320125.328029:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291956352:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320125.328110:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291956352:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (307us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320125.328118:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4657
00000100:00100000:2.0:1767320125.328138:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17513
00000100:00100000:2.0:1767320125.328142:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291956224:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320125.328163:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320125.328190:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291956224:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (443us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320125.328195:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17513
00000100:00080000:3.0:1767320125.332937:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320125.399595:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379933952:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320125.399672:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320125.400849:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379933952
00000100:00100000:3.0:1767320125.400861:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379933952
00000100:00100000:3.0:1767320125.400959:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554
00000100:00100000:3.0:1767320125.400970:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379933952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320125.401007:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320125.401077:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379933952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (1405us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320125.401085:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554
00000100:00100000:3.0:1767320125.401143:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379933952:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320125.401252:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:0.0:1767320125.976471:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320126.936684:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320126.936706:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379934080:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320126.936777:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320126.937332:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934080
00000100:00100000:1.0:1767320126.937343:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934080
00000100:00100000:1.0:1767320126.937480:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555
00000100:00100000:1.0:1767320126.937494:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379934080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320126.937525:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320126.937556:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320126.937604:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379934080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (826us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320126.937613:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555
00000100:00100000:0.0:1767320126.937818:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379934080:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320126.999964:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320128.023090:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320128.475251:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320128.475272:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320128.475276:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320128.475280:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320128.475285:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320128.475293:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5025
00000100:00080000:3.0:1767320128.475299:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320128.475307:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320128.475362:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe680 x1853164379934208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320128.475391:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320128.475394:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320128.475396:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320128.475400:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5025
00000100:00080000:3.0:1767320128.475402:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320128.475406:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320128.475421:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe300 x1853164379934336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320128.475507:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320128.475511:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320128.475513:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320128.475517:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5025
00000100:00080000:3.0:1767320128.475519:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320128.475523:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320128.475535:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efea00 x1853164379934848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320128.475551:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320128.475555:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320128.475556:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320128.475559:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5025
00000100:00080000:3.0:1767320128.475562:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320128.475565:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320128.475575:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d79500 x1853164379935104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320128.475602:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379934976:0@lo:400:kworker.0
00000100:00100000:3.0:1767320128.475674:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320128.475742:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320128.475748:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379934720:0@lo:400:kworker.0
00000100:00100000:3.0:1767320128.475770:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320128.475804:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934976
00000100:00100000:3.0:1767320128.475810:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934976
00000100:00100000:3.0:1767320128.475860:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934720
00000100:00100000:3.0:1767320128.475863:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934720
00000100:00100000:3.0:1767320128.475918:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4658
00000100:00100000:3.0:1767320128.475926:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379934976:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320128.475976:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379934976:12345-0@lo:400:kworker.0 Request processed in 51us (301us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320128.475986:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4658
00000100:00100000:3.0:1767320128.476001:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4659
00000100:00100000:3.0:1767320128.476007:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379934720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320128.476034:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379934720:12345-0@lo:400:kworker.0 Request processed in 28us (263us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320128.476040:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4659
00000100:00100000:3.0:1767320128.476081:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379934720:0@lo:400:kworker.0
00000100:00100000:3.0:1767320128.476092:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379934976:0@lo:400:kworker.0
00000100:00100000:2.0:1767320128.476191:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379934592:0@lo:400:kworker.0
00000100:00100000:2.0:1767320128.476226:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320128.476265:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320128.476270:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379934464:0@lo:400:kworker.0
00000100:00100000:2.0:1767320128.476292:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320128.476331:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934592
00000100:00100000:2.0:1767320128.476335:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934592
00000100:00100000:2.0:1767320128.476367:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934464
00000100:00100000:2.0:1767320128.476370:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934464
00000100:00100000:2.0:1767320128.476388:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765
00000100:00100000:2.0:1767320128.476395:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379934592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320128.476431:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379934592:12345-0@lo:400:kworker.0 Request processed in 36us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320128.476437:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765
00000100:00100000:2.0:1767320128.476450:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766
00000100:00100000:2.0:1767320128.476456:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379934464:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320128.476483:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379934464:12345-0@lo:400:kworker.0 Request processed in 28us (190us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320128.476489:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766
00000100:00100000:2.0:1767320128.476517:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379934464:0@lo:400:kworker.0
00000100:00100000:2.0:1767320128.476526:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379934592:0@lo:400:kworker.0
00000100:00100000:0.0:1767320128.476957:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379934208:0@lo:38:kworker.0
00000100:00100000:0.0:1767320128.476995:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320128.477021:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379934336:0@lo:38:kworker.0
00000100:00100000:0.0:1767320128.477046:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320128.477078:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379934848:0@lo:38:kworker.0
00000100:00100000:0.0:1767320128.477100:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320128.477116:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379935104:0@lo:38:kworker.0
00000100:00100000:0.0:1767320128.477135:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320128.477184:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934208
00000100:00100000:0.0:1767320128.477189:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934208
00000100:00100000:0.0:1767320128.477210:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934848
00000100:00100000:0.0:1767320128.477212:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934848
00000100:00100000:0.0:1767320128.477222:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379935104
00000100:00100000:0.0:1767320128.477225:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379935104
00000100:00100000:0.0:1767320128.477235:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17514
00000100:00100000:0.0:1767320128.477240:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379934208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320128.477265:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320128.477300:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379934208:12345-0@lo:38:kworker.0 Request processed in 59us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320128.477306:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17514
00000100:00100000:0.0:1767320128.477332:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17515
00000100:00100000:0.0:1767320128.477336:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379934848:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320128.477345:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320128.477371:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379934848:12345-0@lo:38:kworker.0 Request processed in 33us (270us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320128.477376:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17515
00000100:00100000:0.0:1767320128.477387:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17516
00000100:00100000:0.0:1767320128.477390:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379935104:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320128.477399:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320128.477422:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379935104:12345-0@lo:38:kworker.0 Request processed in 29us (285us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320128.477426:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17516
00000100:00080000:0.0:1767320128.477454:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320128.477459:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320128.477462:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320128.477483:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320128.477488:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320128.477491:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379934208:0@lo:38:kworker.0
00000100:00080000:0.0:1767320128.477498:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320128.477501:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320128.477503:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379934848:0@lo:38:kworker.0
00000100:00080000:0.0:1767320128.477509:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320128.477512:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320128.477514:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379935104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320128.477705:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379934336
00000100:00100000:1.0:1767320128.477710:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379934336
00000100:00100000:1.0:1767320128.477741:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118
00000100:00100000:1.0:1767320128.477746:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379934336:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320128.477756:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320128.477793:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379934336:12345-0@lo:38:kworker.0 Request processed in 45us (746us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320128.477800:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118
00000100:00080000:1.0:1767320128.477826:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320128.477830:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320128.477834:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379934336:0@lo:38:kworker.0
00010000:00010000:3.0:1767320129.047357:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320130.071052:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320130.447944:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320130.448043:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320130.448571:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291956608
00000100:00100000:0.0:1767320130.448581:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291956608
00000100:00100000:0.0:1767320130.448646:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291956480
00000100:00100000:0.0:1767320130.448649:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291956480
00000100:00100000:0.0:1767320130.448678:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4660
00000100:00100000:0.0:1767320130.448688:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291956608:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320130.448760:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291956608:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (826us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320130.448768:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4660
00000100:00100000:0.0:1767320130.448788:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17517
00000100:00100000:0.0:1767320130.448792:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291956480:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320130.448811:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320130.448837:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291956480:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (794us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320130.448843:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17517
00000100:00080000:2.0:1767320130.448970:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320130.519226:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379935232:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320130.519573:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320130.520092:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379935232
00000100:00100000:3.0:1767320130.520100:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379935232
00000100:00100000:3.0:1767320130.520175:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556
00000100:00080000:2.0:1767320130.520388:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320130.520421:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379935232:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320130.520455:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320130.520522:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379935232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 337us (949us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320130.520530:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556
00000100:00100000:2.0:1767320130.520620:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379935232:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320131.101392:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320132.058786:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379935360:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320132.058896:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320132.059122:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379935360
00000100:00100000:1.0:1767320132.059130:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379935360
00000100:00100000:1.0:1767320132.059201:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557
00000100:00100000:1.0:1767320132.059211:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379935360:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320132.059244:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320132.059306:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379935360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (438us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320132.059314:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557
00000100:00080000:0.0:1767320132.061641:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320132.061769:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379935360:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320132.122438:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320133.143134:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320133.591146:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320133.591157:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320133.591160:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320133.591165:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320133.591169:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320133.591177:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5030
00000100:00080000:0.0:1767320133.591182:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320133.591189:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320133.591228:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ce00 x1853164379935488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320133.591290:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379935488:0@lo:38:kworker.0
00000100:00100000:1.0:1767320133.591376:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320133.591494:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320133.591498:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320133.591501:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320133.591505:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5030
00000100:00080000:0.0:1767320133.591508:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320133.591512:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320133.591528:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f100 x1853164379935616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320133.591603:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320133.591607:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320133.591609:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320133.591612:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5030
00000100:00080000:0.0:1767320133.591615:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320133.591619:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320133.591629:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ca80 x1853164379936128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320133.591643:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320133.591646:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320133.591648:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320133.591651:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5030
00000100:00080000:0.0:1767320133.591654:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320133.591657:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320133.591666:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85aa00 x1853164379936384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320133.591689:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379936000:0@lo:400:kworker.0
00000100:00100000:2.0:1767320133.591705:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379935744:0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.591742:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379935872:0@lo:400:kworker.0
00000100:00100000:2.0:1767320133.591750:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320133.591974:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320133.592032:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320133.592970:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320133.592982:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379936256:0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.593021:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320133.593039:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379935488
00000100:00100000:3.0:1767320133.593047:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379935488
00000100:00100000:3.0:1767320133.593082:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936000
00000100:00100000:3.0:1767320133.593084:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936000
00000100:00100000:3.0:1767320133.593203:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4661
00000100:00100000:3.0:1767320133.593214:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379936000:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.593276:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379936000:12345-0@lo:400:kworker.0 Request processed in 65us (1242us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320133.593283:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4661
00000100:00100000:3.0:1767320133.593299:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17518
00000100:00100000:3.0:1767320133.593303:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379935488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320133.593323:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320133.593447:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379935488:12345-0@lo:38:kworker.0 Request processed in 135us (2064us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320133.593454:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17518
00000100:00080000:3.0:1767320133.593485:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320133.593512:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379935744
00000100:00100000:3.0:1767320133.593516:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379935744
00000100:00100000:3.0:1767320133.593542:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379935872
00000100:00100000:3.0:1767320133.593544:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379935872
00000100:00100000:3.0:1767320133.593783:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767
00000100:00100000:3.0:1767320133.593789:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379935744:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.593824:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379935744:12345-0@lo:400:kworker.0 Request processed in 35us (2075us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320133.593830:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767
00000100:00100000:3.0:1767320133.593840:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768
00000100:00100000:3.0:1767320133.593845:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379935872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.593942:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379935872:12345-0@lo:400:kworker.0 Request processed in 97us (1968us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320133.593948:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768
00000100:00080000:3.0:1767320133.593962:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320133.594021:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379935872:0@lo:400:kworker.0
00000100:00100000:0.0:1767320133.594259:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379936000:0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.594328:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936256
00000100:00100000:3.0:1767320133.594332:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936256
00000100:00100000:3.0:1767320133.594664:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4662
00000100:00100000:3.0:1767320133.594671:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379936256:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320133.594710:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379936256:12345-0@lo:400:kworker.0 Request processed in 39us (1688us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320133.594717:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4662
00000100:00080000:0.0:1767320133.594830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320133.594851:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379936256:0@lo:400:kworker.0
00000100:00080000:1.0:1767320133.596255:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320133.596293:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320133.596297:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379935488:0@lo:38:kworker.0
00000100:00100000:1.0:1767320133.596320:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379935616:0@lo:38:kworker.0
00000100:00100000:1.0:1767320133.596642:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320133.596726:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379936128:0@lo:38:kworker.0
00000100:00100000:1.0:1767320133.596751:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320133.596780:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379936384:0@lo:38:kworker.0
00000100:00100000:1.0:1767320133.596799:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320133.596825:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936128
00000100:00100000:1.0:1767320133.596831:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936128
00000100:00100000:1.0:1767320133.596859:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936384
00000100:00100000:1.0:1767320133.596861:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936384
00000100:00100000:1.0:1767320133.596898:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17519
00000100:00100000:1.0:1767320133.596904:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379936128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320133.596924:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320133.596944:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379935744:0@lo:400:kworker.0
00000100:00100000:1.0:1767320133.596963:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379936128:12345-0@lo:38:kworker.0 Request processed in 57us (210us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320133.596971:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17519
00000100:00100000:1.0:1767320133.596989:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17520
00000100:00100000:1.0:1767320133.596994:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379936384:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320133.597003:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320133.597021:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379936384:12345-0@lo:38:kworker.0 Request processed in 26us (222us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320133.597027:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17520
00000100:00080000:1.0:1767320133.597048:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320133.597051:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320133.597054:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379936384:0@lo:38:kworker.0
00000100:00080000:1.0:1767320133.597068:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320133.597071:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320133.597074:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379936128:0@lo:38:kworker.0
00000100:00100000:0.0:1767320133.597290:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379935616
00000100:00100000:0.0:1767320133.597294:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379935616
00000100:00100000:0.0:1767320133.597422:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119
00000100:00100000:0.0:1767320133.597427:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379935616:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320133.597438:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320133.597487:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379935616:12345-0@lo:38:kworker.0 Request processed in 59us (846us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320133.597494:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119
00000100:00080000:2.0:1767320133.597556:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320133.597560:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320133.597563:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379935616:0@lo:38:kworker.0
00010000:00010000:0.0:1767320134.167045:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320135.198061:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320135.568442:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320135.568535:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320135.569164:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291956864
00000100:00100000:3.0:1767320135.569176:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291956864
00000100:00100000:3.0:1767320135.571214:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291956736
00000100:00100000:3.0:1767320135.571231:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291956736
00000100:00100000:3.0:1767320135.571275:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4663
00000100:00100000:3.0:1767320135.571290:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291956864:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320135.571368:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291956864:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (2935us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320135.571374:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4663
00000100:00100000:3.0:1767320135.571391:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17521
00000100:00100000:3.0:1767320135.571394:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291956736:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320135.571412:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320135.571430:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291956736:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 35us (2896us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320135.571434:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17521
00000100:00080000:0.0:1767320135.575414:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320135.640544:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379936512:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320135.640623:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320135.640822:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936512
00000100:00100000:3.0:1767320135.640831:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936512
00000100:00100000:1.0:1767320135.641091:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558
00000100:00100000:1.0:1767320135.641102:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379936512:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320135.641133:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320135.641194:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379936512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (570us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320135.641202:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558
00000100:00080000:0.0:1767320135.641458:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320135.642155:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379936512:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320136.215643:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320137.176794:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320137.176820:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379936640:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320137.177031:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320137.177169:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936640
00000100:00100000:1.0:1767320137.177177:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936640
00000100:00100000:1.0:1767320137.177304:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559
00000100:00100000:1.0:1767320137.177315:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379936640:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320137.177352:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320137.177402:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379936640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (373us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320137.177412:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559
00000100:00100000:2.0:1767320137.177528:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379936640:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320137.177972:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320137.240603:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320138.266546:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320138.712939:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320138.712951:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320138.712954:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320138.712958:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320138.712962:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320138.712970:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5035
00000100:00080000:0.0:1767320138.712974:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320138.712982:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320138.713035:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859500 x1853164379936768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320138.713069:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320138.713076:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320138.713078:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320138.713082:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5035
00000100:00080000:0.0:1767320138.713085:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320138.713088:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320138.713103:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85aa00 x1853164379936896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320138.713180:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320138.713183:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320138.713186:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320138.713190:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5035
00000100:00080000:0.0:1767320138.713192:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320138.713196:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320138.713207:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d180 x1853164379937408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320138.713235:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320138.713238:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320138.713241:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320138.713244:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5035
00000100:00080000:0.0:1767320138.713246:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320138.713249:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320138.713261:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c380 x1853164379937664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320138.713272:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379937024:0@lo:400:kworker.0
00000100:00100000:0.0:1767320138.713289:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379937280:0@lo:400:kworker.0
00000100:00100000:2.0:1767320138.713359:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379937152:0@lo:400:kworker.0
00000100:00100000:3.0:1767320138.713416:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379937536:0@lo:400:kworker.0
00000100:00100000:1.0:1767320138.713479:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320138.713553:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937024
00000100:00100000:1.0:1767320138.713563:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937024
00000100:00100000:1.0:1767320138.713637:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769
00000100:00100000:1.0:1767320138.713647:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379937024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320138.713667:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320138.713694:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379937024:12345-0@lo:400:kworker.0 Request processed in 49us (215us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320138.713701:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769
00000100:00080000:0.0:1767320138.713715:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320138.713727:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937280
00000100:00100000:0.0:1767320138.713730:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937280
00000100:00100000:1.0:1767320138.713742:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379937024:0@lo:400:kworker.0
00000100:00100000:0.0:1767320138.713764:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4664
00000100:00080000:1.0:1767320138.713767:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320138.713770:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379937280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320138.713796:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379936768:0@lo:38:kworker.0
00000100:00100000:1.0:1767320138.713818:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320138.714097:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379937280:12345-0@lo:400:kworker.0 Request processed in 326us (428us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320138.714104:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4664
00000100:00100000:0.0:1767320138.714119:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936768
00000100:00100000:0.0:1767320138.714122:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936768
00000100:00100000:0.0:1767320138.714143:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17522
00000100:00100000:0.0:1767320138.714147:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379936768:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320138.714165:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320138.715668:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379936896:0@lo:38:kworker.0
00000100:00100000:3.0:1767320138.715691:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320138.715697:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379936768:12345-0@lo:38:kworker.0 Request processed in 1545us (1875us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320138.715707:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17522
00000100:00100000:1.0:1767320138.715707:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320138.715731:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937536
00000100:00100000:0.0:1767320138.715737:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937536
00000100:00100000:1.0:1767320138.715743:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379937408:0@lo:38:kworker.0
00000100:00100000:1.0:1767320138.715766:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320138.715880:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320138.718434:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937408
00000100:00100000:0.0:1767320138.718447:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937408
00000100:00100000:3.0:1767320138.718467:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4665
00000100:00100000:1.0:1767320138.718469:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379937664:0@lo:38:kworker.0
00000100:00100000:2.0:1767320138.718487:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17523
00000100:00100000:3.0:1767320138.718487:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379937536:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320138.718526:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320138.718549:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379937408:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320138.718559:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937664
00000100:00100000:0.0:1767320138.718564:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937664
00000100:00080000:1.0:1767320138.718569:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767320138.718570:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379937536:12345-0@lo:400:kworker.0 Request processed in 91us (2880us total) trans 0 rc 0/0
00010000:00020000:2.0:1767320138.718573:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320138.718579:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17524
00000100:00080000:1.0:1767320138.718579:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320138.718584:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379936768:0@lo:38:kworker.0
00000100:00100000:0.0:1767320138.718586:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379937664:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320138.718590:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4665
00010000:00020000:0.0:1767320138.718600:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320138.718611:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379937408:12345-0@lo:38:kworker.0 Request processed in 115us (2842us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767320138.718614:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767320138.718620:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17523
00000100:00080000:1.0:1767320138.718622:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320138.718626:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937152
00000100:00100000:1.0:1767320138.718630:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379937408:0@lo:38:kworker.0
00000100:00100000:3.0:1767320138.718633:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937152
00000100:00100000:0.0:1767320138.718642:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379937664:12345-0@lo:38:kworker.0 Request processed in 55us (117us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767320138.718642:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320138.718646:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320138.718650:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17524
00000100:00100000:1.0:1767320138.718650:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379937664:0@lo:38:kworker.0
00000100:00100000:3.0:1767320138.718686:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770
00000100:00100000:1.0:1767320138.718688:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379936896
00000100:00100000:2.0:1767320138.718689:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379937536:0@lo:400:kworker.0
00000100:00100000:1.0:1767320138.718694:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379936896
00000100:00100000:0.0:1767320138.718695:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379937280:0@lo:400:kworker.0
00000100:00100000:3.0:1767320138.718696:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379937152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320138.718724:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120
00000100:00100000:1.0:1767320138.718730:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379936896:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767320138.718736:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767320138.718742:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320138.718748:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379937152:12345-0@lo:400:kworker.0 Request processed in 51us (2877us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320138.718754:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770
00000100:00100000:2.0:1767320138.718773:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379937152:0@lo:400:kworker.0
00000100:00100000:1.0:1767320138.718793:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379936896:12345-0@lo:38:kworker.0 Request processed in 61us (3084us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320138.718800:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120
00000100:00080000:1.0:1767320138.718830:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320138.718835:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320138.718838:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379936896:0@lo:38:kworker.0
00010000:00010000:3.0:1767320139.290484:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320139.665505:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320139.665679:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291957248
00000100:00100000:2.0:1767320139.665692:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291957248
00000100:00080000:1.0:1767320139.665749:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320139.665923:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4666
00000100:00100000:2.0:1767320139.665933:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291957248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320139.666011:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291957248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (518us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320139.666018:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4666
00000400:00000100:3.0:1767320139.668448:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291956992 offset 0 length 520: 4
00000100:00100000:3.0:1767320139.668494:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320139.668907:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291957120
00000100:00100000:2.0:1767320139.668917:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291957120
00000100:00100000:2.0:1767320139.668970:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17525
00000100:00100000:2.0:1767320139.668979:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291957120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320139.669007:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320139.669083:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291957120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 103us (588us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320139.669092:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17525
00010000:00010000:1.0:1767320140.311235:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320140.759622:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320140.759686:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379937792:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320140.759756:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320140.760074:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937792
00000100:00100000:1.0:1767320140.760083:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937792
00000100:00100000:1.0:1767320140.760404:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560
00000100:00100000:1.0:1767320140.760413:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379937792:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320140.760440:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320140.760499:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379937792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (742us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320140.760510:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560
00000100:00100000:0.0:1767320140.760731:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379937792:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320140.760779:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320141.338689:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320142.295436:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320142.295460:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379937920:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320142.295529:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320142.296862:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379937920
00000100:00100000:3.0:1767320142.296899:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379937920
00000100:00100000:3.0:1767320142.296977:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561
00000100:00100000:3.0:1767320142.297001:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379937920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320142.297032:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320142.297106:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379937920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (1577us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320142.297114:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561
00000100:00100000:0.0:1767320142.297337:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379937920:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320142.297567:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320142.359282:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320143.383193:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320143.831115:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320118/real 1767320118]  req@ffff8b0e0a2ef800 x1853164379931520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320143 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320143.831150:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0a2ef800 x1853164379931520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320143 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320143.831180:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320143.831189:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320143.831194:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379931520:0@lo:250:kworker.0
00000100:00080000:2.0:1767320143.831308:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320143.831314:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320143.831317:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320143.831321:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5020
00000100:00080000:2.0:1767320143.831326:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320143.831333:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320143.831369:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6680 x1853164379938048/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320143.831395:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320143.831400:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320143.831401:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320143.831404:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5041
00000100:00080000:2.0:1767320143.831407:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320143.831410:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320143.831423:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332680 x1853164379938176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320143.831432:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320143.831435:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320143.831437:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320143.831442:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5041
00000100:00080000:2.0:1767320143.831444:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320143.831448:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320143.831604:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379938048:0@lo:250:kworker.0
00000400:00000100:3.0:1767320143.831668:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379938048 offset 0 length 520: 4
00000100:00100000:3.0:1767320143.831719:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379938176:0@lo:38:kworker.0
00000100:00100000:3.0:1767320143.831750:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320143.831908:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379938176
00000100:00100000:0.0:1767320143.831918:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379938176
00000100:00100000:0.0:1767320143.831963:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17526
00000100:00100000:0.0:1767320143.831970:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379938176:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320143.831992:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320143.832046:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379938176:12345-0@lo:38:kworker.0 Request processed in 75us (295us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320143.832052:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17526
00000100:00080000:1.0:1767320143.832140:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320143.832144:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320143.832147:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379938176:0@lo:38:kworker.0
00000100:00100000:2.0:1767320143.832336:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331500 x1853164379938304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320143.832403:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379938304:0@lo:38:kworker.0
00000100:00100000:1.0:1767320143.832435:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320143.832593:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379938304
00000100:00100000:3.0:1767320143.832598:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379938304
00000100:00100000:3.0:1767320143.832628:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121
00000100:00100000:3.0:1767320143.832633:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379938304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320143.832644:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320143.832688:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379938304:12345-0@lo:38:kworker.0 Request processed in 53us (251us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320143.832694:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121
00000100:00100000:0.0:1767320143.832826:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379938432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320143.832890:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320143.832947:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379938432
00000100:00100000:3.0:1767320143.832952:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379938432
00000100:00100000:3.0:1767320143.832998:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771
00000100:00100000:3.0:1767320143.833006:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379938432:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320143.833087:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320143.833092:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320143.833095:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379938304:0@lo:38:kworker.0
00000100:00080000:1.0:1767320143.833136:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320143.835691:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379938560:0@lo:400:kworker.0
00000100:00100000:1.0:1767320143.835764:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320143.835824:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379938560
00000100:00100000:1.0:1767320143.835844:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379938560
00000100:00100000:1.0:1767320143.835918:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772
00000100:00100000:1.0:1767320143.835926:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379938560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320143.835974:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379938560:12345-0@lo:400:kworker.0 Request processed in 49us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320143.835983:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772
00000100:00100000:1.0:1767320143.836037:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379938560:0@lo:400:kworker.0
00000100:00100000:3.0:1767320143.838183:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379938432:12345-0@lo:400:kworker.0 Request processed in 5162us (5298us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320143.838198:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771
00000100:00080000:2.0:1767320143.841756:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320143.841763:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320143.841767:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320143.841775:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5041
00000100:00080000:2.0:1767320143.841780:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320143.841788:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320143.841810:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fce00 x1853164379938816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320143.841840:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320143.841843:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320143.841846:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320143.841849:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5041
00000100:00080000:2.0:1767320143.841852:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320143.841857:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320143.841885:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572a00 x1853164379939072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320143.842132:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379938688:0@lo:400:kworker.0
00000100:00100000:1.0:1767320143.842214:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320143.842262:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320143.842267:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379938944:0@lo:400:kworker.0
00000100:00100000:1.0:1767320143.842287:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320143.842335:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379938816:0@lo:38:kworker.0
00000100:00100000:1.0:1767320143.842356:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320143.842374:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379939072:0@lo:38:kworker.0
00000100:00100000:1.0:1767320143.842390:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320143.842420:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379938688
00000100:00100000:1.0:1767320143.842426:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379938688
00000100:00100000:1.0:1767320143.842487:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379938944
00000100:00100000:1.0:1767320143.842491:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379938944
00000100:00100000:1.0:1767320143.842507:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379938816
00000100:00100000:1.0:1767320143.842510:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379938816
00000100:00100000:1.0:1767320143.842517:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939072
00000100:00100000:1.0:1767320143.842519:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939072
00000100:00100000:1.0:1767320143.842529:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4667
00000100:00100000:1.0:1767320143.842536:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379938688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320143.842586:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379938688:12345-0@lo:400:kworker.0 Request processed in 50us (373us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320143.842593:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4667
00000100:00100000:1.0:1767320143.842614:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4668
00000100:00100000:1.0:1767320143.842619:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379938944:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320143.842640:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379938944:12345-0@lo:400:kworker.0 Request processed in 21us (352us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320143.842645:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4668
00000100:00100000:1.0:1767320143.842666:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17527
00000100:00100000:1.0:1767320143.842670:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379938816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320143.842688:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320143.842715:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379938816:12345-0@lo:38:kworker.0 Request processed in 43us (358us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320143.842720:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17527
00000100:00100000:1.0:1767320143.842730:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17528
00000100:00100000:1.0:1767320143.842733:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379939072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320143.842741:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320143.842756:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379939072:12345-0@lo:38:kworker.0 Request processed in 21us (365us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320143.842761:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17528
00000100:00080000:1.0:1767320143.842777:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320143.842800:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379938944:0@lo:400:kworker.0
00000100:00100000:1.0:1767320143.842808:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379938688:0@lo:400:kworker.0
00000100:00080000:1.0:1767320143.843000:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320143.843007:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320143.843010:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379938816:0@lo:38:kworker.0
00000100:00080000:1.0:1767320143.843022:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320143.843025:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320143.843028:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379939072:0@lo:38:kworker.0
00000100:00100000:0.0:1767320143.845143:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379938432:0@lo:400:kworker.0
00010000:00010000:1.0:1767320144.407275:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320144.783395:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320144.783478:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320144.793540:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291957504
00000100:00100000:2.0:1767320144.793562:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291957504
00000100:00100000:2.0:1767320144.793660:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291957376
00000100:00100000:2.0:1767320144.793665:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291957376
00000100:00080000:1.0:1767320144.793891:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320144.793895:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4669
00000100:00100000:2.0:1767320144.793908:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291957504:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320144.793909:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17529
00000100:00100000:1.0:1767320144.793914:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291957376:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320144.793935:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320144.793999:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291957376:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 83us (10520us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320144.794007:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17529
00000100:00100000:2.0:1767320144.794378:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291957504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 472us (10992us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320144.794386:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4669
00010000:00010000:2.0:1767320145.431398:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320145.882141:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320145.882172:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379939200:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320145.882241:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320145.882422:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939200
00000100:00100000:2.0:1767320145.882430:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939200
00000100:00100000:2.0:1767320145.882494:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562
00000100:00100000:2.0:1767320145.882503:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379939200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320145.882531:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320145.882575:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379939200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (333us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320145.882582:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562
00000100:00080000:1.0:1767320145.882689:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320145.882721:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379939200:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320146.455304:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320147.421759:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379939328:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320147.421842:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320147.421975:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939328
00000100:00100000:0.0:1767320147.421983:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939328
00000100:00100000:0.0:1767320147.422043:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563
00000100:00100000:0.0:1767320147.422053:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379939328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320147.422082:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320147.422124:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379939328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (281us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320147.422132:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563
00000100:00100000:0.0:1767320147.422192:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379939328:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320147.422222:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320147.479719:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320148.504386:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320148.951463:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320148.951474:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320148.951477:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320148.951481:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320148.951484:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320148.951491:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5046
00000100:00080000:0.0:1767320148.951496:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320148.951502:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320148.951543:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e680 x1853164379939456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320148.951568:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320148.951572:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320148.951574:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320148.951578:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5046
00000100:00080000:0.0:1767320148.951581:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320148.951585:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320148.951598:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9df80 x1853164379939584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320148.951672:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320148.951676:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320148.951678:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320148.951682:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5046
00000100:00080000:0.0:1767320148.951685:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320148.951688:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320148.951699:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ca80 x1853164379940096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320148.951716:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320148.951719:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320148.951721:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320148.951724:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5046
00000100:00080000:0.0:1767320148.951726:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320148.951730:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320148.951740:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d500 x1853164379940352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320148.951764:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379939840:0@lo:400:kworker.0
00000100:00100000:0.0:1767320148.951831:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320148.951911:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320148.951918:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379939712:0@lo:400:kworker.0
00000100:00100000:0.0:1767320148.951940:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320148.951970:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379940224:0@lo:400:kworker.0
00000100:00100000:2.0:1767320148.951995:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379939968:0@lo:400:kworker.0
00000100:00100000:0.0:1767320148.952029:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320148.952061:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320148.952133:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939840
00000100:00100000:1.0:1767320148.952142:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939840
00000100:00100000:1.0:1767320148.952186:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939712
00000100:00100000:1.0:1767320148.952190:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939712
00000100:00100000:1.0:1767320148.952237:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773
00000100:00100000:1.0:1767320148.952246:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379939840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320148.952299:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379939840:12345-0@lo:400:kworker.0 Request processed in 54us (468us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320148.952306:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773
00000100:00100000:1.0:1767320148.952325:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774
00000100:00100000:1.0:1767320148.952331:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379939712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320148.952357:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379939712:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320148.952363:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774
00000100:00080000:1.0:1767320148.952381:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320148.952407:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379939712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320148.952421:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379939840:0@lo:400:kworker.0
00000100:00100000:1.0:1767320148.952449:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379939456:0@lo:38:kworker.0
00000100:00100000:1.0:1767320148.952475:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320148.959627:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379939584:0@lo:38:kworker.0
00000100:00100000:1.0:1767320148.959710:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320148.959743:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379940096:0@lo:38:kworker.0
00000100:00100000:1.0:1767320148.959783:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320148.960380:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940224
00000100:00100000:0.0:1767320148.960391:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940224
00000100:00100000:0.0:1767320148.960605:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939968
00000100:00100000:0.0:1767320148.960610:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939968
00000100:00100000:0.0:1767320148.960634:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939456
00000100:00100000:0.0:1767320148.960637:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939456
00000100:00100000:0.0:1767320148.960657:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4670
00000100:00100000:0.0:1767320148.960680:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379940224:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320148.960744:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379940224:12345-0@lo:400:kworker.0 Request processed in 79us (8721us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320148.960751:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4670
00000100:00100000:0.0:1767320148.960968:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4671
00000100:00100000:0.0:1767320148.960976:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379939968:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320148.961355:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17530
00000100:00100000:2.0:1767320148.961363:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379939456:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320148.961384:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320148.962965:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940096
00000100:00100000:3.0:1767320148.962983:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940096
00000100:00100000:3.0:1767320148.963044:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17531
00000100:00100000:3.0:1767320148.963051:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379940096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320148.963071:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320148.963564:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379939456:12345-0@lo:38:kworker.0 Request processed in 2198us (11085us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320148.963573:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17530
00000100:00100000:1.0:1767320148.963602:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379940352:0@lo:38:kworker.0
00000100:00100000:1.0:1767320148.963653:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320148.963695:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940352
00000100:00100000:2.0:1767320148.963701:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940352
00000100:00100000:2.0:1767320148.963719:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17532
00000100:00080000:1.0:1767320148.963720:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767320148.963725:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379940352:12345-0@lo:38:kworker.0
00000100:00080000:1.0:1767320148.963730:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320148.963737:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379939456:0@lo:38:kworker.0
00010000:00020000:2.0:1767320148.963741:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320148.963778:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379939584
00000100:00100000:1.0:1767320148.963783:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379939584
00000100:00100000:2.0:1767320148.963793:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379940352:12345-0@lo:38:kworker.0 Request processed in 67us (139us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320148.963800:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17532
00000100:00100000:1.0:1767320148.963812:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122
00000100:00100000:1.0:1767320148.963819:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379939584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320148.963831:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320148.963862:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379939968:0@lo:400:kworker.0
00000100:00100000:1.0:1767320148.963888:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379939584:12345-0@lo:38:kworker.0 Request processed in 47us (4157us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320148.963898:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122
00000100:00080000:1.0:1767320148.963932:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320148.963937:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320148.963941:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379939584:0@lo:38:kworker.0
00000100:00080000:1.0:1767320148.963951:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320148.963955:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320148.963958:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379940352:0@lo:38:kworker.0
00000100:00080000:2.0:1767320148.963964:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320148.964025:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379940224:0@lo:400:kworker.0
00000100:00100000:3.0:1767320148.964398:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379940096:12345-0@lo:38:kworker.0 Request processed in 1344us (4611us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320148.964407:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379939968:12345-0@lo:400:kworker.0 Request processed in 3428us (12343us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320148.964410:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17531
00000100:00100000:0.0:1767320148.964422:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4671
00000100:00080000:2.0:1767320148.964493:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320148.964498:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320148.964501:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379940096:0@lo:38:kworker.0
00010000:00010000:2.0:1767320149.527211:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320149.905106:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320149.905162:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320149.905251:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291957760
00000100:00100000:2.0:1767320149.905261:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291957760
00000100:00100000:0.0:1767320149.905362:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291957632
00000100:00100000:0.0:1767320149.905366:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291957632
00000100:00100000:0.0:1767320149.905421:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17533
00000100:00100000:0.0:1767320149.905429:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291957632:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320149.905455:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320149.905529:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291957632:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 98us (365us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320149.905536:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17533
00000100:00100000:2.0:1767320149.906033:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4672
00000100:00100000:2.0:1767320149.906043:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291957760:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320149.906094:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291957760:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 53us (1011us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320149.906102:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4672
00000100:00080000:1.0:1767320149.906905:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320150.551422:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320151.000072:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379940480:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320151.000153:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320151.001725:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940480
00000100:00100000:0.0:1767320151.001738:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940480
00000100:00080000:1.0:1767320151.001793:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320151.001811:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564
00000100:00100000:0.0:1767320151.001824:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379940480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320151.001859:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320151.001951:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379940480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (1797us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320151.001960:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564
00000100:00100000:2.0:1767320151.002219:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379940480:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320151.576941:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320152.535104:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379940608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320152.535193:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320152.535260:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940608
00000100:00100000:2.0:1767320152.535269:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940608
00000100:00100000:2.0:1767320152.535338:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565
00000100:00100000:2.0:1767320152.535349:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379940608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320152.535397:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320152.535515:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320152.538987:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379940608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3630us (3783us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320152.539003:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565
00000100:00100000:1.0:1767320152.539700:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379940608:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320152.599176:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320153.623857:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320154.071642:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320154.071649:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320154.071652:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320154.071656:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320154.071660:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320154.071667:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5051
00000100:00080000:0.0:1767320154.071671:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320154.071678:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320154.071713:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e300 x1853164379940736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320154.071748:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320154.071752:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320154.071754:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320154.071757:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5051
00000100:00080000:0.0:1767320154.071760:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320154.071764:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320154.071779:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d500 x1853164379940864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320154.071823:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320154.071827:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320154.071828:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320154.071831:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5051
00000100:00080000:0.0:1767320154.071835:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320154.071838:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320154.071849:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d880 x1853164379941376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320154.071862:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320154.071865:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320154.071889:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320154.071893:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5051
00000100:00080000:0.0:1767320154.071895:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320154.071899:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320154.071910:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ca80 x1853164379941632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320154.072002:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379940736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320154.072068:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320154.072133:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379940864:0@lo:38:kworker.0
00000100:00100000:2.0:1767320154.072158:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320154.072181:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379941376:0@lo:38:kworker.0
00000100:00100000:2.0:1767320154.072200:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320154.072216:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379941632:0@lo:38:kworker.0
00000100:00100000:2.0:1767320154.072236:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320154.072275:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940864
00000100:00100000:3.0:1767320154.072279:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379940992:0@lo:400:kworker.0
00000100:00100000:2.0:1767320154.072282:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940864
00000100:00100000:2.0:1767320154.072316:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123
00000100:00100000:3.0:1767320154.072322:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320154.072329:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379940864:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320154.072349:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320154.072352:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320154.072359:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379941120:0@lo:400:kworker.0
00000100:00100000:3.0:1767320154.072400:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320154.072471:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379941504:0@lo:400:kworker.0
00000100:00100000:0.0:1767320154.072544:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940992
00000100:00100000:0.0:1767320154.072549:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940992
00000100:00100000:0.0:1767320154.072587:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379941120
00000100:00100000:0.0:1767320154.072590:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379941120
00000100:00100000:0.0:1767320154.072611:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775
00000100:00100000:0.0:1767320154.072617:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379940992:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320154.073491:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379940864:12345-0@lo:38:kworker.0 Request processed in 1161us (1329us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320154.073504:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123
00000100:00100000:3.0:1767320154.073719:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379940736
00000100:00100000:3.0:1767320154.073726:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379940736
00000100:00080000:2.0:1767320154.074004:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320154.074010:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320154.074014:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379940864:0@lo:38:kworker.0
00000100:00100000:3.0:1767320154.074051:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379941376
00000100:00100000:2.0:1767320154.074054:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379941632
00000100:00100000:3.0:1767320154.074057:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379941376
00000100:00100000:2.0:1767320154.074060:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379941632
00000100:00100000:3.0:1767320154.074091:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17534
00000100:00100000:3.0:1767320154.074099:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379940736:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320154.074105:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17535
00000100:00100000:2.0:1767320154.074112:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379941376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320154.074120:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767320154.074125:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320154.074183:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379940736:12345-0@lo:38:kworker.0 Request processed in 83us (2113us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320154.074185:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379941376:12345-0@lo:38:kworker.0 Request processed in 70us (1982us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320154.074197:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17534
00000100:00100000:2.0:1767320154.074453:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17535
00000100:00100000:2.0:1767320154.074469:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17536
00000100:00100000:2.0:1767320154.074474:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379941632:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320154.074485:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320154.074548:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320154.074553:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320154.074557:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379940736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320154.074571:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379941632:12345-0@lo:38:kworker.0 Request processed in 39us (2278us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320154.074579:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17536
00000100:00080000:3.0:1767320154.074659:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320154.074664:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320154.074667:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379941376:0@lo:38:kworker.0
00000100:00080000:3.0:1767320154.074677:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320154.074681:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320154.074684:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379941632:0@lo:38:kworker.0
00000100:00100000:1.0:1767320154.075174:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320154.075208:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320154.075219:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379941248:0@lo:400:kworker.0
00000100:00100000:1.0:1767320154.075249:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320154.075253:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776
00000100:00100000:3.0:1767320154.075267:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379941120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320154.075281:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379941504
00000100:00100000:1.0:1767320154.075288:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379941504
00000100:00100000:3.0:1767320154.075324:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379941120:12345-0@lo:400:kworker.0 Request processed in 62us (2923us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320154.075326:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379941248
00000100:00100000:1.0:1767320154.075332:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379941248
00000100:00100000:3.0:1767320154.075336:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776
00000100:00100000:1.0:1767320154.075373:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4673
00000100:00100000:3.0:1767320154.075380:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379941120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320154.075385:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379941504:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320154.075422:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379941504:12345-0@lo:400:kworker.0 Request processed in 42us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320154.075429:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4673
00000100:00100000:1.0:1767320154.075445:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4674
00000100:00100000:1.0:1767320154.075450:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379941248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320154.075474:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379941248:12345-0@lo:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320154.075479:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4674
00000100:00100000:1.0:1767320154.075507:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379941248:0@lo:400:kworker.0
00000100:00100000:1.0:1767320154.075529:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379941504:0@lo:400:kworker.0
00000100:00080000:2.0:1767320154.076224:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320154.076232:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320154.076235:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320154.077641:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379940992:12345-0@lo:400:kworker.0 Request processed in 5013us (5311us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320154.077655:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775
00000100:00100000:3.0:1767320154.078251:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379940992:0@lo:400:kworker.0
00010000:00010000:2.0:1767320154.647025:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320155.023729:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320155.023824:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320155.023916:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291958016
00000100:00100000:1.0:1767320155.023926:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291958016
00000100:00100000:1.0:1767320155.024000:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291957888
00000100:00100000:1.0:1767320155.024004:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291957888
00000100:00100000:1.0:1767320155.024027:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4675
00000100:00100000:1.0:1767320155.024037:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291958016:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320155.024089:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17537
00000100:00100000:3.0:1767320155.024097:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291957888:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320155.024120:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320155.024121:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291958016:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (398us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320155.024134:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4675
00000100:00100000:3.0:1767320155.024156:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291957888:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (336us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320155.024164:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17537
00000100:00080000:2.0:1767320155.024295:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320155.672258:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320156.120523:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320156.120542:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379941760:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320156.120622:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320156.121137:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379941760
00000100:00100000:3.0:1767320156.121146:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379941760
00000100:00100000:3.0:1767320156.121285:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566
00000100:00100000:3.0:1767320156.121295:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379941760:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320156.121325:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320156.121401:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379941760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (779us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320156.121408:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566
00000100:00100000:2.0:1767320156.121574:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379941760:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320156.126343:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320156.695261:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320157.656457:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379941888:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320157.656531:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320157.660072:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379941888
00000100:00100000:1.0:1767320157.660088:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379941888
00000100:00100000:1.0:1767320157.660185:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567
00000100:00100000:1.0:1767320157.660196:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379941888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320157.660232:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320157.660339:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320157.673103:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379941888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 12897us (16559us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320157.673120:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567
00000100:00100000:2.0:1767320157.673287:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379941888:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320157.719095:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320158.743174:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320159.191049:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320159.191061:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320159.191063:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320159.191067:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320159.191071:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320159.191079:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5056
00000100:00080000:0.0:1767320159.191083:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320159.191089:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320159.191138:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379942016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320159.191161:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320159.191165:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320159.191167:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320159.191171:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5056
00000100:00080000:0.0:1767320159.191173:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320159.191177:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320159.191189:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ed80 x1853164379942144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320159.191247:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320159.191250:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320159.191252:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320159.191255:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5056
00000100:00080000:0.0:1767320159.191257:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320159.191260:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320159.191268:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379942272:0@lo:400:kworker.0
00000100:00100000:0.0:1767320159.191270:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e300 x1853164379942656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320159.191283:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320159.191286:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320159.191288:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320159.191291:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5056
00000100:00080000:0.0:1767320159.191293:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320159.191296:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320159.191304:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9df80 x1853164379942912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320159.191335:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320159.191341:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379942400:0@lo:400:kworker.0
00000100:00100000:0.0:1767320159.191371:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320159.191415:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942272
00000100:00100000:1.0:1767320159.191420:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942400
00000100:00100000:0.0:1767320159.191424:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942272
00000100:00100000:1.0:1767320159.191424:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942400
00000100:00100000:0.0:1767320159.191475:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777
00000100:00100000:0.0:1767320159.191484:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379942272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320159.191502:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379942528:0@lo:400:kworker.0
00000100:00100000:0.0:1767320159.191531:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379942272:12345-0@lo:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320159.191539:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777
00000100:00100000:2.0:1767320159.191541:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320159.191563:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320159.191568:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379942784:0@lo:400:kworker.0
00000100:00100000:2.0:1767320159.191590:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320159.191616:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942528
00000100:00100000:2.0:1767320159.191620:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942528
00000100:00100000:3.0:1767320159.191628:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379942016:0@lo:38:kworker.0
00000100:00100000:3.0:1767320159.191654:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320159.191690:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379942144:0@lo:38:kworker.0
00000100:00100000:3.0:1767320159.191713:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320159.191736:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379942656:0@lo:38:kworker.0
00000100:00100000:3.0:1767320159.191769:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320159.192714:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379942912:0@lo:38:kworker.0
00000100:00100000:3.0:1767320159.192762:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320159.192882:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778
00000100:00100000:1.0:1767320159.192894:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379942400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320159.193000:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942784
00000100:00100000:3.0:1767320159.193006:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942784
00000100:00100000:3.0:1767320159.193048:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942016
00000100:00100000:3.0:1767320159.193052:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942016
00000100:00100000:3.0:1767320159.193061:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942656
00000100:00100000:3.0:1767320159.193064:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942656
00000100:00100000:1.0:1767320159.193103:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379942400:12345-0@lo:400:kworker.0 Request processed in 213us (1730us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320159.193111:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778
00000100:00100000:1.0:1767320159.193136:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942912
00000100:00100000:1.0:1767320159.193139:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942912
00000100:00100000:1.0:1767320159.193152:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4676
00000100:00100000:1.0:1767320159.193159:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379942784:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320159.193196:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379942784:12345-0@lo:400:kworker.0 Request processed in 37us (1604us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320159.193202:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4676
00000100:00100000:1.0:1767320159.193215:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17538
00000100:00100000:1.0:1767320159.193219:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379942016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320159.193237:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320159.193248:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17539
00000100:00100000:3.0:1767320159.193253:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379942912:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320159.193264:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320159.193268:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379942016:12345-0@lo:38:kworker.0 Request processed in 48us (1613us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320159.193274:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17538
00000100:00100000:1.0:1767320159.193286:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17540
00000100:00100000:3.0:1767320159.193287:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379942912:12345-0@lo:38:kworker.0 Request processed in 32us (524us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320159.193290:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379942656:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320159.193292:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17539
00010000:00020000:1.0:1767320159.193299:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320159.193325:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379942656:12345-0@lo:38:kworker.0 Request processed in 34us (1555us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767320159.193328:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320159.193331:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17540
00000100:00080000:3.0:1767320159.193332:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320159.193335:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379942016:0@lo:38:kworker.0
00000100:00080000:3.0:1767320159.193345:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320159.193348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320159.193350:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379942656:0@lo:38:kworker.0
00000100:00080000:3.0:1767320159.193357:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320159.193360:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379942272:0@lo:400:kworker.0
00000100:00080000:3.0:1767320159.193360:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320159.193362:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379942912:0@lo:38:kworker.0
00000100:00100000:3.0:1767320159.193407:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379942144
00000100:00100000:3.0:1767320159.193411:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379942144
00000100:00100000:3.0:1767320159.193432:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124
00000100:00100000:3.0:1767320159.193436:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379942144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320159.193446:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320159.193475:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379942144:12345-0@lo:38:kworker.0 Request processed in 37us (1761us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320159.193481:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124
00000100:00100000:1.0:1767320159.193497:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379942400:0@lo:400:kworker.0
00000100:00080000:3.0:1767320159.193505:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320159.193508:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320159.193512:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379942144:0@lo:38:kworker.0
00000100:00100000:3.0:1767320159.193540:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379942784:0@lo:400:kworker.0
00000100:00080000:0.0:1767320159.193625:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320159.193630:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320159.193633:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320159.193763:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4677
00000100:00100000:2.0:1767320159.193772:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379942528:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320159.193806:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379942528:12345-0@lo:400:kworker.0 Request processed in 37us (2264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320159.193812:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4677
00000100:00100000:3.0:1767320159.194106:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379942528:0@lo:400:kworker.0
00010000:00010000:3.0:1767320159.769098:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320160.147032:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320160.147124:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320160.147311:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291958272
00000100:00100000:2.0:1767320160.147322:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291958272
00000100:00100000:2.0:1767320160.147411:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291958144
00000100:00100000:2.0:1767320160.147415:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291958144
00000100:00100000:2.0:1767320160.147437:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4678
00000100:00100000:2.0:1767320160.147447:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291958272:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320160.147538:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291958272:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (525us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320160.147546:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4678
00000100:00100000:2.0:1767320160.147567:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17541
00000100:00100000:2.0:1767320160.147572:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291958144:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320160.147596:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320160.147624:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291958144:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 50us (499us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320160.147630:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17541
00000100:00080000:0.0:1767320160.147638:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320160.791678:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320161.239884:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320161.239908:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379943040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320161.240031:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320161.241095:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943040
00000100:00100000:3.0:1767320161.241110:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943040
00000100:00100000:3.0:1767320161.241733:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568
00000100:00100000:3.0:1767320161.241746:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379943040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320161.241788:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320161.241919:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379943040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (1888us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320161.241928:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568
00000100:00100000:3.0:1767320161.242008:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379943040:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320161.242230:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320161.815790:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320162.775252:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379943168:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320162.775353:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320162.776451:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943168
00000100:00100000:2.0:1767320162.776465:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943168
00000100:00100000:2.0:1767320162.776565:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569
00000100:00100000:2.0:1767320162.776577:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379943168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320162.776618:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767320162.776776:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320162.776913:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379943168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 338us (1559us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320162.776922:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569
00000100:00100000:0.0:1767320162.781742:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379943168:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320162.839468:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320163.865778:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320164.312685:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320164.312700:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320164.312703:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320164.312708:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320164.312713:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320164.312724:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5061
00000100:00080000:3.0:1767320164.312730:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320164.312739:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320164.312796:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379943296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320164.312818:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320164.312822:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320164.312824:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320164.312829:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5061
00000100:00080000:3.0:1767320164.312831:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320164.312835:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320164.312851:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164379943424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320164.312992:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320164.312996:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320164.312998:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320164.313002:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5061
00000100:00080000:3.0:1767320164.313004:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320164.313008:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320164.313021:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907100 x1853164379943936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320164.313038:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320164.313042:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320164.313044:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320164.313048:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5061
00000100:00080000:3.0:1767320164.313050:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320164.313056:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320164.313069:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ad880 x1853164379944192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320164.313142:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379943296:0@lo:38:kworker.0
00000100:00100000:3.0:1767320164.313236:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320164.313315:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379943424:0@lo:38:kworker.0
00000100:00100000:3.0:1767320164.313347:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320164.313374:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379943936:0@lo:38:kworker.0
00000100:00100000:3.0:1767320164.313398:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320164.313415:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379944192:0@lo:38:kworker.0
00000100:00100000:3.0:1767320164.313437:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320164.313497:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943296
00000100:00100000:3.0:1767320164.313505:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943296
00000100:00100000:3.0:1767320164.313546:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943936
00000100:00100000:3.0:1767320164.313549:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943936
00000100:00100000:3.0:1767320164.313565:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379944192
00000100:00100000:3.0:1767320164.313567:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379944192
00000100:00100000:3.0:1767320164.313587:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17542
00000100:00100000:3.0:1767320164.313595:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379943296:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320164.313622:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320164.313672:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379943296:12345-0@lo:38:kworker.0 Request processed in 74us (435us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320164.313681:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17542
00000100:00100000:3.0:1767320164.313700:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17543
00000100:00100000:3.0:1767320164.313704:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379943936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320164.313713:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320164.313741:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379943936:12345-0@lo:38:kworker.0 Request processed in 35us (342us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320164.313747:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17543
00000100:00100000:3.0:1767320164.313757:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17544
00000100:00100000:3.0:1767320164.313761:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379944192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320164.313769:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320164.313790:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379944192:12345-0@lo:38:kworker.0 Request processed in 28us (353us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320164.313796:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17544
00000100:00100000:3.0:1767320164.313815:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943424
00000100:00100000:3.0:1767320164.313819:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943424
00000100:00100000:3.0:1767320164.313840:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125
00000100:00100000:3.0:1767320164.313844:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379943424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320164.313854:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320164.313923:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379943424:12345-0@lo:38:kworker.0 Request processed in 77us (576us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320164.313929:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125
00000100:00080000:3.0:1767320164.313981:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320164.313995:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320164.313999:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379943296:0@lo:38:kworker.0
00000100:00080000:3.0:1767320164.314011:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320164.314014:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320164.314017:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379943424:0@lo:38:kworker.0
00000100:00080000:3.0:1767320164.314024:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320164.314027:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320164.314031:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379943936:0@lo:38:kworker.0
00000100:00080000:3.0:1767320164.314038:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320164.314041:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320164.314044:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379944192:0@lo:38:kworker.0
00000100:00100000:3.0:1767320164.314097:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379944064:0@lo:400:kworker.0
00000100:00100000:3.0:1767320164.314126:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320164.314149:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320164.314155:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379943808:0@lo:400:kworker.0
00000100:00100000:3.0:1767320164.314176:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320164.314201:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379944064
00000100:00100000:3.0:1767320164.314205:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379944064
00000100:00100000:3.0:1767320164.314248:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943808
00000100:00100000:3.0:1767320164.314251:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943808
00000100:00100000:3.0:1767320164.314269:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4679
00000100:00100000:3.0:1767320164.314274:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379944064:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320164.314318:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379944064:12345-0@lo:400:kworker.0 Request processed in 43us (192us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320164.314324:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4679
00000100:00100000:3.0:1767320164.314335:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4680
00000100:00100000:3.0:1767320164.314341:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379943808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320164.314363:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379943808:12345-0@lo:400:kworker.0 Request processed in 23us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320164.314368:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4680
00000100:00100000:3.0:1767320164.314397:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379943808:0@lo:400:kworker.0
00000100:00100000:3.0:1767320164.314405:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379944064:0@lo:400:kworker.0
00000100:00100000:1.0:1767320164.315075:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379943680:0@lo:400:kworker.0
00000100:00100000:1.0:1767320164.315129:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320164.315173:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320164.315180:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379943552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320164.315204:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320164.315244:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320164.315266:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943680
00000100:00100000:1.0:1767320164.315271:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943680
00000100:00100000:1.0:1767320164.315316:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379943552
00000100:00100000:1.0:1767320164.315319:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379943552
00000100:00100000:1.0:1767320164.315343:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779
00000100:00100000:1.0:1767320164.315350:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379943680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320164.315393:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379943680:12345-0@lo:400:kworker.0 Request processed in 44us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320164.315400:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779
00000100:00100000:1.0:1767320164.315419:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780
00000100:00100000:1.0:1767320164.315424:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379943552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320164.315446:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379943552:12345-0@lo:400:kworker.0 Request processed in 23us (242us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320164.315451:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780
00000100:00080000:1.0:1767320164.315490:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320164.315493:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320164.315513:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379943552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320164.315521:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379943680:0@lo:400:kworker.0
00010000:00010000:1.0:1767320164.892210:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767320165.266504:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291958400 offset 0 length 520: 4
00000100:00100000:2.0:1767320165.266562:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320165.266636:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320165.266696:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291958528
00000100:00100000:1.0:1767320165.266709:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291958528
00000100:00100000:1.0:1767320165.266746:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291958656
00000100:00100000:1.0:1767320165.266748:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291958656
00000100:00080000:3.0:1767320165.266803:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320165.266842:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17545
00000100:00100000:0.0:1767320165.266858:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291958528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320165.266922:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320165.267032:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291958528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 174us (471us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320165.268125:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4681
00000100:00100000:2.0:1767320165.268151:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291958656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320165.268239:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291958656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (1602us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320165.268278:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17545
00000100:00100000:2.0:1767320165.268461:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4681
00010000:00010000:2.0:1767320165.911197:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320166.359647:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379944320:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320166.359745:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320166.360168:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379944320
00000100:00100000:3.0:1767320166.360179:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379944320
00000100:00100000:3.0:1767320166.360269:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570
00000100:00100000:3.0:1767320166.360282:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379944320:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320166.360322:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320166.360438:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379944320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (692us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320166.360447:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570
00000100:00080000:1.0:1767320166.360549:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320166.362118:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379944320:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320166.935325:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320167.895255:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379944448:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320167.895351:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320167.895446:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379944448
00000100:00100000:2.0:1767320167.895559:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379944448
00000100:00100000:2.0:1767320167.895657:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571
00000100:00100000:2.0:1767320167.895671:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379944448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320167.895716:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767320167.895830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320167.904215:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379944448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8530us (8846us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320167.904239:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571
00000100:00100000:1.0:1767320167.913354:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379944448:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320167.959215:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320168.407252:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320143/real 1767320143]  req@ffff8b0e0bef6680 x1853164379938048/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320168 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320168.407296:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bef6680 x1853164379938048/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320168 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320168.407316:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320168.407335:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320168.407339:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379938048:0@lo:250:kworker.0
00000100:00080000:3.0:1767320168.407466:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320168.407475:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320168.407479:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320168.407486:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5046
00000100:00080000:3.0:1767320168.407492:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320168.407500:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320168.407540:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23480 x1853164379944576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320168.407654:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320168.407659:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320168.407661:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320168.407666:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5066
00000100:00080000:3.0:1767320168.407668:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320168.407673:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320168.407696:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ad880 x1853164379944704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320168.407708:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379944576:0@lo:250:kworker.0
00000100:00080000:3.0:1767320168.407712:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320168.407718:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320168.407720:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320168.407725:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5066
00000100:00080000:3.0:1767320168.407727:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320168.407731:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320168.407749:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10905180 x1853164379944832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000400:00000100:0.0:1767320168.407772:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379944576 offset 0 length 520: 4
00000100:00100000:0.0:1767320168.407826:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379944704:0@lo:38:kworker.0
00000100:00100000:0.0:1767320168.407865:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320168.407987:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320168.407990:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320168.407993:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320168.407997:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5066
00000100:00080000:3.0:1767320168.408000:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320168.408004:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320168.408016:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907100 x1853164379945216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320168.408042:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767320168.408218:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379945088:0@lo:400:kworker.0
00000100:00100000:2.0:1767320168.408287:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379945344:0@lo:400:kworker.0
00000100:00100000:1.0:1767320168.408527:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379944960:0@lo:400:kworker.0
00000100:00100000:1.0:1767320168.408576:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320168.408603:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320168.408608:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320168.408614:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5066
00000100:00080000:3.0:1767320168.408620:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320168.408628:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320168.408662:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164379945472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320168.408996:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379944960
00000100:00100000:2.0:1767320168.409007:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379944960
00000100:00100000:2.0:1767320168.409086:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781
00000100:00100000:2.0:1767320168.409097:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379944960:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320168.409170:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379944960:12345-0@lo:400:kworker.0 Request processed in 75us (594us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320168.409177:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781
00000100:00100000:1.0:1767320168.409284:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320168.409305:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379944832:0@lo:38:kworker.0
00000100:00100000:1.0:1767320168.409330:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379944704
00000100:00100000:1.0:1767320168.409336:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379944704
00000100:00100000:1.0:1767320168.409358:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945344
00000100:00100000:1.0:1767320168.409361:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945344
00000100:00100000:0.0:1767320168.409367:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320168.409399:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4682
00000100:00100000:0.0:1767320168.409412:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379945216:0@lo:38:kworker.0
00000100:00100000:1.0:1767320168.409413:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379945344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320168.409471:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379945344:12345-0@lo:400:kworker.0 Request processed in 65us (187us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320168.409483:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320168.409485:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4682
00000100:00100000:0.0:1767320168.409516:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379945472:0@lo:38:kworker.0
00000100:00080000:2.0:1767320168.409523:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320168.409532:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320168.409551:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320168.409640:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945216
00000100:00100000:1.0:1767320168.409644:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945216
00000100:00100000:1.0:1767320168.409657:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17546
00000100:00100000:1.0:1767320168.409661:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379944704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320168.409680:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320168.409709:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379944704:12345-0@lo:38:kworker.0 Request processed in 47us (1845us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320168.409713:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17546
00000100:00100000:1.0:1767320168.409721:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17547
00000100:00100000:1.0:1767320168.409723:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379945216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320168.409728:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320168.409742:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379945216:12345-0@lo:38:kworker.0 Request processed in 18us (271us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320168.409745:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17547
00000100:00100000:1.0:1767320168.409775:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379945344:0@lo:400:kworker.0
00000100:00100000:1.0:1767320168.409807:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379944832
00000100:00100000:1.0:1767320168.409810:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379944832
00000100:00100000:1.0:1767320168.409822:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126
00000100:00100000:1.0:1767320168.409825:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379944832:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320168.409832:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320168.409849:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379944832:12345-0@lo:38:kworker.0 Request processed in 23us (491us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320168.409853:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126
00000100:00100000:1.0:1767320168.409934:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379944960:0@lo:400:kworker.0
00000100:00100000:2.0:1767320168.411713:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945472
00000100:00100000:2.0:1767320168.411728:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945472
00000100:00100000:1.0:1767320168.411855:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17548
00000100:00100000:1.0:1767320168.411891:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379945472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320168.411917:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320168.411992:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379945472:12345-0@lo:38:kworker.0 Request processed in 124us (2441us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320168.411999:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17548
00000100:00100000:1.0:1767320168.412051:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320168.412086:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945088
00000100:00100000:1.0:1767320168.412093:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945088
00000100:00100000:1.0:1767320168.412141:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4683
00000100:00100000:1.0:1767320168.412147:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379945088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320168.412190:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379945088:12345-0@lo:400:kworker.0 Request processed in 43us (139us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320168.412196:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4683
00000100:00100000:1.0:1767320168.412239:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379945088:0@lo:400:kworker.0
00000100:00080000:0.0:1767320168.412350:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320168.412357:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320168.412360:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379944704:0@lo:38:kworker.0
00000100:00080000:0.0:1767320168.412389:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320168.412394:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320168.412397:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379944832:0@lo:38:kworker.0
00000100:00080000:0.0:1767320168.412408:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320168.412412:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320168.412414:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379945216:0@lo:38:kworker.0
00000100:00080000:0.0:1767320168.412422:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320168.412425:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320168.412428:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379945472:0@lo:38:kworker.0
00000100:00080000:0.0:1767320168.412460:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320168.984364:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320170.011347:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320170.383442:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320170.383750:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291958784
00000100:00100000:3.0:1767320170.383764:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291958784
00000100:00100000:3.0:1767320170.383825:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17549
00000100:00100000:3.0:1767320170.383835:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291958784:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320170.383866:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320170.384017:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291958784:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 181us (587us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320170.384026:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17549
00000100:00100000:0.0:1767320170.405205:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320170.405398:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291958912
00000100:00100000:2.0:1767320170.405411:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291958912
00000100:00100000:2.0:1767320170.405551:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4684
00000100:00100000:2.0:1767320170.405562:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291958912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320170.405695:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291958912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 134us (506us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320170.405705:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4684
00000100:00080000:0.0:1767320170.406573:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320171.033510:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320171.479693:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320171.480041:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379945600:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320171.480138:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320171.480844:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945600
00000100:00100000:0.0:1767320171.480859:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945600
00000100:00100000:0.0:1767320171.481003:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572
00000100:00100000:0.0:1767320171.481016:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379945600:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320171.481058:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320171.481125:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379945600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (985us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320171.481132:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572
00000100:00080000:2.0:1767320171.481407:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320171.483513:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379945600:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320172.055076:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320173.015529:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379945728:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320173.015635:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320173.015782:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945728
00000100:00100000:3.0:1767320173.015792:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945728
00000100:00100000:3.0:1767320173.015865:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573
00000100:00100000:3.0:1767320173.015915:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379945728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320173.015951:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767320173.016574:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320173.016834:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379945728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 927us (1196us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320173.016845:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573
00000100:00100000:1.0:1767320173.017079:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379945728:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320173.080225:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320173.528088:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320173.528103:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320173.528107:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320173.528112:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320173.528117:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320173.528128:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5070
00000100:00080000:3.0:1767320173.528133:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320173.528143:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320173.528199:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379945856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320173.528234:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320173.528238:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320173.528240:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320173.528245:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5070
00000100:00080000:3.0:1767320173.528247:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320173.528251:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320173.528265:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164379945984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320173.528366:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320173.528370:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320173.528372:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320173.528377:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5070
00000100:00080000:3.0:1767320173.528379:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320173.528383:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320173.528398:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b97100 x1853164379946368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320173.528414:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320173.528418:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320173.528420:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320173.528436:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5070
00000100:00080000:3.0:1767320173.528439:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320173.528449:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379945856:0@lo:38:kworker.0
00000100:00080000:3.0:1767320173.528449:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320173.528462:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b97480 x1853164379946624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320173.528532:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320173.528544:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320173.528549:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379946112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320173.528599:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320173.528625:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379945984:0@lo:38:kworker.0
00000100:00100000:0.0:1767320173.528657:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320173.528696:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379946368:0@lo:38:kworker.0
00000100:00100000:0.0:1767320173.528720:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320173.528746:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379946496:0@lo:400:kworker.0
00000100:00100000:0.0:1767320173.528747:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379946624:0@lo:38:kworker.0
00000100:00100000:0.0:1767320173.528788:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320173.528811:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379946112
00000100:00100000:1.0:1767320173.528821:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379946112
00000100:00100000:0.0:1767320173.528829:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945856
00000100:00100000:0.0:1767320173.528835:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945856
00000100:00100000:0.0:1767320173.528895:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379946368
00000100:00100000:0.0:1767320173.528909:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379946368
00000100:00100000:1.0:1767320173.528926:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782
00000100:00100000:0.0:1767320173.528931:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379946624
00000100:00100000:0.0:1767320173.528936:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379946624
00000100:00100000:1.0:1767320173.528940:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379946112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320173.528957:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17550
00000100:00100000:0.0:1767320173.528963:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379945856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320173.528987:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320173.529009:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379946112:12345-0@lo:400:kworker.0 Request processed in 72us (409us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320173.529021:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782
00000100:00100000:0.0:1767320173.529033:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379945856:12345-0@lo:38:kworker.0 Request processed in 67us (489us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320173.529041:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17550
00000100:00100000:1.0:1767320173.529058:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320173.529063:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17551
00000100:00100000:0.0:1767320173.529069:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379946368:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320173.529079:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00010000:00020000:0.0:1767320173.529080:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320173.529089:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379946240:0@lo:400:kworker.0
00000100:00100000:0.0:1767320173.529114:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379946368:12345-0@lo:38:kworker.0 Request processed in 44us (393us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320173.529124:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17551
00000100:00100000:1.0:1767320173.529126:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320173.529139:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379946496
00000100:00100000:0.0:1767320173.529144:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379946496
00000100:00080000:1.0:1767320173.529153:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320173.529161:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320173.529169:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379946240
00000100:00100000:0.0:1767320173.529173:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379946240
00000100:00100000:1.0:1767320173.529180:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4685
00000100:00100000:1.0:1767320173.529190:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379946496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320173.529200:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4686
00000100:00100000:0.0:1767320173.529209:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379946240:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320173.529237:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379946496:12345-0@lo:400:kworker.0 Request processed in 48us (180us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320173.529246:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4685
00000100:00100000:0.0:1767320173.529251:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379946240:12345-0@lo:400:kworker.0 Request processed in 42us (127us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320173.529258:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4686
00000100:00100000:1.0:1767320173.529269:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17552
00000100:00100000:1.0:1767320173.529275:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379946624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320173.529287:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320173.529310:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320173.529317:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379946624:12345-0@lo:38:kworker.0 Request processed in 40us (527us total) trans 0 rc -19/-19
00000100:00080000:0.0:1767320173.529319:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320173.529327:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379945856:0@lo:38:kworker.0
00000100:00100000:1.0:1767320173.529331:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17552
00000100:00080000:0.0:1767320173.529342:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320173.529348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00080000:1.0:1767320173.529351:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320173.529352:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379946368:0@lo:38:kworker.0
00000100:00100000:1.0:1767320173.529381:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379946240:0@lo:400:kworker.0
00000100:00080000:0.0:1767320173.529385:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320173.529391:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320173.529395:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379946624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320173.529400:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379946496:0@lo:400:kworker.0
00000100:00100000:3.0:1767320173.529526:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379946112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320173.529601:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379945984
00000100:00100000:2.0:1767320173.529606:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379945984
00000100:00100000:2.0:1767320173.529640:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127
00000100:00100000:2.0:1767320173.529646:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379945984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320173.529663:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320173.530277:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379945984:12345-0@lo:38:kworker.0 Request processed in 628us (1616us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320173.530286:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127
00000100:00080000:0.0:1767320173.530403:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320173.530408:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320173.530412:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379945984:0@lo:38:kworker.0
00010000:00010000:2.0:1767320174.103844:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320175.129444:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320175.503385:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320175.503561:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291959168
00000100:00100000:3.0:1767320175.503581:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291959168
00000100:00080000:1.0:1767320175.503957:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320175.504192:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4687
00000100:00100000:3.0:1767320175.504203:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291959168:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320175.504378:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291959168:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 176us (1010us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320175.504388:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4687
00000100:00100000:1.0:1767320175.513673:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320175.513966:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291959040
00000100:00100000:2.0:1767320175.513997:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291959040
00000100:00100000:2.0:1767320175.514077:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17553
00000100:00100000:2.0:1767320175.514089:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291959040:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320175.514122:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320175.514225:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291959040:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 136us (562us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320175.514233:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17553
00010000:00010000:3.0:1767320176.154072:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320176.599251:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320176.599282:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379946752:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320176.599389:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320176.607120:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379946752
00000100:00100000:3.0:1767320176.607145:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379946752
00000100:00080000:1.0:1767320176.607237:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320176.607267:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574
00000100:00100000:3.0:1767320176.607283:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379946752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320176.607330:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320176.607469:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379946752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 190us (8079us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320176.607478:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574
00000100:00100000:1.0:1767320176.607701:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379946752:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320177.175224:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320178.136702:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379946880:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320178.136785:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320178.136927:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379946880
00000100:00100000:3.0:1767320178.136936:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379946880
00000100:00100000:3.0:1767320178.137027:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575
00000100:00100000:3.0:1767320178.137037:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379946880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320178.137066:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767320178.137148:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320178.137634:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379946880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 597us (846us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.137644:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575
00000100:00100000:1.0:1767320178.137719:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379946880:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320178.199979:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320178.647177:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320178.647191:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320178.647194:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320178.647199:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320178.647204:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320178.647213:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5075
00000100:00080000:3.0:1767320178.647219:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320178.647227:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320178.647268:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b96680 x1853164379947008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320178.648483:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379947008:0@lo:38:kworker.0
00000100:00100000:0.0:1767320178.648562:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320178.648758:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320178.648763:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320178.648767:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320178.648772:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5075
00000100:00080000:3.0:1767320178.648775:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320178.648781:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320178.648805:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b94380 x1853164379947136/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320178.648942:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947008
00000100:00100000:1.0:1767320178.648951:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947008
00000100:00100000:1.0:1767320178.649007:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17554
00000100:00100000:1.0:1767320178.649014:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379947008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320178.649035:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320178.649368:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379947136:0@lo:38:kworker.0
00000100:00100000:0.0:1767320178.649398:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320178.649465:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947136
00000100:00100000:2.0:1767320178.649469:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947136
00000100:00100000:2.0:1767320178.649493:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128
00000100:00100000:2.0:1767320178.649499:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379947136:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320178.649510:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320178.649540:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379947136:12345-0@lo:38:kworker.0 Request processed in 40us (140us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320178.649546:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128
00000100:00080000:3.0:1767320178.649756:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320178.649760:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320178.649762:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320178.649767:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5075
00000100:00080000:3.0:1767320178.649770:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320178.649773:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320178.649789:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b95500 x1853164379947648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320178.649808:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320178.649811:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320178.649813:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320178.649816:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5075
00000100:00080000:3.0:1767320178.649819:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320178.649822:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320178.649831:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b96a00 x1853164379947904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320178.649907:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379947392:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.649938:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320178.649965:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320178.649970:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379947264:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650005:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320178.650031:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947392
00000100:00100000:3.0:1767320178.650036:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947392
00000100:00100000:3.0:1767320178.650067:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947264
00000100:00100000:3.0:1767320178.650071:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947264
00000100:00100000:3.0:1767320178.650098:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783
00000100:00100000:3.0:1767320178.650103:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379947392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650156:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379947392:12345-0@lo:400:kworker.0 Request processed in 52us (217us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.650161:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783
00000100:00100000:3.0:1767320178.650172:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784
00000100:00100000:3.0:1767320178.650178:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379947264:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650198:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379947264:12345-0@lo:400:kworker.0 Request processed in 22us (194us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.650203:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784
00000100:00100000:3.0:1767320178.650230:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379947264:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650238:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379947392:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650255:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379947776:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650276:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320178.650292:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320178.650297:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379947520:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650315:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320178.650363:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947776
00000100:00100000:3.0:1767320178.650366:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947776
00000100:00100000:3.0:1767320178.650391:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947520
00000100:00100000:3.0:1767320178.650394:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947520
00000100:00100000:3.0:1767320178.650414:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4688
00000100:00100000:3.0:1767320178.650420:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379947776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650451:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379947776:12345-0@lo:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.650457:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4688
00000100:00100000:3.0:1767320178.650467:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4689
00000100:00100000:3.0:1767320178.650473:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379947520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650493:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379947520:12345-0@lo:400:kworker.0 Request processed in 21us (178us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320178.650501:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4689
00000100:00100000:3.0:1767320178.650521:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379947520:0@lo:400:kworker.0
00000100:00100000:3.0:1767320178.650529:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379947776:0@lo:400:kworker.0
00000100:00080000:2.0:1767320178.650929:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320178.650934:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320178.651090:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379947008:12345-0@lo:38:kworker.0 Request processed in 2075us (2526us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320178.651098:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17554
00000100:00080000:0.0:1767320178.651149:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320178.651154:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320178.651157:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379947008:0@lo:38:kworker.0
00000100:00100000:0.0:1767320178.651172:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379947648:0@lo:38:kworker.0
00000100:00100000:0.0:1767320178.651195:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320178.651245:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379947904:0@lo:38:kworker.0
00000100:00100000:0.0:1767320178.651261:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320178.651352:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320178.651356:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320178.651358:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379947136:0@lo:38:kworker.0
00000100:00100000:1.0:1767320178.651470:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947648
00000100:00100000:1.0:1767320178.651475:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947648
00000100:00100000:2.0:1767320178.651502:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379947904
00000100:00100000:2.0:1767320178.651505:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379947904
00000100:00100000:2.0:1767320178.651526:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17555
00000100:00100000:2.0:1767320178.651530:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379947648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320178.651544:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320178.651581:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379947648:12345-0@lo:38:kworker.0 Request processed in 49us (385us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320178.651586:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17555
00000100:00100000:2.0:1767320178.651596:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17556
00000100:00100000:2.0:1767320178.651599:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379947904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320178.651607:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320178.651622:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379947904:12345-0@lo:38:kworker.0 Request processed in 21us (359us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320178.651626:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17556
00000100:00080000:0.0:1767320178.651698:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320178.651701:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320178.651704:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379947648:0@lo:38:kworker.0
00000100:00080000:0.0:1767320178.651711:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320178.651714:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320178.651716:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379947904:0@lo:38:kworker.0
00010000:00010000:2.0:1767320179.223150:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320180.247437:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320180.627934:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320180.628440:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291959424
00000100:00100000:1.0:1767320180.628451:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291959424
00000100:00100000:3.0:1767320180.628475:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320180.628568:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291959296
00000100:00100000:0.0:1767320180.628573:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291959296
00000100:00100000:0.0:1767320180.628617:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17557
00000100:00100000:0.0:1767320180.628627:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291959296:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320180.628652:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320180.628715:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291959296:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 86us (250us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320180.628726:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17557
00000100:00100000:1.0:1767320180.628946:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4690
00000100:00100000:1.0:1767320180.628954:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291959424:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320180.629122:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291959424:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 169us (1198us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320180.629130:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4690
00000100:00080000:2.0:1767320180.629350:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320181.271122:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320181.719772:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320181.719800:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379948032:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320181.719944:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320181.720341:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948032
00000100:00100000:3.0:1767320181.720352:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948032
00000100:00100000:3.0:1767320181.720671:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576
00000100:00100000:3.0:1767320181.720687:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379948032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320181.720727:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320181.720804:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379948032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (860us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320181.720812:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576
00000100:00100000:1.0:1767320181.721078:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379948032:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320181.721838:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320182.298457:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320183.255643:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379948160:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320183.255739:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320183.255998:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948160
00000100:00100000:3.0:1767320183.256010:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948160
00000100:00100000:3.0:1767320183.256094:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577
00000100:00100000:3.0:1767320183.256104:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379948160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320183.256143:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320183.256203:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379948160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (464us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320183.256211:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577
00000100:00080000:0.0:1767320183.256282:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320183.256590:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379948160:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320183.322450:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320183.767582:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320183.767598:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320183.767602:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320183.767606:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320183.767612:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320183.767623:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5081
00000100:00080000:2.0:1767320183.767640:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320183.767650:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320183.767745:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289180 x1853164379948288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320183.767782:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320183.767787:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320183.767789:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320183.767793:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5081
00000100:00080000:2.0:1767320183.767796:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320183.767801:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320183.768031:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379948288:0@lo:38:kworker.0
00000100:00100000:1.0:1767320183.768121:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.768316:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b100 x1853164379948416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320183.768470:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320183.768474:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320183.768476:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320183.768480:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5081
00000100:00080000:2.0:1767320183.768483:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320183.768487:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320183.768497:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a680 x1853164379948928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320183.768513:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320183.768517:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320183.768518:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320183.768522:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5081
00000100:00080000:2.0:1767320183.768524:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320183.768528:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320183.768535:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ad80 x1853164379949184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320183.768567:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379948544:0@lo:400:kworker.0
00000100:00100000:2.0:1767320183.768605:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.768638:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320183.768644:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379948672:0@lo:400:kworker.0
00000100:00100000:2.0:1767320183.768666:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.768703:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948544
00000100:00100000:2.0:1767320183.768711:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948544
00000100:00100000:2.0:1767320183.768773:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948672
00000100:00100000:2.0:1767320183.768776:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948672
00000100:00100000:2.0:1767320183.768796:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785
00000100:00100000:2.0:1767320183.768815:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379948544:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.769616:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948288
00000100:00100000:3.0:1767320183.769625:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948288
00000100:00100000:3.0:1767320183.769666:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17558
00000100:00100000:3.0:1767320183.769673:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379948288:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320183.769704:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320183.769779:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379948288:12345-0@lo:38:kworker.0 Request processed in 105us (1657us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320183.769787:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17558
00000100:00100000:3.0:1767320183.769855:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786
00000100:00100000:3.0:1767320183.769865:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379948672:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.770090:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379948672:12345-0@lo:400:kworker.0 Request processed in 228us (1423us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320183.770098:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786
00000100:00100000:3.0:1767320183.770154:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379948672:0@lo:400:kworker.0
00000100:00100000:3.0:1767320183.770356:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379948800:0@lo:400:kworker.0
00000100:00100000:1.0:1767320183.770507:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379949056:0@lo:400:kworker.0
00000100:00100000:1.0:1767320183.770550:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320183.770591:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949056
00000100:00100000:1.0:1767320183.770596:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949056
00000100:00100000:1.0:1767320183.770634:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4691
00000100:00100000:1.0:1767320183.770641:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379949056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320183.770677:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379949056:12345-0@lo:400:kworker.0 Request processed in 37us (127us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320183.770683:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4691
00000100:00100000:1.0:1767320183.770717:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379949056:0@lo:400:kworker.0
00000100:00100000:1.0:1767320183.770736:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379948416:0@lo:38:kworker.0
00000100:00100000:1.0:1767320183.770763:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320183.770792:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379948928:0@lo:38:kworker.0
00000100:00100000:1.0:1767320183.770821:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.771135:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379948544:12345-0@lo:400:kworker.0 Request processed in 2329us (2528us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320183.771144:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785
00000100:00100000:3.0:1767320183.771259:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379948544:0@lo:400:kworker.0
00000100:00100000:1.0:1767320183.771373:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379949184:0@lo:38:kworker.0
00000100:00100000:2.0:1767320183.771469:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948416
00000100:00100000:2.0:1767320183.771474:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948416
00000100:00100000:2.0:1767320183.771496:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129
00000100:00100000:2.0:1767320183.771501:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379948416:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320183.771519:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320183.771547:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379948416:12345-0@lo:38:kworker.0 Request processed in 46us (783us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320183.771553:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129
00000100:00100000:2.0:1767320183.771577:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320183.771614:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948928
00000100:00100000:2.0:1767320183.771618:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948928
00000100:00100000:2.0:1767320183.771637:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379948800
00000100:00100000:2.0:1767320183.771641:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379948800
00000100:00100000:2.0:1767320183.771664:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4692
00000100:00100000:2.0:1767320183.771671:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379948800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320183.771704:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379948800:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320183.771710:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4692
00000100:00100000:2.0:1767320183.771721:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17559
00000100:00100000:2.0:1767320183.771726:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379948928:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320183.771735:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320183.771755:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379948928:12345-0@lo:38:kworker.0 Request processed in 28us (934us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320183.771761:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17559
00000100:00100000:2.0:1767320183.771785:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379948800:0@lo:400:kworker.0
00000100:00080000:0.0:1767320183.771937:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320183.771944:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320183.772093:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320183.772324:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320183.772331:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320183.772336:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379948288:0@lo:38:kworker.0
00000100:00080000:1.0:1767320183.772360:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320183.772364:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320183.772367:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379948416:0@lo:38:kworker.0
00000100:00080000:1.0:1767320183.772453:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320183.772459:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320183.772463:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379948928:0@lo:38:kworker.0
00000100:00100000:0.0:1767320183.772527:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949184
00000100:00100000:0.0:1767320183.772532:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949184
00000100:00100000:0.0:1767320183.772567:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17560
00000100:00100000:0.0:1767320183.772573:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379949184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320183.772587:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320183.772632:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f046cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379949184:12345-0@lo:38:kworker.0 Request processed in 57us (538us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320183.772638:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17560
00000100:00080000:1.0:1767320183.772699:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320183.772703:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320183.772706:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379949184:0@lo:38:kworker.0
00010000:00010000:3.0:1767320184.343449:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320185.367088:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320185.743443:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320185.743499:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320185.743854:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291959552
00000100:00100000:0.0:1767320185.744015:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291959552
00000100:00100000:0.0:1767320185.744084:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291959680
00000100:00100000:0.0:1767320185.744087:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291959680
00000100:00080000:3.0:1767320185.744184:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320185.744317:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4693
00000100:00100000:0.0:1767320185.744331:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291959680:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320185.744447:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291959680:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 119us (946us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320185.744456:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4693
00000100:00100000:0.0:1767320185.744483:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17561
00000100:00100000:0.0:1767320185.744488:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291959552:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320185.744514:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320185.744542:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291959552:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (1118us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320185.744549:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17561
00010000:00010000:2.0:1767320186.392661:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320186.839182:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379949312:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320186.840065:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320186.846064:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949312
00000100:00100000:1.0:1767320186.846088:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949312
00000100:00100000:1.0:1767320186.846322:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578
00000100:00100000:1.0:1767320186.846336:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379949312:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320186.846391:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320186.846516:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379949312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 183us (6455us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320186.846524:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578
00000100:00100000:2.0:1767320186.849819:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379949312:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320186.858085:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320187.418006:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320188.375774:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320188.375818:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379949440:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320188.375935:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320188.381041:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949440
00000100:00100000:1.0:1767320188.381061:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949440
00000100:00100000:1.0:1767320188.381207:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579
00000100:00100000:1.0:1767320188.381219:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379949440:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320188.381260:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320188.381354:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379949440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (5418us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320188.381493:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579
00000100:00100000:0.0:1767320188.381532:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379949440:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320188.381587:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320188.441228:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320188.887238:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320188.887254:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320188.887257:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320188.887262:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320188.887268:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320188.887278:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5086
00000100:00080000:0.0:1767320188.887284:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320188.887292:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320188.887347:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06238000 x1853164379949568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320188.887431:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379949568:0@lo:38:kworker.0
00000100:00100000:1.0:1767320188.887551:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320188.887714:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949568
00000100:00100000:3.0:1767320188.887724:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949568
00000100:00100000:3.0:1767320188.887790:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17562
00000100:00100000:3.0:1767320188.887799:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379949568:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320188.887826:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320188.887921:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320188.887925:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320188.887928:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320188.887932:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5086
00000100:00080000:0.0:1767320188.887935:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320188.887939:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320188.887956:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239180 x1853164379949696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320188.888373:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379949568:12345-0@lo:38:kworker.0 Request processed in 572us (821us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320188.888382:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17562
00000100:00100000:3.0:1767320188.888489:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320188.888580:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379949952:0@lo:400:kworker.0
00000100:00100000:3.0:1767320188.888620:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320188.888655:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379949824:0@lo:400:kworker.0
00000100:00100000:3.0:1767320188.888687:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320188.888721:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949952
00000100:00100000:3.0:1767320188.888726:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949952
00000100:00100000:2.0:1767320188.888842:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949824
00000100:00100000:2.0:1767320188.888848:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949824
00000100:00100000:2.0:1767320188.888909:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787
00000100:00100000:2.0:1767320188.888917:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379949824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320188.888986:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379949824:12345-0@lo:400:kworker.0 Request processed in 69us (298us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320188.888992:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787
00000100:00080000:2.0:1767320188.889012:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320188.889048:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379949824:0@lo:400:kworker.0
00000100:00100000:3.0:1767320188.889367:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788
00000100:00100000:3.0:1767320188.889377:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379949952:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320188.889416:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379949952:12345-0@lo:400:kworker.0 Request processed in 43us (796us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320188.889422:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788
00000100:00100000:2.0:1767320188.889503:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379949952:0@lo:400:kworker.0
00000100:00080000:1.0:1767320188.889592:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320188.889598:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320188.889601:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379949568:0@lo:38:kworker.0
00000100:00100000:1.0:1767320188.889619:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379949696:0@lo:38:kworker.0
00000100:00100000:1.0:1767320188.889652:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320188.889771:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379949696
00000100:00100000:2.0:1767320188.889776:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379949696
00000100:00100000:2.0:1767320188.889809:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130
00000100:00100000:2.0:1767320188.889815:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379949696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320188.889834:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320188.890256:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320188.890261:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320188.890264:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320188.890270:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5086
00000100:00080000:0.0:1767320188.890274:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320188.890279:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320188.890303:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623a300 x1853164379950208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320188.890321:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320188.890325:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320188.890327:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320188.890331:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5086
00000100:00080000:0.0:1767320188.890333:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320188.890337:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320188.890348:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239880 x1853164379950464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320188.890378:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379950080:0@lo:400:kworker.0
00000100:00100000:2.0:1767320188.890460:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379949696:12345-0@lo:38:kworker.0 Request processed in 643us (806us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320188.890468:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130
00000100:00100000:2.0:1767320188.890507:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379950336:0@lo:400:kworker.0
00000100:00100000:2.0:1767320188.890538:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320188.890586:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379950336
00000100:00100000:2.0:1767320188.890591:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379950336
00000100:00100000:2.0:1767320188.890634:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4694
00000100:00100000:2.0:1767320188.890642:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379950336:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767320188.890806:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320188.891064:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379950336:0@lo:400:kworker.0
00000100:00100000:2.0:1767320188.891114:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379950336:12345-0@lo:400:kworker.0 Request processed in 472us (574us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320188.891122:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4694
00000100:00080000:1.0:1767320188.891224:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320188.891230:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320188.891233:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379949696:0@lo:38:kworker.0
00000100:00100000:1.0:1767320188.891250:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379950208:0@lo:38:kworker.0
00000100:00100000:1.0:1767320188.891278:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320188.891295:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379950464:0@lo:38:kworker.0
00000100:00100000:1.0:1767320188.891315:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320188.891491:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320188.891643:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379950208
00000100:00100000:3.0:1767320188.891648:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379950208
00000100:00100000:3.0:1767320188.891691:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379950464
00000100:00100000:3.0:1767320188.891698:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379950464
00000100:00100000:3.0:1767320188.891718:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379950080
00000100:00100000:3.0:1767320188.891721:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379950080
00000100:00100000:0.0:1767320188.891743:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17563
00000100:00100000:0.0:1767320188.891751:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379950208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320188.891782:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320188.891828:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379950208:12345-0@lo:38:kworker.0 Request processed in 76us (549us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320188.892217:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17563
00000100:00100000:3.0:1767320188.892225:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4695
00000100:00100000:3.0:1767320188.892236:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379950080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320188.892241:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17564
00000100:00100000:0.0:1767320188.892249:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379950464:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320188.892262:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320188.892313:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379950080:12345-0@lo:400:kworker.0 Request processed in 79us (821us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320188.892315:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379950464:12345-0@lo:38:kworker.0 Request processed in 65us (999us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320188.892330:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4695
00000100:00100000:0.0:1767320188.892339:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17564
00000100:00080000:3.0:1767320188.892373:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320188.892383:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379950080:0@lo:400:kworker.0
00000100:00080000:0.0:1767320188.892442:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320188.892447:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320188.892451:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379950208:0@lo:38:kworker.0
00000100:00080000:0.0:1767320188.892461:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320188.892465:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320188.892469:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379950464:0@lo:38:kworker.0
00010000:00010000:1.0:1767320189.466431:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767320189.847094:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291959808 offset 0 length 520: 4
00000100:00100000:3.0:1767320189.852481:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320189.854018:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291959936
00000100:00100000:3.0:1767320189.854030:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320189.854037:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291959936
00000100:00100000:2.0:1767320189.856034:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960064
00000100:00100000:2.0:1767320189.856053:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960064
00000100:00100000:2.0:1767320189.856604:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4696
00000100:00100000:2.0:1767320189.856621:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291960064:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320189.856728:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291960064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (2709us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320189.856735:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4696
00000100:00100000:1.0:1767320189.860669:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17565
00000100:00100000:1.0:1767320189.860682:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291959936:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320189.860736:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320189.860890:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291959936:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 207us (10932us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320189.860926:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17565
00000100:00080000:3.0:1767320189.863582:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320190.487349:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320191.511324:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320191.959351:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320191.959371:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379950592:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320191.959494:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320191.960091:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379950592
00000100:00100000:1.0:1767320191.960100:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379950592
00000100:00100000:1.0:1767320191.960193:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580
00000100:00100000:1.0:1767320191.960203:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379950592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320191.960244:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320191.960295:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379950592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (800us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320191.960303:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580
00000100:00080000:3.0:1767320191.960375:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320191.961592:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379950592:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320192.541147:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320193.497415:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320193.497436:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379950720:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320193.497506:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320193.498393:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379950720
00000100:00100000:2.0:1767320193.498402:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379950720
00000100:00100000:2.0:1767320193.498471:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581
00000100:00100000:2.0:1767320193.498480:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379950720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320193.498519:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320193.498617:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379950720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (1110us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320193.498624:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581
00000100:00100000:1.0:1767320193.498658:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379950720:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320193.498724:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320193.559199:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320194.007139:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320168/real 1767320168]  req@ffff8b0e0dc23480 x1853164379944576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320193 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320194.007216:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0dc23480 x1853164379944576/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320193 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320194.009168:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320194.018096:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320194.018107:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320194.018112:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320194.018119:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5070
00000100:00080000:2.0:1767320194.018123:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320194.018131:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320194.018177:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28aa00 x1853164379950848/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320194.018195:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320194.018198:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320194.018200:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320194.018202:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5091
00000100:00080000:2.0:1767320194.018204:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320194.018208:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320194.018222:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b800 x1853164379950976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320194.018230:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320194.018234:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320194.018235:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320194.018240:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5091
00000100:00080000:2.0:1767320194.018242:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320194.018245:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320194.018257:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288700 x1853164379951104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320194.018332:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320194.018335:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320194.018337:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320194.018340:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5091
00000100:00080000:2.0:1767320194.018342:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320194.018345:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320194.018357:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ad80 x1853164379951616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320194.018371:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320194.018374:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320194.018376:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320194.018379:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5091
00000100:00080000:2.0:1767320194.018381:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320194.018384:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320194.018392:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b100 x1853164379951872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320194.018430:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379951744:0@lo:400:kworker.0
00000100:00100000:3.0:1767320194.018488:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379951232:0@lo:400:kworker.0
00000100:00100000:2.0:1767320194.018500:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320194.018536:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320194.018568:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320194.018577:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379951488:0@lo:400:kworker.0
00000100:00100000:3.0:1767320194.018581:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320194.018590:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379951360:0@lo:400:kworker.0
00000100:00100000:2.0:1767320194.018629:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320194.018632:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320194.018672:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379951232
00000100:00100000:3.0:1767320194.018680:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379951360
00000100:00100000:2.0:1767320194.018681:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379951232
00000100:00100000:3.0:1767320194.018688:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379951360
00000100:00100000:3.0:1767320194.018748:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789
00000100:00100000:3.0:1767320194.018758:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379951360:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320194.018764:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790
00000100:00100000:2.0:1767320194.018775:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379951232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320194.018830:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379951360:12345-0@lo:400:kworker.0 Request processed in 67us (195us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320194.018838:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789
00000100:00080000:3.0:1767320194.018896:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320194.018897:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379951744
00000100:00100000:1.0:1767320194.018904:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379951744
00000100:00100000:1.0:1767320194.018953:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379951488
00000100:00100000:1.0:1767320194.018957:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379951488
00000100:00100000:1.0:1767320194.018979:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4697
00000100:00100000:1.0:1767320194.018985:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379951744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320194.019024:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379951744:12345-0@lo:400:kworker.0 Request processed in 39us (524us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320194.019030:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4697
00000100:00100000:1.0:1767320194.019489:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4698
00000100:00100000:1.0:1767320194.019498:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379951488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320194.019528:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379951488:12345-0@lo:400:kworker.0 Request processed in 32us (903us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320194.019535:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4698
00000100:00080000:1.0:1767320194.019556:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320194.020819:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379951232:12345-0@lo:400:kworker.0 Request processed in 2042us (2278us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320194.020829:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790
00000100:00100000:2.0:1767320194.020910:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379951488:0@lo:400:kworker.0
00000100:00100000:2.0:1767320194.020922:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379951744:0@lo:400:kworker.0
00000100:00080000:0.0:1767320194.022383:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320194.022392:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379944576:0@lo:250:kworker.0
00000100:00100000:0.0:1767320194.022424:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379950848:0@lo:250:kworker.0
00000400:00000100:0.0:1767320194.022469:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379950848 offset 0 length 520: 4
00000100:00100000:0.0:1767320194.022498:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379950976:0@lo:38:kworker.0
00000100:00100000:0.0:1767320194.022528:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320194.022560:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379951104:0@lo:38:kworker.0
00000100:00100000:0.0:1767320194.022598:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320194.022619:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379951616:0@lo:38:kworker.0
00000100:00100000:0.0:1767320194.022641:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320194.022658:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379951872:0@lo:38:kworker.0
00000100:00100000:0.0:1767320194.022678:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320194.022737:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379951104
00000100:00100000:0.0:1767320194.022744:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379951104
00000100:00100000:0.0:1767320194.022785:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131
00000100:00100000:0.0:1767320194.022791:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379951104:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320194.022824:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320194.022893:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379951104:12345-0@lo:38:kworker.0 Request processed in 99us (293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320194.022900:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131
00000100:00080000:0.0:1767320194.022936:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320194.022940:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320194.022943:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379951104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320194.023156:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379950976
00000100:00100000:1.0:1767320194.023162:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379950976
00000100:00100000:1.0:1767320194.023200:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379951616
00000100:00100000:1.0:1767320194.023203:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379951616
00000100:00100000:1.0:1767320194.023218:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379951872
00000100:00100000:1.0:1767320194.023220:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379951872
00000100:00100000:1.0:1767320194.023250:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17566
00000100:00100000:1.0:1767320194.023255:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379950976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320194.023266:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320194.023309:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379950976:12345-0@lo:38:kworker.0 Request processed in 43us (771us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320194.023315:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17566
00000100:00100000:1.0:1767320194.023332:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17567
00000100:00100000:1.0:1767320194.023336:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379951616:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320194.023345:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320194.023367:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379951616:12345-0@lo:38:kworker.0 Request processed in 29us (725us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320194.023372:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17567
00000100:00100000:1.0:1767320194.023383:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17568
00000100:00100000:1.0:1767320194.023387:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379951872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320194.023396:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320194.023420:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379951872:12345-0@lo:38:kworker.0 Request processed in 32us (741us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320194.023425:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17568
00000100:00080000:0.0:1767320194.023978:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320194.023983:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320194.023987:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379950976:0@lo:38:kworker.0
00000100:00080000:0.0:1767320194.023996:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320194.024000:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320194.024002:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379951616:0@lo:38:kworker.0
00000100:00080000:0.0:1767320194.024009:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320194.024012:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320194.024015:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379951872:0@lo:38:kworker.0
00000100:00100000:3.0:1767320194.025156:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379951360:0@lo:400:kworker.0
00000100:00100000:3.0:1767320194.025195:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379951232:0@lo:400:kworker.0
00010000:00010000:2.0:1767320194.583172:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320194.962204:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320194.962450:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320194.962742:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960320
00000100:00100000:0.0:1767320194.962754:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960320
00000100:00080000:3.0:1767320194.962935:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320194.963257:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960192
00000100:00100000:0.0:1767320194.963262:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960192
00000100:00100000:1.0:1767320194.963618:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4699
00000100:00100000:1.0:1767320194.963631:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291960320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320194.963730:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291960320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (1536us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320194.963738:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4699
00000100:00100000:1.0:1767320194.963759:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17569
00000100:00100000:1.0:1767320194.963763:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960192:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320194.963795:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320194.963820:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (1371us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320194.963826:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17569
00010000:00010000:2.0:1767320195.607201:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320196.631027:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320197.080516:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379952000:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320197.080577:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320197.081174:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952000
00000100:00100000:2.0:1767320197.081184:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952000
00000100:00100000:2.0:1767320197.081256:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582
00000100:00100000:2.0:1767320197.081265:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379952000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320197.081295:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320197.081363:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379952000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (784us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320197.081372:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582
00000100:00100000:0.0:1767320197.081408:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379952000:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320197.081457:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320197.655155:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320198.615354:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379952128:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320198.615457:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320198.615591:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952128
00000100:00100000:0.0:1767320198.615598:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952128
00000100:00100000:0.0:1767320198.615667:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583
00000100:00100000:0.0:1767320198.615696:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379952128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320198.615735:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320198.615790:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379952128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (332us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320198.615797:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583
00000100:00100000:2.0:1767320198.615916:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379952128:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320198.616049:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320198.680332:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320199.127173:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320199.127194:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320199.127198:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320199.127202:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320199.127206:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320199.127215:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5096
00000100:00080000:0.0:1767320199.127220:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320199.127226:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320199.127269:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23480 x1853164379952256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320199.127287:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320199.127290:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320199.127292:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320199.127296:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5096
00000100:00080000:0.0:1767320199.127298:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320199.127302:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320199.127316:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164379952384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320199.127370:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320199.127374:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320199.127375:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320199.127379:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5096
00000100:00080000:0.0:1767320199.127382:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320199.127385:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320199.127422:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380aa300 x1853164379952768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320199.127482:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320199.127486:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320199.127488:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320199.127492:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5096
00000100:00080000:0.0:1767320199.127494:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320199.127498:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320199.127511:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380abb80 x1853164379953024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320199.127535:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320199.127554:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379952896:0@lo:400:kworker.0
00000100:00100000:0.0:1767320199.127624:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320199.127707:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952896
00000100:00100000:0.0:1767320199.127715:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952896
00000100:00100000:0.0:1767320199.127789:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4700
00000100:00100000:0.0:1767320199.127799:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379952896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320199.127853:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379952896:12345-0@lo:400:kworker.0 Request processed in 56us (229us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320199.127861:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4700
00000100:00080000:0.0:1767320199.127903:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320199.127936:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379952896:0@lo:400:kworker.0
00000100:00100000:3.0:1767320199.128404:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379952640:0@lo:400:kworker.0
00000100:00100000:3.0:1767320199.128440:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320199.128498:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320199.128504:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379952512:0@lo:400:kworker.0
00000100:00100000:3.0:1767320199.128528:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320199.128559:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952512
00000100:00100000:3.0:1767320199.128563:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952512
00000100:00100000:3.0:1767320199.128607:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791
00000100:00100000:3.0:1767320199.128614:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379952512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320199.128653:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379952512:12345-0@lo:400:kworker.0 Request processed in 39us (123us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320199.128658:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791
00000100:00100000:3.0:1767320199.128706:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379952512:0@lo:400:kworker.0
00000100:00100000:2.0:1767320199.128910:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379952256:0@lo:38:kworker.0
00000100:00100000:2.0:1767320199.128940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320199.128968:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379952384:0@lo:38:kworker.0
00000100:00100000:2.0:1767320199.129003:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320199.129022:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379952768:0@lo:38:kworker.0
00000100:00100000:2.0:1767320199.129039:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320199.129051:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379953024:0@lo:38:kworker.0
00000100:00100000:2.0:1767320199.129066:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320199.129202:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952384
00000100:00100000:0.0:1767320199.129207:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952384
00000100:00100000:0.0:1767320199.129237:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132
00000100:00100000:0.0:1767320199.129242:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379952384:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320199.129260:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320199.129293:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379952384:12345-0@lo:38:kworker.0 Request processed in 50us (289us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320199.129299:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132
00000100:00100000:0.0:1767320199.129319:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952640
00000100:00100000:0.0:1767320199.129323:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952640
00000100:00100000:0.0:1767320199.129346:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952256
00000100:00100000:0.0:1767320199.129348:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952256
00000100:00100000:0.0:1767320199.129358:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379952768
00000100:00100000:0.0:1767320199.129361:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379952768
00000100:00100000:0.0:1767320199.129367:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953024
00000100:00100000:0.0:1767320199.129369:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953024
00000100:00100000:0.0:1767320199.129378:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4701
00000100:00100000:0.0:1767320199.129384:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379952640:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320199.129415:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379952640:12345-0@lo:400:kworker.0 Request processed in 31us (975us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320199.129421:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4701
00000100:00100000:0.0:1767320199.129433:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17570
00000100:00100000:0.0:1767320199.129436:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379952256:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320199.129445:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320199.131103:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17571
00000100:00100000:1.0:1767320199.131114:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379952768:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320199.131132:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320199.131259:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17572
00000100:00100000:3.0:1767320199.131266:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379953024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320199.131278:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320199.133123:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379952768:12345-0@lo:38:kworker.0 Request processed in 1994us (4067us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320199.133135:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17571
00000100:00080000:1.0:1767320199.133201:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320199.133207:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320199.133258:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379952640:0@lo:400:kworker.0
00000100:00080000:2.0:1767320199.146513:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320199.146526:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320199.146531:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379952384:0@lo:38:kworker.0
00000100:00080000:2.0:1767320199.146548:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320199.146552:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320199.146555:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379952768:0@lo:38:kworker.0
00000100:00100000:3.0:1767320199.146783:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379953024:12345-0@lo:38:kworker.0 Request processed in 15500us (17700us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320199.146794:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17572
00000100:00080000:2.0:1767320199.147099:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320199.147103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320199.147107:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379953024:0@lo:38:kworker.0
00000100:00100000:0.0:1767320199.161120:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379952256:12345-0@lo:38:kworker.0 Request processed in 31671us (32169us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320199.161135:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17570
00000100:00080000:2.0:1767320199.161387:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320199.161393:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320199.161397:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379952256:0@lo:38:kworker.0
00010000:00010000:2.0:1767320199.703997:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320200.079121:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320200.079193:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320200.079302:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960448
00000100:00100000:3.0:1767320200.079313:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960448
00000100:00100000:3.0:1767320200.079385:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960576
00000100:00100000:3.0:1767320200.079388:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960576
00000100:00100000:3.0:1767320200.079420:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4702
00000100:00100000:3.0:1767320200.079427:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291960576:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320200.079525:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291960576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (331us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320200.079533:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4702
00000100:00100000:3.0:1767320200.079550:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17573
00000100:00100000:3.0:1767320200.079555:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960448:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320200.079575:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320200.079602:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960448:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (491us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320200.079609:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17573
00000100:00080000:1.0:1767320200.079916:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320200.727030:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320201.751567:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320202.200390:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379953152:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320202.200495:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320202.200726:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953152
00000100:00100000:2.0:1767320202.200734:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953152
00000100:00100000:2.0:1767320202.200804:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584
00000100:00100000:2.0:1767320202.200814:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379953152:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320202.200856:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320202.200922:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379953152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (426us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320202.200930:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584
00000100:00100000:0.0:1767320202.201056:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379953152:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320202.202486:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320202.777522:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320203.735271:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379953280:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320203.735735:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320203.736669:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953280
00000100:00100000:2.0:1767320203.736679:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953280
00000100:00100000:2.0:1767320203.736785:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585
00000100:00100000:2.0:1767320203.736795:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379953280:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320203.736846:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320203.736944:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379953280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (1210us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320203.736953:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585
00000100:00080000:3.0:1767320203.737041:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320203.737126:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379953280:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320203.802606:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320204.247087:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320204.247094:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320204.247097:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320204.247100:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320204.247104:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320204.247151:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5101
00000100:00080000:1.0:1767320204.247155:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320204.247161:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320204.247202:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198e00 x1853164379953408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320204.247229:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320204.247232:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320204.247234:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320204.247238:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5101
00000100:00080000:1.0:1767320204.247240:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320204.247243:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320204.247253:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198a80 x1853164379953536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320204.247287:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320204.247289:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320204.247291:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320204.247294:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5101
00000100:00080000:1.0:1767320204.247296:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320204.247299:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320204.247306:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819aa00 x1853164379953920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320204.247320:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320204.247323:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320204.247324:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320204.247327:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5101
00000100:00080000:1.0:1767320204.247329:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320204.247343:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320204.247350:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198700 x1853164379954176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320204.247484:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379953792:0@lo:400:kworker.0
00000100:00100000:1.0:1767320204.247565:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320204.247649:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379953408:0@lo:38:kworker.0
00000100:00100000:3.0:1767320204.248044:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379953664:0@lo:400:kworker.0
00000100:00100000:3.0:1767320204.248076:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320204.248117:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953664
00000100:00100000:3.0:1767320204.248123:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953664
00000100:00100000:3.0:1767320204.248167:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792
00000100:00100000:3.0:1767320204.248174:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379953664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320204.248219:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379953664:12345-0@lo:400:kworker.0 Request processed in 45us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320204.248225:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792
00000100:00080000:3.0:1767320204.248245:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320204.248296:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379954048:0@lo:400:kworker.0
00000100:00100000:3.0:1767320204.248318:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320204.248358:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953792
00000100:00100000:3.0:1767320204.248362:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953792
00000100:00100000:3.0:1767320204.248389:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954048
00000100:00100000:3.0:1767320204.248390:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954048
00000100:00100000:3.0:1767320204.248417:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4703
00000100:00100000:3.0:1767320204.248422:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379953792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320204.248456:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379953792:12345-0@lo:400:kworker.0 Request processed in 34us (890us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320204.248461:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4703
00000100:00100000:3.0:1767320204.248470:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4704
00000100:00100000:3.0:1767320204.248475:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379954048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320204.248496:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379954048:12345-0@lo:400:kworker.0 Request processed in 21us (177us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320204.248500:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4704
00000100:00080000:3.0:1767320204.248695:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320204.248938:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379953792:0@lo:400:kworker.0
00000100:00100000:0.0:1767320204.248963:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320204.248987:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953408
00000100:00100000:1.0:1767320204.248992:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953408
00000100:00100000:1.0:1767320204.249020:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17574
00000100:00100000:1.0:1767320204.249024:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379953408:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320204.249043:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320204.249073:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379953408:12345-0@lo:38:kworker.0 Request processed in 48us (112us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320204.249079:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17574
00000100:00100000:3.0:1767320204.249469:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379953664:0@lo:400:kworker.0
00000100:00100000:2.0:1767320204.249498:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379954048:0@lo:400:kworker.0
00000100:00080000:0.0:1767320204.254254:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320204.254267:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320204.254272:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379953408:0@lo:38:kworker.0
00000100:00100000:0.0:1767320204.254284:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379953536:0@lo:38:kworker.0
00000100:00100000:0.0:1767320204.254383:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320204.254426:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379953920:0@lo:38:kworker.0
00000100:00100000:0.0:1767320204.254450:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320204.254480:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379954176:0@lo:38:kworker.0
00000100:00100000:0.0:1767320204.254514:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320204.254564:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953920
00000100:00100000:1.0:1767320204.254573:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953920
00000100:00100000:1.0:1767320204.254605:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954176
00000100:00100000:1.0:1767320204.254625:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954176
00000100:00100000:2.0:1767320204.255399:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379953536
00000100:00100000:2.0:1767320204.255406:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379953536
00000100:00100000:2.0:1767320204.255435:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133
00000100:00100000:2.0:1767320204.255443:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379953536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320204.255464:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320204.255516:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379953536:12345-0@lo:38:kworker.0 Request processed in 72us (1132us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320204.255523:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133
00000100:00080000:2.0:1767320204.255571:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320204.255576:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320204.255580:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379953536:0@lo:38:kworker.0
00000100:00100000:0.0:1767320204.257279:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17575
00000100:00100000:0.0:1767320204.257293:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379953920:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320204.257313:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320204.257393:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379953920:12345-0@lo:38:kworker.0 Request processed in 102us (2942us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767320204.257481:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320204.257486:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320204.257500:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379953920:0@lo:38:kworker.0
00000100:00100000:1.0:1767320204.259366:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17576
00000100:00100000:1.0:1767320204.259376:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379954176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320204.259395:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320204.259459:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379954176:12345-0@lo:38:kworker.0 Request processed in 83us (4944us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320204.259466:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17576
00000100:00080000:2.0:1767320204.259953:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320204.259959:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320204.259962:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379954176:0@lo:38:kworker.0
00000100:00100000:0.0:1767320204.264766:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17575
00010000:00010000:3.0:1767320204.824509:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320205.199412:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320205.199498:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960832
00000100:00100000:0.0:1767320205.199509:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960832
00000100:00100000:0.0:1767320205.199597:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4705
00000100:00100000:0.0:1767320205.199608:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291960832:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320205.199728:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291960832:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320205.199735:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4705
00000100:00080000:3.0:1767320205.199804:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320205.201059:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320205.201138:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960704
00000100:00100000:1.0:1767320205.201145:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960704
00000100:00100000:1.0:1767320205.201213:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17577
00000100:00100000:1.0:1767320205.201220:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960704:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320205.201242:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320205.201306:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960704:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 85us (250us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320205.201313:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17577
00010000:00010000:1.0:1767320205.847413:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320206.873919:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320207.320256:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379954304:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320207.320329:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320207.320572:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954304
00000100:00100000:2.0:1767320207.320581:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954304
00000100:00080000:3.0:1767320207.321631:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320207.321637:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586
00000100:00100000:2.0:1767320207.321650:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379954304:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320207.321682:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320207.321753:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379954304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (1424us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320207.321760:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586
00000100:00100000:3.0:1767320207.321840:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379954304:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320207.899293:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320208.855157:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379954432:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320208.855228:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320208.855357:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954432
00000100:00100000:0.0:1767320208.855365:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954432
00000100:00080000:3.0:1767320208.855414:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320208.855435:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587
00000100:00100000:0.0:1767320208.855446:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379954432:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320208.855476:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320208.855536:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379954432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (300us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320208.855544:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587
00000100:00100000:3.0:1767320208.855637:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379954432:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320208.921376:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320209.367019:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320209.367031:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320209.367035:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320209.367039:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320209.367044:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320209.367053:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5106
00000100:00080000:1.0:1767320209.367059:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320209.367066:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320209.367113:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199f80 x1853164379954560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320209.367152:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320209.367156:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320209.367158:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320209.367162:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5106
00000100:00080000:1.0:1767320209.367164:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320209.367169:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320209.367183:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198000 x1853164379954688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320209.367264:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320209.367373:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379954560:0@lo:38:kworker.0
00000100:00100000:2.0:1767320209.367447:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320209.367523:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379954688:0@lo:38:kworker.0
00000100:00100000:2.0:1767320209.367552:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320209.367625:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954560
00000100:00100000:2.0:1767320209.367632:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954560
00000100:00100000:2.0:1767320209.367670:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17578
00000100:00100000:2.0:1767320209.367677:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379954560:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320209.367715:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320209.367757:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379954560:12345-0@lo:38:kworker.0 Request processed in 79us (310us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320209.367764:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17578
00000100:00100000:2.0:1767320209.367789:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954688
00000100:00100000:2.0:1767320209.367793:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954688
00000100:00100000:2.0:1767320209.367812:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134
00000100:00100000:2.0:1767320209.367817:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379954688:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320209.367827:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320209.367854:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379954688:12345-0@lo:38:kworker.0 Request processed in 35us (301us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320209.367861:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134
00000100:00080000:2.0:1767320209.367918:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320209.367923:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320209.367927:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379954560:0@lo:38:kworker.0
00000100:00080000:2.0:1767320209.367937:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320209.367940:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320209.367943:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379954688:0@lo:38:kworker.0
00000100:00100000:3.0:1767320209.368051:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320209.368063:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379954944:0@lo:400:kworker.0
00000100:00100000:3.0:1767320209.368092:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320209.368342:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954944
00000100:00100000:2.0:1767320209.368347:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954944
00000100:00100000:2.0:1767320209.368396:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4706
00000100:00100000:2.0:1767320209.368404:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379954944:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320209.368447:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379954944:12345-0@lo:400:kworker.0 Request processed in 45us (354us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320209.368454:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4706
00000100:00080000:3.0:1767320209.368520:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320209.368546:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379954944:0@lo:400:kworker.0
00000100:00100000:0.0:1767320209.368916:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379954816:0@lo:400:kworker.0
00000100:00100000:0.0:1767320209.368949:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320209.369029:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379954816
00000100:00100000:3.0:1767320209.369034:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379954816
00000100:00100000:3.0:1767320209.369083:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793
00000100:00100000:3.0:1767320209.369091:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379954816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320209.369128:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379954816:12345-0@lo:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320209.369134:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793
00000100:00080000:0.0:1767320209.369440:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320209.369462:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379954816:0@lo:400:kworker.0
00000100:00080000:1.0:1767320209.369782:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320209.369788:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320209.369791:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320209.369796:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5106
00000100:00080000:1.0:1767320209.369800:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320209.369805:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320209.369832:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199180 x1853164379955072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320209.369889:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379955072:0@lo:38:kworker.0
00000100:00100000:2.0:1767320209.369932:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320209.369990:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955072
00000100:00100000:3.0:1767320209.369995:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955072
00000100:00100000:3.0:1767320209.370027:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17579
00000100:00100000:3.0:1767320209.370032:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379955072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320209.370048:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320209.370166:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320209.370170:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320209.370172:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320209.370175:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5106
00000100:00080000:1.0:1767320209.370178:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320209.370182:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320209.370195:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198000 x1853164379955328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320209.370239:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379955200:0@lo:400:kworker.0
00000100:00100000:0.0:1767320209.370277:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320209.370307:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955200
00000100:00100000:0.0:1767320209.370311:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955200
00000100:00100000:0.0:1767320209.370347:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4707
00000100:00100000:0.0:1767320209.370353:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379955200:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320209.370386:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379955200:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320209.370392:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4707
00000100:00080000:0.0:1767320209.370410:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320209.370428:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379955200:0@lo:400:kworker.0
00000100:00100000:2.0:1767320209.370704:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379955328:0@lo:38:kworker.0
00000100:00100000:2.0:1767320209.370731:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320209.370820:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379955072:12345-0@lo:38:kworker.0 Request processed in 786us (896us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320209.370828:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17579
00000100:00100000:3.0:1767320209.370840:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955328
00000100:00100000:3.0:1767320209.370843:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955328
00000100:00100000:0.0:1767320209.370890:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17580
00000100:00100000:0.0:1767320209.370895:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379955328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320209.370908:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320209.370936:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379955328:12345-0@lo:38:kworker.0 Request processed in 40us (204us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320209.370942:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17580
00000100:00080000:2.0:1767320209.371153:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320209.371159:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320209.371162:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379955072:0@lo:38:kworker.0
00000100:00080000:2.0:1767320209.371179:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320209.371182:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320209.371184:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379955328:0@lo:38:kworker.0
00010000:00010000:1.0:1767320209.943276:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320210.320614:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320210.320717:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320210.323189:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291961088
00000100:00100000:3.0:1767320210.323189:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291960960
00000100:00100000:0.0:1767320210.323203:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291961088
00000100:00100000:3.0:1767320210.323203:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291960960
00000100:00100000:3.0:1767320210.323294:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4708
00000100:00100000:3.0:1767320210.323310:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291961088:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767320210.323316:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320210.323410:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291961088:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (2806us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320210.323418:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4708
00000100:00100000:3.0:1767320210.323449:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17581
00000100:00100000:3.0:1767320210.323454:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960960:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320210.323483:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320210.323509:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291960960:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (2792us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320210.323516:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17581
00010000:00010000:2.0:1767320210.967105:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320211.991246:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320212.439200:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379955456:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320212.439281:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320212.439344:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955456
00000100:00100000:2.0:1767320212.439354:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955456
00000100:00080000:0.0:1767320212.439390:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320212.439595:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588
00000100:00100000:2.0:1767320212.439607:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379955456:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320212.439652:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320212.439716:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379955456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (434us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320212.439724:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588
00000100:00100000:3.0:1767320212.439807:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379955456:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320213.019655:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320213.976648:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379955584:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320213.976723:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320213.977191:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955584
00000100:00100000:2.0:1767320213.977201:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955584
00000100:00100000:2.0:1767320213.977286:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589
00000100:00100000:2.0:1767320213.977296:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379955584:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320213.977325:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320213.977385:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379955584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (661us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320213.977393:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589
00000100:00100000:3.0:1767320213.977602:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379955584:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320213.977669:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320214.040174:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767320214.423194:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291961216 offset 0 length 520: 4
00000100:00100000:0.0:1767320214.423238:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320214.423273:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320214.423362:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291961344
00000100:00100000:1.0:1767320214.423373:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291961344
00000100:00100000:1.0:1767320214.423414:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291961472
00000100:00100000:1.0:1767320214.423416:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291961472
00000100:00100000:1.0:1767320214.423479:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4709
00000100:00100000:1.0:1767320214.423490:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291961472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320214.423572:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291961472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (297us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320214.423579:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4709
00000100:00100000:1.0:1767320214.423601:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17582
00000100:00100000:1.0:1767320214.423605:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291961344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320214.423625:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320214.423649:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291961344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (411us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320214.423655:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17582
00000100:00080000:2.0:1767320214.423816:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320214.491118:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320214.491128:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320214.491131:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320214.491135:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320214.491140:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320214.491148:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5111
00000100:00080000:3.0:1767320214.491153:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320214.491159:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320214.491200:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc380 x1853164379955712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320214.491232:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320214.491235:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320214.491237:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320214.491242:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5111
00000100:00080000:3.0:1767320214.491244:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320214.491248:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320214.491261:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fed80 x1853164379955840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320214.491351:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320214.491455:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379955712:0@lo:38:kworker.0
00000100:00100000:2.0:1767320214.491545:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320214.491611:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379955840:0@lo:38:kworker.0
00000100:00100000:2.0:1767320214.491634:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320214.491675:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955840
00000100:00100000:2.0:1767320214.491682:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955840
00000100:00100000:2.0:1767320214.491713:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135
00000100:00100000:2.0:1767320214.491720:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379955840:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320214.491741:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320214.491779:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379955840:12345-0@lo:38:kworker.0 Request processed in 58us (143us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320214.491785:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135
00000100:00080000:2.0:1767320214.491822:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320214.491826:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320214.491830:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379955840:0@lo:38:kworker.0
00000100:00080000:3.0:1767320214.492505:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320214.492510:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320214.492513:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320214.492517:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5111
00000100:00080000:3.0:1767320214.492520:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320214.492534:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320214.492550:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd500 x1853164379956224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320214.492570:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320214.492573:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320214.492574:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320214.492577:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5111
00000100:00080000:3.0:1767320214.492579:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320214.492582:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320214.492590:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fea00 x1853164379956480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320214.492613:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379956352:0@lo:400:kworker.0
00000100:00100000:3.0:1767320214.492645:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320214.492675:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320214.492682:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379956096:0@lo:400:kworker.0
00000100:00100000:3.0:1767320214.492709:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320214.492734:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379956224:0@lo:38:kworker.0
00000100:00100000:3.0:1767320214.492755:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320214.492769:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379956480:0@lo:38:kworker.0
00000100:00100000:3.0:1767320214.492783:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320214.492818:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955712
00000100:00100000:3.0:1767320214.492822:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955712
00000100:00100000:3.0:1767320214.492889:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379956352
00000100:00100000:3.0:1767320214.492893:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379956352
00000100:00100000:3.0:1767320214.492929:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379956096
00000100:00100000:3.0:1767320214.492932:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379956096
00000100:00100000:3.0:1767320214.492943:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379956224
00000100:00100000:3.0:1767320214.492945:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379956224
00000100:00100000:3.0:1767320214.492951:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379956480
00000100:00100000:3.0:1767320214.492953:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379956480
00000100:00100000:3.0:1767320214.492961:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4710
00000100:00100000:3.0:1767320214.492967:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379956352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320214.493010:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379956352:12345-0@lo:400:kworker.0 Request processed in 43us (363us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320214.493016:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4710
00000100:00100000:3.0:1767320214.493027:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4711
00000100:00100000:3.0:1767320214.493032:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379956096:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320214.493052:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379956096:12345-0@lo:400:kworker.0 Request processed in 21us (344us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320214.493057:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4711
00000100:00100000:3.0:1767320214.493065:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17583
00000100:00100000:3.0:1767320214.493069:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379955712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320214.493084:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320214.493112:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379955712:12345-0@lo:38:kworker.0 Request processed in 41us (1566us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320214.493117:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17583
00000100:00100000:3.0:1767320214.493128:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17584
00000100:00100000:3.0:1767320214.493131:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379956224:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320214.493140:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320214.493162:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379956224:12345-0@lo:38:kworker.0 Request processed in 29us (406us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320214.493168:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17584
00000100:00100000:3.0:1767320214.493178:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17585
00000100:00100000:3.0:1767320214.493182:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379956480:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320214.493190:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320214.493216:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379956480:12345-0@lo:38:kworker.0 Request processed in 32us (431us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320214.493221:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17585
00000100:00080000:3.0:1767320214.493237:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320214.493261:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379956096:0@lo:400:kworker.0
00000100:00100000:3.0:1767320214.493270:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379956352:0@lo:400:kworker.0
00000100:00080000:3.0:1767320214.493294:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320214.493297:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320214.493300:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379956224:0@lo:38:kworker.0
00000100:00080000:3.0:1767320214.493307:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320214.493311:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320214.493313:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379956480:0@lo:38:kworker.0
00000100:00080000:3.0:1767320214.493321:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320214.493324:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320214.493327:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379955712:0@lo:38:kworker.0
00000100:00100000:0.0:1767320214.495916:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379955968:0@lo:400:kworker.0
00000100:00100000:0.0:1767320214.495989:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320214.497680:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379955968
00000100:00100000:2.0:1767320214.497691:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379955968
00000100:00100000:2.0:1767320214.497769:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794
00000100:00100000:2.0:1767320214.497777:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379955968:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320214.497862:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379955968:12345-0@lo:400:kworker.0 Request processed in 85us (1872us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320214.497889:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794
00000100:00100000:1.0:1767320214.498039:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379955968:0@lo:400:kworker.0
00000100:00080000:3.0:1767320214.498918:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320215.063246:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320216.087113:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320217.111206:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320217.559078:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320217.559097:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379956608:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320217.559168:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320217.559293:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379956608
00000100:00100000:3.0:1767320217.559302:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379956608
00000100:00080000:2.0:1767320217.559365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320217.559380:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590
00000100:00100000:3.0:1767320217.559465:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379956608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320217.559495:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320217.559591:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379956608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (422us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320217.559698:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379956608:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320217.564105:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590
00010000:00010000:1.0:1767320218.135792:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320219.095184:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379956736:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320219.095263:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320219.095415:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379956736
00000100:00100000:3.0:1767320219.095423:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379956736
00000100:00080000:2.0:1767320219.095503:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320219.095511:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591
00000100:00100000:3.0:1767320219.095523:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379956736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320219.095554:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320219.095628:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379956736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (364us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320219.095635:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591
00000100:00100000:1.0:1767320219.095713:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379956736:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320219.160614:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320219.536999:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320219.537059:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320219.537226:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291961728
00000100:00100000:2.0:1767320219.537238:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291961728
00000100:00100000:2.0:1767320219.537317:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291961600
00000100:00100000:2.0:1767320219.537322:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291961600
00000100:00100000:2.0:1767320219.537341:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4712
00000100:00100000:2.0:1767320219.537353:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291961728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320219.537442:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291961728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (452us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320219.537450:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4712
00000100:00100000:2.0:1767320219.537471:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17586
00000100:00100000:2.0:1767320219.537475:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291961600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320219.537507:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320219.537536:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291961600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (477us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320219.537542:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17586
00000100:00080000:0.0:1767320219.539786:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320219.607166:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320194/real 1767320194]  req@ffff8b0f2f28aa00 x1853164379950848/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320219 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320219.607206:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f28aa00 x1853164379950848/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320219 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320219.607221:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320219.607311:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320219.607316:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379950848:0@lo:250:kworker.0
00000100:00080000:2.0:1767320219.607432:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320219.607440:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320219.607443:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320219.607447:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5096
00000100:00080000:2.0:1767320219.607452:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320219.607458:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320219.607505:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22a00 x1853164379956864/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320219.607572:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379956864:0@lo:250:kworker.0
00000400:00000100:0.0:1767320219.607630:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379956864 offset 0 length 520: 4
00000100:00080000:2.0:1767320219.607686:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320219.607690:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320219.607692:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320219.607696:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767320219.607699:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320219.607703:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320219.607720:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20700 x1853164379956992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320219.607849:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379956992:0@lo:38:kworker.0
00000100:00100000:0.0:1767320219.607906:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320219.608042:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320219.608046:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320219.608048:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320219.608052:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767320219.608055:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320219.608059:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320219.608074:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20000 x1853164379957120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320219.608122:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379957120:0@lo:38:kworker.0
00000100:00100000:0.0:1767320219.608152:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320219.608226:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379957120
00000100:00100000:1.0:1767320219.608235:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379957120
00000100:00100000:1.0:1767320219.608286:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136
00000100:00100000:1.0:1767320219.608295:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379957120:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320219.608317:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320219.608416:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320219.608420:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320219.608422:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320219.608426:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767320219.608428:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320219.608433:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320219.608445:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47480 x1853164379957632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320219.608530:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379956992
00000100:00100000:3.0:1767320219.608535:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379956992
00000100:00100000:3.0:1767320219.608563:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17587
00000100:00100000:3.0:1767320219.608569:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379956992:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320219.608574:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379957632:0@lo:38:kworker.0
00010000:00020000:3.0:1767320219.608584:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320219.608613:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320219.608632:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379956992:12345-0@lo:38:kworker.0 Request processed in 60us (723us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320219.608639:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17587
00000100:00100000:3.0:1767320219.608651:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379957632
00000100:00100000:3.0:1767320219.608654:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379957632
00000100:00100000:3.0:1767320219.608670:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17588
00000100:00100000:3.0:1767320219.608674:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379957632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320219.608683:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320219.608704:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379957632:12345-0@lo:38:kworker.0 Request processed in 28us (92us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320219.608709:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17588
00000100:00100000:1.0:1767320219.608742:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379957120:12345-0@lo:38:kworker.0 Request processed in 447us (588us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320219.608750:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136
00000100:00100000:1.0:1767320219.608789:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379957248:0@lo:400:kworker.0
00000100:00100000:3.0:1767320219.608814:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379957376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320219.608822:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320219.608850:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320219.608890:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379957248
00000100:00100000:1.0:1767320219.608895:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379957248
00000100:00100000:3.0:1767320219.608932:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379957376
00000100:00100000:3.0:1767320219.608938:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379957376
00000100:00100000:1.0:1767320219.608946:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795
00000100:00100000:1.0:1767320219.608956:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379957248:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320219.608969:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796
00000100:00100000:3.0:1767320219.608978:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379957376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320219.609006:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379957248:12345-0@lo:400:kworker.0 Request processed in 51us (185us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320219.609014:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795
00000100:00100000:3.0:1767320219.609025:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379957376:12345-0@lo:400:kworker.0 Request processed in 47us (173us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320219.609031:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796
00000100:00080000:1.0:1767320219.609039:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320219.609074:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379957248:0@lo:400:kworker.0
00000100:00100000:3.0:1767320219.609075:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379957376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320219.609107:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379957504:0@lo:400:kworker.0
00000100:00100000:1.0:1767320219.609130:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320219.609248:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320219.609253:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320219.609257:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379957120:0@lo:38:kworker.0
00000100:00080000:0.0:1767320219.609274:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320219.609278:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320219.609281:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379956992:0@lo:38:kworker.0
00000100:00080000:0.0:1767320219.609297:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320219.609300:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320219.609303:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379957632:0@lo:38:kworker.0
00000100:00080000:2.0:1767320219.609440:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320219.609444:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320219.609446:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320219.609449:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5116
00000100:00080000:2.0:1767320219.609452:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320219.609456:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320219.609471:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47480 x1853164379957888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320219.609505:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320219.609513:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379957760:0@lo:400:kworker.0
00000100:00100000:2.0:1767320219.609544:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320219.609591:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379957888:0@lo:38:kworker.0
00000100:00100000:0.0:1767320219.609925:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320219.609967:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379957504
00000100:00100000:3.0:1767320219.609973:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379957504
00000100:00100000:3.0:1767320219.610012:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379957760
00000100:00100000:3.0:1767320219.610015:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379957760
00000100:00100000:3.0:1767320219.610038:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4713
00000100:00100000:3.0:1767320219.610045:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379957504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320219.610086:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379957504:12345-0@lo:400:kworker.0 Request processed in 41us (954us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320219.610093:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4713
00000100:00100000:3.0:1767320219.610107:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4714
00000100:00100000:3.0:1767320219.610113:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379957760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320219.610139:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379957760:12345-0@lo:400:kworker.0 Request processed in 26us (594us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320219.610144:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4714
00000100:00080000:2.0:1767320219.610289:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320219.610314:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379957760:0@lo:400:kworker.0
00000100:00100000:2.0:1767320219.610325:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379957504:0@lo:400:kworker.0
00000100:00100000:1.0:1767320219.612520:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379957888
00000100:00100000:1.0:1767320219.612532:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379957888
00000100:00100000:1.0:1767320219.612695:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17589
00000100:00100000:1.0:1767320219.612703:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379957888:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320219.612727:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320219.614524:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379957888:12345-0@lo:38:kworker.0 Request processed in 1810us (4588us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320219.614538:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17589
00000100:00080000:0.0:1767320219.614810:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320219.614816:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320219.614821:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379957888:0@lo:38:kworker.0
00010000:00010000:2.0:1767320220.186283:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320221.207169:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320222.234072:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320222.682007:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320222.682035:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379958016:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320222.682108:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320222.682336:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958016
00000100:00100000:3.0:1767320222.682346:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958016
00000100:00100000:3.0:1767320222.682420:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592
00000100:00100000:3.0:1767320222.682429:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379958016:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320222.682473:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320222.682521:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379958016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (413us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320222.682528:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592
00000100:00100000:0.0:1767320222.682715:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379958016:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320222.682887:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320223.255801:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320224.215594:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320224.217951:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379958144:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320224.218030:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320224.221733:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958144
00000100:00100000:0.0:1767320224.221750:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958144
00000100:00100000:0.0:1767320224.221912:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593
00000100:00100000:0.0:1767320224.221923:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379958144:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320224.221955:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320224.222045:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379958144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (4013us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320224.222052:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593
00000100:00100000:1.0:1767320224.223694:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379958144:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320224.224592:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320224.279583:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320224.656614:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320224.656714:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320224.658550:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291961856
00000100:00100000:2.0:1767320224.658563:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291961856
00000100:00100000:2.0:1767320224.658624:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291961984
00000100:00100000:2.0:1767320224.658628:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291961984
00000100:00100000:2.0:1767320224.658690:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4715
00000100:00100000:2.0:1767320224.658703:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291961984:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320224.658799:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291961984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (2083us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320224.658807:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4715
00000100:00100000:2.0:1767320224.658829:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17590
00000100:00100000:2.0:1767320224.658834:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291961856:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320224.659206:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320224.659236:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291961856:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 400us (2634us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320224.659243:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17590
00000100:00080000:1.0:1767320224.659459:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320224.727038:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320224.727049:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320224.727052:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320224.727056:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320224.727060:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320224.727068:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5122
00000100:00080000:2.0:1767320224.727073:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320224.727080:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320224.727119:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379958272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320224.727144:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320224.727147:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320224.727149:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320224.727154:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5122
00000100:00080000:2.0:1767320224.727157:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320224.727161:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320224.727177:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47480 x1853164379958400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320224.727245:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320224.727248:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320224.727250:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320224.727254:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5122
00000100:00080000:2.0:1767320224.727256:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320224.727259:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320224.727273:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ea00 x1853164379958912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320224.727289:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320224.727292:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320224.727294:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320224.727297:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5122
00000100:00080000:2.0:1767320224.727299:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320224.727303:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320224.727313:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4700 x1853164379959168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320224.727427:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379959040:0@lo:400:kworker.0
00000100:00100000:2.0:1767320224.727506:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320224.727570:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320224.727577:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379958784:0@lo:400:kworker.0
00000100:00100000:2.0:1767320224.727600:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320224.727697:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379958528:0@lo:400:kworker.0
00000100:00100000:1.0:1767320224.727729:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320224.727762:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320224.727780:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379958656:0@lo:400:kworker.0
00000100:00100000:1.0:1767320224.727803:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320224.727909:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958528
00000100:00100000:3.0:1767320224.727917:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958528
00000100:00100000:0.0:1767320224.727938:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959040
00000100:00100000:0.0:1767320224.727942:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959040
00000100:00100000:3.0:1767320224.727964:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958656
00000100:00100000:3.0:1767320224.727967:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958656
00000100:00100000:0.0:1767320224.727970:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958784
00000100:00100000:0.0:1767320224.727973:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958784
00000100:00100000:3.0:1767320224.727987:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797
00000100:00100000:3.0:1767320224.727996:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379958528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320224.728002:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4716
00000100:00100000:0.0:1767320224.728007:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379959040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320224.728046:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379959040:12345-0@lo:400:kworker.0 Request processed in 38us (540us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320224.728053:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4716
00000100:00100000:3.0:1767320224.728054:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379958528:12345-0@lo:400:kworker.0 Request processed in 60us (325us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320224.728062:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797
00000100:00100000:3.0:1767320224.728073:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798
00000100:00100000:0.0:1767320224.728078:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4717
00000100:00100000:3.0:1767320224.728079:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379958656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320224.728083:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379958784:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320224.728104:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379958784:12345-0@lo:400:kworker.0 Request processed in 20us (502us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320224.728104:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379958656:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320224.728110:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798
00000100:00100000:0.0:1767320224.728112:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4717
00000100:00100000:0.0:1767320224.728146:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379958784:0@lo:400:kworker.0
00000100:00100000:3.0:1767320224.728146:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379958656:0@lo:400:kworker.0
00000100:00100000:0.0:1767320224.728156:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379959040:0@lo:400:kworker.0
00000100:00100000:3.0:1767320224.728156:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379958528:0@lo:400:kworker.0
00000100:00100000:3.0:1767320224.728197:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379958272:0@lo:38:kworker.0
00000100:00100000:3.0:1767320224.728221:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320224.728250:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379958400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320224.728276:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320224.728297:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379958912:0@lo:38:kworker.0
00000100:00100000:3.0:1767320224.728316:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320224.728427:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958272
00000100:00100000:0.0:1767320224.728440:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958272
00000100:00100000:0.0:1767320224.728459:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958912
00000100:00100000:0.0:1767320224.728462:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958912
00000100:00100000:0.0:1767320224.728475:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17591
00000100:00100000:0.0:1767320224.728479:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379958272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320224.728496:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320224.728526:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379958272:12345-0@lo:38:kworker.0 Request processed in 45us (304us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320224.728532:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17591
00000100:00100000:0.0:1767320224.728548:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17592
00000100:00100000:0.0:1767320224.728552:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379958912:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320224.728562:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320224.728577:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379958400
00000100:00100000:1.0:1767320224.728581:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379958400
00000100:00100000:0.0:1767320224.728584:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379958912:12345-0@lo:38:kworker.0 Request processed in 31us (267us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320224.728589:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17592
00000100:00100000:1.0:1767320224.728603:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137
00000100:00100000:1.0:1767320224.728608:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3919f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379958400:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767320224.728612:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320224.728616:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00020000:1.0:1767320224.728617:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320224.728643:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3919f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379958400:12345-0@lo:38:kworker.0 Request processed in 33us (365us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320224.728648:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137
00000100:00080000:3.0:1767320224.728791:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320224.728797:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320224.728800:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379958912:0@lo:38:kworker.0
00000100:00100000:3.0:1767320224.728806:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379959168:0@lo:38:kworker.0
00000100:00100000:3.0:1767320224.728829:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320224.728866:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320224.728904:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320224.728907:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379958272:0@lo:38:kworker.0
00000100:00080000:3.0:1767320224.728920:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320224.728923:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320224.728926:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379958400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320224.728946:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959168
00000100:00100000:3.0:1767320224.728949:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959168
00000100:00100000:3.0:1767320224.728976:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17593
00000100:00100000:3.0:1767320224.728980:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379959168:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320224.728989:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320224.729019:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379959168:12345-0@lo:38:kworker.0 Request processed in 37us (189us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320224.729025:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17593
00000100:00080000:3.0:1767320224.729046:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320224.729050:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320224.729052:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379959168:0@lo:38:kworker.0
00010000:00010000:3.0:1767320225.304066:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320226.327438:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320227.351103:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320227.799211:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320227.799230:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379959296:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320227.799304:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320227.799557:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959296
00000100:00100000:3.0:1767320227.799567:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959296
00000100:00100000:3.0:1767320227.799712:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594
00000100:00100000:3.0:1767320227.799722:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379959296:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320227.799752:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320227.799809:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379959296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (505us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320227.799816:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594
00000100:00100000:2.0:1767320227.799937:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379959296:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320227.800119:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320228.375071:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320229.337116:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379959424:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320229.337183:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320229.337385:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959424
00000100:00100000:0.0:1767320229.337400:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959424
00000100:00100000:0.0:1767320229.337483:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595
00000100:00100000:0.0:1767320229.337491:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379959424:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320229.337525:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320229.337574:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379959424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (390us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320229.337581:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595
00000100:00100000:0.0:1767320229.337632:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379959424:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320229.338244:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320229.401496:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320229.775661:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320229.775735:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291962240
00000100:00100000:2.0:1767320229.775747:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291962240
00000100:00100000:2.0:1767320229.775827:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4718
00000100:00100000:2.0:1767320229.775838:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291962240:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320229.775962:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291962240:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 125us (309us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320229.775971:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4718
00000100:00080000:0.0:1767320229.776053:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320229.778322:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320229.778421:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291962112
00000100:00100000:0.0:1767320229.778431:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291962112
00000100:00100000:0.0:1767320229.778487:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17594
00000100:00100000:0.0:1767320229.778496:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291962112:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320229.778519:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320229.778577:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291962112:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 81us (263us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320229.778585:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17594
00000100:00080000:2.0:1767320229.847119:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320229.847131:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320229.847135:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320229.847139:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320229.847144:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320229.847152:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5127
00000100:00080000:2.0:1767320229.847157:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320229.847163:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320229.847202:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7800 x1853164379959552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320229.847224:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320229.847227:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320229.847228:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320229.847231:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5127
00000100:00080000:2.0:1767320229.847233:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320229.847235:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320229.847255:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859f80 x1853164379959680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320229.847342:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379959808:0@lo:400:kworker.0
00000100:00100000:1.0:1767320229.847428:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320229.847543:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959808
00000100:00100000:3.0:1767320229.847550:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959808
00000100:00100000:3.0:1767320229.847599:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799
00000100:00100000:3.0:1767320229.847605:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379959808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320229.847721:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379959552:0@lo:38:kworker.0
00000100:00100000:0.0:1767320229.847756:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320229.847776:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379959680:0@lo:38:kworker.0
00000100:00100000:0.0:1767320229.847797:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320229.847830:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959680
00000100:00100000:0.0:1767320229.847834:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959680
00000100:00100000:0.0:1767320229.847852:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138
00000100:00100000:0.0:1767320229.847857:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379959680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320229.847891:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320229.847923:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379959680:12345-0@lo:38:kworker.0 Request processed in 64us (125us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320229.847930:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138
00000100:00080000:0.0:1767320229.847951:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320229.847977:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320229.847982:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320229.847985:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379959680:0@lo:38:kworker.0
00000100:00100000:0.0:1767320229.848008:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959552
00000100:00100000:0.0:1767320229.848012:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959552
00000100:00100000:0.0:1767320229.848033:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17595
00000100:00100000:0.0:1767320229.848038:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379959552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320229.848048:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320229.848077:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379959552:12345-0@lo:38:kworker.0 Request processed in 38us (320us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320229.848084:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17595
00000100:00080000:0.0:1767320229.848107:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320229.848111:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320229.848114:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379959552:0@lo:38:kworker.0
00000100:00100000:0.0:1767320229.848134:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379959936:0@lo:400:kworker.0
00000100:00100000:0.0:1767320229.848156:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320229.848198:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379959936
00000100:00100000:0.0:1767320229.848201:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379959936
00000100:00100000:0.0:1767320229.848259:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800
00000100:00100000:0.0:1767320229.848266:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379959936:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320229.848298:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379959936:12345-0@lo:400:kworker.0 Request processed in 32us (140us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320229.848304:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800
00000100:00100000:0.0:1767320229.848332:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379959936:0@lo:400:kworker.0
00000100:00080000:2.0:1767320229.848597:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767320229.848599:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379959808:12345-0@lo:400:kworker.0 Request processed in 992us (1170us total) trans 0 rc 0/0
00000100:00080000:2.0:1767320229.848600:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320229.848603:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320229.848607:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5127
00000100:00100000:3.0:1767320229.848607:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799
00000100:00080000:2.0:1767320229.848610:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320229.848614:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320229.848629:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859880 x1853164379960192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320229.848640:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:2.0:1767320229.848648:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767320229.848648:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379960064:0@lo:400:kworker.0
00000100:00080000:2.0:1767320229.848651:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320229.848652:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320229.848656:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5127
00000100:00080000:2.0:1767320229.848658:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320229.848662:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320229.848673:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ea00 x1853164379960448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320229.848674:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320229.848693:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379960320:0@lo:400:kworker.0
00000100:00100000:2.0:1767320229.848694:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379960192:0@lo:38:kworker.0
00000100:00100000:3.0:1767320229.848713:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320229.848725:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960064
00000100:00100000:2.0:1767320229.848729:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960064
00000100:00100000:3.0:1767320229.848738:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960320
00000100:00100000:3.0:1767320229.848741:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960320
00000100:00100000:2.0:1767320229.848760:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4719
00000100:00100000:2.0:1767320229.848766:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379960064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320229.848800:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379959808:0@lo:400:kworker.0
00000100:00100000:2.0:1767320229.848807:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379960064:12345-0@lo:400:kworker.0 Request processed in 41us (131us total) trans 0 rc 0/0
00000100:00080000:0.0:1767320229.848809:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320229.848861:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4720
00000100:00100000:3.0:1767320229.848885:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379960320:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320229.848927:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379960320:12345-0@lo:400:kworker.0 Request processed in 48us (201us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320229.848934:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4720
00000100:00100000:3.0:1767320229.848962:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320229.848977:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379960448:0@lo:38:kworker.0
00000100:00100000:3.0:1767320229.848997:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320229.849021:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4719
00000100:00100000:3.0:1767320229.849021:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960192
00000100:00100000:3.0:1767320229.849025:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960192
00000100:00100000:2.0:1767320229.849034:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960448
00000100:00100000:2.0:1767320229.849037:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960448
00000100:00100000:3.0:1767320229.849039:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17596
00000100:00100000:3.0:1767320229.849043:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379960192:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320229.849051:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17597
00000100:00100000:2.0:1767320229.849055:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379960448:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320229.849055:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767320229.849063:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320229.849082:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379960448:12345-0@lo:38:kworker.0 Request processed in 25us (83us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320229.849082:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379960192:12345-0@lo:38:kworker.0 Request processed in 37us (119us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320229.849088:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17597
00000100:00100000:3.0:1767320229.849101:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17596
00000100:00080000:3.0:1767320229.849120:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320229.849124:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320229.849127:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379960192:0@lo:38:kworker.0
00000100:00080000:3.0:1767320229.849137:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320229.849139:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320229.849141:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379960448:0@lo:38:kworker.0
00000100:00100000:3.0:1767320229.849164:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379960320:0@lo:400:kworker.0
00000100:00100000:3.0:1767320229.849170:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379960064:0@lo:400:kworker.0
00010000:00010000:1.0:1767320230.423840:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320231.447168:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320232.474257:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320232.920522:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320232.920541:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379960576:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320232.920614:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320232.921527:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960576
00000100:00100000:1.0:1767320232.922117:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960576
00000100:00100000:1.0:1767320232.922221:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596
00000100:00100000:1.0:1767320232.922232:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379960576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320232.922263:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320232.922339:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379960576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (1723us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320232.923137:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379960576:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320232.923420:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596
00000100:00080000:0.0:1767320232.924379:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767320233.497670:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320234.455369:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320234.455404:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379960704:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320234.455486:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320234.455667:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960704
00000100:00100000:2.0:1767320234.455676:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960704
00000100:00100000:2.0:1767320234.455798:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597
00000100:00100000:2.0:1767320234.455807:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379960704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320234.455849:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320234.455922:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379960704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (436us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320234.455929:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597
00000100:00100000:1.0:1767320234.456017:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379960704:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320234.456317:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320234.519421:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320234.895090:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320234.896326:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320234.912735:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291962496
00000100:00100000:0.0:1767320234.912754:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291962496
00000100:00100000:0.0:1767320234.912939:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291962368
00000100:00100000:0.0:1767320234.912944:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291962368
00000100:00080000:1.0:1767320234.913038:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320234.915981:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4721
00000100:00100000:3.0:1767320234.916103:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291962496:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320234.916441:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291962496:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 443us (21358us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320234.916451:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4721
00000100:00100000:3.0:1767320234.916498:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17598
00000100:00100000:3.0:1767320234.916504:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291962368:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320234.916531:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320234.916562:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291962368:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (20246us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320234.916573:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17598
00000100:00080000:3.0:1767320234.969399:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320234.969414:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320234.969418:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320234.969423:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320234.969430:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320234.969440:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5132
00000100:00080000:3.0:1767320234.969445:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320234.969454:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320234.969514:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fce00 x1853164379960832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320234.969562:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320234.969566:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320234.969569:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320234.969573:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5132
00000100:00080000:3.0:1767320234.969576:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320234.969580:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320234.969598:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fed80 x1853164379960960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320234.969689:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320234.969693:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320234.969695:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320234.969699:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5132
00000100:00080000:3.0:1767320234.969702:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320234.969706:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320234.969718:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45180 x1853164379961472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320234.969735:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320234.969739:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320234.969740:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320234.969743:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5132
00000100:00080000:3.0:1767320234.969746:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320234.969751:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320234.969765:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47100 x1853164379961728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320234.969809:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379961600:0@lo:400:kworker.0
00000100:00100000:3.0:1767320234.969958:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320234.970058:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320234.970065:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379961344:0@lo:400:kworker.0
00000100:00100000:3.0:1767320234.970090:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320234.970132:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961600
00000100:00100000:3.0:1767320234.970141:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961600
00000100:00100000:3.0:1767320234.970210:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961344
00000100:00100000:3.0:1767320234.970214:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961344
00000100:00100000:3.0:1767320234.970253:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4722
00000100:00100000:2.0:1767320234.970257:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379961216:0@lo:400:kworker.0
00000100:00100000:3.0:1767320234.970269:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379961600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320234.970402:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379960832:0@lo:38:kworker.0
00000100:00100000:3.0:1767320234.970978:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379961600:12345-0@lo:400:kworker.0 Request processed in 714us (1019us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320234.970987:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4722
00000100:00100000:3.0:1767320234.971116:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4723
00000100:00100000:3.0:1767320234.971127:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379961344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320234.971180:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379961344:12345-0@lo:400:kworker.0 Request processed in 57us (1089us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320234.971187:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4723
00000100:00100000:3.0:1767320234.971245:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379961344:0@lo:400:kworker.0
00000100:00100000:3.0:1767320234.971257:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379961600:0@lo:400:kworker.0
00000100:00100000:1.0:1767320234.971978:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379961088:0@lo:400:kworker.0
00000100:00100000:1.0:1767320234.972047:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320234.972126:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961088
00000100:00100000:1.0:1767320234.972134:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961088
00000100:00100000:1.0:1767320234.972183:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801
00000100:00100000:1.0:1767320234.972192:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379961088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320234.972243:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379961088:12345-0@lo:400:kworker.0 Request processed in 50us (194us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320234.972250:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801
00000100:00080000:1.0:1767320234.972281:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320234.972286:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320234.972326:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379961088:0@lo:400:kworker.0
00000100:00100000:2.0:1767320234.976892:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320234.979190:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961216
00000100:00100000:1.0:1767320234.979204:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961216
00000100:00100000:1.0:1767320234.979400:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802
00000100:00100000:1.0:1767320234.979412:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379961216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320234.982215:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379961216:12345-0@lo:400:kworker.0 Request processed in 2784us (5308us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320234.982230:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802
00000100:00100000:0.0:1767320234.989101:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320234.989184:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379960960:0@lo:38:kworker.0
00000100:00100000:0.0:1767320234.989243:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320234.989329:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379961472:0@lo:38:kworker.0
00000100:00100000:3.0:1767320234.989330:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960960
00000100:00100000:3.0:1767320234.989355:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960960
00000100:00100000:0.0:1767320234.989380:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320234.989417:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379961728:0@lo:38:kworker.0
00000100:00100000:3.0:1767320234.989425:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139
00000100:00100000:3.0:1767320234.989435:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379960960:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320234.989449:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:3.0:1767320234.989462:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320234.989521:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379960832
00000100:00100000:0.0:1767320234.989530:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379960832
00000100:00100000:3.0:1767320234.989559:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379960960:12345-0@lo:38:kworker.0 Request processed in 123us (313us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320234.989568:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961472
00000100:00100000:3.0:1767320234.989574:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139
00000100:00100000:0.0:1767320234.989576:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961472
00000100:00100000:0.0:1767320234.989605:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961728
00000100:00100000:0.0:1767320234.989609:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961728
00000100:00100000:3.0:1767320234.989618:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17599
00000100:00100000:3.0:1767320234.989625:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379960832:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320234.989636:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320234.989641:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379961216:0@lo:400:kworker.0
00000100:00100000:3.0:1767320234.989667:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379960832:12345-0@lo:38:kworker.0 Request processed in 40us (578us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320234.990252:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17600
00000100:00100000:0.0:1767320234.990272:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379961472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320234.990498:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320234.990560:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379961472:12345-0@lo:38:kworker.0 Request processed in 289us (1179us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320234.990568:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17600
00000100:00100000:0.0:1767320234.990590:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17601
00000100:00100000:0.0:1767320234.990594:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379961728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320234.990605:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320234.990629:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379961728:12345-0@lo:38:kworker.0 Request processed in 33us (1181us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320234.990634:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17601
00000100:00080000:0.0:1767320234.991453:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320234.991461:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320234.991468:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379960832:0@lo:38:kworker.0
00000100:00080000:0.0:1767320234.991483:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320234.991487:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320234.991490:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379960960:0@lo:38:kworker.0
00000100:00080000:0.0:1767320234.991501:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320234.991505:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320234.991508:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379961472:0@lo:38:kworker.0
00000100:00080000:0.0:1767320234.991517:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320234.991520:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320234.991523:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379961728:0@lo:38:kworker.0
00000100:00100000:3.0:1767320234.994899:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17599
00010000:00010000:2.0:1767320235.543862:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320236.569058:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320237.593452:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320238.039399:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379961856:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320238.039477:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320238.039661:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961856
00000100:00100000:3.0:1767320238.039674:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961856
00000100:00100000:3.0:1767320238.039770:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598
00000100:00100000:3.0:1767320238.039784:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379961856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320238.039825:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320238.039934:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379961856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (455us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320238.039942:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598
00000100:00100000:2.0:1767320238.040067:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379961856:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320238.040150:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320238.634422:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320239.580773:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379961984:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320239.580915:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320239.585527:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379961984
00000100:00100000:1.0:1767320239.587624:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379961984
00000100:00080000:2.0:1767320239.587893:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320239.588085:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599
00000100:00100000:1.0:1767320239.588100:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379961984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320239.588148:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320239.588773:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379961984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 676us (7866us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320239.588785:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599
00000100:00100000:2.0:1767320239.602147:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379961984:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320239.639368:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320240.023443:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767320240.023497:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291962880 offset 0 length 520: 4
00000100:00100000:3.0:1767320240.023532:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320240.023681:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291962624
00000100:00100000:1.0:1767320240.023696:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291962624
00000100:00100000:1.0:1767320240.023754:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291962752
00000100:00100000:1.0:1767320240.023758:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291962752
00000100:00100000:1.0:1767320240.023829:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4724
00000100:00100000:1.0:1767320240.023842:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291962752:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320240.023995:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291962752:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 155us (461us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320240.024211:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4724
00000100:00080000:0.0:1767320240.024302:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320240.031308:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17602
00000100:00100000:3.0:1767320240.031329:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291962624:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320240.031364:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320240.031502:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291962624:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 177us (8075us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320240.031513:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17602
00000100:00080000:1.0:1767320240.093967:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320240.093979:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320240.093983:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320240.093988:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320240.093994:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320240.094004:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5137
00000100:00080000:1.0:1767320240.094085:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320240.094097:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320240.096129:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85a300 x1853164379962112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320240.096218:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379962112:0@lo:38:kworker.0
00000100:00100000:2.0:1767320240.096330:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320240.096506:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320240.096512:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320240.096516:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320240.096522:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5137
00000100:00080000:1.0:1767320240.096527:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320240.096536:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320240.096575:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164379962240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320240.099756:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379962240:0@lo:38:kworker.0
00000100:00100000:2.0:1767320240.099907:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320240.099922:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379962112
00000100:00100000:3.0:1767320240.099933:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379962112
00000100:00100000:3.0:1767320240.099983:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17603
00000100:00100000:3.0:1767320240.099993:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379962112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320240.100022:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320240.100104:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379962112:12345-0@lo:38:kworker.0 Request processed in 96us (3758us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767320240.103581:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320240.103600:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320240.103607:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379962112:0@lo:38:kworker.0
00000100:00100000:0.0:1767320240.106381:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379962240
00000100:00100000:0.0:1767320240.106410:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379962240
00000100:00100000:0.0:1767320240.106518:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140
00000100:00100000:0.0:1767320240.106532:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379962240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320240.106577:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320240.106709:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379962240:12345-0@lo:38:kworker.0 Request processed in 179us (6810us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320240.106717:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140
00000100:00080000:1.0:1767320240.108682:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320240.108688:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320240.108693:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320240.108702:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5137
00000100:00080000:1.0:1767320240.108709:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320240.108716:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320240.108745:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964dc00 x1853164379962752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320240.108764:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320240.108768:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320240.108770:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320240.108773:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5137
00000100:00080000:1.0:1767320240.108775:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320240.108996:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320240.109098:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379963008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320240.109151:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379962624:0@lo:400:kworker.0
00000100:00100000:2.0:1767320240.109477:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379962880:0@lo:400:kworker.0
00000100:00100000:2.0:1767320240.109557:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379962752:0@lo:38:kworker.0
00000100:00100000:2.0:1767320240.109616:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379962496:0@lo:400:kworker.0
00000100:00100000:2.0:1767320240.109653:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320240.109713:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320240.109719:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379962368:0@lo:400:kworker.0
00000100:00100000:2.0:1767320240.109744:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320240.109793:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379962496
00000100:00100000:2.0:1767320240.109802:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379962496
00000100:00100000:2.0:1767320240.109864:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379962368
00000100:00100000:2.0:1767320240.109887:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379962368
00000100:00100000:0.0:1767320240.110195:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803
00000100:00100000:0.0:1767320240.110209:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379962496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320240.110289:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379962496:12345-0@lo:400:kworker.0 Request processed in 84us (636us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320240.110308:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803
00000100:00100000:1.0:1767320240.110567:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320240.110587:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17603
00000100:00100000:1.0:1767320240.110630:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320240.110662:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379962624
00000100:00100000:1.0:1767320240.110666:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379962624
00000100:00080000:1.0:1767320240.110691:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320240.110720:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379962880
00000100:00100000:1.0:1767320240.110723:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379962880
00000100:00080000:1.0:1767320240.110733:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320240.110757:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4725
00000100:00100000:1.0:1767320240.110764:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379962624:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320240.110817:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379962624:12345-0@lo:400:kworker.0 Request processed in 53us (249us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320240.110824:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4725
00000100:00100000:1.0:1767320240.110848:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4726
00000100:00100000:1.0:1767320240.110853:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379962880:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320240.110915:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379962880:12345-0@lo:400:kworker.0 Request processed in 61us (283us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320240.110921:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4726
00000100:00100000:1.0:1767320240.110963:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379962880:0@lo:400:kworker.0
00000100:00100000:1.0:1767320240.110993:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379962624:0@lo:400:kworker.0
00000100:00100000:3.0:1767320240.111070:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379962496:0@lo:400:kworker.0
00000100:00100000:3.0:1767320240.111571:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320240.111599:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379963008:0@lo:38:kworker.0
00000100:00100000:3.0:1767320240.111639:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320240.111679:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320240.111685:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320240.111689:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379962240:0@lo:38:kworker.0
00000100:00100000:3.0:1767320240.111718:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379962752
00000100:00100000:1.0:1767320240.111721:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379963008
00000100:00100000:3.0:1767320240.111722:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379962752
00000100:00100000:1.0:1767320240.111724:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379963008
00000100:00100000:3.0:1767320240.112574:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17604
00000100:00100000:3.0:1767320240.112585:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379963008:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320240.112610:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320240.112668:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379963008:12345-0@lo:38:kworker.0 Request processed in 82us (1027us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320240.112674:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17604
00000100:00100000:3.0:1767320240.112691:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17605
00000100:00100000:3.0:1767320240.112694:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379962752:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320240.112703:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320240.112725:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379962752:12345-0@lo:38:kworker.0 Request processed in 29us (1155us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320240.112730:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17605
00000100:00100000:2.0:1767320240.116758:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804
00000100:00100000:2.0:1767320240.116778:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379962368:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320240.117279:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379962368:12345-0@lo:400:kworker.0 Request processed in 505us (7530us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320240.117289:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804
00000100:00080000:2.0:1767320240.117439:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320240.117525:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320240.117532:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320240.117548:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379962752:0@lo:38:kworker.0
00000100:00080000:2.0:1767320240.117571:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320240.117575:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320240.117578:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379963008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320240.117649:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379962368:0@lo:400:kworker.0
00010000:00010000:2.0:1767320240.663240:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320241.688666:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320242.711418:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320243.161436:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379963136:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320243.161554:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320243.161853:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379963136
00000100:00100000:3.0:1767320243.161864:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379963136
00000100:00100000:3.0:1767320243.161982:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600
00000100:00100000:3.0:1767320243.161994:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379963136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320243.162035:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320243.162100:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379963136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (545us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320243.162108:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600
00000100:00080000:1.0:1767320243.162900:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320243.162964:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379963136:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320243.736361:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320244.248457:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320219/real 1767320219]  req@ffff8b0e0dc22a00 x1853164379956864/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320244.248518:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0dc22a00 x1853164379956864/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320244.248545:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320244.248644:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320244.248649:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379956864:0@lo:250:kworker.0
00000100:00080000:1.0:1767320244.258174:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320244.258188:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320244.258194:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320244.258204:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5122
00000100:00080000:1.0:1767320244.258211:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320244.258221:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320244.258284:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360ad80 x1853164379963264/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320244.258324:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320244.258329:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320244.258330:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320244.258334:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5142
00000100:00080000:1.0:1767320244.258337:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320244.258341:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320244.258360:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164379963392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320244.258370:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320244.258374:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320244.258376:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320244.258380:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5142
00000100:00080000:1.0:1767320244.258382:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320244.258386:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320244.258399:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164379963520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320244.258525:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379963648:0@lo:400:kworker.0
00000100:00100000:3.0:1767320244.258618:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320244.258768:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320244.258771:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320244.258774:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320244.258779:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5142
00000100:00080000:1.0:1767320244.258782:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320244.258786:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320244.258798:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360aa00 x1853164379964032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320244.258903:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379963264:0@lo:250:kworker.0
00000400:00000100:2.0:1767320244.258946:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379963264 offset 0 length 520: 4
00000100:00100000:2.0:1767320244.258971:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379963392:0@lo:38:kworker.0
00000100:00100000:0.0:1767320244.259413:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379963648
00000100:00100000:0.0:1767320244.259425:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379963648
00000100:00100000:0.0:1767320244.259501:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805
00000100:00100000:0.0:1767320244.259514:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379963648:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320244.259801:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320244.259900:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379963520:0@lo:38:kworker.0
00000100:00100000:2.0:1767320244.259951:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320244.259983:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379964032:0@lo:38:kworker.0
00000100:00100000:2.0:1767320244.260003:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320244.260073:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379963392
00000100:00100000:2.0:1767320244.260081:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379963392
00000100:00100000:2.0:1767320244.260110:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964032
00000100:00100000:2.0:1767320244.260112:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964032
00000100:00100000:2.0:1767320244.260128:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17606
00000100:00100000:2.0:1767320244.260135:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379963392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320244.260154:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320244.260192:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379963392:12345-0@lo:38:kworker.0 Request processed in 57us (400us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320244.260199:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17606
00000100:00100000:2.0:1767320244.260215:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17607
00000100:00100000:2.0:1767320244.260219:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379964032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320244.260228:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320244.260248:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379964032:12345-0@lo:38:kworker.0 Request processed in 28us (244us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320244.260266:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17607
00000100:00080000:2.0:1767320244.260298:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320244.260302:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320244.260305:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379963392:0@lo:38:kworker.0
00000100:00080000:2.0:1767320244.260314:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320244.260316:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320244.260319:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379964032:0@lo:38:kworker.0
00000100:00100000:2.0:1767320244.260579:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379963904:0@lo:400:kworker.0
00000100:00100000:2.0:1767320244.260604:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320244.260622:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320244.260628:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379963776:0@lo:400:kworker.0
00000100:00100000:2.0:1767320244.260647:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320244.260667:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379963776
00000100:00100000:2.0:1767320244.260671:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379963776
00000100:00100000:2.0:1767320244.260703:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806
00000100:00100000:2.0:1767320244.260709:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379963776:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320244.260757:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379963776:12345-0@lo:400:kworker.0 Request processed in 48us (109us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320244.260764:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806
00000100:00100000:2.0:1767320244.260787:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379963776:0@lo:400:kworker.0
00000100:00100000:2.0:1767320244.260805:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379964160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320244.260827:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320244.260853:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379963904
00000100:00100000:2.0:1767320244.260855:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379963904
00000100:00100000:2.0:1767320244.260899:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964160
00000100:00100000:2.0:1767320244.260901:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964160
00000100:00100000:2.0:1767320244.260918:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4727
00000100:00100000:2.0:1767320244.260923:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379963904:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320244.263392:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320244.263406:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320244.263411:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320244.263420:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5142
00000100:00080000:1.0:1767320244.263426:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320244.263435:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320244.263488:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b100 x1853164379964288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320244.263561:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320244.263569:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320244.263586:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379963904:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320244.263600:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4728
00000100:00100000:2.0:1767320244.263613:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4727
00000100:00100000:1.0:1767320244.263622:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379964160:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320244.263926:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379963648:12345-0@lo:400:kworker.0 Request processed in 4406us (5298us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320244.263937:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805
00000100:00100000:0.0:1767320244.263991:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379963520
00000100:00100000:0.0:1767320244.264000:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379963520
00000100:00100000:0.0:1767320244.264333:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141
00000100:00100000:0.0:1767320244.264339:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379963520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320244.264365:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320244.264416:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379963520:12345-0@lo:38:kworker.0 Request processed in 75us (4463us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320244.264422:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141
00000100:00100000:0.0:1767320244.264478:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379964288:0@lo:38:kworker.0
00000100:00100000:0.0:1767320244.264522:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320244.264572:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320244.264578:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320244.264581:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379963520:0@lo:38:kworker.0
00000100:00100000:0.0:1767320244.264615:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964288
00000100:00100000:0.0:1767320244.264619:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964288
00000100:00100000:0.0:1767320244.264662:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17608
00000100:00100000:0.0:1767320244.264668:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379964288:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320244.264678:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320244.264706:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379964288:12345-0@lo:38:kworker.0 Request processed in 37us (184us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320244.264712:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17608
00000100:00080000:0.0:1767320244.264733:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320244.264737:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320244.264740:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379964288:0@lo:38:kworker.0
00000100:00100000:3.0:1767320244.265587:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379963648:0@lo:400:kworker.0
00000100:00100000:1.0:1767320244.265752:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379964160:12345-0@lo:400:kworker.0 Request processed in 2140us (4921us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320244.265762:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4728
00000100:00100000:1.0:1767320244.266531:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379963904:0@lo:400:kworker.0
00000100:00100000:1.0:1767320244.266590:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379964160:0@lo:400:kworker.0
00000100:00100000:1.0:1767320244.695379:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320244.695399:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379964416:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320244.695460:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320244.695692:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964416
00000100:00100000:0.0:1767320244.695701:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964416
00000100:00100000:0.0:1767320244.695754:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601
00000100:00100000:0.0:1767320244.695764:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379964416:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320244.695792:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320244.695851:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379964416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (390us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320244.695858:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601
00000100:00100000:1.0:1767320244.696137:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379964416:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320244.760193:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320245.135618:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320245.135662:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320245.135745:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963008
00000100:00100000:1.0:1767320245.135754:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963008
00000100:00100000:1.0:1767320245.135795:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963136
00000100:00100000:1.0:1767320245.135797:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963136
00000100:00100000:1.0:1767320245.135851:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4729
00000100:00100000:1.0:1767320245.135861:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291963136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320245.135964:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291963136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (300us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320245.135970:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4729
00000100:00100000:1.0:1767320245.135990:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17609
00000100:00100000:1.0:1767320245.135994:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291963008:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320245.136015:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320245.136048:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291963008:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (430us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320245.136054:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17609
00000100:00080000:0.0:1767320245.136144:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320245.783606:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320246.807324:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320247.831436:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320248.279280:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379964544:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320248.279355:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320248.279494:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964544
00000100:00100000:3.0:1767320248.279503:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964544
00000100:00100000:3.0:1767320248.279580:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602
00000100:00100000:3.0:1767320248.279589:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379964544:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320248.279617:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320248.279699:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379964544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (344us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320248.279707:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602
00000100:00100000:3.0:1767320248.279754:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379964544:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320248.280098:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320248.855344:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320249.303200:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320249.303238:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320249.303241:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320249.303245:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320249.303249:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320249.303257:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767320249.303261:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320249.303279:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320249.303319:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ed80 x1853164379964672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320249.303337:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320249.303340:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320249.303342:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320249.303346:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767320249.303348:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320249.303352:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320249.303366:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164379964800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320249.303435:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320249.303438:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320249.303440:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320249.303444:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767320249.303446:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320249.303450:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320249.303461:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729e680 x1853164379965312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320249.303477:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320249.303481:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320249.303483:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320249.303486:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767320249.303488:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320249.303492:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320249.303501:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c700 x1853164379965568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320249.303560:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379965184:0@lo:400:kworker.0
00000100:00100000:3.0:1767320249.303725:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379964928:0@lo:400:kworker.0
00000100:00100000:0.0:1767320249.303785:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320249.303832:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379965056:0@lo:400:kworker.0
00000100:00100000:2.0:1767320249.303900:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379964672:0@lo:38:kworker.0
00000100:00100000:3.0:1767320249.308732:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320249.308823:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320249.308836:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379965440:0@lo:400:kworker.0
00000100:00100000:3.0:1767320249.308890:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320249.309176:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964928
00000100:00100000:3.0:1767320249.309185:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964928
00000100:00100000:3.0:1767320249.309250:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807
00000100:00100000:3.0:1767320249.309259:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379964928:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320249.309326:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379964928:12345-0@lo:400:kworker.0 Request processed in 67us (600us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320249.309333:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807
00000100:00100000:3.0:1767320249.309356:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965184
00000100:00100000:3.0:1767320249.309360:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965184
00000100:00100000:3.0:1767320249.309402:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965440
00000100:00100000:3.0:1767320249.309405:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965440
00000100:00100000:3.0:1767320249.309427:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4730
00000100:00100000:3.0:1767320249.309433:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379965184:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320249.309466:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379965184:12345-0@lo:400:kworker.0 Request processed in 33us (5697us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320249.309472:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4730
00000100:00100000:3.0:1767320249.309483:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4731
00000100:00100000:3.0:1767320249.309490:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379965440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320249.309525:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379965440:12345-0@lo:400:kworker.0 Request processed in 36us (634us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320249.309532:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4731
00000100:00080000:3.0:1767320249.309548:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320249.309583:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379965440:0@lo:400:kworker.0
00000100:00100000:3.0:1767320249.309595:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379964928:0@lo:400:kworker.0
00000100:00100000:0.0:1767320249.311096:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379965184:0@lo:400:kworker.0
00000100:00100000:1.0:1767320249.311259:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320249.311490:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320249.311527:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379964800:0@lo:38:kworker.0
00000100:00100000:2.0:1767320249.311565:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320249.311597:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379965312:0@lo:38:kworker.0
00000100:00100000:2.0:1767320249.311632:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320249.311658:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964672
00000100:00100000:2.0:1767320249.311665:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964672
00000100:00100000:2.0:1767320249.311695:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965312
00000100:00100000:2.0:1767320249.311698:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965312
00000100:00100000:2.0:1767320249.311719:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17610
00000100:00100000:2.0:1767320249.311725:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379964672:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320249.312108:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17611
00000100:00100000:1.0:1767320249.312113:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379965312:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320249.312159:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320249.312199:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379964672:12345-0@lo:38:kworker.0 Request processed in 473us (708us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320249.312206:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17610
00000100:00100000:2.0:1767320249.312250:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379965568:0@lo:38:kworker.0
00000100:00100000:2.0:1767320249.312289:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320249.312309:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965568
00000100:00100000:2.0:1767320249.312313:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965568
00000100:00100000:2.0:1767320249.312333:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17612
00000100:00100000:2.0:1767320249.312337:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379965568:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320249.312385:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965056
00000100:00100000:3.0:1767320249.312389:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965056
00000100:00100000:3.0:1767320249.312428:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808
00000100:00100000:3.0:1767320249.312436:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379965056:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320249.312484:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379965056:12345-0@lo:400:kworker.0 Request processed in 50us (1226us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320249.312494:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808
00000100:00080000:3.0:1767320249.312512:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320249.312560:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320249.312566:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320249.312570:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379964672:0@lo:38:kworker.0
00000100:00100000:0.0:1767320249.313032:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379964800
00000100:00100000:0.0:1767320249.313037:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379964800
00000100:00100000:0.0:1767320249.313073:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142
00000100:00100000:0.0:1767320249.313079:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379964800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320249.317455:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320249.317557:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379965312:12345-0@lo:38:kworker.0 Request processed in 5438us (5921us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320249.317570:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17611
00000100:00100000:1.0:1767320249.317660:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379965056:0@lo:400:kworker.0
00000100:00080000:3.0:1767320249.317790:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320249.317796:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320249.317800:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379965312:0@lo:38:kworker.0
00010000:00020000:2.0:1767320249.318065:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320249.318113:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379965568:12345-0@lo:38:kworker.0 Request processed in 5774us (5823us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320249.318121:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17612
00010000:00020000:0.0:1767320249.318404:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320249.318440:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379964800:12345-0@lo:38:kworker.0 Request processed in 5359us (6873us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320249.318448:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142
00000100:00080000:1.0:1767320249.318528:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320249.318534:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320249.318537:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379964800:0@lo:38:kworker.0
00000100:00080000:1.0:1767320249.318547:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320249.318551:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320249.318553:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379965568:0@lo:38:kworker.0
00000100:00100000:1.0:1767320249.816425:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320249.816448:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379965696:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320249.816532:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320249.816843:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965696
00000100:00100000:0.0:1767320249.816852:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965696
00000100:00100000:0.0:1767320249.816930:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603
00000100:00100000:0.0:1767320249.816939:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379965696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320249.816970:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320249.817030:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379965696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (497us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320249.817039:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603
00000100:00100000:2.0:1767320249.817280:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379965696:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320249.879160:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320250.257098:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320250.257324:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963264
00000100:00100000:2.0:1767320250.257335:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963264
00000100:00100000:2.0:1767320250.257428:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17613
00000100:00100000:2.0:1767320250.257437:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291963264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320250.257465:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320250.257944:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291963264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 504us (853us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320250.257953:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17613
00000100:00100000:3.0:1767320250.261604:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320250.261708:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963392
00000100:00100000:2.0:1767320250.261718:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963392
00000100:00100000:2.0:1767320250.261832:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4732
00000100:00100000:2.0:1767320250.261843:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291963392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320250.261948:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291963392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 107us (352us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320250.261957:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4732
00000100:00080000:3.0:1767320250.262570:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320250.903302:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320251.927149:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320252.979141:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320253.401498:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379965824:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320253.401569:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320253.401711:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965824
00000100:00100000:1.0:1767320253.401719:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965824
00000100:00100000:1.0:1767320253.401788:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604
00000100:00100000:1.0:1767320253.401797:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379965824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320253.401835:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320253.401897:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379965824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (327us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320253.401904:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604
00000100:00080000:3.0:1767320253.402152:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320253.403423:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379965824:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320253.975239:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320254.423228:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320254.423239:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320254.423242:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320254.423246:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320254.423250:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320254.423258:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5151
00000100:00080000:0.0:1767320254.423262:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320254.423268:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320254.423304:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729dc00 x1853164379965952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320254.423333:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320254.423337:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320254.423340:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320254.423343:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5151
00000100:00080000:0.0:1767320254.423345:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320254.423350:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320254.423365:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729e300 x1853164379966080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320254.423424:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320254.423427:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320254.423429:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320254.423434:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5151
00000100:00080000:0.0:1767320254.423437:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320254.423440:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320254.423445:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379965952:0@lo:38:kworker.0
00000100:00100000:0.0:1767320254.423454:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f800 x1853164379966592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320254.423470:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320254.423473:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320254.423475:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320254.423479:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5151
00000100:00080000:0.0:1767320254.423481:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320254.423485:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320254.423495:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d500 x1853164379966848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320254.423524:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320254.423546:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379966464:0@lo:400:kworker.0
00000100:00100000:3.0:1767320254.423572:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379965952
00000100:00100000:3.0:1767320254.423581:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379965952
00000100:00100000:1.0:1767320254.423585:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320254.423620:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966464
00000100:00100000:3.0:1767320254.423624:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966464
00000100:00100000:1.0:1767320254.423636:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320254.423645:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379966336:0@lo:400:kworker.0
00000100:00100000:3.0:1767320254.423667:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4733
00000100:00100000:1.0:1767320254.423677:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320254.423682:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379966464:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320254.423717:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379966208:0@lo:400:kworker.0
00000100:00100000:2.0:1767320254.423814:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17614
00000100:00100000:2.0:1767320254.423821:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379965952:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320254.423853:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320254.423909:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379965952:12345-0@lo:38:kworker.0 Request processed in 86us (385us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320254.423917:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17614
00000100:00100000:2.0:1767320254.423946:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379966720:0@lo:400:kworker.0
00000100:00100000:2.0:1767320254.423973:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320254.424009:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966720
00000100:00100000:2.0:1767320254.424013:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966720
00000100:00100000:2.0:1767320254.424055:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4734
00000100:00100000:2.0:1767320254.424063:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379966720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320254.424098:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379966720:12345-0@lo:400:kworker.0 Request processed in 36us (124us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320254.424148:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4734
00000100:00100000:2.0:1767320254.424198:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379966720:0@lo:400:kworker.0
00000100:00080000:2.0:1767320254.424330:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320254.424344:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320254.424348:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379965952:0@lo:38:kworker.0
00000100:00100000:2.0:1767320254.424355:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379966080:0@lo:38:kworker.0
00000100:00100000:2.0:1767320254.424380:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320254.424415:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379966592:0@lo:38:kworker.0
00000100:00100000:2.0:1767320254.424436:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320254.424457:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966592
00000100:00100000:2.0:1767320254.424461:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966592
00000100:00100000:2.0:1767320254.424483:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17615
00000100:00100000:2.0:1767320254.424487:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379966592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320254.424498:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320254.424527:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379966592:12345-0@lo:38:kworker.0 Request processed in 38us (89us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320254.424535:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17615
00000100:00080000:2.0:1767320254.424559:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320254.424563:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320254.424566:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379966592:0@lo:38:kworker.0
00000100:00100000:2.0:1767320254.424572:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379966848:0@lo:38:kworker.0
00000100:00100000:2.0:1767320254.424610:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320254.424630:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966848
00000100:00100000:2.0:1767320254.424634:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966848
00000100:00100000:2.0:1767320254.424650:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17616
00000100:00100000:2.0:1767320254.424655:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379966848:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320254.424664:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320254.424687:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379966848:12345-0@lo:38:kworker.0 Request processed in 31us (76us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320254.424693:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17616
00000100:00080000:2.0:1767320254.424716:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320254.424720:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320254.424723:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379966848:0@lo:38:kworker.0
00000100:00100000:2.0:1767320254.424768:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966336
00000100:00100000:2.0:1767320254.424771:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966336
00000100:00100000:2.0:1767320254.424802:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809
00000100:00100000:2.0:1767320254.424811:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379966336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320254.424822:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379966464:12345-0@lo:400:kworker.0 Request processed in 1144us (1237us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320254.424831:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4733
00000100:00100000:2.0:1767320254.424853:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379966336:12345-0@lo:400:kworker.0 Request processed in 43us (1175us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320254.424860:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809
00000100:00080000:2.0:1767320254.424897:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320254.424902:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320254.426451:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379966336:0@lo:400:kworker.0
00000100:00100000:1.0:1767320254.426478:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379966464:0@lo:400:kworker.0
00000100:00100000:0.0:1767320254.426788:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966080
00000100:00100000:0.0:1767320254.426795:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966080
00000100:00100000:0.0:1767320254.426827:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143
00000100:00100000:0.0:1767320254.426834:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379966080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320254.426853:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320254.426943:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379966080:12345-0@lo:38:kworker.0 Request processed in 108us (2561us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320254.426949:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143
00000100:00080000:1.0:1767320254.427056:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320254.427069:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320254.427071:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320254.427077:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379966080:0@lo:38:kworker.0
00000100:00100000:0.0:1767320254.427097:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966208
00000100:00100000:0.0:1767320254.427101:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966208
00000100:00100000:0.0:1767320254.427127:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810
00000100:00100000:0.0:1767320254.427134:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379966208:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320254.427204:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379966208:12345-0@lo:400:kworker.0 Request processed in 71us (136us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320254.427210:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810
00000100:00100000:1.0:1767320254.427488:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379966208:0@lo:400:kworker.0
00000100:00100000:1.0:1767320254.936565:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379966976:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320254.936633:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320254.936740:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379966976
00000100:00100000:2.0:1767320254.936748:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379966976
00000100:00100000:2.0:1767320254.936794:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605
00000100:00100000:2.0:1767320254.936803:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379966976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320254.936831:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320254.939528:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379966976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2719us (2887us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320254.939541:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605
00000100:00100000:1.0:1767320254.943267:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379966976:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320254.999060:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320255.379623:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320255.379741:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320255.380918:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963648
00000100:00100000:1.0:1767320255.380932:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963648
00000100:00100000:2.0:1767320255.380933:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963520
00000100:00100000:2.0:1767320255.380938:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963520
00000100:00100000:2.0:1767320255.380990:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17617
00000100:00100000:2.0:1767320255.380999:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291963520:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:3.0:1767320255.381000:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:2.0:1767320255.381027:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320255.381100:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291963520:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 100us (1359us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320255.381109:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17617
00000100:00100000:1.0:1767320255.381419:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4735
00000100:00100000:1.0:1767320255.381428:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291963648:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320255.381466:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291963648:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 41us (1854us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320255.381471:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4735
00010000:00010000:2.0:1767320256.023183:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320257.047477:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320258.071021:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320258.519667:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379967104:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320258.519758:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320258.520090:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379967104
00000100:00100000:0.0:1767320258.520402:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379967104
00000100:00100000:0.0:1767320258.520480:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606
00000100:00100000:0.0:1767320258.520491:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379967104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320258.520524:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320258.520588:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379967104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (830us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320258.520596:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606
00000100:00100000:2.0:1767320258.520778:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379967104:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320258.521001:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767320259.095315:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320259.543099:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320259.543109:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320259.543121:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320259.543126:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320259.543131:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320259.543139:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5156
00000100:00080000:2.0:1767320259.543143:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320259.543151:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320259.543193:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ea00 x1853164379967232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320259.543219:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320259.543223:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320259.543225:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320259.543229:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5156
00000100:00080000:2.0:1767320259.543232:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320259.543235:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320259.543248:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ed80 x1853164379967360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320259.543309:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320259.543312:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320259.543314:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320259.543317:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5156
00000100:00080000:2.0:1767320259.543319:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320259.543322:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320259.543330:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379967616:0@lo:400:kworker.0
00000100:00100000:2.0:1767320259.543332:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ca80 x1853164379967872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320259.543346:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320259.543349:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320259.543350:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320259.543353:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5156
00000100:00080000:2.0:1767320259.543355:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320259.543359:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320259.543367:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f480 x1853164379968128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320259.543398:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320259.543402:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379967488:0@lo:400:kworker.0
00000100:00100000:0.0:1767320259.543451:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379968000:0@lo:400:kworker.0
00000100:00100000:3.0:1767320259.543458:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320259.543462:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379967744:0@lo:400:kworker.0
00000100:00100000:1.0:1767320259.543606:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379967232:0@lo:38:kworker.0
00000100:00100000:2.0:1767320259.543650:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320259.543687:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379967616
00000100:00100000:2.0:1767320259.543693:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379967616
00000100:00100000:2.0:1767320259.543738:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379967488
00000100:00100000:3.0:1767320259.546282:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320259.546369:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811
00000100:00100000:3.0:1767320259.546385:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379967616:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320259.546439:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379967616:12345-0@lo:400:kworker.0 Request processed in 62us (3040us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320259.546445:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811
00000100:00080000:3.0:1767320259.546472:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320259.546485:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379967744
00000100:00100000:3.0:1767320259.546493:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379967744
00000100:00100000:3.0:1767320259.546538:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4736
00000100:00100000:3.0:1767320259.546544:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379967744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320259.547648:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320259.547910:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968000
00000100:00100000:0.0:1767320259.547918:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968000
00000100:00100000:0.0:1767320259.547964:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4737
00000100:00100000:0.0:1767320259.547973:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379968000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320259.548361:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379968000:12345-0@lo:400:kworker.0 Request processed in 388us (716us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320259.548369:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4737
00000100:00100000:0.0:1767320259.548421:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379968000:0@lo:400:kworker.0
00000100:00100000:0.0:1767320259.548491:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379967744:0@lo:400:kworker.0
00000100:00100000:0.0:1767320259.548506:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379967616:0@lo:400:kworker.0
00000100:00080000:0.0:1767320259.548535:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320259.548621:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379967744:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320259.548629:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4736
00000100:00100000:1.0:1767320259.548970:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320259.549232:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379967360:0@lo:38:kworker.0
00000100:00100000:1.0:1767320259.549271:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320259.549308:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379967872:0@lo:38:kworker.0
00000100:00100000:1.0:1767320259.549328:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320259.549381:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379967488
00000100:00100000:0.0:1767320259.549383:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379967360
00000100:00100000:0.0:1767320259.549386:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379967360
00000100:00100000:0.0:1767320259.549411:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144
00000100:00100000:0.0:1767320259.549417:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379967360:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320259.549421:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812
00000100:00100000:2.0:1767320259.549426:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379967488:12345-0@lo:400:kworker.0
00010000:00020000:0.0:1767320259.549437:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320259.549464:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379967360:12345-0@lo:38:kworker.0 Request processed in 46us (192us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320259.549467:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379967488:12345-0@lo:400:kworker.0 Request processed in 42us (5817us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320259.549471:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144
00000100:00100000:2.0:1767320259.549473:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812
00000100:00100000:2.0:1767320259.549503:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379967488:0@lo:400:kworker.0
00000100:00100000:1.0:1767320259.549543:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379968128:0@lo:38:kworker.0
00000100:00100000:1.0:1767320259.549565:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320259.549611:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379967232
00000100:00100000:3.0:1767320259.549616:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379967232
00000100:00100000:3.0:1767320259.549642:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379967872
00000100:00100000:3.0:1767320259.549645:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379967872
00000100:00100000:3.0:1767320259.549661:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17618
00000100:00100000:3.0:1767320259.549666:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379967232:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320259.549668:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17619
00000100:00100000:2.0:1767320259.549673:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379967872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320259.549676:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767320259.549681:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320259.549709:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379967872:12345-0@lo:38:kworker.0 Request processed in 35us (380us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320259.549709:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379967232:12345-0@lo:38:kworker.0 Request processed in 42us (739us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320259.549715:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17619
00000100:00100000:2.0:1767320259.549742:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968128
00000100:00100000:2.0:1767320259.549745:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968128
00000100:00080000:1.0:1767320259.549756:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320259.549762:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320259.549765:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379967232:0@lo:38:kworker.0
00000100:00080000:1.0:1767320259.549779:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320259.549782:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320259.549785:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379967360:0@lo:38:kworker.0
00000100:00080000:1.0:1767320259.549792:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320259.549794:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320259.549797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379967872:0@lo:38:kworker.0
00000100:00100000:3.0:1767320259.549847:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17618
00000100:00100000:2.0:1767320259.550284:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17620
00000100:00100000:2.0:1767320259.550293:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379968128:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320259.550304:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320259.550387:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379968128:12345-0@lo:38:kworker.0 Request processed in 94us (821us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320259.550393:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17620
00000100:00080000:1.0:1767320259.550690:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320259.550696:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320259.550699:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379968128:0@lo:38:kworker.0
00000100:00100000:2.0:1767320260.055795:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379968256:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320260.055860:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320260.055906:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968256
00000100:00100000:1.0:1767320260.055914:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968256
00000100:00100000:1.0:1767320260.055960:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607
00000100:00100000:1.0:1767320260.055970:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379968256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320260.055997:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320260.056048:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379968256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (187us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320260.056056:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607
00000100:00100000:2.0:1767320260.056170:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379968256:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320260.121166:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320260.505087:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320260.505148:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320260.505244:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963776
00000100:00100000:2.0:1767320260.505257:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963776
00000100:00100000:2.0:1767320260.505306:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291963904
00000100:00100000:2.0:1767320260.505309:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291963904
00000100:00100000:2.0:1767320260.505364:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4738
00000100:00100000:2.0:1767320260.505375:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291963904:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320260.505461:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291963904:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (312us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320260.505468:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4738
00000100:00100000:2.0:1767320260.505486:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17621
00000100:00100000:2.0:1767320260.505491:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291963776:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320260.505510:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320260.505536:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291963776:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (459us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320260.505541:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17621
00000100:00080000:1.0:1767320260.508224:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320261.143110:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320262.172461:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320263.192495:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320263.639238:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379968384:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320263.639311:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320263.639456:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968384
00000100:00100000:2.0:1767320263.639465:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968384
00000100:00100000:2.0:1767320263.639529:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608
00000100:00100000:2.0:1767320263.639539:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379968384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320263.639572:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320263.639620:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379968384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (309us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320263.639628:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608
00000100:00100000:2.0:1767320263.639691:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379968384:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320263.639933:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320264.220210:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767320264.593396:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291964032 offset 0 length 520: 4
00000100:00100000:3.0:1767320264.593443:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320264.593491:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320264.593583:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291964288
00000100:00100000:2.0:1767320264.593592:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291964288
00000100:00100000:2.0:1767320264.593662:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291964160
00000100:00100000:2.0:1767320264.593665:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291964160
00000100:00100000:2.0:1767320264.593687:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4739
00000100:00100000:2.0:1767320264.593697:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291964288:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320264.593766:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291964288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (322us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320264.593773:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4739
00000100:00100000:2.0:1767320264.593792:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17622
00000100:00100000:2.0:1767320264.593796:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291964160:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320264.593830:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320264.593858:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291964160:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (365us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320264.593864:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17622
00000100:00080000:3.0:1767320264.593959:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320264.663456:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320264.663467:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320264.663470:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320264.663483:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320264.663488:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320264.663495:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5161
00000100:00080000:0.0:1767320264.663499:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320264.663505:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320264.663545:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d500 x1853164379968512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320264.663605:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379968512:0@lo:38:kworker.0
00000100:00100000:2.0:1767320264.663676:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320264.663839:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968512
00000100:00100000:1.0:1767320264.663847:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968512
00000100:00100000:1.0:1767320264.663922:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17623
00000100:00100000:1.0:1767320264.663939:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379968512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320264.663958:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320264.664372:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320264.664395:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320264.664398:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320264.664403:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5161
00000100:00080000:0.0:1767320264.664406:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320264.664411:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320264.664431:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f800 x1853164379968640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320264.664660:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379968640:0@lo:38:kworker.0
00000100:00100000:2.0:1767320264.664700:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320264.664940:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968640
00000100:00100000:3.0:1767320264.664946:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968640
00000100:00100000:3.0:1767320264.664976:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145
00000100:00100000:3.0:1767320264.664983:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379968640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320264.664999:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320264.665041:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379968640:12345-0@lo:38:kworker.0 Request processed in 56us (339us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320264.665048:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145
00000100:00100000:1.0:1767320264.665349:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379968512:12345-0@lo:38:kworker.0 Request processed in 1417us (1671us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320264.665358:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17623
00000100:00080000:0.0:1767320264.665521:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320264.665525:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320264.665527:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320264.665532:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5161
00000100:00080000:0.0:1767320264.665535:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320264.665539:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320264.665555:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ff480 x1853164379969152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320264.665574:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320264.665577:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320264.665579:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320264.665583:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5161
00000100:00080000:0.0:1767320264.665585:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320264.665589:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320264.665599:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ff800 x1853164379969408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320264.665633:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379969024:0@lo:400:kworker.0
00000100:00100000:0.0:1767320264.665668:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320264.665691:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320264.665698:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379968896:0@lo:400:kworker.0
00000100:00100000:0.0:1767320264.665723:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320264.665975:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969024
00000100:00100000:1.0:1767320264.665981:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969024
00000100:00100000:1.0:1767320264.666027:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4740
00000100:00100000:1.0:1767320264.666034:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379969024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320264.666319:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379969024:12345-0@lo:400:kworker.0 Request processed in 284us (649us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320264.666327:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4740
00000100:00100000:1.0:1767320264.666353:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379968768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320264.666399:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379969280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320264.666424:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320264.666454:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969280
00000100:00100000:1.0:1767320264.666458:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969280
00000100:00100000:1.0:1767320264.666497:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4741
00000100:00100000:1.0:1767320264.666504:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379969280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320264.666538:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379969280:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320264.666544:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4741
00000100:00100000:1.0:1767320264.666580:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379969280:0@lo:400:kworker.0
00000100:00080000:1.0:1767320264.666610:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320264.666772:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379969024:0@lo:400:kworker.0
00000100:00100000:0.0:1767320264.666796:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320264.667054:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968896
00000100:00100000:0.0:1767320264.667059:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968896
00000100:00100000:0.0:1767320264.667261:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813
00000100:00100000:0.0:1767320264.667268:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379968896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320264.667307:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379968896:12345-0@lo:400:kworker.0 Request processed in 40us (1582us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320264.667313:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813
00000100:00100000:0.0:1767320264.667323:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379968768
00000100:00100000:0.0:1767320264.667326:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379968768
00000100:00100000:0.0:1767320264.667343:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814
00000100:00100000:0.0:1767320264.667348:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379968768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320264.667376:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379968768:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320264.667382:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814
00000100:00100000:0.0:1767320264.667410:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379968896:0@lo:400:kworker.0
00000100:00080000:0.0:1767320264.667432:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320264.667448:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379968768:0@lo:400:kworker.0
00000100:00080000:2.0:1767320264.667711:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320264.667717:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320264.667722:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379968512:0@lo:38:kworker.0
00000100:00100000:2.0:1767320264.667907:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379969152:0@lo:38:kworker.0
00000100:00100000:2.0:1767320264.668035:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320264.668269:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379969408:0@lo:38:kworker.0
00000100:00100000:2.0:1767320264.668293:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320264.668363:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320264.668368:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320264.668371:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379968640:0@lo:38:kworker.0
00000100:00100000:1.0:1767320264.668461:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969152
00000100:00100000:1.0:1767320264.668466:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969152
00000100:00100000:1.0:1767320264.668574:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969408
00000100:00100000:1.0:1767320264.668577:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969408
00000100:00100000:1.0:1767320264.668603:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17624
00000100:00100000:1.0:1767320264.668609:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379969152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320264.668627:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320264.668668:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379969152:12345-0@lo:38:kworker.0 Request processed in 58us (632us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320264.668674:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17624
00000100:00100000:1.0:1767320264.668690:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17625
00000100:00100000:1.0:1767320264.668693:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379969408:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320264.668702:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320264.668725:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379969408:12345-0@lo:38:kworker.0 Request processed in 30us (431us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767320264.668850:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320264.668854:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320264.668857:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379969152:0@lo:38:kworker.0
00000100:00080000:2.0:1767320264.668865:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320264.668891:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320264.668894:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379969408:0@lo:38:kworker.0
00000100:00100000:1.0:1767320264.669320:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17625
00000100:00100000:1.0:1767320265.175764:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320265.175798:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379969536:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320265.175896:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320265.177416:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969536
00000100:00100000:3.0:1767320265.177428:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969536
00000100:00100000:3.0:1767320265.177495:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609
00000100:00100000:3.0:1767320265.177504:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379969536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320265.177535:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320265.177602:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379969536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1706us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320265.177609:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609
00000100:00100000:3.0:1767320265.177671:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379969536:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320265.239200:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320266.264169:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320267.287211:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320268.311438:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320268.759966:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379969664:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320268.760048:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320268.760124:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969664
00000100:00100000:1.0:1767320268.760132:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969664
00000100:00100000:1.0:1767320268.760189:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610
00000100:00100000:1.0:1767320268.760199:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379969664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320268.760229:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320268.760268:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379969664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (220us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320268.760275:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610
00000100:00080000:0.0:1767320268.760490:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320268.760661:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379969664:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320269.335124:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320269.712941:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320269.713209:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291964416
00000100:00100000:1.0:1767320269.713232:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291964416
00000100:00100000:1.0:1767320269.713285:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17626
00000100:00100000:1.0:1767320269.713294:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291964416:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320269.713327:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320269.713391:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291964416:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 97us (459us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320269.713399:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17626
00000100:00100000:1.0:1767320269.714470:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320269.714975:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291964544
00000100:00100000:2.0:1767320269.714989:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291964544
00000100:00080000:0.0:1767320269.715112:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320269.715898:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4742
00000100:00100000:2.0:1767320269.715913:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291964544:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320269.715990:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291964544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (1521us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320269.715999:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4742
00000100:00080000:0.0:1767320269.783578:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320269.783589:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320269.783592:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320269.783596:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320269.783600:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320269.783608:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5167
00000100:00080000:0.0:1767320269.783613:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320269.783620:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320269.783661:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fca80 x1853164379969792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320269.783677:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320269.783680:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320269.783682:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320269.783686:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5167
00000100:00080000:0.0:1767320269.783688:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320269.783692:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320269.783704:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc000 x1853164379969920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320269.783779:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320269.783782:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320269.783784:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320269.783787:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5167
00000100:00080000:0.0:1767320269.783790:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320269.783793:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320269.783803:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd180 x1853164379970432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320269.783818:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320269.783821:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320269.783823:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320269.783826:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5167
00000100:00080000:0.0:1767320269.783828:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320269.783832:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320269.783839:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fed80 x1853164379970688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320269.783887:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379970176:0@lo:400:kworker.0
00000100:00100000:0.0:1767320269.783951:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320269.784013:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320269.784018:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379970304:0@lo:400:kworker.0
00000100:00100000:0.0:1767320269.784052:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320269.784085:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379970176
00000100:00100000:0.0:1767320269.784091:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379970176
00000100:00100000:0.0:1767320269.784137:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815
00000100:00100000:0.0:1767320269.784145:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379970176:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320269.784202:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379970176:12345-0@lo:400:kworker.0 Request processed in 57us (251us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320269.784209:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815
00000100:00080000:0.0:1767320269.784235:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320269.784261:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379970176:0@lo:400:kworker.0
00000100:00100000:0.0:1767320269.784284:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379970304
00000100:00100000:0.0:1767320269.784287:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379970304
00000100:00100000:0.0:1767320269.784317:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4743
00000100:00100000:0.0:1767320269.784323:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379970304:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320269.784353:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379970304:12345-0@lo:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320269.784358:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4743
00000100:00080000:0.0:1767320269.784371:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320269.784385:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379970304:0@lo:400:kworker.0
00000100:00100000:2.0:1767320269.784566:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320244/real 1767320244]  req@ffff8b0e0360ad80 x1853164379963264/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320269 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320269.784586:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0360ad80 x1853164379963264/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320269 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320269.784599:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379969792:0@lo:38:kworker.0
00000100:00100000:2.0:1767320269.784624:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320269.784646:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379969920:0@lo:38:kworker.0
00000100:00100000:2.0:1767320269.784668:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320269.784688:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379970432:0@lo:38:kworker.0
00000100:00100000:2.0:1767320269.784708:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320269.784724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379970688:0@lo:38:kworker.0
00000100:00100000:2.0:1767320269.784741:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320269.784756:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320269.784766:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320269.784769:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379963264:0@lo:250:kworker.0
00000100:00100000:2.0:1767320269.784795:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969792
00000100:00100000:2.0:1767320269.784808:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969792
00000100:00100000:2.0:1767320269.784829:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379970432
00000100:00100000:2.0:1767320269.784832:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379970432
00000100:00100000:2.0:1767320269.784845:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379970688
00000100:00100000:2.0:1767320269.784848:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379970688
00000100:00100000:2.0:1767320269.784858:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17627
00000100:00100000:2.0:1767320269.784863:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379969792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320269.784907:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320269.784937:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379970560:0@lo:400:kworker.0
00000100:00100000:2.0:1767320269.784941:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379969792:12345-0@lo:38:kworker.0 Request processed in 75us (315us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320269.784949:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17627
00000100:00100000:2.0:1767320269.784964:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17628
00000100:00100000:2.0:1767320269.784969:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379970432:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320269.784975:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767320269.784981:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320269.784999:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320269.785009:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379970432:12345-0@lo:38:kworker.0 Request processed in 39us (299us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320269.785010:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379970048:0@lo:400:kworker.0
00000100:00100000:2.0:1767320269.785031:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17628
00000100:00100000:2.0:1767320269.785042:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379970560
00000100:00100000:2.0:1767320269.785046:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379970560
00000100:00100000:3.0:1767320269.785054:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320269.785074:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4744
00000100:00100000:2.0:1767320269.785080:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379970560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320269.785107:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379969920
00000100:00100000:3.0:1767320269.785113:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379969920
00000100:00100000:2.0:1767320269.785117:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379970560:12345-0@lo:400:kworker.0 Request processed in 36us (141us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320269.785123:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4744
00000100:00100000:2.0:1767320269.785138:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17629
00000100:00100000:2.0:1767320269.785143:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379970688:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320269.785147:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146
00000100:00100000:3.0:1767320269.785156:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379969920:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320269.785158:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:3.0:1767320269.785174:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320269.785207:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379969920:12345-0@lo:38:kworker.0 Request processed in 49us (537us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320269.785213:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146
00000100:00100000:3.0:1767320269.785231:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379970048
00000100:00100000:3.0:1767320269.785235:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379970048
00000100:00100000:3.0:1767320269.785259:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816
00000100:00100000:3.0:1767320269.785267:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379970048:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320269.785302:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379970048:12345-0@lo:400:kworker.0 Request processed in 34us (246us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320269.785311:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816
00000100:00080000:0.0:1767320269.785344:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320269.785349:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320269.785353:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767320269.785353:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379970048:0@lo:400:kworker.0
00000100:00080000:0.0:1767320269.785362:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5146
00000100:00080000:0.0:1767320269.785365:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767320269.785371:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379970560:0@lo:400:kworker.0
00000100:00080000:0.0:1767320269.785372:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320269.785396:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd500 x1853164379970816/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320269.785405:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320269.785430:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379970816:0@lo:250:kworker.0
00000400:00000100:0.0:1767320269.785451:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379970816 offset 0 length 520: 4
00000100:00080000:0.0:1767320269.785475:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320269.785479:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320269.785482:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379969792:0@lo:38:kworker.0
00000100:00080000:0.0:1767320269.785490:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320269.785493:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320269.785496:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379969920:0@lo:38:kworker.0
00000100:00080000:0.0:1767320269.785504:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320269.785506:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320269.785510:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379970432:0@lo:38:kworker.0
00000100:00100000:2.0:1767320269.785579:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379970688:12345-0@lo:38:kworker.0 Request processed in 434us (836us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320269.785586:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17629
00000100:00080000:0.0:1767320269.785912:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320269.785917:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320269.785920:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379970688:0@lo:38:kworker.0
00000100:00100000:1.0:1767320270.295526:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379970944:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320270.295586:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320270.295675:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379970944
00000100:00100000:3.0:1767320270.295683:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379970944
00000100:00100000:3.0:1767320270.295739:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611
00000100:00100000:3.0:1767320270.295746:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379970944:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320270.295777:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320270.295835:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379970944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (248us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320270.295840:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611
00000100:00100000:0.0:1767320270.295955:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379970944:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320270.363551:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320271.386719:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320272.407095:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320273.431693:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320273.881530:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320273.881556:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379971072:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320273.881635:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320273.883108:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971072
00000100:00100000:1.0:1767320273.883121:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971072
00000100:00100000:1.0:1767320273.883216:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612
00000100:00100000:1.0:1767320273.883226:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379971072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320273.883261:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320273.883344:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379971072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (1708us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320273.883351:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612
00000100:00080000:3.0:1767320273.883504:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320273.883909:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379971072:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320274.455082:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320274.841653:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320274.841784:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320274.850743:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291964672
00000100:00100000:0.0:1767320274.850768:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291964672
00000100:00100000:0.0:1767320274.850846:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291964800
00000100:00100000:0.0:1767320274.850850:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291964800
00000100:00100000:0.0:1767320274.850962:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4745
00000100:00100000:0.0:1767320274.850990:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291964800:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320274.851112:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291964800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 138us (9326us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320274.851121:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4745
00000100:00100000:0.0:1767320274.851150:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17630
00000100:00100000:0.0:1767320274.851156:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291964672:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320274.851195:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320274.851224:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291964672:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 67us (9716us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320274.851232:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17630
00000100:00080000:2.0:1767320274.852009:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320274.903477:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320274.903498:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320274.903501:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320274.903506:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320274.903799:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320274.903811:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5172
00000100:00080000:2.0:1767320274.903817:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320274.903826:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320274.903923:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ca80 x1853164379971200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320274.903966:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320274.903971:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320274.903988:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320274.903994:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5172
00000100:00080000:2.0:1767320274.903997:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320274.904001:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320274.904030:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ed80 x1853164379971328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320274.904113:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320274.904117:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320274.904120:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320274.904125:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5172
00000100:00080000:2.0:1767320274.904128:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320274.904133:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320274.904147:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28f100 x1853164379971840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320274.904404:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320274.904432:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379971456:0@lo:400:kworker.0
00000100:00100000:1.0:1767320274.904544:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320274.904650:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379971584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320274.904679:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320274.904699:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320274.904705:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379971712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320274.904733:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320274.905292:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320274.905308:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379971968:0@lo:400:kworker.0
00000100:00100000:3.0:1767320274.905352:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320274.905405:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971456
00000100:00100000:3.0:1767320274.905414:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971456
00000100:00100000:3.0:1767320274.905488:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971584
00000100:00100000:3.0:1767320274.905493:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971584
00000100:00080000:2.0:1767320274.905704:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320274.905709:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320274.905713:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320274.905718:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5172
00000100:00080000:2.0:1767320274.905722:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320274.905728:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320274.905757:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ce00 x1853164379972096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320274.905814:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817
00000100:00100000:2.0:1767320274.905826:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379971456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320274.905924:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379971456:12345-0@lo:400:kworker.0 Request processed in 101us (1380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320274.905932:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817
00000100:00100000:3.0:1767320274.906023:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818
00000100:00100000:3.0:1767320274.906032:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379971584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320274.906074:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379971584:12345-0@lo:400:kworker.0 Request processed in 44us (1394us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320274.906080:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818
00000100:00100000:0.0:1767320274.906173:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379971200:0@lo:38:kworker.0
00000100:00100000:0.0:1767320274.906212:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320274.906235:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379971328:0@lo:38:kworker.0
00000100:00100000:0.0:1767320274.906259:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320274.906286:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379971840:0@lo:38:kworker.0
00000100:00100000:0.0:1767320274.906306:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320274.906322:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379972096:0@lo:38:kworker.0
00000100:00100000:0.0:1767320274.906341:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320274.906372:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971712
00000100:00100000:0.0:1767320274.906376:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971712
00000100:00100000:0.0:1767320274.906412:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971968
00000100:00100000:0.0:1767320274.906415:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971968
00000100:00100000:0.0:1767320274.906448:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971200
00000100:00100000:0.0:1767320274.906450:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971200
00000100:00100000:0.0:1767320274.906460:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971840
00000100:00100000:0.0:1767320274.906462:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971840
00000100:00100000:0.0:1767320274.906469:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972096
00000100:00100000:0.0:1767320274.906471:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972096
00000100:00100000:0.0:1767320274.906481:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4746
00000100:00100000:0.0:1767320274.906488:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379971712:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320274.906521:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379971712:12345-0@lo:400:kworker.0 Request processed in 34us (1788us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320274.906527:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4746
00000100:00100000:0.0:1767320274.906544:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4747
00000100:00100000:0.0:1767320274.906549:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379971968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320274.906577:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379971968:12345-0@lo:400:kworker.0 Request processed in 27us (1224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320274.906583:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4747
00000100:00100000:0.0:1767320274.906597:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17631
00000100:00100000:0.0:1767320274.906602:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379971200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320274.906623:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320274.906657:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379971200:12345-0@lo:38:kworker.0 Request processed in 54us (444us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320274.906663:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17631
00000100:00100000:0.0:1767320274.906675:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17632
00000100:00100000:0.0:1767320274.906679:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379971840:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320274.906689:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320274.906714:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379971840:12345-0@lo:38:kworker.0 Request processed in 33us (406us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320274.906720:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17632
00000100:00100000:0.0:1767320274.906730:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17633
00000100:00100000:0.0:1767320274.906734:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379972096:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320274.906742:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320274.906764:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379972096:12345-0@lo:38:kworker.0 Request processed in 29us (422us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320274.906770:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17633
00000100:00080000:0.0:1767320274.906818:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320274.906824:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320274.906827:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379971200:0@lo:38:kworker.0
00000100:00080000:0.0:1767320274.906836:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320274.906839:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320274.906842:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379971840:0@lo:38:kworker.0
00000100:00080000:0.0:1767320274.906850:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320274.906853:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320274.906856:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379972096:0@lo:38:kworker.0
00000100:00080000:0.0:1767320274.906942:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320274.906948:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320274.906993:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379971968:0@lo:400:kworker.0
00000100:00100000:1.0:1767320274.909263:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379971328
00000100:00100000:1.0:1767320274.909283:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379971328
00000100:00100000:1.0:1767320274.909361:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147
00000100:00100000:1.0:1767320274.909372:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379971328:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320274.909401:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320274.909521:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379971328:12345-0@lo:38:kworker.0 Request processed in 149us (3259us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320274.909530:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147
00000100:00100000:1.0:1767320274.909603:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379971712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320274.909618:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379971584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320274.909665:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379971456:0@lo:400:kworker.0
00000100:00080000:0.0:1767320274.911401:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320274.911416:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320274.911422:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379971328:0@lo:38:kworker.0
00000100:00100000:1.0:1767320275.416327:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379972224:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320275.416425:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320275.416568:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972224
00000100:00100000:2.0:1767320275.416578:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972224
00000100:00100000:2.0:1767320275.416646:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613
00000100:00100000:2.0:1767320275.416658:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379972224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320275.416700:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320275.417339:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379972224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 682us (913us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320275.417350:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613
00000100:00100000:1.0:1767320275.417438:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379972224:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320275.479439:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320276.503275:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320277.530821:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320278.553273:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320278.999758:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379972352:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320278.999891:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320279.000120:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972352
00000100:00100000:2.0:1767320279.000131:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972352
00000100:00100000:2.0:1767320279.000210:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614
00000100:00100000:2.0:1767320279.000221:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379972352:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320279.000260:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320279.000325:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379972352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (434us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320279.000335:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614
00000100:00100000:1.0:1767320279.000383:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379972352:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320279.000420:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320279.575815:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320279.954046:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320279.960538:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291965056
00000100:00100000:0.0:1767320279.960561:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291965056
00000100:00100000:0.0:1767320279.960692:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4748
00000100:00100000:0.0:1767320279.960709:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291965056:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767320279.961055:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320279.961201:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291965056:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 498us (7170us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320279.961212:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4748
00000100:00100000:1.0:1767320279.963480:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320279.964345:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291964928
00000100:00100000:0.0:1767320279.964362:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291964928
00000100:00100000:0.0:1767320279.964437:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17634
00000100:00100000:0.0:1767320279.964447:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291964928:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320279.964479:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320279.964573:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291964928:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 125us (1105us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320279.964582:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17634
00000100:00080000:0.0:1767320280.023334:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320280.023349:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320280.023354:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320280.023359:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320280.023365:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320280.023375:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5177
00000100:00080000:0.0:1767320280.023381:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320280.023390:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320280.023454:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ff800 x1853164379972480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320280.023494:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320280.023498:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320280.023500:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320280.023505:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5177
00000100:00080000:0.0:1767320280.023508:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320280.023512:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320280.023529:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ff480 x1853164379972608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320280.023597:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320280.023601:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320280.023603:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320280.023607:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5177
00000100:00080000:0.0:1767320280.023610:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320280.023613:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320280.023625:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe300 x1853164379973120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320280.023648:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320280.023651:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320280.023653:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320280.023657:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5177
00000100:00080000:0.0:1767320280.023659:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320280.023663:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320280.023675:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28ed80 x1853164379973376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320280.023706:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379973248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320280.023797:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320280.024244:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379972480:0@lo:38:kworker.0
00000100:00100000:2.0:1767320280.024284:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320280.024318:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379972608:0@lo:38:kworker.0
00000100:00100000:2.0:1767320280.024346:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320280.024369:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379973120:0@lo:38:kworker.0
00000100:00100000:2.0:1767320280.024391:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320280.024473:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379973376:0@lo:38:kworker.0
00000100:00100000:2.0:1767320280.024497:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320280.024538:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972608
00000100:00100000:2.0:1767320280.024547:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972608
00000100:00100000:2.0:1767320280.024589:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148
00000100:00100000:2.0:1767320280.024597:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379972608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320280.024623:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320280.024674:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379972608:12345-0@lo:38:kworker.0 Request processed in 76us (326us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320280.024682:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148
00000100:00100000:2.0:1767320280.024709:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379973248
00000100:00100000:2.0:1767320280.024713:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379973248
00000100:00100000:2.0:1767320280.024758:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972480
00000100:00100000:2.0:1767320280.024761:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972480
00000100:00100000:2.0:1767320280.024777:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379973120
00000100:00100000:2.0:1767320280.024780:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379973120
00000100:00100000:2.0:1767320280.024787:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379973376
00000100:00100000:2.0:1767320280.024789:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379973376
00000100:00100000:2.0:1767320280.024799:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4749
00000100:00100000:2.0:1767320280.024806:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379973248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320280.024852:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379973248:12345-0@lo:400:kworker.0 Request processed in 47us (1054us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320280.024859:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4749
00000100:00100000:2.0:1767320280.024893:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17635
00000100:00100000:2.0:1767320280.024898:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379972480:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320280.024919:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320280.024953:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379972480:12345-0@lo:38:kworker.0 Request processed in 53us (668us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320280.024959:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17635
00000100:00100000:3.0:1767320280.025824:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17636
00000100:00100000:3.0:1767320280.025839:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379973120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320280.025890:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320280.025989:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379973120:12345-0@lo:38:kworker.0 Request processed in 152us (1596us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320280.025998:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17636
00000100:00100000:3.0:1767320280.026023:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17637
00000100:00100000:3.0:1767320280.026027:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379973376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320280.026036:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320280.026067:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379973376:12345-0@lo:38:kworker.0 Request processed in 37us (1567us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320280.026073:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17637
00000100:00100000:0.0:1767320280.026075:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320280.026104:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379972736:0@lo:400:kworker.0
00000100:00080000:3.0:1767320280.026175:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320280.026182:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320280.026188:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379972480:0@lo:38:kworker.0
00000100:00100000:1.0:1767320280.026250:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379972864:0@lo:400:kworker.0
00000100:00080000:2.0:1767320280.026331:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320280.026371:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379972992:0@lo:400:kworker.0
00000100:00100000:0.0:1767320280.028055:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320280.028153:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379973248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320280.028224:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972736
00000100:00100000:0.0:1767320280.028232:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972736
00000100:00100000:0.0:1767320280.028299:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819
00000100:00100000:0.0:1767320280.028308:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379972736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320280.028381:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379972736:12345-0@lo:400:kworker.0 Request processed in 74us (334us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320280.028390:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819
00000100:00080000:0.0:1767320280.028417:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320280.028437:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379972736:0@lo:400:kworker.0
00000100:00080000:3.0:1767320280.031980:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320280.031993:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320280.031998:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379972608:0@lo:38:kworker.0
00000100:00080000:3.0:1767320280.032013:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320280.032017:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320280.032019:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379973120:0@lo:38:kworker.0
00000100:00080000:3.0:1767320280.032030:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320280.032033:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320280.032036:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379973376:0@lo:38:kworker.0
00000100:00100000:1.0:1767320280.040042:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320280.040194:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972864
00000100:00100000:0.0:1767320280.040207:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972864
00000100:00100000:0.0:1767320280.040300:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820
00000100:00100000:0.0:1767320280.040313:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379972864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320280.040387:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379972864:12345-0@lo:400:kworker.0 Request processed in 78us (356us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320280.040396:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820
00000100:00080000:1.0:1767320280.043968:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320280.044072:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379972864:0@lo:400:kworker.0
00000100:00100000:2.0:1767320280.045855:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320280.046229:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379972992
00000100:00100000:0.0:1767320280.046241:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379972992
00000100:00100000:0.0:1767320280.046391:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4750
00000100:00100000:0.0:1767320280.046475:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379972992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320280.046572:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379972992:12345-0@lo:400:kworker.0 Request processed in 171us (726us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320280.046581:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4750
00000100:00080000:1.0:1767320280.046673:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320280.048271:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379972992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320280.535274:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379973504:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320280.535371:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320280.535752:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379973504
00000100:00100000:1.0:1767320280.535763:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379973504
00000100:00100000:1.0:1767320280.535828:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615
00000100:00100000:1.0:1767320280.535847:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379973504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320280.535909:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320280.535993:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379973504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320280.536003:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615
00000100:00100000:0.0:1767320280.536087:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379973504:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320280.599138:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320281.624260:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320282.647520:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320283.671460:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320284.119318:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379973632:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320284.119408:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320284.119532:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379973632
00000100:00100000:0.0:1767320284.119543:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379973632
00000100:00080000:2.0:1767320284.119595:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320284.119622:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616
00000100:00100000:0.0:1767320284.119643:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379973632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320284.119684:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320284.123250:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379973632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3603us (3825us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320284.123272:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616
00000100:00100000:1.0:1767320284.125178:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379973632:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320284.695221:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320285.072746:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320285.072860:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291965312
00000100:00100000:2.0:1767320285.072935:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291965312
00000100:00100000:2.0:1767320285.073065:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4751
00000100:00100000:2.0:1767320285.073078:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291965312:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767320285.073301:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320285.073348:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291965312:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 132us (470us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320285.073360:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4751
00000100:00100000:1.0:1767320285.090790:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320285.090935:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291965184
00000100:00100000:0.0:1767320285.090950:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291965184
00000100:00100000:0.0:1767320285.091023:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17638
00000100:00100000:0.0:1767320285.091033:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291965184:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320285.091142:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320285.091240:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291965184:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 206us (464us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320285.091250:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17638
00000100:00080000:3.0:1767320285.144780:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320285.144794:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320285.144797:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320285.144803:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320285.144808:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320285.144818:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767320285.144825:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320285.144836:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320285.144915:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164379973760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320285.144951:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320285.144956:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320285.144957:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320285.144962:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767320285.144965:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320285.144969:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320285.144984:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc000 x1853164379973888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320285.145083:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320285.145087:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320285.145089:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320285.145093:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767320285.145096:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320285.145099:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320285.145111:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164379974400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320285.145128:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320285.145132:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320285.145133:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320285.145136:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5182
00000100:00080000:3.0:1767320285.145139:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320285.145143:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320285.145154:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df800 x1853164379974656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320285.145396:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379974272:0@lo:400:kworker.0
00000100:00100000:0.0:1767320285.145710:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320285.145812:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379974016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320285.145845:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320285.145917:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320285.145924:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379974528:0@lo:400:kworker.0
00000100:00100000:0.0:1767320285.145949:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320285.145983:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974016
00000100:00100000:0.0:1767320285.145993:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974016
00000100:00100000:0.0:1767320285.146069:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821
00000100:00100000:0.0:1767320285.146079:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379974016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320285.146141:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379974016:12345-0@lo:400:kworker.0 Request processed in 63us (294us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320285.146150:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821
00000100:00100000:3.0:1767320285.146325:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379974144:0@lo:400:kworker.0
00000100:00100000:3.0:1767320285.146361:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320285.146663:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974272
00000100:00100000:1.0:1767320285.146669:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974272
00000100:00100000:1.0:1767320285.146718:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974528
00000100:00100000:1.0:1767320285.146721:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974528
00000100:00100000:1.0:1767320285.146746:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4752
00000100:00100000:1.0:1767320285.146755:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379974272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320285.146806:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379974272:12345-0@lo:400:kworker.0 Request processed in 52us (1096us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320285.146813:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4752
00000100:00100000:1.0:1767320285.146834:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4753
00000100:00100000:1.0:1767320285.146840:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379974528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320285.146903:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379974528:12345-0@lo:400:kworker.0 Request processed in 30us (919us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320285.146910:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4753
00000100:00080000:1.0:1767320285.146930:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320285.146963:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379974272:0@lo:400:kworker.0
00000100:00100000:2.0:1767320285.147351:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379973760:0@lo:38:kworker.0
00000100:00100000:2.0:1767320285.147410:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320285.147603:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379973888:0@lo:38:kworker.0
00000100:00100000:2.0:1767320285.147637:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320285.147662:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379974400:0@lo:38:kworker.0
00000100:00100000:2.0:1767320285.147689:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320285.147708:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379974656:0@lo:38:kworker.0
00000100:00100000:2.0:1767320285.147730:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320285.147761:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379973760
00000100:00100000:2.0:1767320285.147766:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379973760
00000100:00100000:2.0:1767320285.147789:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974400
00000100:00100000:2.0:1767320285.147791:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974400
00000100:00100000:2.0:1767320285.147805:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974656
00000100:00100000:2.0:1767320285.147807:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974656
00000100:00100000:2.0:1767320285.147818:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17639
00000100:00100000:2.0:1767320285.147823:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379973760:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320285.147846:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320285.147927:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379973760:12345-0@lo:38:kworker.0 Request processed in 102us (516us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320285.147935:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17639
00000100:00100000:2.0:1767320285.147950:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17640
00000100:00100000:2.0:1767320285.147953:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379974400:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320285.147963:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320285.147986:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379974400:12345-0@lo:38:kworker.0 Request processed in 31us (296us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320285.147991:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17640
00000100:00100000:2.0:1767320285.148002:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17641
00000100:00100000:2.0:1767320285.148005:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379974656:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320285.148014:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320285.148045:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379974656:12345-0@lo:38:kworker.0 Request processed in 37us (314us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320285.148050:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17641
00000100:00080000:2.0:1767320285.148085:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320285.148090:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320285.148093:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379973760:0@lo:38:kworker.0
00000100:00080000:2.0:1767320285.148100:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320285.148103:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320285.148106:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379974400:0@lo:38:kworker.0
00000100:00080000:2.0:1767320285.148112:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320285.148115:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320285.148117:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379974656:0@lo:38:kworker.0
00000100:00100000:0.0:1767320285.148648:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379974016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320285.148679:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379974528:0@lo:400:kworker.0
00000100:00100000:3.0:1767320285.148778:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379973888
00000100:00100000:3.0:1767320285.148785:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379973888
00000100:00100000:3.0:1767320285.148828:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149
00000100:00100000:3.0:1767320285.148835:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379973888:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320285.148850:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320285.148952:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379973888:12345-0@lo:38:kworker.0 Request processed in 115us (1313us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320285.148958:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149
00000100:00080000:0.0:1767320285.149060:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320285.149066:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320285.149069:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379973888:0@lo:38:kworker.0
00000100:00100000:1.0:1767320285.149154:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974144
00000100:00100000:1.0:1767320285.149160:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974144
00000100:00100000:1.0:1767320285.149231:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822
00000100:00100000:1.0:1767320285.149238:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379974144:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320285.149293:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379974144:12345-0@lo:400:kworker.0 Request processed in 56us (2932us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320285.149299:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822
00000100:00100000:3.0:1767320285.149799:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379974144:0@lo:400:kworker.0
00000100:00080000:0.0:1767320285.149902:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320285.655371:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379974784:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320285.655632:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320285.656599:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974784
00000100:00100000:3.0:1767320285.656614:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974784
00000100:00100000:3.0:1767320285.656690:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617
00000100:00100000:3.0:1767320285.656703:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379974784:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320285.656750:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320285.656837:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379974784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (1205us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320285.656845:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617
00000100:00100000:0.0:1767320285.657834:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379974784:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320285.721626:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320286.743262:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320287.767247:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320288.791263:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320289.239422:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320289.239448:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379974912:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320289.239542:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320289.239606:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379974912
00000100:00100000:3.0:1767320289.239627:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379974912
00000100:00080000:1.0:1767320289.239681:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320289.239714:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618
00000100:00100000:3.0:1767320289.239729:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379974912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320289.239777:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320289.239862:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379974912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (319us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320289.239899:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618
00000100:00100000:1.0:1767320289.240185:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379974912:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320289.816044:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320290.195522:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320290.195563:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767320290.195589:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291965696 offset 0 length 520: 4
00000100:00100000:3.0:1767320290.195747:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291965568
00000100:00100000:3.0:1767320290.195758:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291965568
00000100:00100000:3.0:1767320290.195846:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291965440
00000100:00100000:3.0:1767320290.195850:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291965440
00000100:00100000:3.0:1767320290.195917:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4754
00000100:00100000:3.0:1767320290.195931:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291965568:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320290.196012:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291965568:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (500us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320290.196019:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4754
00000100:00100000:3.0:1767320290.196039:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17642
00000100:00100000:3.0:1767320290.196043:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291965440:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320290.196063:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320290.196087:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291965440:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (524us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320290.196095:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17642
00000100:00080000:0.0:1767320290.197608:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320290.263041:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320290.263059:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320290.263065:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320290.263070:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320290.263076:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320290.263097:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5187
00000100:00080000:1.0:1767320290.263104:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320290.263115:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320290.263170:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964e680 x1853164379975040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320290.263203:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320290.263208:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320290.263212:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320290.263219:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5187
00000100:00080000:1.0:1767320290.263222:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320290.263227:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320290.263246:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164379975168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320290.266913:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320290.266922:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320290.266926:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320290.266936:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5187
00000100:00080000:1.0:1767320290.266942:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320290.266950:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320290.266978:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964df80 x1853164379975680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320290.267003:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320290.267006:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320290.267008:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320290.267012:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5187
00000100:00080000:1.0:1767320290.267014:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320290.267019:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320290.267029:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964d500 x1853164379975936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320290.267693:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379975296:0@lo:400:kworker.0
00000100:00100000:1.0:1767320290.267782:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320290.267899:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320290.267907:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379975808:0@lo:400:kworker.0
00000100:00100000:1.0:1767320290.267936:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320290.267979:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975296
00000100:00100000:1.0:1767320290.267988:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975296
00000100:00100000:1.0:1767320290.268044:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823
00000100:00100000:1.0:1767320290.268054:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379975296:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320290.269269:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379975296:12345-0@lo:400:kworker.0 Request processed in 1208us (1479us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320290.269283:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823
00000100:00100000:1.0:1767320290.269337:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975808
00000100:00100000:1.0:1767320290.269344:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975808
00000100:00100000:1.0:1767320290.269685:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4755
00000100:00100000:1.0:1767320290.269697:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379975808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320290.269753:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379975808:12345-0@lo:400:kworker.0 Request processed in 57us (1814us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320290.269754:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379975424:0@lo:400:kworker.0
00000100:00100000:1.0:1767320290.269771:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4755
00000100:00100000:1.0:1767320290.269844:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379975808:0@lo:400:kworker.0
00000100:00100000:3.0:1767320290.269866:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320290.269900:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379975296:0@lo:400:kworker.0
00000100:00100000:3.0:1767320290.270052:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320290.270061:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379975552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320290.270090:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320290.270128:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975424
00000100:00100000:3.0:1767320290.270135:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975424
00000100:00100000:3.0:1767320290.270181:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824
00000100:00100000:3.0:1767320290.270190:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379975424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320290.270242:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379975424:12345-0@lo:400:kworker.0 Request processed in 53us (392us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320290.270249:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824
00000100:00100000:3.0:1767320290.270290:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379975424:0@lo:400:kworker.0
00000100:00100000:1.0:1767320290.271024:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975552
00000100:00100000:1.0:1767320290.271035:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975552
00000100:00100000:1.0:1767320290.271080:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4756
00000100:00100000:1.0:1767320290.271088:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379975552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320290.271155:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379975552:12345-0@lo:400:kworker.0 Request processed in 68us (1064us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320290.271162:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4756
00000100:00100000:3.0:1767320290.273105:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379975552:0@lo:400:kworker.0
00000100:00100000:0.0:1767320290.273360:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379975040:0@lo:38:kworker.0
00000100:00100000:0.0:1767320290.273442:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320290.273478:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379975168:0@lo:38:kworker.0
00000100:00100000:0.0:1767320290.273519:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320290.273520:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975040
00000100:00100000:1.0:1767320290.273535:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975040
00000100:00100000:0.0:1767320290.273556:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379975680:0@lo:38:kworker.0
00000100:00100000:0.0:1767320290.273588:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320290.273609:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975680
00000100:00100000:1.0:1767320290.273702:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975680
00000100:00100000:2.0:1767320290.273728:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975168
00000100:00100000:2.0:1767320290.273738:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975168
00000100:00100000:1.0:1767320290.273739:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17643
00000100:00100000:1.0:1767320290.273755:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379975040:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320290.273786:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320290.273787:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150
00000100:00100000:2.0:1767320290.273801:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379975168:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320290.273823:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320290.274813:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379975168:12345-0@lo:38:kworker.0 Request processed in 1009us (1291us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320290.274823:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150
00000100:00080000:2.0:1767320290.274885:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320290.274892:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320290.274933:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17644
00000100:00100000:2.0:1767320290.274938:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379975680:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320290.274954:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320290.274993:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379975680:12345-0@lo:38:kworker.0 Request processed in 54us (1409us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320290.275001:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17644
00000100:00100000:1.0:1767320290.275039:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379975040:12345-0@lo:38:kworker.0 Request processed in 1280us (1590us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320290.275053:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17643
00000100:00080000:0.0:1767320290.275731:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320290.275739:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320290.275744:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379975680:0@lo:38:kworker.0
00000100:00100000:0.0:1767320290.275753:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379975936:0@lo:38:kworker.0
00000100:00100000:0.0:1767320290.275788:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320290.275922:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320290.275929:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320290.275933:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379975040:0@lo:38:kworker.0
00000100:00080000:0.0:1767320290.275949:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320290.275952:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320290.275955:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379975168:0@lo:38:kworker.0
00000100:00100000:3.0:1767320290.276023:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379975936
00000100:00100000:3.0:1767320290.276030:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379975936
00000100:00100000:3.0:1767320290.276064:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17645
00000100:00100000:3.0:1767320290.276070:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379975936:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320290.276086:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320290.276134:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379975936:12345-0@lo:38:kworker.0 Request processed in 63us (344us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320290.276141:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17645
00000100:00080000:0.0:1767320290.276244:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320290.276249:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320290.276255:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379975936:0@lo:38:kworker.0
00000100:00100000:0.0:1767320290.775569:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320290.775602:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379976064:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320290.775786:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320290.775945:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379976064
00000100:00100000:3.0:1767320290.775954:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379976064
00000100:00100000:3.0:1767320290.776005:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619
00000100:00100000:3.0:1767320290.776024:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379976064:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320290.776051:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320290.776108:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379976064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (321us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320290.776114:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619
00000100:00100000:0.0:1767320290.776259:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379976064:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320290.839731:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320291.863254:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320292.887080:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320293.915772:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320294.359201:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320269/real 1767320269]  req@ffff8b0f2f3fd500 x1853164379970816/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320294 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320294.359234:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f3fd500 x1853164379970816/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320294 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320294.359254:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320294.359275:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320294.359279:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379970816:0@lo:250:kworker.0
00000100:00080000:3.0:1767320294.359643:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320294.359649:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320294.359666:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320294.359672:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5172
00000100:00080000:3.0:1767320294.359676:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320294.359682:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320294.359702:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd180 x1853164379976320/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320294.359760:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379976320:0@lo:250:kworker.0
00000400:00000100:1.0:1767320294.359821:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379976320 offset 0 length 520: 4
00000100:00100000:0.0:1767320294.359851:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320294.359861:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379976192:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320294.359888:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320294.359892:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320294.359894:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320294.359906:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5192
00000100:00080000:3.0:1767320294.359909:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320294.359913:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320294.359914:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320294.359929:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379976448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320294.359956:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379976192
00000100:00100000:0.0:1767320294.359963:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379976192
00000100:00100000:0.0:1767320294.360018:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620
00000100:00100000:0.0:1767320294.360027:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379976192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320294.360054:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320294.360095:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379976192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (180us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320294.360101:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620
00000100:00100000:0.0:1767320294.360147:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379976192:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320294.360177:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320294.360548:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379976448:0@lo:38:kworker.0
00000100:00100000:1.0:1767320294.360583:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320294.360715:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379976448
00000100:00100000:0.0:1767320294.360720:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379976448
00000100:00080000:3.0:1767320294.360785:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320294.360789:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320294.360791:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320294.360805:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5192
00000100:00080000:3.0:1767320294.360808:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320294.360812:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320294.360832:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df800 x1853164379976576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320294.363245:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320294.363543:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379976704:0@lo:400:kworker.0
00000100:00100000:2.0:1767320294.363616:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320294.364022:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379976576:0@lo:38:kworker.0
00000100:00100000:2.0:1767320294.364051:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320294.364085:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379976576
00000100:00100000:2.0:1767320294.364092:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379976576
00000100:00100000:2.0:1767320294.364128:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151
00000100:00100000:2.0:1767320294.364135:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379976576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320294.364157:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320294.364427:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379976576:12345-0@lo:38:kworker.0 Request processed in 290us (373us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320294.364435:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151
00000100:00080000:2.0:1767320294.364575:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320294.364581:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320294.364584:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379976576:0@lo:38:kworker.0
00000100:00100000:2.0:1767320294.364638:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379976704
00000100:00100000:2.0:1767320294.364642:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379976704
00000100:00100000:2.0:1767320294.364694:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825
00000100:00100000:2.0:1767320294.364701:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379976704:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320294.364746:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379976704:12345-0@lo:400:kworker.0 Request processed in 47us (1130us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320294.364752:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825
00000100:00100000:2.0:1767320294.364781:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379976704:0@lo:400:kworker.0
00000100:00080000:2.0:1767320294.364830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320294.369562:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17646
00000100:00100000:1.0:1767320294.369576:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379976448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320294.369603:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320294.369706:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379976448:12345-0@lo:38:kworker.0 Request processed in 129us (9120us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320294.369713:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17646
00000100:00080000:1.0:1767320294.369778:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320294.369784:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320294.369788:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379976448:0@lo:38:kworker.0
00000100:00080000:3.0:1767320294.370454:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320294.370459:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320294.370462:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320294.370467:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5192
00000100:00080000:3.0:1767320294.370471:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320294.370477:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320294.370484:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320294.370498:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379976832:0@lo:400:kworker.0
00000100:00100000:3.0:1767320294.370540:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320294.370594:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164379976960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320294.370619:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320294.370623:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320294.370625:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320294.370628:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5192
00000100:00080000:3.0:1767320294.370630:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320294.370634:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320294.370643:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379977088:0@lo:400:kworker.0
00000100:00100000:3.0:1767320294.370667:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320294.370701:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df480 x1853164379977216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320294.371121:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379976832
00000100:00100000:0.0:1767320294.371129:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379976832
00000100:00080000:2.0:1767320294.371189:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320294.371206:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977088
00000100:00100000:0.0:1767320294.371210:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977088
00000100:00100000:0.0:1767320294.371237:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4757
00000100:00100000:0.0:1767320294.371245:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379976832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320294.371302:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379976832:12345-0@lo:400:kworker.0 Request processed in 57us (761us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320294.371310:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4757
00000100:00100000:0.0:1767320294.371345:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379976832:0@lo:400:kworker.0
00000100:00100000:0.0:1767320294.371364:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4758
00000100:00100000:0.0:1767320294.371370:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379977088:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320294.371401:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379977088:12345-0@lo:400:kworker.0 Request processed in 32us (734us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320294.371406:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4758
00000100:00100000:0.0:1767320294.371429:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379977088:0@lo:400:kworker.0
00000100:00100000:1.0:1767320294.372352:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379976960:0@lo:38:kworker.0
00000100:00100000:1.0:1767320294.372401:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320294.372435:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379977216:0@lo:38:kworker.0
00000100:00100000:1.0:1767320294.372455:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320294.372485:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379976960
00000100:00100000:1.0:1767320294.372490:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379976960
00000100:00100000:1.0:1767320294.372528:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977216
00000100:00100000:1.0:1767320294.372531:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977216
00000100:00100000:1.0:1767320294.372548:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17647
00000100:00100000:1.0:1767320294.372554:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379976960:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320294.372573:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320294.372610:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379976960:12345-0@lo:38:kworker.0 Request processed in 55us (208us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320294.372617:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17647
00000100:00100000:1.0:1767320294.372635:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17648
00000100:00100000:1.0:1767320294.372640:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379977216:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320294.372649:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320294.372670:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379977216:12345-0@lo:38:kworker.0 Request processed in 29us (214us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320294.372676:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17648
00000100:00080000:1.0:1767320294.372703:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320294.372708:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320294.372711:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379976960:0@lo:38:kworker.0
00000100:00080000:1.0:1767320294.372719:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320294.372722:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320294.372725:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379977216:0@lo:38:kworker.0
00010000:00010000:2.0:1767320294.935813:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320295.312713:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320295.312858:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320295.313163:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291965952
00000100:00100000:2.0:1767320295.313179:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291965952
00000100:00100000:3.0:1767320295.313212:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291965824
00000100:00100000:3.0:1767320295.313218:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291965824
00000100:00100000:3.0:1767320295.313273:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17649
00000100:00100000:3.0:1767320295.313281:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291965824:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320295.313307:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320295.313376:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291965824:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (516us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320295.313384:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17649
00000100:00100000:2.0:1767320295.314464:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4759
00000100:00100000:2.0:1767320295.314476:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291965952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320295.314536:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291965952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 63us (1835us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320295.314544:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4759
00000100:00080000:0.0:1767320295.314755:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320295.895211:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379977344:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320295.895331:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320295.895425:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977344
00000100:00100000:3.0:1767320295.895439:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977344
00000100:00100000:3.0:1767320295.895496:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621
00000100:00100000:3.0:1767320295.895510:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379977344:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320295.895544:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320295.895597:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379977344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (265us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320295.895605:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621
00000100:00100000:2.0:1767320295.895642:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379977344:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320295.959130:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320296.983341:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320298.007169:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320299.031188:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320299.478978:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320299.478989:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320299.478992:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320299.478996:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320299.479001:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320299.479008:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767320299.479013:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320299.479021:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320299.479068:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379977472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320299.479104:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320299.479107:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320299.479109:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320299.479114:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767320299.479116:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320299.479119:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320299.479134:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dce00 x1853164379977600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320299.479211:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379977728:0@lo:400:kworker.0
00000100:00100000:0.0:1767320299.479278:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320299.479385:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379977472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320299.479415:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320299.479430:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379977600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320299.479450:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320299.479488:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977728
00000100:00100000:2.0:1767320299.479495:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977728
00000100:00100000:2.0:1767320299.479554:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826
00000100:00100000:2.0:1767320299.479562:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379977728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320299.479693:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977472
00000100:00100000:1.0:1767320299.479696:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977472
00000100:00100000:1.0:1767320299.479717:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17650
00000100:00100000:1.0:1767320299.479722:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379977472:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320299.479748:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320299.479790:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379977472:12345-0@lo:38:kworker.0 Request processed in 67us (373us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320299.479796:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17650
00000100:00100000:1.0:1767320299.479818:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379977856:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320299.479838:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320299.479899:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320299.479904:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320299.479907:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379977472:0@lo:38:kworker.0
00000100:00100000:1.0:1767320299.479933:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977856
00000100:00100000:1.0:1767320299.479937:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977856
00000100:00100000:1.0:1767320299.479963:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622
00000100:00100000:1.0:1767320299.479970:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7017:x1853164379977856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320299.479989:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320299.480021:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:7017:x1853164379977856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (181us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320299.480026:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622
00000100:00100000:1.0:1767320299.480055:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379977856:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320299.480080:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320299.480102:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977600
00000100:00100000:1.0:1767320299.480106:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977600
00000100:00100000:1.0:1767320299.480126:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152
00000100:00100000:1.0:1767320299.480130:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379977600:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320299.480140:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320299.480167:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379977600:12345-0@lo:38:kworker.0 Request processed in 36us (715us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320299.480172:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152
00000100:00080000:1.0:1767320299.480194:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320299.480197:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320299.480200:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379977600:0@lo:38:kworker.0
00000100:00100000:1.0:1767320299.480486:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379978112:0@lo:400:kworker.0
00000100:00100000:1.0:1767320299.480510:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320299.482443:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379977728:12345-0@lo:400:kworker.0 Request processed in 2872us (3156us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320299.482460:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826
00000100:00100000:2.0:1767320299.482508:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379977984:0@lo:400:kworker.0
00000100:00100000:2.0:1767320299.482563:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320299.482636:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379977984
00000100:00100000:2.0:1767320299.482643:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379977984
00000100:00100000:2.0:1767320299.482701:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827
00000100:00100000:2.0:1767320299.482710:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379977984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320299.482716:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379978112
00000100:00100000:1.0:1767320299.482723:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379978112
00000100:00100000:2.0:1767320299.482770:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379977984:12345-0@lo:400:kworker.0 Request processed in 60us (207us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320299.482777:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827
00000100:00100000:2.0:1767320299.482810:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379977984:0@lo:400:kworker.0
00000100:00100000:1.0:1767320299.482896:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4760
00000100:00100000:1.0:1767320299.482904:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379978112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320299.482945:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379978112:12345-0@lo:400:kworker.0 Request processed in 43us (2434us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320299.482952:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4760
00000100:00100000:1.0:1767320299.482989:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379978112:0@lo:400:kworker.0
00000100:00080000:3.0:1767320299.485115:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320299.485125:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320299.485128:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320299.485145:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767320299.485150:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320299.485157:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320299.485196:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379978240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320299.485238:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320299.485242:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320299.485245:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320299.485249:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767320299.485252:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320299.485257:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320299.485258:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320299.485269:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164379978496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320299.485277:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379978368:0@lo:400:kworker.0
00000100:00100000:3.0:1767320299.485302:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379978240:0@lo:38:kworker.0
00000100:00100000:1.0:1767320299.485338:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320299.485365:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379978368
00000100:00100000:3.0:1767320299.485372:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379978368
00000100:00100000:0.0:1767320299.485742:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379977728:0@lo:400:kworker.0
00000100:00080000:2.0:1767320299.485982:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320299.485989:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320299.486011:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320299.486048:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379978496:0@lo:38:kworker.0
00000100:00100000:2.0:1767320299.486079:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320299.486152:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379978240
00000100:00100000:1.0:1767320299.486158:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379978240
00000100:00100000:0.0:1767320299.486171:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379978496
00000100:00100000:0.0:1767320299.486177:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379978496
00000100:00100000:1.0:1767320299.486244:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17651
00000100:00100000:1.0:1767320299.486251:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379978240:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320299.486272:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320299.486318:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379978240:12345-0@lo:38:kworker.0 Request processed in 66us (305us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320299.486326:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17651
00000100:00100000:0.0:1767320299.486343:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4761
00000100:00100000:1.0:1767320299.486350:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17652
00000100:00100000:0.0:1767320299.486356:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379978368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320299.486360:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379978496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320299.486373:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320299.486413:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379978496:12345-0@lo:38:kworker.0 Request processed in 55us (333us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320299.486421:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17652
00000100:00100000:0.0:1767320299.486422:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379978368:12345-0@lo:400:kworker.0 Request processed in 68us (1083us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320299.486431:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4761
00000100:00100000:1.0:1767320299.486473:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379978368:0@lo:400:kworker.0
00000100:00080000:3.0:1767320299.496904:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320299.497796:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320299.497807:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320299.497813:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379978240:0@lo:38:kworker.0
00000100:00080000:2.0:1767320299.497830:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320299.497834:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320299.497836:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379978496:0@lo:38:kworker.0
00010000:00010000:1.0:1767320300.058245:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320300.431591:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320300.431685:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320300.433310:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291966208
00000100:00100000:3.0:1767320300.433322:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291966208
00000100:00100000:3.0:1767320300.433449:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291966080
00000100:00100000:3.0:1767320300.433454:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291966080
00000100:00100000:3.0:1767320300.433498:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4762
00000100:00100000:3.0:1767320300.433509:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291966208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320300.433585:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291966208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 77us (2003us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320300.433592:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4762
00000100:00100000:3.0:1767320300.433626:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17653
00000100:00100000:3.0:1767320300.433631:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291966080:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320300.433649:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320300.433674:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291966080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (1990us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320300.433681:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17653
00000100:00080000:2.0:1767320300.434838:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320301.015233:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320301.015258:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379978624:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320301.015327:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320301.015437:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379978624
00000100:00100000:1.0:1767320301.015446:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379978624
00000100:00100000:1.0:1767320301.015503:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623
00000100:00100000:1.0:1767320301.015510:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379978624:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320301.015533:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320301.015596:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379978624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320301.015604:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623
00000100:00080000:0.0:1767320301.015660:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320301.018120:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379978624:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320301.079135:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320302.107174:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320303.131315:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320304.151676:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320304.599828:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320304.599836:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320304.599839:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320304.599843:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320304.599848:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320304.599857:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767320304.599862:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320304.599887:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320304.599921:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798a80 x1853164379978752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320304.599939:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320304.599943:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320304.599944:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320304.599948:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767320304.599950:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320304.599954:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320304.599965:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799f80 x1853164379978880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320304.600018:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320304.600022:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320304.600024:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320304.600028:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767320304.600031:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320304.600035:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320304.600046:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b800 x1853164379979392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320304.600061:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379979264:0@lo:400:kworker.0
00000100:00080000:2.0:1767320304.600063:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320304.600072:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320304.600074:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320304.600079:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5201
00000100:00080000:2.0:1767320304.600081:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320304.600085:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320304.600097:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379aa00 x1853164379979648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320304.600136:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379979008:0@lo:400:kworker.0
00000100:00100000:0.0:1767320304.600144:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320304.600177:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320304.600214:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320304.600217:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320304.600224:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379979136:0@lo:400:kworker.0
00000100:00100000:2.0:1767320304.600227:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379979520:0@lo:400:kworker.0
00000100:00100000:0.0:1767320304.600251:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320304.600285:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979264
00000100:00100000:0.0:1767320304.600293:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979264
00000100:00100000:0.0:1767320304.600342:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4763
00000100:00100000:0.0:1767320304.600351:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379979264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320304.600397:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379979264:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320304.600404:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4763
00000100:00080000:0.0:1767320304.600425:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320304.600457:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379979264:0@lo:400:kworker.0
00000100:00100000:0.0:1767320304.600486:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979008
00000100:00100000:0.0:1767320304.600489:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979008
00000100:00100000:0.0:1767320304.600515:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979136
00000100:00100000:0.0:1767320304.600517:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979136
00000100:00100000:0.0:1767320304.600535:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828
00000100:00100000:0.0:1767320304.600540:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379979008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320304.600569:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379979008:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320304.600574:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828
00000100:00100000:0.0:1767320304.600584:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829
00000100:00100000:0.0:1767320304.600589:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379979136:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320304.600634:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379979136:12345-0@lo:400:kworker.0 Request processed in 44us (383us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320304.600639:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829
00000100:00080000:0.0:1767320304.600663:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320304.600665:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320304.600680:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379979136:0@lo:400:kworker.0
00000100:00100000:2.0:1767320304.600899:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320304.600930:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379979008:0@lo:400:kworker.0
00000100:00100000:1.0:1767320304.601235:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379978752:0@lo:38:kworker.0
00000100:00100000:1.0:1767320304.601268:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320304.601292:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379978880:0@lo:38:kworker.0
00000100:00100000:2.0:1767320304.601310:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320304.601321:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320304.601323:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379979776:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320304.601351:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379979392:0@lo:38:kworker.0
00000100:00100000:2.0:1767320304.601358:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320304.601381:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320304.601401:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379979648:0@lo:38:kworker.0
00000100:00100000:1.0:1767320304.601418:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320304.601443:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979520
00000100:00100000:1.0:1767320304.601448:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979520
00000100:00100000:1.0:1767320304.601482:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379978752
00000100:00100000:1.0:1767320304.601485:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379978752
00000100:00100000:1.0:1767320304.601492:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979392
00000100:00100000:1.0:1767320304.601494:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979392
00000100:00100000:1.0:1767320304.601499:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979648
00000100:00100000:1.0:1767320304.601502:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979648
00000100:00100000:1.0:1767320304.601510:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4764
00000100:00100000:1.0:1767320304.601516:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379979520:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320304.601548:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379979520:12345-0@lo:400:kworker.0 Request processed in 33us (678us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320304.601554:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4764
00000100:00100000:1.0:1767320304.601569:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17654
00000100:00100000:1.0:1767320304.601573:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379978752:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320304.601590:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320304.601773:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379978752:12345-0@lo:38:kworker.0 Request processed in 197us (503us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320304.601779:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17654
00000100:00100000:1.0:1767320304.601794:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17655
00000100:00100000:1.0:1767320304.601798:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379979392:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320304.601808:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320304.601830:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379979392:12345-0@lo:38:kworker.0 Request processed in 31us (450us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320304.601835:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17655
00000100:00100000:1.0:1767320304.601847:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17656
00000100:00100000:1.0:1767320304.601850:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379979648:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320304.601859:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320304.601903:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379979648:12345-0@lo:38:kworker.0 Request processed in 51us (483us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320304.601909:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17656
00000100:00100000:2.0:1767320304.601924:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379979520:0@lo:400:kworker.0
00000100:00100000:1.0:1767320304.601933:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379978880
00000100:00100000:1.0:1767320304.601939:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379978880
00000100:00100000:1.0:1767320304.601959:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153
00000100:00100000:1.0:1767320304.601965:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379978880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320304.601974:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320304.601993:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979776
00000100:00100000:2.0:1767320304.601998:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979776
00000100:00100000:1.0:1767320304.602003:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379978880:12345-0@lo:38:kworker.0 Request processed in 37us (683us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320304.602010:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153
00000100:00100000:2.0:1767320304.602030:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624
00000100:00100000:2.0:1767320304.602038:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379979776:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320304.602059:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320304.602095:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379979776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (738us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320304.602102:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624
00000100:00100000:2.0:1767320304.602128:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379979776:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320304.602155:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320304.602249:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320304.602254:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320304.602257:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379978752:0@lo:38:kworker.0
00000100:00080000:0.0:1767320304.602267:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320304.602270:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320304.602273:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379978880:0@lo:38:kworker.0
00000100:00080000:0.0:1767320304.602280:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320304.602283:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320304.602285:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379979392:0@lo:38:kworker.0
00000100:00080000:0.0:1767320304.602292:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320304.602295:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320304.602297:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379979648:0@lo:38:kworker.0
00010000:00010000:2.0:1767320305.175074:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320305.551428:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320305.552097:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291966464
00000100:00100000:0.0:1767320305.552108:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291966464
00000100:00100000:0.0:1767320305.552185:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4765
00000100:00100000:0.0:1767320305.552195:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291966464:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320305.552258:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291966464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 65us (839us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320305.552264:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4765
00000100:00080000:2.0:1767320305.552361:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320305.552680:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320305.552735:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291966336
00000100:00100000:0.0:1767320305.552741:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291966336
00000100:00100000:0.0:1767320305.552772:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17657
00000100:00100000:0.0:1767320305.552777:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291966336:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320305.552797:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320305.552826:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291966336:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 48us (148us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320305.552833:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17657
00000100:00100000:0.0:1767320306.135209:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379979904:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320306.135281:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320306.136303:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379979904
00000100:00100000:3.0:1767320306.136313:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379979904
00000100:00100000:3.0:1767320306.136385:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625
00000100:00100000:3.0:1767320306.136395:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379979904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320306.136424:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320306.136485:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379979904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (1203us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320306.136492:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625
00000100:00080000:0.0:1767320306.136559:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320306.136596:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379979904:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320306.205187:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320307.226066:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320308.247251:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320309.271246:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320309.719093:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320309.719103:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320309.719106:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320309.719109:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320309.719114:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320309.719121:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5207
00000100:00080000:3.0:1767320309.719126:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320309.719132:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320309.719158:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164379980160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320309.719174:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320309.719177:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320309.719179:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320309.719183:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5207
00000100:00080000:3.0:1767320309.719185:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767320309.719190:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379980160:0@lo:38:kworker.0
00000100:00100000:0.0:1767320309.719237:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379980032:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320309.719258:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320309.719267:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320309.719372:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980032
00000100:00100000:0.0:1767320309.719379:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980032
00000100:00100000:0.0:1767320309.719433:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626
00000100:00100000:0.0:1767320309.719441:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379980032:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320309.719472:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320309.719514:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379980032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (245us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320309.719534:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626
00000100:00080000:0.0:1767320309.719556:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320309.719585:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980160
00000100:00100000:0.0:1767320309.719589:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980160
00000100:00100000:0.0:1767320309.719610:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17658
00000100:00100000:0.0:1767320309.719614:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379980160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320309.719644:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320309.719702:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379980160:12345-0@lo:38:kworker.0 Request processed in 86us (444us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320309.719707:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17658
00000100:00080000:3.0:1767320309.719753:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320309.720089:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379980288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320309.720143:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379980416:0@lo:400:kworker.0
00000100:00100000:0.0:1767320309.720171:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320309.720228:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980416
00000100:00100000:1.0:1767320309.720232:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980416
00000100:00100000:1.0:1767320309.720272:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830
00000100:00100000:1.0:1767320309.720278:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379980416:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320309.720332:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320309.720372:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320309.720377:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320309.720381:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379980160:0@lo:38:kworker.0
00000100:00100000:2.0:1767320309.720404:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379980288:0@lo:38:kworker.0
00000100:00100000:0.0:1767320309.720436:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379980032:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320309.720489:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379980416:12345-0@lo:400:kworker.0 Request processed in 211us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320309.720496:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830
00000100:00100000:1.0:1767320309.720536:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379980544:0@lo:400:kworker.0
00000100:00100000:1.0:1767320309.720561:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320309.720583:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320309.720591:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980544
00000100:00100000:1.0:1767320309.720595:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980544
00000100:00100000:2.0:1767320309.720617:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980288
00000100:00100000:2.0:1767320309.720621:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980288
00000100:00100000:1.0:1767320309.720622:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4766
00000100:00100000:2.0:1767320309.720639:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154
00000100:00100000:1.0:1767320309.720640:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379980544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320309.720644:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379980288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320309.720667:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320309.720682:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379980544:12345-0@lo:400:kworker.0 Request processed in 55us (119us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320309.720688:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4766
00000100:00100000:2.0:1767320309.720692:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379980288:12345-0@lo:38:kworker.0 Request processed in 47us (109us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320309.720698:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154
00000100:00080000:1.0:1767320309.720703:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320309.720718:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379980544:0@lo:400:kworker.0
00000100:00080000:2.0:1767320309.720718:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320309.720721:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320309.720724:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379980288:0@lo:38:kworker.0
00000100:00080000:3.0:1767320309.720925:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320309.720929:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320309.720932:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320309.720936:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5207
00000100:00080000:3.0:1767320309.720939:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320309.720943:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320309.720958:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dce00 x1853164379980672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320309.720994:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320309.720997:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320309.720999:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320309.721003:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5207
00000100:00080000:3.0:1767320309.721005:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320309.721008:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320309.721018:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164379980928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320309.721040:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379980800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320309.721065:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320309.721077:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980800
00000100:00100000:2.0:1767320309.721081:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980800
00000100:00100000:2.0:1767320309.721111:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4767
00000100:00100000:2.0:1767320309.721118:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379980800:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320309.721154:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320309.721156:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379980800:12345-0@lo:400:kworker.0 Request processed in 39us (90us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320309.721162:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4767
00000100:00100000:1.0:1767320309.721164:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379980672:0@lo:38:kworker.0
00000100:00100000:1.0:1767320309.721189:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320309.721210:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379980928:0@lo:38:kworker.0
00000100:00100000:1.0:1767320309.721229:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320309.721251:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980672
00000100:00100000:1.0:1767320309.721254:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980672
00000100:00100000:1.0:1767320309.721270:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379980928
00000100:00100000:1.0:1767320309.721272:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379980928
00000100:00100000:1.0:1767320309.721282:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17659
00000100:00100000:1.0:1767320309.721286:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379980672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320309.721297:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320309.721323:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379980672:12345-0@lo:38:kworker.0 Request processed in 35us (134us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320309.721328:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17659
00000100:00100000:1.0:1767320309.721341:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17660
00000100:00100000:1.0:1767320309.721345:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379980928:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320309.721354:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320309.721375:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379980928:12345-0@lo:38:kworker.0 Request processed in 28us (144us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320309.721380:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17660
00000100:00080000:1.0:1767320309.721402:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320309.721407:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320309.721410:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379980672:0@lo:38:kworker.0
00000100:00080000:1.0:1767320309.721415:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320309.721418:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320309.721420:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379980928:0@lo:38:kworker.0
00000100:00100000:3.0:1767320309.721605:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379980800:0@lo:400:kworker.0
00000100:00100000:0.0:1767320309.721718:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379980416:0@lo:400:kworker.0
00010000:00010000:2.0:1767320310.295480:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320310.671428:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320310.671524:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320310.682736:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291966592
00000100:00100000:0.0:1767320310.682750:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291966592
00000100:00100000:0.0:1767320310.682822:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17661
00000100:00100000:0.0:1767320310.684077:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291966592:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320310.684108:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320310.684192:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291966592:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1361us (12666us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320310.684205:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17661
00000100:00100000:2.0:1767320310.686464:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291966720
00000100:00100000:2.0:1767320310.686475:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291966720
00000100:00080000:1.0:1767320310.686543:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320310.686584:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4768
00000100:00100000:2.0:1767320310.686593:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291966720:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320310.686667:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291966720:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 74us (15249us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320310.686674:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4768
00000100:00100000:2.0:1767320311.256541:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379981056:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320311.256614:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320311.257634:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981056
00000100:00100000:0.0:1767320311.257664:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981056
00000100:00100000:0.0:1767320311.257741:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627
00000100:00100000:0.0:1767320311.257752:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379981056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320311.257787:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320311.257850:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379981056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1236us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320311.257857:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627
00000100:00100000:2.0:1767320311.258361:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379981056:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320311.258566:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320311.319036:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320312.347475:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320313.367709:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320314.391086:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767320314.768092:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291966848 offset 0 length 520: 4
00000100:00100000:3.0:1767320314.768159:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320314.772294:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320314.777750:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291966976
00000100:00100000:2.0:1767320314.777766:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291966976
00000100:00100000:2.0:1767320314.777824:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291967104
00000100:00100000:2.0:1767320314.777828:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291967104
00000100:00100000:2.0:1767320314.777896:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4769
00000100:00100000:2.0:1767320314.777906:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291967104:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320314.777998:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291967104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (5714us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320314.778006:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4769
00000100:00100000:2.0:1767320314.778027:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17662
00000100:00100000:2.0:1767320314.778031:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291966976:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320314.778049:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320314.778074:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291966976:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (9915us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320314.778080:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17662
00000100:00080000:1.0:1767320314.778220:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320314.839101:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320314.839112:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320314.839116:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320314.839119:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320314.839123:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320314.839131:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5212
00000100:00080000:0.0:1767320314.839135:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320314.839142:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320314.839182:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608000 x1853164379981184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320314.839201:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320314.839203:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320314.839204:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320314.839207:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5212
00000100:00080000:0.0:1767320314.839209:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320314.839213:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320314.839225:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609c00 x1853164379981312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320314.839290:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379981440:0@lo:400:kworker.0
00000100:00100000:3.0:1767320314.839353:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320314.839488:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320314.839498:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379981696:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320314.839527:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320314.839560:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981696
00000100:00100000:2.0:1767320314.839566:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981696
00000100:00100000:2.0:1767320314.839643:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628
00000100:00100000:2.0:1767320314.839653:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379981696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320314.839679:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320314.839727:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379981696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (201us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320314.839732:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628
00000100:00080000:2.0:1767320314.839749:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320314.839788:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379981696:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320314.839814:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981440
00000100:00100000:2.0:1767320314.839816:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981440
00000100:00100000:2.0:1767320314.839832:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831
00000100:00100000:2.0:1767320314.839836:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379981440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320314.839888:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379981184:0@lo:38:kworker.0
00000100:00100000:1.0:1767320314.839925:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320314.839948:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379981312:0@lo:38:kworker.0
00000100:00100000:1.0:1767320314.840026:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320314.840078:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379981568:0@lo:400:kworker.0
00000100:00100000:1.0:1767320314.840103:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320314.840139:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981568
00000100:00100000:1.0:1767320314.840143:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981568
00000100:00100000:1.0:1767320314.840174:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832
00000100:00100000:1.0:1767320314.840181:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379981568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320314.840215:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379981568:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320314.840221:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832
00000100:00100000:1.0:1767320314.840250:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379981568:0@lo:400:kworker.0
00000100:00100000:1.0:1767320314.840265:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981184
00000100:00100000:1.0:1767320314.840269:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981184
00000100:00100000:1.0:1767320314.840291:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17663
00000100:00100000:1.0:1767320314.840296:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379981184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320314.840313:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320314.840344:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379981184:12345-0@lo:38:kworker.0 Request processed in 47us (418us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320314.840351:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17663
00000100:00080000:1.0:1767320314.840378:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320314.840382:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320314.840385:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379981184:0@lo:38:kworker.0
00000100:00100000:1.0:1767320314.841079:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981312
00000100:00100000:1.0:1767320314.841085:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981312
00000100:00100000:1.0:1767320314.841110:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155
00000100:00100000:1.0:1767320314.841116:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379981312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320314.841128:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320314.841168:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379981312:12345-0@lo:38:kworker.0 Request processed in 52us (1197us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320314.841174:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155
00000100:00080000:0.0:1767320314.841243:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320314.841247:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320314.841249:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320314.841254:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5212
00000100:00080000:0.0:1767320314.841257:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320314.841261:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320314.841276:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d500 x1853164379981952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320314.841295:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320314.841298:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320314.841300:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320314.841304:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5212
00000100:00080000:0.0:1767320314.841306:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320314.841310:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320314.841320:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ed80 x1853164379982208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320314.841578:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320314.841602:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320314.841621:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379981824:0@lo:400:kworker.0
00000100:00100000:0.0:1767320314.841656:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320314.841685:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981824
00000100:00100000:0.0:1767320314.841689:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981824
00000100:00100000:0.0:1767320314.841721:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4770
00000100:00100000:0.0:1767320314.841730:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379981824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320314.841778:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379981824:12345-0@lo:400:kworker.0 Request processed in 39us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320314.841785:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4770
00000100:00100000:0.0:1767320314.841815:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379981824:0@lo:400:kworker.0
00000100:00100000:0.0:1767320314.841831:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320314.841838:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379982080:0@lo:400:kworker.0
00000100:00100000:0.0:1767320314.841861:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320314.841898:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982080
00000100:00100000:0.0:1767320314.841902:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982080
00000100:00100000:0.0:1767320314.841927:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4771
00000100:00100000:0.0:1767320314.841933:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379982080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320314.841963:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379982080:12345-0@lo:400:kworker.0 Request processed in 30us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320314.841967:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4771
00000100:00100000:0.0:1767320314.841993:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379982080:0@lo:400:kworker.0
00000100:00080000:0.0:1767320314.842024:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320314.842028:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320314.842051:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320314.842057:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379981312:0@lo:38:kworker.0
00000100:00100000:1.0:1767320314.842075:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379981952:0@lo:38:kworker.0
00000100:00100000:1.0:1767320314.842100:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320314.842124:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379982208:0@lo:38:kworker.0
00000100:00100000:1.0:1767320314.842143:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320314.842222:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379981952
00000100:00100000:0.0:1767320314.842227:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379981952
00000100:00100000:0.0:1767320314.842251:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982208
00000100:00100000:0.0:1767320314.842254:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982208
00000100:00100000:0.0:1767320314.842270:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17664
00000100:00100000:0.0:1767320314.842274:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379981952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320314.842287:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320314.842320:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379981952:12345-0@lo:38:kworker.0 Request processed in 43us (218us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320314.842326:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17664
00000100:00100000:0.0:1767320314.842338:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17665
00000100:00100000:0.0:1767320314.842341:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379982208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320314.842350:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320314.842369:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379982208:12345-0@lo:38:kworker.0 Request processed in 27us (225us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320314.842374:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17665
00000100:00080000:0.0:1767320314.842396:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320314.842400:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320314.842403:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379981952:0@lo:38:kworker.0
00000100:00080000:0.0:1767320314.842410:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320314.842412:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320314.842414:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379982208:0@lo:38:kworker.0
00000100:00100000:2.0:1767320314.842626:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379981440:12345-0@lo:400:kworker.0 Request processed in 2786us (3270us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320314.842633:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831
00000100:00100000:3.0:1767320314.843969:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379981440:0@lo:400:kworker.0
00010000:00010000:2.0:1767320315.415276:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320316.375301:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379982336:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320316.375369:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320316.375509:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982336
00000100:00100000:1.0:1767320316.375517:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982336
00000100:00100000:1.0:1767320316.375593:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629
00000100:00100000:1.0:1767320316.375628:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379982336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320316.375654:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320316.375692:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379982336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (322us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320316.375699:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629
00000100:00080000:0.0:1767320316.375866:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320316.375922:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379982336:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320316.439947:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320317.463228:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320318.487158:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320319.511155:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320319.891155:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320319.891248:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320319.891579:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291967360
00000100:00100000:0.0:1767320319.891589:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291967360
00000100:00100000:0.0:1767320319.891665:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291967232
00000100:00100000:0.0:1767320319.891670:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291967232
00000100:00100000:0.0:1767320319.891694:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4772
00000100:00100000:0.0:1767320319.891706:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291967360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320319.891781:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291967360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (636us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320319.891789:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4772
00000100:00100000:0.0:1767320319.891809:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17666
00000100:00100000:0.0:1767320319.891814:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291967232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320319.891834:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320319.891861:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291967232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (613us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320319.891905:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17666
00000100:00080000:1.0:1767320319.893554:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320319.959182:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320319.959209:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379982464:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320319.959281:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320319.959785:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982464
00000100:00100000:2.0:1767320319.959792:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982464
00000100:00100000:2.0:1767320319.959845:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630
00000100:00100000:2.0:1767320319.959852:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379982464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320319.959893:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320319.959932:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379982464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (651us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320319.959937:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630
00000100:00080000:1.0:1767320319.959986:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320319.960156:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379982464:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320319.964802:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320319.964810:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320319.964813:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320319.964816:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320319.964820:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320319.964826:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5217
00000100:00080000:3.0:1767320319.964829:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320319.964834:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320319.964900:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ed80 x1853164379982592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320319.976662:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320319.976672:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320319.976676:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320319.976683:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5217
00000100:00080000:3.0:1767320319.976688:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320319.976695:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320319.976740:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379982720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320319.976838:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379982848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320319.976922:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320319.977028:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320294/real 1767320294]  req@ffff8b0e0e0dd180 x1853164379976320/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320319 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320319.977066:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0e0dd180 x1853164379976320/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320319 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320319.977085:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379982592:0@lo:38:kworker.0
00000100:00100000:1.0:1767320319.977117:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320319.977159:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379982720:0@lo:38:kworker.0
00000100:00100000:1.0:1767320319.977183:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320319.977216:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320319.977240:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320319.978203:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379976320:0@lo:250:kworker.0
00000100:00100000:1.0:1767320319.978285:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982720
00000100:00100000:1.0:1767320319.978293:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982720
00000100:00080000:3.0:1767320319.979714:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320319.979721:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320319.979724:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320319.979730:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5217
00000100:00080000:3.0:1767320319.979734:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320319.979739:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320319.979762:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93800 x1853164379983104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320319.979788:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320319.979792:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320319.979794:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320319.979797:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5217
00000100:00080000:3.0:1767320319.979799:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320319.979803:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320319.979813:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18a80 x1853164379983360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320319.979832:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320319.979835:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320319.979837:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320319.979840:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5196
00000100:00080000:3.0:1767320319.979842:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320319.979845:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320319.979854:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1bb80 x1853164379983488/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320319.979920:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379982976:0@lo:400:kworker.0
00000100:00100000:3.0:1767320319.979977:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320319.980012:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320319.980019:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379983232:0@lo:400:kworker.0
00000100:00100000:3.0:1767320319.980041:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320319.980074:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982592
00000100:00100000:3.0:1767320319.980080:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982592
00000100:00100000:3.0:1767320319.980109:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982976
00000100:00100000:3.0:1767320319.980112:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982976
00000100:00100000:3.0:1767320319.980159:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379983232
00000100:00100000:3.0:1767320319.980162:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379983232
00000100:00100000:3.0:1767320319.980187:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4773
00000100:00100000:3.0:1767320319.980196:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379982976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320319.980901:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156
00000100:00100000:1.0:1767320319.980910:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379982720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320319.980929:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320319.980973:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379982720:12345-0@lo:38:kworker.0 Request processed in 63us (3788us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320319.980980:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156
00000100:00100000:1.0:1767320319.981015:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379983104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320319.981040:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320319.981065:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379983360:0@lo:38:kworker.0
00000100:00100000:1.0:1767320319.981084:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320319.981095:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379983488:0@lo:250:kworker.0
00000400:00000100:1.0:1767320319.981110:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379983488 offset 0 length 520: 4
00000100:00080000:1.0:1767320319.981206:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320319.981212:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320319.981215:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379982720:0@lo:38:kworker.0
00000100:00080000:1.0:1767320319.981263:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320319.981275:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379983104
00000100:00100000:1.0:1767320319.981279:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379983104
00000100:00100000:1.0:1767320319.981295:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379983360
00000100:00100000:1.0:1767320319.981297:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379983360
00000100:00100000:1.0:1767320319.981307:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4774
00000100:00100000:1.0:1767320319.981316:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379983232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320319.981356:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379983232:12345-0@lo:400:kworker.0 Request processed in 43us (1314us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320319.981376:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4774
00000100:00100000:1.0:1767320319.981392:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17667
00000100:00100000:1.0:1767320319.981396:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379982592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320319.981406:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320319.981435:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379982592:12345-0@lo:38:kworker.0 Request processed in 37us (4317us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320319.981441:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17667
00000100:00100000:1.0:1767320319.981452:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17668
00000100:00100000:1.0:1767320319.981456:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379983104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320319.981464:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320319.981486:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379983104:12345-0@lo:38:kworker.0 Request processed in 29us (445us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320319.981492:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17668
00000100:00100000:1.0:1767320319.981504:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17669
00000100:00100000:1.0:1767320319.981508:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379983360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320319.981516:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320319.981537:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379983360:12345-0@lo:38:kworker.0 Request processed in 28us (452us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320319.981543:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17669
00000100:00100000:3.0:1767320319.981939:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379982976:12345-0@lo:400:kworker.0 Request processed in 1743us (1960us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320319.981946:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4773
00000100:00100000:3.0:1767320319.981984:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379983232:0@lo:400:kworker.0
00000100:00100000:3.0:1767320319.981994:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379982976:0@lo:400:kworker.0
00000100:00080000:1.0:1767320319.982278:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320319.982284:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320319.982287:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379983104:0@lo:38:kworker.0
00000100:00080000:1.0:1767320319.982295:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320319.982298:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320319.982301:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379983360:0@lo:38:kworker.0
00000100:00080000:1.0:1767320319.982309:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320319.982314:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320319.982316:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379982592:0@lo:38:kworker.0
00000100:00100000:2.0:1767320319.982555:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379982848
00000100:00100000:2.0:1767320319.982561:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379982848
00000100:00100000:2.0:1767320319.982640:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833
00000100:00100000:2.0:1767320319.982648:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379982848:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320319.982725:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320319.984075:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379982848:12345-0@lo:400:kworker.0 Request processed in 1421us (7145us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320319.984088:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833
00000100:00100000:0.0:1767320319.984730:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379982848:0@lo:400:kworker.0
00010000:00010000:1.0:1767320320.535135:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320321.497284:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379983616:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320321.497365:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320321.497656:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379983616
00000100:00100000:1.0:1767320321.497666:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379983616
00000100:00100000:1.0:1767320321.497741:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631
00000100:00100000:1.0:1767320321.497751:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379983616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320321.497782:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320321.497840:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379983616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (475us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320321.497848:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631
00000100:00100000:0.0:1767320321.497980:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379983616:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320321.498088:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320321.559155:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320322.585504:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320323.608524:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320324.631961:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320325.012388:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320325.012499:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291967488
00000100:00100000:0.0:1767320325.012510:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291967488
00000100:00100000:0.0:1767320325.012569:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17670
00000100:00100000:0.0:1767320325.012583:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291967488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320325.012609:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320325.012695:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291967488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 112us (319us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320325.012704:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17670
00000100:00100000:3.0:1767320325.017057:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320325.017171:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291967616
00000100:00100000:1.0:1767320325.017191:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291967616
00000100:00100000:1.0:1767320325.017270:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4775
00000100:00100000:1.0:1767320325.017281:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291967616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320325.017371:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291967616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (324us total) trans 0 rc 0/0
00000100:00080000:2.0:1767320325.017374:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320325.017381:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4775
00000100:00100000:1.0:1767320325.082824:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320325.082844:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379983744:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320325.082943:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320325.083335:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379983744
00000100:00100000:3.0:1767320325.083345:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379983744
00000100:00100000:3.0:1767320325.083411:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632
00000100:00100000:3.0:1767320325.083421:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379983744:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320325.083452:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320325.083509:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379983744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (565us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320325.083527:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632
00000100:00100000:3.0:1767320325.083581:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379983744:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320325.083693:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320325.083750:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320325.083756:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320325.083758:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320325.083762:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320325.083766:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320325.083771:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5222
00000100:00080000:2.0:1767320325.083775:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320325.083779:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320325.083805:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b800 x1853164379983872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320325.083834:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320325.083839:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320325.083841:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320325.083845:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5222
00000100:00080000:2.0:1767320325.083847:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320325.083851:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320325.083865:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799f80 x1853164379984000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320325.083976:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320325.083980:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320325.083982:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320325.083985:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5222
00000100:00080000:2.0:1767320325.083988:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320325.083991:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320325.084004:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efce00 x1853164379984384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320325.084304:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379984256:0@lo:400:kworker.0
00000100:00100000:0.0:1767320325.084349:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320325.084379:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320325.084385:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379984128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320325.084411:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320325.084448:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984256
00000100:00100000:0.0:1767320325.084453:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984256
00000100:00100000:0.0:1767320325.084496:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4776
00000100:00100000:0.0:1767320325.084504:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379984256:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320325.084556:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379984256:12345-0@lo:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320325.084563:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4776
00000100:00080000:0.0:1767320325.084583:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320325.084605:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379984256:0@lo:400:kworker.0
00000100:00100000:0.0:1767320325.084643:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984128
00000100:00100000:0.0:1767320325.084647:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984128
00000100:00080000:0.0:1767320325.084663:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320325.084684:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834
00000100:00100000:0.0:1767320325.084690:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379984128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320325.084725:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379984128:12345-0@lo:400:kworker.0 Request processed in 35us (313us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320325.084730:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834
00000100:00100000:0.0:1767320325.084752:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379984128:0@lo:400:kworker.0
00000100:00100000:1.0:1767320325.085030:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379983872:0@lo:38:kworker.0
00000100:00100000:1.0:1767320325.085064:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320325.085079:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379984000:0@lo:38:kworker.0
00000100:00100000:1.0:1767320325.085113:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320325.085416:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984000
00000100:00100000:3.0:1767320325.085423:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984000
00000100:00100000:3.0:1767320325.085455:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157
00000100:00100000:3.0:1767320325.085461:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379984000:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320325.085482:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320325.085543:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379984000:12345-0@lo:38:kworker.0 Request processed in 80us (428us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320325.085549:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157
00000100:00080000:3.0:1767320325.085580:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320325.085586:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320325.085589:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379984000:0@lo:38:kworker.0
00000100:00080000:2.0:1767320325.085701:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320325.085705:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320325.085708:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320325.085712:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5222
00000100:00080000:2.0:1767320325.085715:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320325.085721:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320325.085736:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe680 x1853164379984640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320325.085829:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379984384:0@lo:38:kworker.0
00000100:00100000:3.0:1767320325.085861:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320325.085919:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379984640:0@lo:38:kworker.0
00000100:00100000:3.0:1767320325.085942:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320325.085969:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379983872
00000100:00100000:3.0:1767320325.085973:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379983872
00000100:00100000:3.0:1767320325.085992:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984384
00000100:00100000:3.0:1767320325.085995:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984384
00000100:00100000:3.0:1767320325.086020:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984640
00000100:00100000:3.0:1767320325.086023:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984640
00000100:00100000:3.0:1767320325.086040:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17671
00000100:00100000:3.0:1767320325.086044:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379983872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320325.086055:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320325.086099:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379983872:12345-0@lo:38:kworker.0 Request processed in 42us (1022us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320325.086106:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17671
00000100:00100000:3.0:1767320325.086118:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17672
00000100:00100000:3.0:1767320325.086122:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379984384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320325.086132:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320325.086156:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379984384:12345-0@lo:38:kworker.0 Request processed in 33us (294us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320325.086162:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17672
00000100:00100000:3.0:1767320325.086173:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17673
00000100:00100000:3.0:1767320325.086177:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379984640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320325.086511:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320325.086551:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379984640:12345-0@lo:38:kworker.0 Request processed in 371us (608us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320325.086557:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17673
00000100:00100000:3.0:1767320325.086593:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379984512:0@lo:400:kworker.0
00000100:00100000:3.0:1767320325.086618:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320325.086650:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984512
00000100:00100000:3.0:1767320325.086653:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984512
00000100:00100000:3.0:1767320325.086688:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4777
00000100:00100000:3.0:1767320325.086693:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379984512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320325.086737:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379984512:12345-0@lo:400:kworker.0 Request processed in 43us (117us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320325.086742:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4777
00000100:00100000:3.0:1767320325.086773:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379984512:0@lo:400:kworker.0
00000100:00080000:3.0:1767320325.086798:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320325.086802:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320325.086805:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379984384:0@lo:38:kworker.0
00000100:00080000:3.0:1767320325.086814:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320325.086816:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320325.086819:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379984640:0@lo:38:kworker.0
00000100:00080000:3.0:1767320325.086828:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320325.086832:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320325.086834:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379983872:0@lo:38:kworker.0
00000100:00080000:0.0:1767320325.086937:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320325.655540:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320326.615316:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320326.615337:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379984768:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320326.615413:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320326.615569:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984768
00000100:00100000:1.0:1767320326.615579:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984768
00000100:00100000:1.0:1767320326.615636:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633
00000100:00100000:1.0:1767320326.615646:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379984768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320326.615676:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320326.615719:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379984768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (305us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320326.615726:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633
00000100:00100000:3.0:1767320326.615901:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379984768:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320326.679222:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320327.703845:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320328.732941:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320329.754866:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320330.128802:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320330.128984:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320330.141173:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291967872
00000100:00100000:0.0:1767320330.141190:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291967872
00000100:00100000:0.0:1767320330.141362:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291967744
00000100:00100000:0.0:1767320330.141367:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291967744
00000100:00100000:0.0:1767320330.141398:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4778
00000100:00100000:0.0:1767320330.141413:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291967872:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320330.141512:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291967872:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 104us (12718us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320330.141521:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4778
00000100:00100000:0.0:1767320330.141539:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17674
00000100:00100000:0.0:1767320330.141544:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291967744:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320330.141563:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320330.141599:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291967744:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (12615us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320330.141606:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17674
00000100:00080000:2.0:1767320330.145813:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320330.199342:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320330.199380:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379984896:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320330.199454:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320330.200066:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379984896
00000100:00100000:2.0:1767320330.200075:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379984896
00000100:00100000:2.0:1767320330.200137:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634
00000100:00100000:2.0:1767320330.200145:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379984896:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320330.200172:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320330.200219:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379984896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (765us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320330.200237:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634
00000100:00080000:3.0:1767320330.200296:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320330.200382:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320330.200387:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320330.200389:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320330.200393:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320330.200397:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320330.200401:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5227
00000100:00080000:1.0:1767320330.200405:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320330.200409:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320330.200433:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ed80 x1853164379985024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320330.200459:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320330.200463:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320330.200465:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320330.200478:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5227
00000100:00080000:1.0:1767320330.200481:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320330.200485:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320330.200498:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9fb80 x1853164379985152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320330.200541:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320330.200544:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320330.200546:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320330.200559:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5227
00000100:00080000:1.0:1767320330.200561:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320330.200565:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320330.200584:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609c00 x1853164379985536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320330.200601:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320330.200604:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320330.200606:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320330.200610:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5227
00000100:00080000:1.0:1767320330.200613:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320330.200616:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320330.200629:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a4e00 x1853164379985792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320330.200651:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379985664:0@lo:400:kworker.0
00000100:00100000:3.0:1767320330.200828:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379985024:0@lo:38:kworker.0
00000100:00100000:3.0:1767320330.200862:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320330.200907:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379985152:0@lo:38:kworker.0
00000100:00100000:3.0:1767320330.200933:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320330.200957:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379985536:0@lo:38:kworker.0
00000100:00100000:3.0:1767320330.200976:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320330.200993:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379985792:0@lo:38:kworker.0
00000100:00100000:3.0:1767320330.201012:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320330.201041:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985152
00000100:00100000:3.0:1767320330.201046:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985152
00000100:00100000:3.0:1767320330.201068:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158
00000100:00100000:3.0:1767320330.201073:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379985152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320330.201091:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320330.201122:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379985152:12345-0@lo:38:kworker.0 Request processed in 47us (187us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320330.201128:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158
00000100:00100000:3.0:1767320330.201148:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985024
00000100:00100000:3.0:1767320330.201151:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985024
00000100:00100000:3.0:1767320330.201165:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985536
00000100:00100000:3.0:1767320330.201167:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985536
00000100:00100000:3.0:1767320330.201178:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985792
00000100:00100000:3.0:1767320330.201180:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985792
00000100:00100000:3.0:1767320330.201192:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17675
00000100:00100000:3.0:1767320330.201196:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379985024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320330.201206:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320330.201242:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379985024:12345-0@lo:38:kworker.0 Request processed in 44us (379us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320330.201248:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17675
00000100:00100000:3.0:1767320330.201259:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17676
00000100:00100000:3.0:1767320330.201263:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379985536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320330.201272:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320330.201293:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379985536:12345-0@lo:38:kworker.0 Request processed in 28us (316us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320330.201299:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17676
00000100:00100000:3.0:1767320330.201309:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17677
00000100:00100000:3.0:1767320330.201312:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379985792:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320330.201321:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320330.201341:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379985792:12345-0@lo:38:kworker.0 Request processed in 27us (328us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320330.201346:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17677
00000100:00080000:3.0:1767320330.201516:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320330.201522:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320330.201525:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379985024:0@lo:38:kworker.0
00000100:00080000:3.0:1767320330.201535:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320330.201537:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320330.201540:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379985152:0@lo:38:kworker.0
00000100:00080000:3.0:1767320330.201547:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320330.201550:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320330.201553:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379985536:0@lo:38:kworker.0
00000100:00080000:3.0:1767320330.201559:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320330.201562:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320330.201565:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379985792:0@lo:38:kworker.0
00000100:00100000:3.0:1767320330.201620:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379985280:0@lo:400:kworker.0
00000100:00100000:3.0:1767320330.201647:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320330.201864:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379984896:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320330.201908:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985280
00000100:00100000:3.0:1767320330.201912:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985280
00000100:00100000:3.0:1767320330.201945:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835
00000100:00100000:3.0:1767320330.201951:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379985280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320330.201987:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379985280:12345-0@lo:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320330.201993:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835
00000100:00080000:3.0:1767320330.202006:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320330.202021:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379985280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320330.202239:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320330.202262:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320330.202269:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379985408:0@lo:400:kworker.0
00000100:00100000:1.0:1767320330.202291:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320330.202314:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985664
00000100:00100000:1.0:1767320330.202317:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985664
00000100:00100000:1.0:1767320330.202346:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985408
00000100:00100000:1.0:1767320330.202349:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985408
00000100:00100000:1.0:1767320330.202378:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4779
00000100:00100000:1.0:1767320330.202385:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379985664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320330.202417:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379985664:12345-0@lo:400:kworker.0 Request processed in 32us (178us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320330.202422:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4779
00000100:00100000:1.0:1767320330.202437:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4780
00000100:00100000:1.0:1767320330.202443:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379985408:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320330.202468:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379985408:12345-0@lo:400:kworker.0 Request processed in 25us (176us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320330.202482:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4780
00000100:00080000:1.0:1767320330.202501:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320330.202519:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379985408:0@lo:400:kworker.0
00000100:00100000:1.0:1767320330.202528:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379985664:0@lo:400:kworker.0
00010000:00010000:2.0:1767320330.775200:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320331.735484:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320331.735512:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379985920:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320331.735594:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320331.735714:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379985920
00000100:00100000:1.0:1767320331.735723:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379985920
00000100:00100000:1.0:1767320331.735768:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635
00000100:00100000:1.0:1767320331.735776:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379985920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320331.735804:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320331.735856:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379985920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320331.735864:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635
00000100:00100000:3.0:1767320331.736383:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379985920:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320331.801589:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320332.825090:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320333.847549:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320334.871949:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320335.249038:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320335.249085:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320335.249236:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291968128
00000100:00100000:1.0:1767320335.249249:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291968128
00000100:00100000:1.0:1767320335.249335:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291968000
00000100:00100000:1.0:1767320335.249338:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291968000
00000100:00100000:1.0:1767320335.249359:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4781
00000100:00100000:1.0:1767320335.249369:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291968128:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320335.249471:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291968128:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 105us (449us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320335.249478:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4781
00000100:00100000:1.0:1767320335.249503:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17678
00000100:00100000:1.0:1767320335.249508:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291968000:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320335.249533:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320335.249561:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291968000:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (475us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320335.249566:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17678
00000100:00080000:3.0:1767320335.250363:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320335.319343:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320335.319365:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379986048:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320335.319470:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320335.319593:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320335.319599:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320335.319603:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320335.319607:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320335.319612:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320335.319618:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5232
00000100:00080000:0.0:1767320335.319623:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320335.319630:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320335.319673:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b800 x1853164379986176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320335.319699:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320335.319703:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320335.319705:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320335.319711:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5232
00000100:00080000:0.0:1767320335.319713:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320335.319717:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320335.319736:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799f80 x1853164379986304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320335.319782:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320335.319786:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320335.319788:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320335.319792:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5232
00000100:00080000:0.0:1767320335.319794:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320335.319798:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320335.319811:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5f80 x1853164379986688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320335.319837:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320335.319841:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320335.319843:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320335.319847:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5232
00000100:00080000:0.0:1767320335.319850:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320335.319854:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320335.319866:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7800 x1853164379986944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320335.319936:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320335.319948:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379986816:0@lo:400:kworker.0
00000100:00100000:0.0:1767320335.319984:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320335.320022:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986816
00000100:00100000:0.0:1767320335.320031:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986816
00000100:00100000:0.0:1767320335.320100:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4782
00000100:00100000:0.0:1767320335.320108:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379986816:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320335.320156:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379986816:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320335.320162:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4782
00000100:00080000:0.0:1767320335.320184:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320335.320234:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379986816:0@lo:400:kworker.0
00000100:00100000:1.0:1767320335.320323:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379986560:0@lo:400:kworker.0
00000100:00100000:1.0:1767320335.320350:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320335.320372:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320335.320376:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379986432:0@lo:400:kworker.0
00000100:00100000:1.0:1767320335.320394:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320335.320417:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379986176:0@lo:38:kworker.0
00000100:00100000:1.0:1767320335.320445:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320335.320455:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379986304:0@lo:38:kworker.0
00000100:00100000:1.0:1767320335.320473:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320335.320487:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379986688:0@lo:38:kworker.0
00000100:00100000:1.0:1767320335.320501:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320335.320510:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379986944:0@lo:38:kworker.0
00000100:00100000:1.0:1767320335.320522:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320335.320541:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986560
00000100:00100000:1.0:1767320335.320544:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986560
00000100:00100000:1.0:1767320335.320567:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986176
00000100:00100000:1.0:1767320335.320569:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986176
00000100:00100000:1.0:1767320335.320578:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986688
00000100:00100000:1.0:1767320335.320579:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986688
00000100:00100000:1.0:1767320335.320584:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986944
00000100:00100000:1.0:1767320335.320585:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986944
00000100:00100000:1.0:1767320335.320591:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4783
00000100:00100000:1.0:1767320335.320595:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379986560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320335.320620:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379986560:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320335.320624:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4783
00000100:00100000:1.0:1767320335.320637:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17679
00000100:00100000:1.0:1767320335.320639:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379986176:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320335.320656:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320335.320677:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379986176:12345-0@lo:38:kworker.0 Request processed in 36us (232us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320335.320681:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17679
00000100:00100000:1.0:1767320335.320687:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17680
00000100:00100000:1.0:1767320335.320690:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379986688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320335.320696:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320335.320708:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379986688:12345-0@lo:38:kworker.0 Request processed in 16us (206us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320335.320711:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17680
00000100:00100000:1.0:1767320335.320717:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17681
00000100:00100000:1.0:1767320335.320720:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379986944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320335.320725:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320335.320736:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379986944:12345-0@lo:38:kworker.0 Request processed in 15us (213us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320335.320739:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17681
00000100:00100000:1.0:1767320335.320767:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379986560:0@lo:400:kworker.0
00000100:00080000:1.0:1767320335.320788:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320335.320793:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320335.320797:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379986176:0@lo:38:kworker.0
00000100:00080000:1.0:1767320335.320806:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320335.320810:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320335.320812:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379986688:0@lo:38:kworker.0
00000100:00080000:1.0:1767320335.320820:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320335.320823:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320335.320826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379986944:0@lo:38:kworker.0
00000100:00100000:3.0:1767320335.320980:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986048
00000100:00100000:3.0:1767320335.320986:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986048
00000100:00100000:3.0:1767320335.321030:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636
00000100:00100000:3.0:1767320335.321039:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379986048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320335.321067:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320335.321126:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379986048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (1657us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320335.321131:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636
00000100:00100000:3.0:1767320335.321149:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986304
00000100:00100000:3.0:1767320335.321152:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986304
00000100:00100000:3.0:1767320335.321165:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159
00000100:00100000:3.0:1767320335.321169:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379986304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320335.321176:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320335.321197:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379986304:12345-0@lo:38:kworker.0 Request processed in 28us (723us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320335.321201:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159
00000100:00080000:3.0:1767320335.321227:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320335.321231:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320335.321234:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379986304:0@lo:38:kworker.0
00000100:00100000:2.0:1767320335.321307:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379986048:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320335.321460:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379986432
00000100:00100000:0.0:1767320335.321464:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379986432
00000100:00100000:0.0:1767320335.321504:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836
00000100:00100000:0.0:1767320335.321510:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379986432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320335.321642:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379986432:12345-0@lo:400:kworker.0 Request processed in 131us (1245us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320335.321649:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836
00000100:00080000:0.0:1767320335.321669:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320335.321672:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320335.321675:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320335.321910:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379986432:0@lo:400:kworker.0
00010000:00010000:2.0:1767320335.895254:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320336.856828:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379987072:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320336.856956:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320336.857149:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987072
00000100:00100000:1.0:1767320336.857162:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987072
00000100:00100000:1.0:1767320336.857243:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637
00000100:00100000:1.0:1767320336.857254:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379987072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320336.857295:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320336.857358:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379987072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (402us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320336.857367:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637
00000100:00100000:0.0:1767320336.857639:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379987072:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320336.919981:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320337.944055:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320338.967476:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320339.991180:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320340.373811:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767320340.373907:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291968256 offset 0 length 520: 4
00000100:00100000:0.0:1767320340.373934:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320340.374415:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291968512
00000100:00100000:2.0:1767320340.374425:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291968512
00000100:00100000:2.0:1767320340.374540:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291968384
00000100:00100000:2.0:1767320340.374546:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291968384
00000100:00100000:2.0:1767320340.374577:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4784
00000100:00100000:2.0:1767320340.374643:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291968512:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320340.374724:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291968512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 138us (929us total) trans 0 rc 0/0
00000100:00080000:0.0:1767320340.374749:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320340.378532:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17682
00000100:00100000:1.0:1767320340.378554:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291968384:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320340.378590:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320340.378715:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291968384:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 163us (4777us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320340.380737:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4784
00000100:00100000:1.0:1767320340.381482:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17682
00000100:00080000:3.0:1767320340.439069:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320340.439081:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320340.439084:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320340.439094:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320340.439100:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320340.439110:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5237
00000100:00080000:3.0:1767320340.439116:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320340.439123:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320340.439167:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafdc00 x1853164379987200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320340.439191:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320340.439196:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320340.439198:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320340.439202:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5237
00000100:00080000:3.0:1767320340.439205:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320340.439214:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320340.439217:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379987200:0@lo:38:kworker.0
00000100:00100000:3.0:1767320340.439227:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164379987328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320340.439292:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320340.439296:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320340.439297:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320340.439301:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5237
00000100:00080000:3.0:1767320340.439303:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320340.439307:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320340.439317:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff800 x1853164379987840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320340.439340:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320340.439341:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320340.439350:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320340.439352:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320340.439356:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5237
00000100:00080000:3.0:1767320340.439358:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320340.439362:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320340.439371:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff100 x1853164379988096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320340.439439:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379987328:0@lo:38:kworker.0
00000100:00100000:1.0:1767320340.439474:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320340.439486:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379987584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320340.439509:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379987840:0@lo:38:kworker.0
00000100:00100000:2.0:1767320340.439652:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379987456:0@lo:400:kworker.0
00000100:00100000:3.0:1767320340.439735:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379987712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320340.440705:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320340.440750:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379988096:0@lo:38:kworker.0
00000100:00100000:1.0:1767320340.440782:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320340.440839:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987200
00000100:00100000:0.0:1767320340.440849:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320340.440853:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987200
00000100:00100000:1.0:1767320340.440921:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987840
00000100:00100000:1.0:1767320340.440927:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987840
00000100:00100000:1.0:1767320340.440949:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379988096
00000100:00100000:1.0:1767320340.440952:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379988096
00000100:00100000:0.0:1767320340.440964:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379987968:0@lo:400:kworker.0
00000100:00100000:1.0:1767320340.440995:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17683
00000100:00100000:1.0:1767320340.441006:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379987200:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320340.441015:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:1.0:1767320340.441035:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320340.441093:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379987200:12345-0@lo:38:kworker.0 Request processed in 87us (1758us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320340.441101:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17683
00000100:00100000:1.0:1767320340.441124:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987968
00000100:00100000:1.0:1767320340.441128:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987968
00000100:00100000:1.0:1767320340.441166:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4785
00000100:00100000:1.0:1767320340.441172:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379987968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320340.441226:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379987968:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320340.441231:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4785
00000100:00100000:1.0:1767320340.441244:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17684
00000100:00100000:1.0:1767320340.441248:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379987840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320340.441257:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320340.441293:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379987840:12345-0@lo:38:kworker.0 Request processed in 40us (590us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320340.441298:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987584
00000100:00100000:1.0:1767320340.441303:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17684
00000100:00100000:0.0:1767320340.441309:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987584
00000100:00100000:0.0:1767320340.441362:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837
00000100:00100000:0.0:1767320340.441369:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379987584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320340.441444:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379987584:12345-0@lo:400:kworker.0 Request processed in 75us (606us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320340.441451:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837
00000100:00080000:0.0:1767320340.441475:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320340.441479:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320340.441509:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379987584:0@lo:400:kworker.0
00000100:00100000:0.0:1767320340.441676:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17685
00000100:00100000:0.0:1767320340.441682:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379988096:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320340.441701:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320340.441731:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379988096:12345-0@lo:38:kworker.0 Request processed in 48us (949us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320340.441737:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17685
00000100:00080000:0.0:1767320340.441799:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320340.441804:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320340.441807:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379987840:0@lo:38:kworker.0
00000100:00080000:0.0:1767320340.441820:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320340.441823:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320340.441825:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379988096:0@lo:38:kworker.0
00000100:00080000:0.0:1767320340.441833:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320340.441835:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320340.441838:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379987200:0@lo:38:kworker.0
00000100:00100000:0.0:1767320340.441904:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379987968:0@lo:400:kworker.0
00000100:00100000:0.0:1767320340.442036:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987328
00000100:00100000:0.0:1767320340.442052:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987328
00000100:00100000:0.0:1767320340.442073:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160
00000100:00100000:0.0:1767320340.442078:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379987328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320340.442416:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320340.442453:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379987328:12345-0@lo:38:kworker.0 Request processed in 373us (2979us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320340.442459:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160
00000100:00100000:0.0:1767320340.442474:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320340.442482:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379988224:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320340.442508:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320340.443261:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320340.443268:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320340.443272:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379987328:0@lo:38:kworker.0
00000100:00100000:0.0:1767320340.443332:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379988224
00000100:00100000:0.0:1767320340.443337:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379988224
00000100:00100000:0.0:1767320340.443393:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638
00000100:00100000:0.0:1767320340.443401:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379988224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320340.443428:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320340.443476:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379988224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (966us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320340.443482:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638
00000100:00080000:0.0:1767320340.443509:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320340.443535:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379988224:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320340.443691:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320340.443748:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987456
00000100:00100000:2.0:1767320340.443752:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987456
00000100:00100000:2.0:1767320340.443786:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838
00000100:00100000:2.0:1767320340.443792:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379987456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320340.443823:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379987456:12345-0@lo:400:kworker.0 Request processed in 32us (133us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320340.443829:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838
00000100:00100000:2.0:1767320340.444200:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379987456:0@lo:400:kworker.0
00000100:00100000:3.0:1767320340.445387:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320340.446660:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379987712
00000100:00100000:1.0:1767320340.446671:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379987712
00000100:00100000:1.0:1767320340.446799:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4786
00000100:00100000:1.0:1767320340.446809:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379987712:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320340.447011:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320340.447294:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379987712:12345-0@lo:400:kworker.0 Request processed in 486us (1920us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320340.447302:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4786
00000100:00100000:2.0:1767320340.447540:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379987712:0@lo:400:kworker.0
00010000:00010000:1.0:1767320341.015422:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320341.977004:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379988352:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320341.977098:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320341.977243:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379988352
00000100:00100000:1.0:1767320341.977253:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379988352
00000100:00100000:1.0:1767320341.977311:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639
00000100:00100000:1.0:1767320341.977320:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379988352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320341.977348:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320341.977410:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379988352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (313us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320341.977418:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639
00000100:00100000:3.0:1767320341.977597:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379988352:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320342.039854:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320343.063143:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320344.091082:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320344.536702:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320319/real 1767320319]  req@ffff8b0e04c1bb80 x1853164379983488/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320344 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320344.536747:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e04c1bb80 x1853164379983488/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320344 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320344.536772:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320344.536818:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320344.536823:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379983488:0@lo:250:kworker.0
00000100:00080000:3.0:1767320344.537078:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320344.537085:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320344.537088:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320344.537094:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5222
00000100:00080000:3.0:1767320344.537099:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320344.537107:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320344.537148:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164379988480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320344.537179:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320344.537183:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320344.537184:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320344.537189:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5242
00000100:00080000:3.0:1767320344.537191:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320344.537196:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320344.537212:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafea00 x1853164379988608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320344.537219:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320344.537222:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320344.537224:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320344.537227:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5242
00000100:00080000:3.0:1767320344.537230:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320344.537233:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320344.537246:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafdc00 x1853164379988736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320344.537318:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320344.537322:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320344.537324:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320344.537328:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5242
00000100:00080000:3.0:1767320344.537331:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320344.537334:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320344.537378:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafed80 x1853164379989248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320344.537396:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320344.537399:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320344.537401:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320344.537405:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5242
00000100:00080000:3.0:1767320344.537407:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320344.537411:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320344.537422:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd180 x1853164379989504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320344.537452:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379989120:0@lo:400:kworker.0
00000100:00100000:3.0:1767320344.537530:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320344.537599:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320344.537605:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379989376:0@lo:400:kworker.0
00000100:00100000:3.0:1767320344.537626:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320344.537669:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379989120
00000100:00100000:3.0:1767320344.537678:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379989120
00000100:00100000:3.0:1767320344.537738:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379989376
00000100:00100000:3.0:1767320344.537741:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379989376
00000100:00100000:3.0:1767320344.537764:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4787
00000100:00100000:3.0:1767320344.537774:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379989120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320344.537913:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379988992:0@lo:400:kworker.0
00000100:00100000:1.0:1767320344.537955:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320344.537984:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320344.537991:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379988864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320344.538013:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320344.538041:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4788
00000100:00100000:1.0:1767320344.538049:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379989376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320344.538105:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379989376:12345-0@lo:400:kworker.0 Request processed in 57us (477us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320344.538113:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4788
00000100:00100000:1.0:1767320344.538159:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379989376:0@lo:400:kworker.0
00000100:00100000:3.0:1767320344.538285:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379989120:12345-0@lo:400:kworker.0 Request processed in 512us (754us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320344.538293:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4787
00000100:00080000:2.0:1767320344.538375:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320344.538394:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379988992
00000100:00100000:2.0:1767320344.538399:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379988992
00000100:00100000:2.0:1767320344.538446:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379988864
00000100:00100000:2.0:1767320344.538449:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379988864
00000100:00100000:0.0:1767320344.538457:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379988480:0@lo:250:kworker.0
00000100:00100000:2.0:1767320344.538476:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839
00000100:00100000:2.0:1767320344.538486:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379988992:12345-0@lo:400:kworker.0
00000400:00000100:0.0:1767320344.538494:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379988480 offset 0 length 520: 4
00000100:00100000:0.0:1767320344.538524:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379988608:0@lo:38:kworker.0
00000100:00100000:2.0:1767320344.538539:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379988992:12345-0@lo:400:kworker.0 Request processed in 55us (583us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320344.538547:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839
00000100:00100000:0.0:1767320344.538559:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320344.538565:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840
00000100:00100000:2.0:1767320344.538575:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379988864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320344.538586:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379988736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320344.538613:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379988864:12345-0@lo:400:kworker.0 Request processed in 40us (598us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320344.538620:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840
00000100:00100000:0.0:1767320344.538626:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320344.538649:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379989248:0@lo:38:kworker.0
00000100:00100000:2.0:1767320344.538665:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379988864:0@lo:400:kworker.0
00000100:00100000:0.0:1767320344.538677:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320344.538680:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379988992:0@lo:400:kworker.0
00000100:00100000:0.0:1767320344.538712:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379989504:0@lo:38:kworker.0
00000100:00100000:2.0:1767320344.538721:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379988736
00000100:00100000:2.0:1767320344.538726:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379988736
00000100:00100000:0.0:1767320344.538740:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320344.538750:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161
00000100:00100000:2.0:1767320344.538757:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379988736:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320344.538780:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320344.538782:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379988608
00000100:00100000:0.0:1767320344.538788:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379988608
00000100:00100000:0.0:1767320344.538810:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379989248
00000100:00100000:0.0:1767320344.538813:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379989248
00000100:00100000:0.0:1767320344.538827:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379989504
00000100:00100000:0.0:1767320344.538830:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379989504
00000100:00100000:0.0:1767320344.538846:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17686
00000100:00100000:0.0:1767320344.538851:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379988608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320344.538862:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320344.538917:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379989120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320344.538940:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17687
00000100:00100000:0.0:1767320344.538948:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379988608:12345-0@lo:38:kworker.0 Request processed in 93us (389us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320344.538948:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379989248:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320344.538964:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17686
00010000:00020000:1.0:1767320344.538966:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320344.538996:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17688
00000100:00100000:1.0:1767320344.539001:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379989248:12345-0@lo:38:kworker.0 Request processed in 52us (324us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320344.539006:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379989504:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320344.539014:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17687
00010000:00020000:0.0:1767320344.539023:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320344.539057:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379989504:12345-0@lo:38:kworker.0 Request processed in 51us (317us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320344.539065:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17688
00000100:00080000:1.0:1767320344.539085:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320344.539091:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320344.539095:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379988608:0@lo:38:kworker.0
00000100:00080000:1.0:1767320344.539104:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320344.539108:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320344.539111:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379989248:0@lo:38:kworker.0
00000100:00080000:1.0:1767320344.539118:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320344.539127:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320344.539130:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379989504:0@lo:38:kworker.0
00000100:00100000:2.0:1767320344.539329:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379988736:12345-0@lo:38:kworker.0 Request processed in 570us (705us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320344.539335:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161
00000100:00080000:1.0:1767320344.539405:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320344.539409:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320344.539413:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379988736:0@lo:38:kworker.0
00000100:00080000:3.0:1767320344.539467:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320344.539476:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320345.113109:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320345.489794:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320345.489958:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320345.490743:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291968768
00000100:00100000:2.0:1767320345.490753:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291968768
00000100:00100000:2.0:1767320345.490855:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291968640
00000100:00100000:2.0:1767320345.490858:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291968640
00000100:00100000:0.0:1767320345.491234:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4789
00000100:00100000:0.0:1767320345.491246:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291968768:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320345.491323:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291968768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (1538us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320345.491359:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4789
00000100:00100000:0.0:1767320345.491378:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17689
00000100:00100000:0.0:1767320345.491382:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291968640:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320345.491401:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320345.491422:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291968640:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 39us (1465us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320345.491428:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17689
00000100:00080000:3.0:1767320345.492749:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320345.561813:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379989632:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320345.561916:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320345.562272:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379989632
00000100:00100000:0.0:1767320345.562280:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379989632
00000100:00100000:0.0:1767320345.562347:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640
00000100:00100000:0.0:1767320345.562357:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379989632:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320345.562388:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320345.562440:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379989632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (523us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320345.562447:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640
00000100:00100000:3.0:1767320345.562885:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379989632:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320346.135083:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320347.095549:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379989760:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320347.095627:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320347.095741:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379989760
00000100:00100000:3.0:1767320347.095749:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379989760
00000100:00080000:0.0:1767320347.095797:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320347.095819:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641
00000100:00100000:0.0:1767320347.095831:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379989760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320347.095861:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320347.103418:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379989760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7579us (7779us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320347.103434:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641
00000100:00100000:2.0:1767320347.103457:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379989760:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320347.161411:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320348.183259:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320349.207360:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320349.655164:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320349.655175:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320349.655187:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320349.655191:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320349.655195:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320349.655209:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5246
00000100:00080000:2.0:1767320349.655214:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320349.655221:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320349.655259:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd500 x1853164379989888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320349.655282:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320349.655285:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320349.655286:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320349.655290:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5246
00000100:00080000:2.0:1767320349.655301:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320349.655305:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320349.655327:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08effb80 x1853164379990016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320349.655409:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320349.655412:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320349.655414:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320349.655418:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5246
00000100:00080000:2.0:1767320349.655420:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320349.655424:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320349.655436:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164379990528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320349.655450:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320349.655454:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320349.655455:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320349.655472:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5246
00000100:00100000:3.0:1767320349.655655:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379990144:0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.655741:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320349.655814:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320349.655821:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379990272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.655850:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320349.655934:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379990656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.655963:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320349.655982:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320349.655987:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379990400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656006:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320349.656046:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990656
00000100:00100000:3.0:1767320349.656054:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990656
00000100:00100000:3.0:1767320349.656099:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990400
00000100:00100000:3.0:1767320349.656102:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990400
00000100:00100000:3.0:1767320349.656123:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4790
00000100:00100000:3.0:1767320349.656132:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379990656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656184:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379990656:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320349.656191:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4790
00000100:00100000:3.0:1767320349.656209:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4791
00000100:00100000:3.0:1767320349.656215:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379990400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656241:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379990400:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320349.656247:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4791
00000100:00100000:3.0:1767320349.656265:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990144
00000100:00100000:3.0:1767320349.656268:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990144
00000100:00100000:3.0:1767320349.656306:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990272
00000100:00100000:3.0:1767320349.656310:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990272
00000100:00100000:3.0:1767320349.656331:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841
00000100:00100000:3.0:1767320349.656337:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379990144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656371:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379990144:12345-0@lo:400:kworker.0 Request processed in 34us (630us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320349.656377:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841
00000100:00100000:3.0:1767320349.656388:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842
00000100:00100000:3.0:1767320349.656393:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379990272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656422:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379990272:12345-0@lo:400:kworker.0 Request processed in 29us (570us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320349.656428:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842
00000100:00100000:3.0:1767320349.656467:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379990400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656489:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379990656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656518:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379990272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320349.656527:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379990144:0@lo:400:kworker.0
00000100:00100000:1.0:1767320349.656629:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379989888:0@lo:38:kworker.0
00000100:00100000:1.0:1767320349.656663:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320349.656680:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379990016:0@lo:38:kworker.0
00000100:00100000:1.0:1767320349.656702:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320349.656715:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379989888
00000100:00100000:0.0:1767320349.656721:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379989888
00000100:00100000:1.0:1767320349.656734:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379990528:0@lo:38:kworker.0
00000100:00100000:0.0:1767320349.656753:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17690
00000100:00100000:1.0:1767320349.656758:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320349.656762:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379989888:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320349.656782:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320349.656796:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990528
00000100:00100000:1.0:1767320349.656802:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990528
00000100:00100000:1.0:1767320349.656826:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17691
00000100:00100000:0.0:1767320349.656833:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379989888:12345-0@lo:38:kworker.0 Request processed in 71us (167us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320349.656834:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379990528:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320349.656847:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17690
00010000:00020000:1.0:1767320349.656853:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320349.656900:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320349.656905:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320349.656908:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320349.656929:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320349.656934:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320349.656937:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379989888:0@lo:38:kworker.0
00000100:00080000:0.0:1767320349.656946:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320349.656950:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320349.656952:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379990528:0@lo:38:kworker.0
00000100:00100000:0.0:1767320349.656983:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990016
00000100:00100000:0.0:1767320349.656987:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990016
00000100:00100000:0.0:1767320349.657005:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162
00000100:00100000:0.0:1767320349.657009:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379990016:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320349.657019:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320349.657037:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379990528:12345-0@lo:38:kworker.0 Request processed in 70us (145us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320349.657046:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17691
00000100:00100000:0.0:1767320349.657050:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379990016:12345-0@lo:38:kworker.0 Request processed in 38us (346us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320349.657057:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162
00000100:00080000:1.0:1767320349.657099:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320349.657104:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320349.657107:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379990016:0@lo:38:kworker.0
00000100:00080000:2.0:1767320349.657312:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320349.657318:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320349.657343:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379990784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320349.657618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379990784:0@lo:38:kworker.0
00000100:00100000:1.0:1767320349.657647:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320349.657857:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990784
00000100:00100000:2.0:1767320349.657864:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990784
00000100:00100000:2.0:1767320349.657914:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17692
00000100:00100000:2.0:1767320349.657920:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379990784:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320349.657933:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320349.657980:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379990784:12345-0@lo:38:kworker.0 Request processed in 59us (332us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320349.657986:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17692
00000100:00080000:0.0:1767320349.658156:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320349.658162:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320349.658167:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379990784:0@lo:38:kworker.0
00010000:00010000:2.0:1767320350.231426:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320350.607593:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320350.607705:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320350.607788:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291969024
00000100:00100000:1.0:1767320350.607797:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291968896
00000100:00100000:2.0:1767320350.607798:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291969024
00000100:00100000:1.0:1767320350.607805:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291968896
00000100:00080000:0.0:1767320350.607907:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320350.607965:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4792
00000100:00100000:1.0:1767320350.607979:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291969024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320350.608054:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291969024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (472us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320350.611119:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17693
00000100:00100000:2.0:1767320350.611134:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291968896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320350.611159:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320350.611784:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4792
00000100:00100000:2.0:1767320350.611906:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291968896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 771us (4198us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320350.611915:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17693
00000100:00100000:1.0:1767320350.679738:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320350.679759:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379990912:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320350.679836:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320350.680079:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379990912
00000100:00100000:0.0:1767320350.680088:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379990912
00000100:00100000:0.0:1767320350.680137:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642
00000100:00100000:0.0:1767320350.680146:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379990912:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320350.680173:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320350.680234:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379990912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (396us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320350.680244:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642
00000100:00100000:1.0:1767320350.680332:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379990912:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320351.255154:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320352.216276:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379991040:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320352.216349:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320352.216592:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991040
00000100:00100000:2.0:1767320352.216601:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991040
00000100:00100000:2.0:1767320352.216670:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643
00000100:00100000:2.0:1767320352.216679:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379991040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320352.216709:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320352.216801:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379991040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (451us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320352.216808:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643
00000100:00080000:0.0:1767320352.217251:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320352.222295:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379991040:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320352.279584:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320353.303089:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320354.328740:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320354.775694:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320354.775705:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320354.775708:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320354.775712:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320354.775716:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320354.775724:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5252
00000100:00080000:2.0:1767320354.775729:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320354.775735:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320354.775778:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379991168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320354.775807:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320354.775811:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320354.775812:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320354.775816:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5252
00000100:00080000:2.0:1767320354.775819:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320354.775822:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320354.775835:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08effb80 x1853164379991296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320354.775920:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320354.775923:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320354.775925:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320354.775928:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5252
00000100:00080000:2.0:1767320354.775930:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320354.775934:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320354.775944:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efe300 x1853164379991808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320354.775958:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320354.775961:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320354.775963:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320354.775965:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5252
00000100:00080000:2.0:1767320354.775967:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320354.775971:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320354.775981:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc700 x1853164379992064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320354.776059:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379991552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320354.776072:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379991424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320354.776153:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379991168:0@lo:38:kworker.0
00000100:00100000:0.0:1767320354.778646:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.778720:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379991296:0@lo:38:kworker.0
00000100:00100000:0.0:1767320354.778755:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.778786:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379991808:0@lo:38:kworker.0
00000100:00100000:0.0:1767320354.778809:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.778830:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379992064:0@lo:38:kworker.0
00000100:00100000:0.0:1767320354.778882:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.778939:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991296
00000100:00100000:0.0:1767320354.778947:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991296
00000100:00100000:0.0:1767320354.778978:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163
00000100:00100000:0.0:1767320354.778986:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379991296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320354.779008:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320354.779051:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379991296:12345-0@lo:38:kworker.0 Request processed in 64us (294us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320354.779058:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163
00000100:00080000:0.0:1767320354.779101:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320354.779106:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320354.779110:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379991296:0@lo:38:kworker.0
00000100:00100000:0.0:1767320354.779148:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991168
00000100:00100000:0.0:1767320354.779152:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991168
00000100:00100000:0.0:1767320354.779171:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991808
00000100:00100000:0.0:1767320354.779173:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991808
00000100:00100000:0.0:1767320354.779184:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992064
00000100:00100000:0.0:1767320354.779186:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992064
00000100:00100000:0.0:1767320354.779200:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17694
00000100:00100000:0.0:1767320354.779205:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379991168:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320354.779215:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320354.779255:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379991168:12345-0@lo:38:kworker.0 Request processed in 39us (607us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320354.779262:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17694
00000100:00100000:0.0:1767320354.779274:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17695
00000100:00100000:0.0:1767320354.779278:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379991808:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320354.779288:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320354.779477:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379991808:12345-0@lo:38:kworker.0 Request processed in 196us (666us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320354.779485:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17695
00000100:00100000:0.0:1767320354.779498:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17696
00000100:00100000:0.0:1767320354.779502:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379992064:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320354.779511:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320354.779536:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379992064:12345-0@lo:38:kworker.0 Request processed in 33us (668us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320354.779541:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17696
00000100:00080000:0.0:1767320354.779579:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320354.779583:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320354.779586:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379991168:0@lo:38:kworker.0
00000100:00080000:0.0:1767320354.779594:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320354.779597:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320354.779599:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379991808:0@lo:38:kworker.0
00000100:00080000:0.0:1767320354.779606:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320354.779608:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320354.779611:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379992064:0@lo:38:kworker.0
00000100:00100000:0.0:1767320354.779649:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379991936:0@lo:400:kworker.0
00000100:00100000:0.0:1767320354.779677:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.779700:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320354.779707:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379991680:0@lo:400:kworker.0
00000100:00100000:0.0:1767320354.779728:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.779757:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991936
00000100:00100000:0.0:1767320354.779761:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991936
00000100:00100000:0.0:1767320354.779794:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991680
00000100:00100000:0.0:1767320354.779797:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991680
00000100:00100000:0.0:1767320354.779814:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4793
00000100:00100000:0.0:1767320354.779819:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379991936:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320354.780553:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379991936:12345-0@lo:400:kworker.0 Request processed in 731us (873us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320354.780562:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4793
00000100:00100000:0.0:1767320354.780582:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4794
00000100:00100000:0.0:1767320354.780592:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379991680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320354.780623:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164379991680:12345-0@lo:400:kworker.0 Request processed in 36us (895us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320354.780629:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4794
00000100:00080000:0.0:1767320354.780653:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320354.780680:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164379991680:0@lo:400:kworker.0
00000100:00100000:0.0:1767320354.780691:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379991936:0@lo:400:kworker.0
00000100:00100000:3.0:1767320354.785902:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.786431:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991424
00000100:00100000:0.0:1767320354.786440:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991424
00000100:00100000:1.0:1767320354.786456:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320354.786502:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379991552
00000100:00100000:0.0:1767320354.786505:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379991552
00000100:00100000:0.0:1767320354.786527:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843
00000100:00100000:0.0:1767320354.786536:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379991424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320354.786779:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844
00000100:00100000:3.0:1767320354.786789:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379991552:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320354.790086:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320354.790095:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320354.791173:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379991552:12345-0@lo:400:kworker.0 Request processed in 4380us (4711us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320354.791186:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844
00000100:00100000:1.0:1767320354.793044:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379991552:0@lo:400:kworker.0
00000100:00100000:0.0:1767320354.797054:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379991424:12345-0@lo:400:kworker.0 Request processed in 10510us (11149us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320354.797071:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843
00000100:00100000:3.0:1767320354.797496:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379991424:0@lo:400:kworker.0
00010000:00010000:2.0:1767320355.351112:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320355.729739:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320355.729837:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320355.730075:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291969280
00000100:00100000:0.0:1767320355.730085:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291969280
00000100:00100000:0.0:1767320355.730180:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291969152
00000100:00100000:0.0:1767320355.730185:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291969152
00000100:00100000:0.0:1767320355.730208:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4795
00000100:00100000:0.0:1767320355.730218:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291969280:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320355.730302:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291969280:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (573us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320355.730310:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4795
00000100:00100000:0.0:1767320355.730330:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17697
00000100:00100000:0.0:1767320355.730335:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291969152:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320355.730353:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320355.730376:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291969152:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (540us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320355.730385:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17697
00000100:00080000:3.0:1767320355.730501:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320355.802976:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379992192:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320355.803050:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320355.803595:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992192
00000100:00100000:0.0:1767320355.803604:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992192
00000100:00100000:0.0:1767320355.803659:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644
00000100:00100000:0.0:1767320355.803668:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379992192:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320355.803698:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320355.803755:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379992192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (706us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320355.803762:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644
00000100:00100000:3.0:1767320355.803890:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379992192:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320356.375536:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320357.335342:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320357.335366:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379992320:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320357.335438:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320357.335577:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992320
00000100:00100000:0.0:1767320357.335586:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992320
00000100:00100000:0.0:1767320357.335648:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645
00000100:00100000:0.0:1767320357.335657:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379992320:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320357.335691:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320357.335738:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379992320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (300us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320357.335745:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645
00000100:00080000:3.0:1767320357.336033:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320357.336071:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379992320:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320357.399629:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320358.423846:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320359.447252:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320359.895192:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320359.895211:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320359.895214:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320359.895218:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320359.895222:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320359.895230:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5257
00000100:00080000:0.0:1767320359.895236:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320359.895242:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320359.895284:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b480 x1853164379992448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320359.895300:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320359.895304:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320359.895305:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320359.895309:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5257
00000100:00080000:0.0:1767320359.895311:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320359.895314:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320359.895337:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85bb80 x1853164379992576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320359.895390:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320359.895394:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320359.895396:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320359.895400:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5257
00000100:00080000:0.0:1767320359.895402:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320359.895405:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320359.895415:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859500 x1853164379993088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320359.895430:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320359.895433:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320359.895434:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320359.895437:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5257
00000100:00080000:0.0:1767320359.895439:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320359.895442:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320359.895452:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859c00 x1853164379993344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320359.895490:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379993216:0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.895559:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320359.895622:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320359.895629:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379992960:0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.895651:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320359.895688:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993216
00000100:00100000:0.0:1767320359.895695:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993216
00000100:00100000:0.0:1767320359.895743:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992960
00000100:00100000:0.0:1767320359.895746:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992960
00000100:00100000:0.0:1767320359.895768:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4796
00000100:00100000:0.0:1767320359.895776:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379993216:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.895838:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379993216:12345-0@lo:400:kworker.0 Request processed in 62us (278us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320359.895845:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4796
00000100:00100000:0.0:1767320359.895863:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4797
00000100:00100000:0.0:1767320359.895893:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379992960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.895920:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164379992960:12345-0@lo:400:kworker.0 Request processed in 51us (268us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320359.895926:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4797
00000100:00100000:0.0:1767320359.895950:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379992832:0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.895977:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320359.896002:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320359.896009:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379992704:0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.896029:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320359.896069:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164379992960:0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.896079:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379993216:0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.896111:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992832
00000100:00100000:0.0:1767320359.896115:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992832
00000100:00100000:0.0:1767320359.896137:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992704
00000100:00100000:0.0:1767320359.896140:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992704
00000100:00100000:0.0:1767320359.896156:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845
00000100:00100000:0.0:1767320359.896162:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379992832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.896195:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379992832:12345-0@lo:400:kworker.0 Request processed in 33us (217us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320359.896213:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845
00000100:00100000:0.0:1767320359.896235:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379992832:0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.896250:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846
00000100:00100000:0.0:1767320359.896255:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379992704:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320359.896284:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379992704:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320359.896289:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846
00000100:00100000:0.0:1767320359.896307:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379992704:0@lo:400:kworker.0
00000100:00080000:3.0:1767320359.896389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320359.896394:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320359.896397:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320359.896701:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379992448:0@lo:38:kworker.0
00000100:00100000:1.0:1767320359.896735:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320359.896759:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379992576:0@lo:38:kworker.0
00000100:00100000:1.0:1767320359.896783:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320359.896859:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379993088:0@lo:38:kworker.0
00000100:00100000:1.0:1767320359.896906:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320359.896931:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379993344:0@lo:38:kworker.0
00000100:00100000:1.0:1767320359.896948:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320359.896977:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992448
00000100:00100000:1.0:1767320359.896982:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992448
00000100:00100000:1.0:1767320359.897004:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17698
00000100:00100000:1.0:1767320359.897009:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379992448:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320359.897028:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320359.897061:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379992448:12345-0@lo:38:kworker.0 Request processed in 51us (325us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320359.897066:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17698
00000100:00100000:1.0:1767320359.897081:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993088
00000100:00100000:1.0:1767320359.897084:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993088
00000100:00100000:1.0:1767320359.897095:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993344
00000100:00100000:1.0:1767320359.897097:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993344
00000100:00100000:1.0:1767320359.897110:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17699
00000100:00100000:1.0:1767320359.897115:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379993088:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320359.897123:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320359.897145:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379993088:12345-0@lo:38:kworker.0 Request processed in 29us (238us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320359.897150:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17699
00000100:00100000:1.0:1767320359.897161:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17700
00000100:00100000:1.0:1767320359.897165:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379993344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320359.897172:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320359.897191:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379993344:12345-0@lo:38:kworker.0 Request processed in 24us (241us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320359.897196:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17700
00000100:00080000:1.0:1767320359.897236:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320359.897241:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320359.897245:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379992448:0@lo:38:kworker.0
00000100:00080000:1.0:1767320359.897253:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320359.897256:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320359.897259:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379993088:0@lo:38:kworker.0
00000100:00080000:1.0:1767320359.897265:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320359.897268:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320359.897271:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379993344:0@lo:38:kworker.0
00000100:00100000:2.0:1767320359.897940:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379992576
00000100:00100000:2.0:1767320359.897947:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379992576
00000100:00100000:2.0:1767320359.898017:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164
00000100:00100000:2.0:1767320359.898023:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379992576:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320359.898034:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320359.898088:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379992576:12345-0@lo:38:kworker.0 Request processed in 63us (1303us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320359.898094:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164
00000100:00080000:1.0:1767320359.898153:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320359.898157:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320359.898160:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379992576:0@lo:38:kworker.0
00010000:00010000:2.0:1767320360.471227:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320360.854589:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320360.854750:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320360.857026:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291969536
00000100:00100000:2.0:1767320360.857049:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291969536
00000100:00080000:3.0:1767320360.857177:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320360.857182:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291969408
00000100:00100000:2.0:1767320360.857186:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291969408
00000100:00100000:2.0:1767320360.857486:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4798
00000100:00100000:2.0:1767320360.857499:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291969536:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320360.857667:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291969536:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 171us (3091us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320360.857677:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4798
00000100:00100000:2.0:1767320360.857703:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17701
00000100:00100000:2.0:1767320360.857710:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291969408:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320360.857749:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320360.857792:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291969408:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 80us (3041us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320360.857799:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17701
00000100:00100000:3.0:1767320360.919178:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379993472:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320360.919290:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320360.919410:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993472
00000100:00100000:0.0:1767320360.919421:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993472
00000100:00100000:0.0:1767320360.919481:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646
00000100:00100000:0.0:1767320360.919492:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379993472:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320360.919531:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320360.919596:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379993472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (306us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320360.919604:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646
00000100:00100000:3.0:1767320360.919654:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379993472:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320361.499823:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320362.456092:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320362.456121:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379993600:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320362.456257:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320362.457414:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993600
00000100:00100000:2.0:1767320362.457430:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993600
00000100:00100000:2.0:1767320362.457760:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647
00000100:00100000:2.0:1767320362.457774:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379993600:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320362.457819:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320362.458130:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379993600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 358us (1880us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320362.458140:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647
00000100:00100000:1.0:1767320362.458274:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379993600:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320362.458669:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320362.521645:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320363.543294:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320364.567347:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320365.015092:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320365.015106:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320365.015121:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320365.015126:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320365.015132:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320365.015142:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5262
00000100:00080000:3.0:1767320365.015147:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320365.015164:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320365.015222:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7aa00 x1853164379993728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320365.015251:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320365.015254:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320365.015257:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320365.015261:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5262
00000100:00080000:3.0:1767320365.015263:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320365.015267:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320365.015283:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7b480 x1853164379993856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320365.015375:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320365.015379:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320365.015381:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320365.015386:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5262
00000100:00080000:3.0:1767320365.015388:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320365.015391:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320365.015403:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449500 x1853164379994368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320365.015418:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320365.015421:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320365.015423:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320365.015426:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5262
00000100:00080000:3.0:1767320365.015428:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320365.015433:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320365.015442:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449880 x1853164379994624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320365.015483:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379994240:0@lo:400:kworker.0
00000100:00100000:3.0:1767320365.015563:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320365.015804:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379993984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320365.015841:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320365.015906:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379994240
00000100:00100000:0.0:1767320365.015915:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379994240
00000100:00100000:0.0:1767320365.015986:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4799
00000100:00100000:0.0:1767320365.015997:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379994240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320365.016052:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379994240:12345-0@lo:400:kworker.0 Request processed in 57us (488us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320365.016059:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4799
00000100:00100000:0.0:1767320365.016107:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379994496:0@lo:400:kworker.0
00000100:00100000:0.0:1767320365.016134:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320365.016163:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379994496
00000100:00100000:0.0:1767320365.016166:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379994496
00000100:00100000:0.0:1767320365.016190:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4800
00000100:00100000:0.0:1767320365.016196:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379994496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320365.016227:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164379994496:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320365.016233:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4800
00000100:00080000:0.0:1767320365.016261:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320365.016350:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379994112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320365.016388:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320365.016432:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993984
00000100:00100000:2.0:1767320365.016436:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993984
00000100:00100000:2.0:1767320365.016473:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379994112
00000100:00100000:2.0:1767320365.016477:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379994112
00000100:00100000:2.0:1767320365.016501:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847
00000100:00100000:2.0:1767320365.016507:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379993984:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320365.016548:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379993984:12345-0@lo:400:kworker.0 Request processed in 40us (705us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320365.016554:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847
00000100:00100000:2.0:1767320365.016567:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848
00000100:00100000:2.0:1767320365.016574:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379994112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320365.016601:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379994112:12345-0@lo:400:kworker.0 Request processed in 29us (213us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320365.016607:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848
00000100:00080000:2.0:1767320365.016648:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320365.016652:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320365.016830:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379994240:0@lo:400:kworker.0
00000100:00100000:2.0:1767320365.016991:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379993984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320365.017065:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164379994496:0@lo:400:kworker.0
00000100:00100000:1.0:1767320365.017191:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379993728:0@lo:38:kworker.0
00000100:00100000:1.0:1767320365.017232:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320365.017264:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379993856:0@lo:38:kworker.0
00000100:00100000:1.0:1767320365.017297:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320365.017320:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379994368:0@lo:38:kworker.0
00000100:00100000:1.0:1767320365.017348:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320365.017369:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379994624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320365.017404:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320365.017441:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993728
00000100:00100000:1.0:1767320365.017446:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993728
00000100:00100000:1.0:1767320365.017465:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379994368
00000100:00100000:1.0:1767320365.017467:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379994368
00000100:00100000:1.0:1767320365.017478:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379994624
00000100:00100000:1.0:1767320365.017480:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379994624
00000100:00100000:1.0:1767320365.017489:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17702
00000100:00100000:1.0:1767320365.017493:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379993728:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320365.017512:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320365.017543:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379993728:12345-0@lo:38:kworker.0 Request processed in 49us (312us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320365.017549:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17702
00000100:00100000:1.0:1767320365.017563:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17703
00000100:00100000:1.0:1767320365.017566:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379994368:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320365.017573:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320365.017589:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379994368:12345-0@lo:38:kworker.0 Request processed in 21us (241us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320365.017594:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17703
00000100:00100000:1.0:1767320365.017602:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17704
00000100:00100000:1.0:1767320365.017605:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379994624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320365.017612:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320365.017722:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379993856
00000100:00100000:0.0:1767320365.017727:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379993856
00000100:00100000:0.0:1767320365.017749:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165
00000100:00100000:0.0:1767320365.017754:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379993856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320365.017764:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320365.017794:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379993856:12345-0@lo:38:kworker.0 Request processed in 39us (495us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320365.017799:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165
00000100:00080000:0.0:1767320365.017899:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320365.017905:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320365.017909:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379993728:0@lo:38:kworker.0
00000100:00080000:0.0:1767320365.017926:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320365.017933:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320365.017936:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379993856:0@lo:38:kworker.0
00000100:00080000:0.0:1767320365.017951:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320365.017954:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320365.017957:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379994368:0@lo:38:kworker.0
00000100:00100000:1.0:1767320365.018020:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379994624:12345-0@lo:38:kworker.0 Request processed in 412us (614us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320365.018027:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17704
00000100:00100000:2.0:1767320365.018124:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379994112:0@lo:400:kworker.0
00000100:00080000:0.0:1767320365.022472:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320365.022491:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320365.022497:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379994624:0@lo:38:kworker.0
00010000:00010000:1.0:1767320365.593371:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320365.967234:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320365.967433:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291969920
00000100:00100000:0.0:1767320365.967447:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291969920
00000100:00100000:0.0:1767320365.967548:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4801
00000100:00100000:0.0:1767320365.967560:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291969920:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320365.967675:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291969920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 116us (456us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320365.967685:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4801
00000100:00080000:2.0:1767320365.968069:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767320365.972431:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291969664 offset 0 length 520: 4
00000100:00100000:3.0:1767320365.984593:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320365.987027:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291969792
00000100:00100000:0.0:1767320365.987107:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291969792
00000100:00100000:0.0:1767320365.987196:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17705
00000100:00100000:0.0:1767320365.987207:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291969792:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320365.987239:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320365.987346:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291969792:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 138us (2767us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320365.987356:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17705
00000100:00100000:3.0:1767320366.039462:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320366.040072:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379994752:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320366.040179:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320366.040255:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379994752
00000100:00100000:2.0:1767320366.040267:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379994752
00000100:00100000:2.0:1767320366.040338:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648
00000100:00100000:2.0:1767320366.040350:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379994752:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320366.040390:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320366.040444:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379994752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (265us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320366.040452:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648
00000100:00100000:3.0:1767320366.040511:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379994752:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320366.615457:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320367.575636:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320367.575669:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379994880:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320367.575767:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320367.576126:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379994880
00000100:00100000:1.0:1767320367.576148:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379994880
00000100:00100000:1.0:1767320367.576238:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649
00000100:00100000:1.0:1767320367.576249:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379994880:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320367.576289:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320367.576363:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379994880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (595us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320367.576371:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649
00000100:00100000:3.0:1767320367.576489:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379994880:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320367.576625:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320367.645729:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320368.664617:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320369.112548:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320344/real 1767320344]  req@ffff8b0e0bafc380 x1853164379988480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320369 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320369.112586:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bafc380 x1853164379988480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320369 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320369.112608:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320369.112628:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320369.112632:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379988480:0@lo:250:kworker.0
00000100:00080000:0.0:1767320369.112701:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320369.112708:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320369.112711:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320369.112716:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5246
00000100:00080000:0.0:1767320369.112721:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320369.112729:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320369.112764:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4a80 x1853164379995008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320369.112790:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320369.112794:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320369.112796:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320369.112800:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5267
00000100:00080000:0.0:1767320369.112802:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320369.112805:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320369.112823:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6a00 x1853164379995136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320369.112838:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320369.112841:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320369.112843:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320369.112846:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5267
00000100:00080000:0.0:1767320369.112849:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320369.112852:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320369.112863:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4000 x1853164379995264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320369.112943:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320369.112946:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320369.112948:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320369.112952:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5267
00000100:00080000:0.0:1767320369.112954:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320369.112959:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320369.112970:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7800 x1853164379995776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320369.112989:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379995392:0@lo:400:kworker.0
00000100:00080000:0.0:1767320369.112991:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320369.112999:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320369.113001:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320369.113005:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5267
00000100:00080000:0.0:1767320369.113007:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320369.113011:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320369.113021:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7480 x1853164379996032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320369.113046:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379995520:0@lo:400:kworker.0
00000100:00100000:1.0:1767320369.113102:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379995008:0@lo:250:kworker.0
00000100:00100000:3.0:1767320369.113386:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379995648:0@lo:400:kworker.0
00000100:00100000:0.0:1767320369.113914:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320369.113990:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379995904:0@lo:400:kworker.0
00000100:00100000:0.0:1767320369.114019:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320369.114054:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379995520
00000100:00100000:0.0:1767320369.114062:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379995520
00000100:00100000:0.0:1767320369.114135:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849
00000100:00100000:0.0:1767320369.114144:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379995520:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320369.114210:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379995520:12345-0@lo:400:kworker.0 Request processed in 66us (296us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320369.114219:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320369.114225:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849
00000100:00100000:0.0:1767320369.114250:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379995392
00000100:00100000:0.0:1767320369.114254:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379995392
00000100:00080000:2.0:1767320369.114280:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320369.114287:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320369.114291:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850
00000100:00100000:0.0:1767320369.114298:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379995392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320369.114335:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379995392:12345-0@lo:400:kworker.0 Request processed in 38us (123us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320369.114342:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850
00000100:00100000:0.0:1767320369.114362:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379995904
00000100:00100000:0.0:1767320369.114365:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379995904
00000100:00100000:0.0:1767320369.114401:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4802
00000100:00100000:0.0:1767320369.114408:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379995904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320369.114441:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164379995904:12345-0@lo:400:kworker.0 Request processed in 34us (421us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320369.114447:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4802
00000100:00100000:0.0:1767320369.114516:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164379995904:0@lo:400:kworker.0
00000100:00100000:0.0:1767320369.114544:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379995520:0@lo:400:kworker.0
00000100:00100000:0.0:1767320369.114562:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379995392:0@lo:400:kworker.0
00000100:00080000:2.0:1767320369.114668:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:1.0:1767320369.116251:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164379995008 offset 0 length 520: 4
00000100:00100000:1.0:1767320369.116314:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379995136:0@lo:38:kworker.0
00000100:00100000:1.0:1767320369.116367:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320369.116393:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379995264:0@lo:38:kworker.0
00000100:00100000:1.0:1767320369.116426:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320369.116448:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379995776:0@lo:38:kworker.0
00000100:00100000:1.0:1767320369.116474:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320369.116476:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379995136
00000100:00100000:2.0:1767320369.116487:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379995136
00000100:00100000:1.0:1767320369.116508:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379996032:0@lo:38:kworker.0
00000100:00100000:2.0:1767320369.116531:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379995776
00000100:00100000:2.0:1767320369.116536:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379995776
00000100:00100000:1.0:1767320369.116537:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320369.116566:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996032
00000100:00100000:2.0:1767320369.116569:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996032
00000100:00100000:1.0:1767320369.116585:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379995264
00000100:00100000:1.0:1767320369.116591:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379995264
00000100:00100000:2.0:1767320369.116595:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17706
00000100:00100000:2.0:1767320369.116605:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379995136:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320369.116625:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166
00000100:00100000:1.0:1767320369.116632:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379995264:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320369.116634:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767320369.116646:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320369.116712:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379995136:12345-0@lo:38:kworker.0 Request processed in 99us (336us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320369.116719:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17706
00000100:00100000:2.0:1767320369.116737:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17707
00000100:00100000:2.0:1767320369.116741:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379995776:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320369.116751:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320369.120541:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379995264:12345-0@lo:38:kworker.0 Request processed in 3891us (4096us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320369.120565:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166
00000100:00100000:1.0:1767320369.120654:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17708
00000100:00100000:1.0:1767320369.120663:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379996032:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320369.120693:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320369.120776:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164379996032:12345-0@lo:38:kworker.0 Request processed in 114us (4239us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320369.120782:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17708
00000100:00080000:1.0:1767320369.120887:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320369.120895:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320369.120900:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379995136:0@lo:38:kworker.0
00000100:00080000:1.0:1767320369.120916:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320369.120920:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320369.120924:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379995264:0@lo:38:kworker.0
00000100:00100000:3.0:1767320369.121484:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320369.121559:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379995648
00000100:00100000:3.0:1767320369.121569:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379995648
00000100:00100000:3.0:1767320369.121635:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4803
00000100:00100000:3.0:1767320369.121644:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379995648:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320369.121719:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379995648:12345-0@lo:400:kworker.0 Request processed in 75us (236us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320369.121726:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4803
00000100:00080000:3.0:1767320369.121747:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320369.122179:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379995648:0@lo:400:kworker.0
00000100:00100000:2.0:1767320369.123651:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164379995776:12345-0@lo:38:kworker.0 Request processed in 6898us (7167us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320369.123666:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17707
00000100:00080000:1.0:1767320369.125329:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320369.125348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320369.125354:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379995776:0@lo:38:kworker.0
00000100:00080000:1.0:1767320369.125373:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320369.125377:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320369.125380:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379996032:0@lo:38:kworker.0
00010000:00010000:1.0:1767320369.689587:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320370.713298:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320371.090611:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320371.090778:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320371.094191:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970176
00000100:00100000:2.0:1767320371.094214:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970176
00000100:00100000:2.0:1767320371.094322:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970048
00000100:00100000:2.0:1767320371.094326:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970048
00000100:00100000:2.0:1767320371.094359:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4804
00000100:00100000:2.0:1767320371.094370:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291970176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320371.094477:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291970176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 108us (3881us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320371.094485:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4804
00000100:00100000:2.0:1767320371.094509:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17709
00000100:00100000:2.0:1767320371.094513:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291970048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320371.094540:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320371.094570:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291970048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 55us (3793us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320371.094577:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17709
00000100:00080000:0.0:1767320371.097326:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320371.162719:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379996160:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320371.162826:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320371.163120:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996160
00000100:00100000:0.0:1767320371.163133:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996160
00000100:00100000:0.0:1767320371.163224:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650
00000100:00100000:0.0:1767320371.163235:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379996160:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320371.163279:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320371.163339:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379996160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (512us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320371.163346:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650
00000100:00100000:0.0:1767320371.163408:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379996160:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320371.163481:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320371.735281:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320372.695730:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320372.695767:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379996288:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320372.697338:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320372.698066:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996288
00000100:00100000:2.0:1767320372.698090:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996288
00000100:00100000:2.0:1767320372.698199:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651
00000100:00100000:2.0:1767320372.698212:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379996288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320372.698256:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320372.698355:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379996288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (2488us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320372.698363:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651
00000100:00100000:1.0:1767320372.698475:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379996288:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320372.698824:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320372.759353:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320373.783929:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320374.232207:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320374.232221:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320374.232224:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320374.232229:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320374.232234:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320374.232243:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5271
00000100:00080000:2.0:1767320374.232249:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320374.232257:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320374.232309:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd500 x1853164379996416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320374.232344:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320374.232348:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320374.232350:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320374.232361:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5271
00000100:00080000:2.0:1767320374.232364:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320374.232369:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320374.232381:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164379996544/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320374.232447:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379996416:0@lo:38:kworker.0
00000100:00080000:2.0:1767320374.232474:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320374.232479:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320374.232481:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320374.232486:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5271
00000100:00080000:2.0:1767320374.232489:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320374.232493:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320374.232508:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc000 x1853164379997056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320374.232529:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320374.232533:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320374.232535:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320374.232539:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5271
00000100:00080000:2.0:1767320374.232541:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767320374.232547:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320374.232550:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320374.232566:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7b480 x1853164379997312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320374.232600:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379996928:0@lo:400:kworker.0
00000100:00100000:1.0:1767320374.232642:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379996544:0@lo:38:kworker.0
00000100:00100000:2.0:1767320374.232643:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320374.232685:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320374.232687:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320374.232696:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379997184:0@lo:400:kworker.0
00000100:00100000:2.0:1767320374.232728:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320374.232729:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379997056:0@lo:38:kworker.0
00000100:00100000:1.0:1767320374.232763:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320374.232788:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379997312:0@lo:38:kworker.0
00000100:00100000:2.0:1767320374.232805:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996544
00000100:00100000:1.0:1767320374.232812:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320374.232816:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996544
00000100:00100000:1.0:1767320374.232846:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996416
00000100:00100000:1.0:1767320374.232851:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996416
00000100:00100000:1.0:1767320374.232901:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996928
00000100:00100000:1.0:1767320374.232905:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996928
00000100:00100000:1.0:1767320374.232948:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997184
00000100:00100000:1.0:1767320374.232952:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997184
00000100:00100000:2.0:1767320374.232958:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167
00000100:00100000:2.0:1767320374.232968:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379996544:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320374.232974:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997056
00000100:00100000:1.0:1767320374.232978:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997056
00000100:00100000:1.0:1767320374.232988:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997312
00000100:00100000:1.0:1767320374.232991:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997312
00010000:00020000:2.0:1767320374.232993:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320374.233004:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4805
00000100:00100000:1.0:1767320374.233013:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379996928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320374.233050:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379996544:12345-0@lo:38:kworker.0 Request processed in 81us (363us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320374.233059:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167
00000100:00100000:1.0:1767320374.233088:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379996928:12345-0@lo:400:kworker.0 Request processed in 75us (446us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320374.233098:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4805
00000100:00100000:2.0:1767320374.233107:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4806
00000100:00100000:2.0:1767320374.233119:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379997184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320374.233126:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17710
00000100:00100000:1.0:1767320374.233132:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379996416:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320374.233144:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320374.233159:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379997184:12345-0@lo:400:kworker.0 Request processed in 43us (432us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320374.233168:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4806
00000100:00100000:1.0:1767320374.233179:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379996416:12345-0@lo:38:kworker.0 Request processed in 44us (634us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320374.233187:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17710
00000100:00100000:3.0:1767320374.233251:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379996672:0@lo:400:kworker.0
00000100:00100000:3.0:1767320374.233286:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320374.233313:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320374.233318:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379996800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320374.233334:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320374.233427:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996672
00000100:00100000:0.0:1767320374.233433:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996672
00000100:00100000:0.0:1767320374.233468:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379996800
00000100:00100000:0.0:1767320374.233471:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379996800
00000100:00100000:0.0:1767320374.233497:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851
00000100:00100000:0.0:1767320374.233504:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379996672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320374.233547:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379996672:12345-0@lo:400:kworker.0 Request processed in 44us (260us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320374.233554:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851
00000100:00100000:0.0:1767320374.233572:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852
00000100:00100000:0.0:1767320374.233578:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379996800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320374.233608:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379996800:12345-0@lo:400:kworker.0 Request processed in 30us (272us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320374.233613:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852
00000100:00100000:2.0:1767320374.239806:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17711
00000100:00100000:3.0:1767320374.239821:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17712
00000100:00100000:2.0:1767320374.239826:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379997056:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320374.239843:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379997312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320374.239892:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320374.240019:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164379997312:12345-0@lo:38:kworker.0 Request processed in 177us (7205us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320374.240027:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17712
00000100:00080000:3.0:1767320374.240109:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320374.240115:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320374.240129:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320374.240188:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379996800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320374.240205:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379996672:0@lo:400:kworker.0
00000100:00100000:3.0:1767320374.240273:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379997184:0@lo:400:kworker.0
00000100:00100000:3.0:1767320374.240288:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379996928:0@lo:400:kworker.0
00000100:00080000:3.0:1767320374.240363:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320374.240370:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320374.240373:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379997312:0@lo:38:kworker.0
00000100:00080000:3.0:1767320374.240384:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320374.240387:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320374.240390:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379996416:0@lo:38:kworker.0
00000100:00080000:3.0:1767320374.240400:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320374.240403:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320374.240407:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379996544:0@lo:38:kworker.0
00010000:00020000:2.0:1767320374.243228:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320374.243367:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379997056:12345-0@lo:38:kworker.0 Request processed in 3535us (10592us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320374.243381:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17711
00000100:00080000:3.0:1767320374.243427:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320374.243435:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320374.243440:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379997056:0@lo:38:kworker.0
00010000:00010000:2.0:1767320374.808153:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320375.842023:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320376.208982:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320376.209113:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320376.213789:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970432
00000100:00100000:2.0:1767320376.213814:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970432
00000100:00100000:2.0:1767320376.213975:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970304
00000100:00100000:2.0:1767320376.213979:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970304
00000100:00100000:2.0:1767320376.214013:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4807
00000100:00100000:2.0:1767320376.214027:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291970432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320376.214167:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291970432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 142us (5200us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320376.214177:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4807
00000100:00100000:2.0:1767320376.214203:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17713
00000100:00100000:2.0:1767320376.214208:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291970304:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320376.214234:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320376.214266:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291970304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (5153us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320376.214273:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17713
00000100:00080000:3.0:1767320376.215156:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320376.281059:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320376.281088:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379997440:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320376.281182:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320376.281796:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997440
00000100:00100000:3.0:1767320376.281809:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997440
00000100:00100000:1.0:1767320376.282321:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652
00000100:00100000:1.0:1767320376.282337:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379997440:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320376.282394:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320376.282483:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379997440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (1300us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320376.282491:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652
00000100:00080000:1.0:1767320376.282523:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320376.282591:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379997440:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320376.856252:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320377.815206:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379997568:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320377.815307:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320377.815829:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997568
00000100:00100000:0.0:1767320377.815843:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997568
00000100:00100000:0.0:1767320377.816026:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653
00000100:00100000:0.0:1767320377.816056:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379997568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320377.816097:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320377.816166:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164379997568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (859us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320377.816175:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653
00000100:00100000:2.0:1767320377.816453:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164379997568:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320377.816594:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320377.881919:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320378.903304:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320379.351419:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320379.351430:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320379.351440:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320379.351444:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320379.351449:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320379.351457:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320379.351461:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320379.351468:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320379.351524:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44b100 x1853164379997696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320379.351552:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320379.351554:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320379.351556:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320379.351559:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320379.351561:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320379.351564:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320379.351577:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448a80 x1853164379997824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320379.351636:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320379.351638:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320379.351640:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320379.351643:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320379.351645:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320379.351647:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320379.351655:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c449500 x1853164379998336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320379.351666:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320379.351668:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320379.351669:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320379.351672:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5276
00000100:00080000:3.0:1767320379.351673:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320379.351676:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320379.351682:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448000 x1853164379998592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320379.351701:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379998208:0@lo:400:kworker.0
00000100:00100000:3.0:1767320379.351774:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320379.351833:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320379.351837:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379998464:0@lo:400:kworker.0
00000100:00100000:3.0:1767320379.351850:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320379.351898:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998208
00000100:00100000:3.0:1767320379.351905:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998208
00000100:00100000:3.0:1767320379.351952:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998464
00000100:00100000:3.0:1767320379.351954:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998464
00000100:00100000:3.0:1767320379.351971:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4808
00000100:00100000:3.0:1767320379.351977:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379998208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352229:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379997952:0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352271:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320379.352305:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320379.352311:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379998080:0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352333:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320379.352361:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997952
00000100:00100000:2.0:1767320379.352365:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997952
00000100:00100000:2.0:1767320379.352392:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998080
00000100:00100000:2.0:1767320379.352394:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998080
00000100:00100000:2.0:1767320379.352409:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853
00000100:00100000:2.0:1767320379.352413:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379997952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352454:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379997952:12345-0@lo:400:kworker.0 Request processed in 41us (183us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320379.352460:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853
00000100:00100000:2.0:1767320379.352476:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854
00000100:00100000:2.0:1767320379.352482:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379998080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352510:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379998080:12345-0@lo:400:kworker.0 Request processed in 29us (176us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320379.352516:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854
00000100:00100000:2.0:1767320379.352536:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4809
00000100:00100000:2.0:1767320379.352544:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379998464:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352575:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164379998464:12345-0@lo:400:kworker.0 Request processed in 33us (723us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320379.352579:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4809
00000100:00100000:2.0:1767320379.352613:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164379998464:0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352635:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379998080:0@lo:400:kworker.0
00000100:00100000:2.0:1767320379.352640:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379997952:0@lo:400:kworker.0
00000100:00100000:1.0:1767320379.353149:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379997696:0@lo:38:kworker.0
00000100:00100000:1.0:1767320379.353207:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320379.353247:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379997824:0@lo:38:kworker.0
00000100:00100000:1.0:1767320379.353273:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320379.353313:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379998336:0@lo:38:kworker.0
00000100:00100000:1.0:1767320379.353338:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320379.353354:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379998592:0@lo:38:kworker.0
00000100:00100000:1.0:1767320379.353375:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320379.353406:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320379.353412:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320379.353415:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320379.353720:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997824
00000100:00100000:2.0:1767320379.353728:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997824
00000100:00100000:2.0:1767320379.353766:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168
00000100:00100000:2.0:1767320379.353773:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379997824:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320379.353807:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320379.353815:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379997696
00000100:00100000:0.0:1767320379.353820:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379997696
00000100:00100000:0.0:1767320379.353844:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998336
00000100:00100000:0.0:1767320379.353845:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998336
00000100:00100000:0.0:1767320379.353858:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998592
00000100:00100000:0.0:1767320379.353860:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998592
00000100:00100000:2.0:1767320379.353891:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379997824:12345-0@lo:38:kworker.0 Request processed in 84us (582us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320379.353901:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168
00000100:00100000:0.0:1767320379.353903:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17714
00000100:00100000:0.0:1767320379.353909:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379997696:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320379.353918:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320379.353932:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17715
00000100:00100000:2.0:1767320379.353939:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379998336:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320379.353947:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379997696:12345-0@lo:38:kworker.0 Request processed in 37us (740us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767320379.353951:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320379.353955:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17714
00000100:00100000:0.0:1767320379.353972:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17716
00000100:00100000:0.0:1767320379.353975:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379998592:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320379.353983:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320379.354001:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379998336:12345-0@lo:38:kworker.0 Request processed in 49us (649us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320379.354008:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379998592:12345-0@lo:38:kworker.0 Request processed in 29us (630us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320379.354013:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17715
00000100:00100000:0.0:1767320379.354029:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17716
00000100:00100000:3.0:1767320379.354167:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164379998208:12345-0@lo:400:kworker.0 Request processed in 2188us (2391us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320379.354175:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4808
00000100:00100000:2.0:1767320379.354349:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164379998208:0@lo:400:kworker.0
00000100:00080000:3.0:1767320379.354937:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320379.354943:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320379.354946:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379997696:0@lo:38:kworker.0
00000100:00080000:3.0:1767320379.354955:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320379.354958:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320379.354960:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379997824:0@lo:38:kworker.0
00000100:00080000:3.0:1767320379.354966:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320379.354968:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320379.354970:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379998336:0@lo:38:kworker.0
00000100:00080000:3.0:1767320379.354977:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320379.354979:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320379.354981:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379998592:0@lo:38:kworker.0
00010000:00010000:1.0:1767320379.927513:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320380.951157:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320381.326648:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320381.326700:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320381.326791:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970688
00000100:00100000:0.0:1767320381.326804:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970688
00000100:00080000:2.0:1767320381.326907:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320381.326912:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970560
00000100:00100000:3.0:1767320381.326918:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970560
00000100:00100000:0.0:1767320381.326926:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4810
00000100:00100000:0.0:1767320381.326940:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291970688:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320381.326957:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17717
00000100:00100000:3.0:1767320381.326966:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291970560:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320381.326991:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320381.327058:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291970688:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 117us (418us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320381.327066:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291970560:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 97us (362us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320381.327073:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4810
00000100:00100000:3.0:1767320381.327081:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17717
00000100:00100000:2.0:1767320381.399406:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379998720:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320381.399497:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320381.399544:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998720
00000100:00100000:0.0:1767320381.399555:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998720
00000100:00080000:1.0:1767320381.399610:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320381.399637:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654
00000100:00100000:0.0:1767320381.399648:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379998720:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320381.399684:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320381.399743:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164379998720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (245us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320381.399751:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654
00000100:00100000:2.0:1767320381.399920:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164379998720:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320381.975146:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320382.938394:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379998848:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320382.938519:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320382.938652:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998848
00000100:00100000:3.0:1767320382.938666:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998848
00000100:00100000:3.0:1767320382.938751:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655
00000100:00100000:3.0:1767320382.938762:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379998848:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320382.938816:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767320382.939904:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320382.941198:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164379998848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2428us (2668us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320382.941215:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655
00000100:00100000:0.0:1767320382.941557:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164379998848:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320383.000398:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320384.025141:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320384.471220:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320384.471235:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320384.471240:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320384.471245:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320384.471252:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320384.471264:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5281
00000100:00080000:3.0:1767320384.471271:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320384.471280:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320384.471338:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efea00 x1853164379998976/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320384.471359:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320384.471363:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320384.471364:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320384.471368:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5281
00000100:00080000:3.0:1767320384.471371:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320384.471374:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320384.471387:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc700 x1853164379999104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320384.471467:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320384.471471:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320384.471473:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320384.471477:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5281
00000100:00080000:3.0:1767320384.471479:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320384.471483:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320384.471494:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199c00 x1853164379999616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320384.471510:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320384.471513:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320384.471515:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320384.471519:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5281
00000100:00080000:3.0:1767320384.471521:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320384.471526:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320384.471539:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819a300 x1853164379999872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320384.471617:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379999232:0@lo:400:kworker.0
00000100:00100000:2.0:1767320384.471712:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320384.471797:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320384.471803:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379999360:0@lo:400:kworker.0
00000100:00100000:2.0:1767320384.471828:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320384.471858:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379999488:0@lo:400:kworker.0
00000100:00100000:2.0:1767320384.471914:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320384.471940:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320384.471945:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379999744:0@lo:400:kworker.0
00000100:00100000:2.0:1767320384.471967:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320384.472019:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379999488
00000100:00100000:2.0:1767320384.472029:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379999488
00000100:00100000:2.0:1767320384.472094:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379999744
00000100:00100000:2.0:1767320384.472097:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379999744
00000100:00100000:2.0:1767320384.472126:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4811
00000100:00100000:2.0:1767320384.472135:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379999488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320384.472198:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164379999488:12345-0@lo:400:kworker.0 Request processed in 64us (284us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320384.472206:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4811
00000100:00100000:2.0:1767320384.472226:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4812
00000100:00100000:2.0:1767320384.472233:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379999744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320384.472259:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164379999744:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320384.472266:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4812
00000100:00080000:2.0:1767320384.472291:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320384.472341:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164379999744:0@lo:400:kworker.0
00000100:00100000:2.0:1767320384.472353:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164379999488:0@lo:400:kworker.0
00000100:00100000:0.0:1767320384.472651:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379999232
00000100:00100000:0.0:1767320384.472656:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379999232
00000100:00100000:0.0:1767320384.472712:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379999360
00000100:00100000:0.0:1767320384.472716:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379999360
00000100:00100000:0.0:1767320384.472741:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855
00000100:00100000:0.0:1767320384.472749:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379999232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320384.472796:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379999232:12345-0@lo:400:kworker.0 Request processed in 48us (1085us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320384.472802:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855
00000100:00100000:0.0:1767320384.472818:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856
00000100:00100000:0.0:1767320384.472824:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379999360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320384.472849:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164379999360:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320384.472854:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856
00000100:00100000:0.0:1767320384.472946:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379999360:0@lo:400:kworker.0
00000100:00100000:0.0:1767320384.472957:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164379999232:0@lo:400:kworker.0
00000100:00080000:2.0:1767320384.473915:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320384.473923:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320384.474392:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379998976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320384.474473:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320384.474522:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379999104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320384.474554:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320384.474609:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379999616:0@lo:38:kworker.0
00000100:00100000:1.0:1767320384.474633:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320384.474657:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379999872:0@lo:38:kworker.0
00000100:00100000:1.0:1767320384.474678:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320384.474722:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379998976
00000100:00100000:1.0:1767320384.474732:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379998976
00000100:00100000:3.0:1767320384.474760:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379999104
00000100:00100000:3.0:1767320384.474768:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379999104
00000100:00100000:1.0:1767320384.474772:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379999616
00000100:00100000:1.0:1767320384.474777:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379999616
00000100:00100000:1.0:1767320384.474800:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164379999872
00000100:00100000:1.0:1767320384.474804:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164379999872
00000100:00100000:3.0:1767320384.474807:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169
00000100:00100000:3.0:1767320384.474816:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379999104:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320384.474825:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17718
00000100:00100000:1.0:1767320384.474832:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379998976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320384.474845:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767320384.474848:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320384.474993:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17719
00000100:00100000:0.0:1767320384.475000:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379999616:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320384.475010:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320384.475085:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17720
00000100:00100000:2.0:1767320384.475092:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379999872:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320384.475102:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320384.480655:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164379999104:12345-0@lo:38:kworker.0 Request processed in 5821us (6081us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320384.481056:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169
00000100:00100000:0.0:1767320384.481348:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164379999616:12345-0@lo:38:kworker.0 Request processed in 6345us (6711us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320384.481362:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17719
00000100:00100000:2.0:1767320384.484314:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164379999872:12345-0@lo:38:kworker.0 Request processed in 9205us (9618us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320384.484334:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17720
00000100:00100000:1.0:1767320384.488621:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164379998976:12345-0@lo:38:kworker.0 Request processed in 13766us (14125us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320384.488643:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17718
00000100:00080000:3.0:1767320384.490116:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320384.490130:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320384.490137:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164379998976:0@lo:38:kworker.0
00000100:00080000:3.0:1767320384.490159:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320384.490163:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320384.490167:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164379999104:0@lo:38:kworker.0
00000100:00080000:3.0:1767320384.490182:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320384.490186:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320384.490190:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164379999616:0@lo:38:kworker.0
00000100:00080000:3.0:1767320384.490203:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320384.490207:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320384.490210:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164379999872:0@lo:38:kworker.0
00010000:00010000:2.0:1767320385.048964:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320386.071612:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320386.453167:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320386.453401:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970944
00000100:00100000:1.0:1767320386.453415:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970944
00000100:00100000:1.0:1767320386.453529:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4813
00000100:00100000:1.0:1767320386.453542:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291970944:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320386.453641:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291970944:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 101us (489us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320386.453650:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4813
00000100:00080000:3.0:1767320386.454204:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320386.454286:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320386.454349:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291970816
00000100:00100000:0.0:1767320386.454357:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291970816
00000100:00100000:0.0:1767320386.454393:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17721
00000100:00100000:0.0:1767320386.454400:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291970816:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320386.454426:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320386.454478:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291970816:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 77us (193us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320386.454491:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17721
00000100:00100000:0.0:1767320386.520558:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380000000:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320386.520657:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320386.526886:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000000
00000100:00100000:3.0:1767320386.526908:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000000
00000100:00100000:3.0:1767320386.527121:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656
00000100:00100000:3.0:1767320386.527134:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380000000:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320386.527193:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320386.527325:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380000000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 194us (6668us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320386.527334:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656
00000100:00100000:1.0:1767320386.527578:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380000000:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320386.532047:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320387.095350:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320388.056229:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320388.056272:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380000128:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320388.056368:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320388.056524:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000128
00000100:00100000:1.0:1767320388.056535:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000128
00000100:00100000:1.0:1767320388.056621:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657
00000100:00100000:1.0:1767320388.056633:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380000128:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320388.056671:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320388.056734:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380000128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320388.056742:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657
00000100:00100000:0.0:1767320388.056975:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380000128:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320388.058296:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320388.119259:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320389.143524:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320389.596414:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320389.596423:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320389.596427:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320389.596432:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320389.596437:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320389.596446:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320389.596451:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320389.596459:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320389.596506:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239c00 x1853164380000256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320389.596540:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320389.596544:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320389.596546:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320389.596551:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320389.596553:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320389.596557:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320389.596571:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289c00 x1853164380000384/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320389.596629:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320389.596632:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320389.596634:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320389.596638:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320389.596641:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320389.596645:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320389.596654:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a300 x1853164380000896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320389.596669:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320389.596672:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320389.596674:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320389.596677:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5286
00000100:00080000:1.0:1767320389.596679:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320389.596683:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320389.596691:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b480 x1853164380001152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320389.596722:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380000640:0@lo:400:kworker.0
00000100:00100000:1.0:1767320389.596803:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320389.596890:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320389.596896:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380000512:0@lo:400:kworker.0
00000100:00100000:1.0:1767320389.596919:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320389.596979:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380001024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320389.597008:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320389.597028:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320389.597033:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380000768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320389.597051:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320389.597088:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001024
00000100:00100000:1.0:1767320389.597097:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001024
00000100:00100000:1.0:1767320389.597154:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000768
00000100:00100000:1.0:1767320389.597157:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000768
00000100:00100000:1.0:1767320389.597178:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4814
00000100:00100000:1.0:1767320389.597185:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380001024:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320389.597331:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000640
00000100:00100000:3.0:1767320389.597335:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000640
00000100:00100000:3.0:1767320389.597365:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000512
00000100:00100000:3.0:1767320389.597367:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000512
00000100:00100000:3.0:1767320389.597390:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857
00000100:00100000:3.0:1767320389.597396:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380000640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320389.597449:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380000640:12345-0@lo:400:kworker.0 Request processed in 53us (646us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320389.597457:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857
00000100:00100000:3.0:1767320389.597472:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858
00000100:00100000:3.0:1767320389.597477:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380000512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320389.597499:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380000512:12345-0@lo:400:kworker.0 Request processed in 22us (579us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320389.597505:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858
00000100:00080000:3.0:1767320389.597520:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320389.597525:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320389.597558:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380000512:0@lo:400:kworker.0
00000100:00100000:3.0:1767320389.597569:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380000640:0@lo:400:kworker.0
00000100:00100000:3.0:1767320389.597596:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380000256:0@lo:38:kworker.0
00000100:00100000:3.0:1767320389.597620:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320389.597638:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380000384:0@lo:38:kworker.0
00000100:00100000:3.0:1767320389.597657:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320389.597678:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380000896:0@lo:38:kworker.0
00000100:00100000:3.0:1767320389.597695:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320389.597709:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380001152:0@lo:38:kworker.0
00000100:00100000:3.0:1767320389.597724:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320389.597745:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000256
00000100:00100000:3.0:1767320389.597748:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000256
00000100:00100000:3.0:1767320389.597760:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000896
00000100:00100000:3.0:1767320389.597762:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000896
00000100:00100000:3.0:1767320389.597767:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001152
00000100:00100000:3.0:1767320389.597769:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001152
00000100:00100000:3.0:1767320389.597778:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4815
00000100:00100000:3.0:1767320389.597784:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380000768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320389.597822:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380000768:12345-0@lo:400:kworker.0 Request processed in 38us (770us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320389.597828:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4815
00000100:00100000:3.0:1767320389.597844:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17722
00000100:00100000:3.0:1767320389.597848:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380000256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320389.597885:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320389.597916:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380000256:12345-0@lo:38:kworker.0 Request processed in 66us (295us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320389.597921:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17722
00000100:00100000:3.0:1767320389.597944:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17723
00000100:00100000:3.0:1767320389.597947:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380000896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320389.597956:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320389.597977:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380000896:12345-0@lo:38:kworker.0 Request processed in 29us (282us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320389.597983:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17723
00000100:00100000:3.0:1767320389.597993:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17724
00000100:00100000:3.0:1767320389.597996:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380001152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320389.598004:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320389.598024:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380001152:12345-0@lo:38:kworker.0 Request processed in 25us (297us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320389.598032:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17724
00000100:00100000:3.0:1767320389.598050:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380000384
00000100:00100000:3.0:1767320389.598054:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380000384
00000100:00100000:3.0:1767320389.598074:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170
00000100:00100000:3.0:1767320389.598078:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380000384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320389.598088:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320389.598112:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380000384:12345-0@lo:38:kworker.0 Request processed in 32us (453us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320389.598118:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170
00000100:00080000:3.0:1767320389.598169:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320389.598175:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320389.598178:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380000256:0@lo:38:kworker.0
00000100:00080000:3.0:1767320389.598186:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320389.598190:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320389.598192:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380000384:0@lo:38:kworker.0
00000100:00080000:3.0:1767320389.598199:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320389.598202:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320389.598205:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380000896:0@lo:38:kworker.0
00000100:00080000:3.0:1767320389.598284:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320389.598287:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320389.598290:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380001152:0@lo:38:kworker.0
00000100:00100000:3.0:1767320389.598419:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380000768:0@lo:400:kworker.0
00000100:00100000:1.0:1767320389.598786:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380001024:12345-0@lo:400:kworker.0 Request processed in 1599us (1775us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320389.598795:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4814
00000100:00100000:3.0:1767320389.599320:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380001024:0@lo:400:kworker.0
00010000:00010000:1.0:1767320390.167694:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320390.554564:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767320390.554619:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291971072 offset 0 length 520: 4
00000100:00100000:1.0:1767320390.554665:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320390.554757:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291971328
00000100:00100000:2.0:1767320390.554770:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291971328
00000100:00100000:2.0:1767320390.554925:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291971200
00000100:00100000:2.0:1767320390.554929:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291971200
00000100:00100000:2.0:1767320390.554953:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4816
00000100:00100000:2.0:1767320390.554965:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291971328:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320390.555064:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291971328:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 100us (513us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320390.555073:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4816
00000100:00100000:2.0:1767320390.555096:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17725
00000100:00100000:2.0:1767320390.555102:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291971200:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320390.555128:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320390.555156:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291971200:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (491us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320390.555163:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17725
00000100:00080000:0.0:1767320390.555444:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320391.195713:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320391.641860:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320391.641922:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380001280:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320391.642027:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320391.642456:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001280
00000100:00100000:3.0:1767320391.642467:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001280
00000100:00100000:3.0:1767320391.642549:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658
00000100:00100000:3.0:1767320391.642560:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380001280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320391.642601:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320391.642670:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380001280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (643us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320391.642678:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658
00000100:00080000:0.0:1767320391.642742:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320391.644142:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380001280:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320392.215991:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320393.175311:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380001408:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320393.175397:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320393.175583:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001408
00000100:00100000:0.0:1767320393.175592:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001408
00000100:00100000:0.0:1767320393.175662:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659
00000100:00100000:0.0:1767320393.175672:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380001408:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320393.175701:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767320393.175854:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320393.176359:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380001408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 687us (971us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320393.176369:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659
00000100:00100000:2.0:1767320393.176615:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380001408:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320393.239683:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320394.263230:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320394.711048:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320394.711059:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320394.711071:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320394.711076:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320394.711080:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320394.711087:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5292
00000100:00080000:1.0:1767320394.711091:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320394.711098:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320394.711141:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28aa00 x1853164380001536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320394.711167:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320394.711170:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320394.711172:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320394.711177:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5292
00000100:00080000:1.0:1767320394.711180:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320394.711184:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320394.711587:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288000 x1853164380001664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320394.711661:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320394.711664:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320394.711667:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320394.711670:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5292
00000100:00080000:1.0:1767320394.711673:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320394.711677:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320394.711690:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164380002176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320394.711707:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320394.711710:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320394.711712:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320394.711715:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5292
00000100:00080000:1.0:1767320394.711718:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320394.711721:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320394.711731:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28b480 x1853164380002432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320394.711804:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380001920:0@lo:400:kworker.0
00000100:00100000:2.0:1767320394.711934:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320394.712016:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320394.712025:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380001792:0@lo:400:kworker.0
00000100:00100000:2.0:1767320394.712052:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320394.712103:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380002048:0@lo:400:kworker.0
00000100:00100000:2.0:1767320394.712115:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380002304:0@lo:400:kworker.0
00000100:00100000:2.0:1767320394.712159:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320394.712195:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320394.712230:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380002304
00000100:00100000:2.0:1767320394.712240:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380002304
00000100:00100000:0.0:1767320394.712281:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320369/real 1767320369]  req@ffff8b0e0bef4a80 x1853164379995008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320394 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320394.712304:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380002048
00000100:00100000:2.0:1767320394.712309:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380002048
00000100:00100000:0.0:1767320394.712312:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bef4a80 x1853164379995008/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320394 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320394.712334:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380001536:0@lo:38:kworker.0
00000100:00100000:2.0:1767320394.712342:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4817
00000100:00100000:2.0:1767320394.712355:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380002304:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320394.712375:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320394.712601:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001920
00000100:00100000:3.0:1767320394.712607:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001920
00000100:00100000:3.0:1767320394.712637:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001792
00000100:00100000:3.0:1767320394.712639:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001792
00000100:00100000:3.0:1767320394.712660:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859
00000100:00100000:3.0:1767320394.712667:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380001920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320394.712731:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860
00000100:00100000:1.0:1767320394.712740:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380001792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320394.714606:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380002304:12345-0@lo:400:kworker.0 Request processed in 2248us (2439us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320394.714618:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4817
00000100:00100000:2.0:1767320394.714650:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001536
00000100:00100000:2.0:1767320394.714656:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001536
00000100:00100000:2.0:1767320394.714687:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4818
00000100:00100000:2.0:1767320394.714698:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380002048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320394.714749:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380002048:12345-0@lo:400:kworker.0 Request processed in 55us (2556us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320394.714755:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4818
00000100:00100000:2.0:1767320394.714768:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17726
00000100:00100000:2.0:1767320394.714773:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380001536:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320394.714792:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320394.714820:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380001536:12345-0@lo:38:kworker.0 Request processed in 46us (2446us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320394.714927:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17726
00000100:00080000:2.0:1767320394.714953:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320394.714960:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320394.715011:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320394.715021:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320394.715027:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380001536:0@lo:38:kworker.0
00000100:00100000:0.0:1767320394.715041:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380001664:0@lo:38:kworker.0
00000100:00100000:2.0:1767320394.715287:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380002304:0@lo:400:kworker.0
00000100:00100000:2.0:1767320394.715389:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380002048:0@lo:400:kworker.0
00000100:00100000:0.0:1767320394.715431:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320394.717616:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380001920:12345-0@lo:400:kworker.0 Request processed in 4941us (5673us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320394.717630:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859
00000100:00100000:0.0:1767320394.719038:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380002176:0@lo:38:kworker.0
00000100:00100000:0.0:1767320394.719425:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320394.719483:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380002432:0@lo:38:kworker.0
00000100:00100000:0.0:1767320394.719675:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320394.719784:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320394.719809:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320394.719814:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164379995008:0@lo:250:kworker.0
00000100:00100000:0.0:1767320394.719917:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380002176
00000100:00100000:0.0:1767320394.719929:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380002176
00000100:00100000:0.0:1767320394.719971:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380002432
00000100:00100000:0.0:1767320394.719975:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380002432
00000100:00100000:0.0:1767320394.719997:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17727
00000100:00100000:0.0:1767320394.720006:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380002176:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320394.720032:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320394.720084:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380002176:12345-0@lo:38:kworker.0 Request processed in 78us (660us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320394.720092:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17727
00000100:00100000:0.0:1767320394.720648:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17728
00000100:00100000:0.0:1767320394.720656:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380002432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320394.720668:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320394.720788:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380002432:12345-0@lo:38:kworker.0 Request processed in 131us (1112us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320394.720794:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17728
00000100:00080000:0.0:1767320394.720919:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320394.720925:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320394.720929:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380002176:0@lo:38:kworker.0
00000100:00080000:0.0:1767320394.720940:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320394.720943:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320394.720946:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380002432:0@lo:38:kworker.0
00000100:00080000:0.0:1767320394.721005:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320394.721011:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320394.721014:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320394.721019:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5271
00000100:00080000:0.0:1767320394.721023:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320394.721029:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320394.721059:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4a80 x1853164380002560/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320394.722190:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380002560:0@lo:250:kworker.0
00000400:00000100:0.0:1767320394.722253:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380002560 offset 0 length 520: 4
00000100:00100000:1.0:1767320394.722400:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380001792:12345-0@lo:400:kworker.0 Request processed in 9649us (10334us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320394.722418:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860
00000100:00100000:2.0:1767320394.722843:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380001664
00000100:00100000:2.0:1767320394.722854:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380001664
00000100:00100000:2.0:1767320394.722925:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171
00000100:00100000:2.0:1767320394.722933:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380001664:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320394.722955:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320394.723419:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380001664:12345-0@lo:38:kworker.0 Request processed in 485us (8320us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320394.723505:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171
00000100:00100000:3.0:1767320394.723675:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380001792:0@lo:400:kworker.0
00000100:00100000:3.0:1767320394.723690:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380001920:0@lo:400:kworker.0
00000100:00080000:1.0:1767320394.723777:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320394.723783:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320394.723786:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380001664:0@lo:38:kworker.0
00010000:00010000:2.0:1767320395.287569:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320395.664278:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320395.664723:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291971584
00000100:00100000:0.0:1767320395.664734:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291971584
00000100:00100000:0.0:1767320395.664817:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4819
00000100:00100000:0.0:1767320395.664836:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291971584:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320395.664964:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291971584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 133us (690us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320395.664973:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4819
00000100:00080000:2.0:1767320395.665057:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320395.665543:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320395.665577:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291971456
00000100:00100000:0.0:1767320395.665584:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291971456
00000100:00100000:0.0:1767320395.665613:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17729
00000100:00100000:0.0:1767320395.665619:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291971456:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320395.665639:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320395.665732:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291971456:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 111us (189us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320395.665739:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17729
00010000:00010000:1.0:1767320396.311154:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320396.766948:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380002688:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320396.767022:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320396.767169:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380002688
00000100:00100000:1.0:1767320396.767178:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380002688
00000100:00100000:1.0:1767320396.767249:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660
00000100:00100000:1.0:1767320396.767258:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380002688:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320396.767287:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320396.767329:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380002688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (306us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320396.767335:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660
00000100:00080000:3.0:1767320396.767398:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320396.767485:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380002688:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320397.335152:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320398.295405:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380002816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320398.295488:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320398.295658:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380002816
00000100:00100000:0.0:1767320398.295667:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380002816
00000100:00100000:0.0:1767320398.295734:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661
00000100:00100000:0.0:1767320398.295744:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380002816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320398.295775:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320398.295833:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380002816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (344us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320398.295840:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661
00000100:00100000:2.0:1767320398.295999:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380002816:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320398.299291:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320398.361348:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320399.383139:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320399.831329:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320399.831339:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320399.831342:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320399.831347:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320399.831352:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320399.831361:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5297
00000100:00080000:3.0:1767320399.831366:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320399.831383:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320399.831421:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819b800 x1853164380002944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320399.831448:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320399.831451:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320399.831453:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320399.831457:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5297
00000100:00080000:3.0:1767320399.831460:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320399.831463:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320399.831475:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819b480 x1853164380003072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320399.831534:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380003200:0@lo:400:kworker.0
00000100:00100000:2.0:1767320399.831613:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320399.831723:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380002944:0@lo:38:kworker.0
00000100:00100000:1.0:1767320399.831756:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320399.831778:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380003072:0@lo:38:kworker.0
00000100:00100000:1.0:1767320399.831800:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320399.831890:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380002944
00000100:00100000:1.0:1767320399.831897:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380002944
00000100:00100000:1.0:1767320399.831932:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17730
00000100:00100000:1.0:1767320399.831940:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380002944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320399.831960:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320399.832002:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380002944:12345-0@lo:38:kworker.0 Request processed in 61us (245us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320399.832009:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17730
00000100:00080000:1.0:1767320399.832050:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320399.832055:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320399.832059:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380002944:0@lo:38:kworker.0
00000100:00100000:0.0:1767320399.832279:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003200
00000100:00100000:0.0:1767320399.832284:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003200
00000100:00100000:0.0:1767320399.832334:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861
00000100:00100000:0.0:1767320399.832342:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380003200:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320399.832411:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320399.832441:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003072
00000100:00100000:1.0:1767320399.832446:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003072
00000100:00100000:1.0:1767320399.832469:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172
00000100:00100000:1.0:1767320399.832473:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380003072:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320399.832484:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320399.832516:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380003072:12345-0@lo:38:kworker.0 Request processed in 41us (714us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320399.832522:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172
00000100:00080000:1.0:1767320399.832547:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320399.832561:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320399.832565:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380003072:0@lo:38:kworker.0
00000100:00100000:1.0:1767320399.833210:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380003328:0@lo:400:kworker.0
00000100:00100000:1.0:1767320399.833250:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320399.833284:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003328
00000100:00100000:1.0:1767320399.833289:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003328
00000100:00100000:1.0:1767320399.833319:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862
00000100:00100000:1.0:1767320399.833326:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380003328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320399.833364:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380003328:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320399.833384:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862
00000100:00100000:1.0:1767320399.833420:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380003328:0@lo:400:kworker.0
00000100:00100000:0.0:1767320399.837094:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380003200:12345-0@lo:400:kworker.0 Request processed in 4742us (5470us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320399.837109:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861
00000100:00100000:2.0:1767320399.839717:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380003200:0@lo:400:kworker.0
00000100:00080000:3.0:1767320399.843569:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320399.843575:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320399.843580:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320399.843587:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5297
00000100:00080000:3.0:1767320399.843591:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320399.843599:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320399.843621:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198380 x1853164380003584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320399.843647:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320399.843651:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320399.843653:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320399.843656:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5297
00000100:00080000:3.0:1767320399.843658:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320399.843662:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320399.843673:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198e00 x1853164380003840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320399.843722:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380003584:0@lo:38:kworker.0
00000100:00100000:3.0:1767320399.843789:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320399.844254:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380003712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320399.844288:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320399.844317:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320399.844324:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380003456:0@lo:400:kworker.0
00000100:00100000:1.0:1767320399.844345:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320399.844389:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003584
00000100:00100000:1.0:1767320399.844397:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003584
00000100:00100000:1.0:1767320399.844427:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003712
00000100:00100000:1.0:1767320399.844430:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003712
00000100:00100000:1.0:1767320399.844465:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003456
00000100:00100000:1.0:1767320399.844467:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003456
00000100:00100000:1.0:1767320399.844489:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4820
00000100:00100000:1.0:1767320399.844496:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380003712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320399.844547:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380003712:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320399.844567:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4820
00000100:00100000:1.0:1767320399.844588:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4821
00000100:00100000:1.0:1767320399.844595:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380003456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320399.844623:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380003456:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320399.844628:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4821
00000100:00100000:1.0:1767320399.844640:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17731
00000100:00100000:1.0:1767320399.844645:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380003584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320399.844664:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320399.844691:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380003584:12345-0@lo:38:kworker.0 Request processed in 45us (903us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320399.844698:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17731
00000100:00080000:1.0:1767320399.844729:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320399.844771:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380003456:0@lo:400:kworker.0
00000100:00100000:1.0:1767320399.844783:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380003712:0@lo:400:kworker.0
00000100:00100000:3.0:1767320399.845202:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380003840:0@lo:38:kworker.0
00000100:00100000:3.0:1767320399.845235:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320399.845280:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320399.845284:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320399.845288:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380003584:0@lo:38:kworker.0
00000100:00100000:1.0:1767320399.845502:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003840
00000100:00100000:1.0:1767320399.845508:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003840
00000100:00100000:1.0:1767320399.845539:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17732
00000100:00100000:1.0:1767320399.845544:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380003840:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320399.846003:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320399.846057:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380003840:12345-0@lo:38:kworker.0 Request processed in 511us (821us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320399.846065:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17732
00000100:00080000:3.0:1767320399.846702:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320399.847036:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320399.847040:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380003840:0@lo:38:kworker.0
00010000:00010000:1.0:1767320400.407550:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320400.785324:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320400.785493:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291971712
00000100:00100000:3.0:1767320400.785505:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291971712
00000100:00100000:3.0:1767320400.785559:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17733
00000100:00100000:3.0:1767320400.785567:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291971712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320400.785590:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320400.785660:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291971712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 92us (344us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320400.785671:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17733
00000100:00100000:2.0:1767320400.795996:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320400.798539:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291971840
00000100:00100000:0.0:1767320400.798555:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291971840
00000100:00100000:0.0:1767320400.798714:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4822
00000100:00100000:0.0:1767320400.798723:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291971840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320400.798814:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291971840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (2828us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320400.798822:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4822
00000100:00080000:1.0:1767320400.806208:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320401.439776:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320401.879129:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320401.879151:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380003968:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320401.879221:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320401.879374:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380003968
00000100:00100000:0.0:1767320401.879383:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380003968
00000100:00100000:0.0:1767320401.879465:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662
00000100:00100000:0.0:1767320401.879475:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380003968:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320401.879505:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320401.879552:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380003968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (331us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320401.879559:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662
00000100:00080000:1.0:1767320401.879756:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320401.879971:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380003968:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320402.455161:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320403.415146:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320403.415169:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380004096:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320403.415321:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320403.415397:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004096
00000100:00100000:2.0:1767320403.415415:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004096
00000100:00100000:2.0:1767320403.415479:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663
00000100:00100000:2.0:1767320403.415490:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380004096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320403.415520:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320403.415569:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380004096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (260us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320403.415574:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663
00000100:00080000:1.0:1767320403.415627:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320403.415644:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380004096:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320403.481510:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320404.504247:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320404.952248:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320404.952256:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320404.952259:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320404.952263:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320404.952267:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320404.952751:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5302
00000100:00080000:3.0:1767320404.952756:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320404.952762:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320404.952853:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198e00 x1853164380004224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320404.952910:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320404.952914:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320404.952916:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320404.952920:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5302
00000100:00080000:3.0:1767320404.952923:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320404.952927:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320404.952952:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198380 x1853164380004352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320404.953015:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320404.953018:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320404.953020:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320404.953024:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5302
00000100:00080000:3.0:1767320404.953026:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320404.953030:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320404.953040:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38198700 x1853164380004864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320404.953055:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320404.953058:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320404.953060:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320404.953063:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5302
00000100:00080000:3.0:1767320404.953065:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320404.953069:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320404.953078:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819b800 x1853164380005120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320404.953150:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380004224:0@lo:38:kworker.0
00000100:00100000:0.0:1767320404.953217:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.953269:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380004352:0@lo:38:kworker.0
00000100:00100000:0.0:1767320404.953305:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.953340:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380004864:0@lo:38:kworker.0
00000100:00100000:0.0:1767320404.953362:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.953377:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380005120:0@lo:38:kworker.0
00000100:00100000:0.0:1767320404.953396:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.953434:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004352
00000100:00100000:0.0:1767320404.953443:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004352
00000100:00100000:0.0:1767320404.953484:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173
00000100:00100000:0.0:1767320404.953491:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380004352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320404.953511:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320404.953552:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380004352:12345-0@lo:38:kworker.0 Request processed in 59us (245us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320404.953559:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173
00000100:00100000:0.0:1767320404.953584:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004224
00000100:00100000:0.0:1767320404.953587:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004224
00000100:00100000:0.0:1767320404.953602:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004864
00000100:00100000:0.0:1767320404.953604:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004864
00000100:00100000:0.0:1767320404.953617:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380005120
00000100:00100000:0.0:1767320404.953619:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380005120
00000100:00100000:0.0:1767320404.953637:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17734
00000100:00100000:0.0:1767320404.953641:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380004224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320404.953652:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320404.953677:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380004224:12345-0@lo:38:kworker.0 Request processed in 34us (460us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320404.953686:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17734
00000100:00100000:0.0:1767320404.953698:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17735
00000100:00100000:0.0:1767320404.953702:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380004864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320404.953711:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320404.953733:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380004864:12345-0@lo:38:kworker.0 Request processed in 29us (369us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320404.953738:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17735
00000100:00100000:0.0:1767320404.953751:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17736
00000100:00100000:0.0:1767320404.953754:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380005120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320404.953762:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320404.953781:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380005120:12345-0@lo:38:kworker.0 Request processed in 25us (384us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320404.953785:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17736
00000100:00080000:0.0:1767320404.953833:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320404.953838:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320404.953841:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380004224:0@lo:38:kworker.0
00000100:00080000:0.0:1767320404.953850:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320404.953853:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320404.953855:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380004352:0@lo:38:kworker.0
00000100:00080000:0.0:1767320404.953862:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320404.953865:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320404.953891:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380004864:0@lo:38:kworker.0
00000100:00080000:0.0:1767320404.953900:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320404.953903:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320404.953906:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380005120:0@lo:38:kworker.0
00000100:00100000:0.0:1767320404.953974:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380004736:0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.953997:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.954018:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320404.954023:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380004992:0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954041:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.954065:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380004608:0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954090:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.954107:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320404.954112:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380004480:0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954131:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320404.954156:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004608
00000100:00100000:0.0:1767320404.954160:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004608
00000100:00100000:0.0:1767320404.954189:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004480
00000100:00100000:0.0:1767320404.954192:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004480
00000100:00100000:0.0:1767320404.954219:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863
00000100:00100000:0.0:1767320404.954226:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380004608:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954267:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380004608:12345-0@lo:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320404.954273:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863
00000100:00100000:0.0:1767320404.954285:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864
00000100:00100000:0.0:1767320404.954291:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380004480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954317:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380004480:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320404.954322:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864
00000100:00100000:0.0:1767320404.954338:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004736
00000100:00100000:0.0:1767320404.954341:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004736
00000100:00100000:0.0:1767320404.954362:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380004992
00000100:00100000:0.0:1767320404.954365:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380004992
00000100:00100000:0.0:1767320404.954380:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4823
00000100:00100000:0.0:1767320404.954384:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380004736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954414:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380004736:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320404.954419:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4823
00000100:00100000:0.0:1767320404.954429:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4824
00000100:00100000:0.0:1767320404.954435:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380004992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954456:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380004992:12345-0@lo:400:kworker.0 Request processed in 22us (414us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320404.954462:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4824
00000100:00100000:0.0:1767320404.954492:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380004480:0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954501:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380004608:0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954523:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380004992:0@lo:400:kworker.0
00000100:00100000:0.0:1767320404.954530:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380004736:0@lo:400:kworker.0
00000100:00080000:0.0:1767320404.954566:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320404.954571:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320405.527828:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320405.906109:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320405.906159:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320405.909341:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291972096
00000100:00100000:3.0:1767320405.909358:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291972096
00000100:00100000:3.0:1767320405.909460:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291971968
00000100:00100000:3.0:1767320405.909465:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291971968
00000100:00100000:3.0:1767320405.909491:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4825
00000100:00100000:3.0:1767320405.909503:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291972096:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320405.909590:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291972096:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (3492us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320405.909598:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4825
00000100:00100000:3.0:1767320405.909618:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17737
00000100:00100000:3.0:1767320405.909623:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291971968:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320405.909645:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320405.909670:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291971968:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (3510us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320405.909676:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17737
00000100:00080000:0.0:1767320405.910689:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320406.551149:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320407.000820:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380005248:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320407.000918:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320407.001793:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380005248
00000100:00100000:3.0:1767320407.001804:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380005248
00000100:00100000:3.0:1767320407.001906:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664
00000100:00100000:3.0:1767320407.001918:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380005248:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320407.001948:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320407.002024:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380005248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (1105us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320407.002032:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664
00000100:00080000:0.0:1767320407.002143:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320407.003833:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380005248:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320407.575065:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320408.539645:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380005376:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320408.539714:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320408.543242:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380005376
00000100:00100000:1.0:1767320408.543265:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380005376
00000100:00080000:0.0:1767320408.543531:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320408.543864:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665
00000100:00100000:1.0:1767320408.544013:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380005376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320408.544052:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320408.544184:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380005376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 178us (4468us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320408.544192:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665
00000100:00100000:0.0:1767320408.544262:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380005376:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320408.599324:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320409.624438:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320410.072561:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320410.072572:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320410.072575:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320410.072579:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320410.072584:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320410.072591:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5307
00000100:00080000:2.0:1767320410.072596:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320410.072603:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320410.072901:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572d80 x1853164380005504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320410.072928:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320410.072931:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320410.072934:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320410.072938:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5307
00000100:00080000:2.0:1767320410.072940:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320410.072944:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320410.072961:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573b80 x1853164380005632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320410.073033:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320410.073036:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320410.073038:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320410.073042:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5307
00000100:00080000:2.0:1767320410.073044:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320410.073048:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320410.073060:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c573100 x1853164380006144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320410.073074:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320410.073076:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320410.073078:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320410.073081:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5307
00000100:00080000:2.0:1767320410.073083:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320410.073087:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320410.073100:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44bb80 x1853164380006400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320410.073127:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380006016:0@lo:400:kworker.0
00000100:00100000:2.0:1767320410.073199:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320410.073261:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320410.073268:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380006272:0@lo:400:kworker.0
00000100:00100000:2.0:1767320410.073297:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320410.073329:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006016
00000100:00100000:2.0:1767320410.073337:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006016
00000100:00100000:2.0:1767320410.073387:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006272
00000100:00100000:2.0:1767320410.073390:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006272
00000100:00100000:2.0:1767320410.073412:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4826
00000100:00100000:2.0:1767320410.073420:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380006016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320410.073471:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380006016:12345-0@lo:400:kworker.0 Request processed in 51us (271us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320410.073481:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4826
00000100:00100000:2.0:1767320410.073499:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4827
00000100:00100000:2.0:1767320410.073505:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380006272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320410.073531:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380006272:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320410.073536:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4827
00000100:00080000:2.0:1767320410.073552:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320410.073581:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380006272:0@lo:400:kworker.0
00000100:00100000:2.0:1767320410.073592:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380006016:0@lo:400:kworker.0
00000100:00100000:1.0:1767320410.073693:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380005888:0@lo:400:kworker.0
00000100:00100000:1.0:1767320410.073728:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320410.073771:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320410.073777:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380005760:0@lo:400:kworker.0
00000100:00100000:1.0:1767320410.073799:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320410.073830:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380005888
00000100:00100000:1.0:1767320410.073834:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380005888
00000100:00100000:1.0:1767320410.073903:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380005760
00000100:00100000:1.0:1767320410.073906:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380005760
00000100:00100000:1.0:1767320410.073928:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865
00000100:00100000:1.0:1767320410.073935:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380005888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320410.073972:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380005888:12345-0@lo:400:kworker.0 Request processed in 36us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320410.073978:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865
00000100:00100000:1.0:1767320410.073994:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866
00000100:00100000:1.0:1767320410.074000:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380005760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320410.074026:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380005760:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320410.074032:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866
00000100:00080000:1.0:1767320410.074046:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320410.074049:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320410.074071:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380005760:0@lo:400:kworker.0
00000100:00100000:1.0:1767320410.074081:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380005888:0@lo:400:kworker.0
00000100:00100000:0.0:1767320410.074348:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380005504:0@lo:38:kworker.0
00000100:00100000:0.0:1767320410.074382:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320410.074407:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380005632:0@lo:38:kworker.0
00000100:00100000:0.0:1767320410.074430:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320410.074453:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380006144:0@lo:38:kworker.0
00000100:00100000:0.0:1767320410.074475:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320410.074492:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380006400:0@lo:38:kworker.0
00000100:00100000:0.0:1767320410.074512:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320410.074540:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380005632
00000100:00100000:0.0:1767320410.074544:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380005632
00000100:00100000:0.0:1767320410.074566:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174
00000100:00100000:0.0:1767320410.074570:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380005632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320410.074587:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320410.074621:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380005632:12345-0@lo:38:kworker.0 Request processed in 49us (190us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320410.074627:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174
00000100:00100000:0.0:1767320410.074665:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380005504
00000100:00100000:0.0:1767320410.074669:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380005504
00000100:00100000:0.0:1767320410.074687:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006144
00000100:00100000:0.0:1767320410.074690:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006144
00000100:00100000:0.0:1767320410.074698:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006400
00000100:00100000:0.0:1767320410.074700:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006400
00000100:00100000:0.0:1767320410.074709:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17738
00000100:00100000:0.0:1767320410.074712:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380005504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320410.074723:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320410.074759:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380005504:12345-0@lo:38:kworker.0 Request processed in 44us (376us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320410.074766:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17738
00000100:00100000:0.0:1767320410.074778:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17739
00000100:00100000:0.0:1767320410.074781:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380006144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320410.074790:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320410.074812:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380006144:12345-0@lo:38:kworker.0 Request processed in 29us (336us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320410.074817:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17739
00000100:00100000:0.0:1767320410.074826:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17740
00000100:00100000:0.0:1767320410.074829:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380006400:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320410.074839:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320410.074859:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380006400:12345-0@lo:38:kworker.0 Request processed in 28us (345us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320410.074864:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17740
00000100:00080000:0.0:1767320410.074923:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320410.074929:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320410.074932:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380005504:0@lo:38:kworker.0
00000100:00080000:0.0:1767320410.074940:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320410.074943:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320410.074946:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380005632:0@lo:38:kworker.0
00000100:00080000:0.0:1767320410.074953:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320410.074957:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320410.074959:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380006144:0@lo:38:kworker.0
00000100:00080000:0.0:1767320410.074966:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320410.074969:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320410.074972:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380006400:0@lo:38:kworker.0
00010000:00010000:3.0:1767320410.647171:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320411.028833:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320411.033323:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320411.035970:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291972352
00000100:00100000:1.0:1767320411.035986:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291972352
00000100:00100000:1.0:1767320411.040096:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291972224
00000100:00100000:1.0:1767320411.040114:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291972224
00000100:00100000:1.0:1767320411.040159:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4828
00000100:00100000:1.0:1767320411.040178:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291972352:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320411.040298:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291972352:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 129us (11474us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320411.040514:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4828
00000100:00100000:1.0:1767320411.040540:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17741
00000100:00100000:1.0:1767320411.040545:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291972224:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320411.040567:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320411.040779:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291972224:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 51us (7298us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320411.040788:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17741
00000100:00080000:2.0:1767320411.040918:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320411.673725:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320412.122768:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380006528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320412.122849:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320412.123133:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006528
00000100:00100000:1.0:1767320412.123142:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006528
00000100:00080000:1.0:1767320412.123170:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320412.123208:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666
00000100:00100000:1.0:1767320412.123227:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380006528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320412.123255:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320412.123311:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380006528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (462us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320412.123318:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666
00000100:00100000:3.0:1767320412.123998:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380006528:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320412.702300:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320413.655436:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380006656:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320413.655519:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320413.655883:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006656
00000100:00100000:0.0:1767320413.655893:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006656
00000100:00100000:0.0:1767320413.655975:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667
00000100:00100000:0.0:1767320413.655985:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380006656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320413.656018:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320413.656081:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380006656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (561us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320413.656088:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667
00000100:00100000:3.0:1767320413.656332:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380006656:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320413.656450:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320413.719505:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320414.748213:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320415.191469:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320415.191479:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320415.191482:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320415.191486:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320415.191491:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320415.191499:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5312
00000100:00080000:1.0:1767320415.191504:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320415.191511:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320415.191554:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289180 x1853164380006784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320415.191571:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320415.191575:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320415.191576:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320415.191580:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5312
00000100:00080000:1.0:1767320415.191583:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320415.191586:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320415.191602:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164380006912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320415.191663:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320415.191667:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320415.191668:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320415.191672:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5312
00000100:00080000:1.0:1767320415.191674:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320415.191678:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320415.191689:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a8a80 x1853164380007424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320415.191716:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320415.191719:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320415.191721:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320415.191724:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5312
00000100:00080000:1.0:1767320415.191726:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320415.191730:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320415.191740:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9f80 x1853164380007680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320415.191808:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007168:0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.191911:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320415.191979:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320415.191985:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007040:0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192006:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320415.192044:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007168
00000100:00100000:3.0:1767320415.192051:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007168
00000100:00100000:3.0:1767320415.192105:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007040
00000100:00100000:3.0:1767320415.192108:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007040
00000100:00100000:3.0:1767320415.192129:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867
00000100:00100000:3.0:1767320415.192137:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192183:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007168:12345-0@lo:400:kworker.0 Request processed in 46us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320415.192190:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867
00000100:00100000:3.0:1767320415.192204:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868
00000100:00100000:3.0:1767320415.192210:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192236:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007040:12345-0@lo:400:kworker.0 Request processed in 26us (228us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320415.192241:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868
00000100:00100000:3.0:1767320415.192278:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007040:0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192288:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007168:0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192308:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380007296:0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192334:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320415.192353:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320415.192358:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380007552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192377:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320415.192402:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007296
00000100:00100000:3.0:1767320415.192405:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007296
00000100:00100000:3.0:1767320415.192428:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007552
00000100:00100000:3.0:1767320415.192431:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007552
00000100:00100000:3.0:1767320415.192448:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4829
00000100:00100000:3.0:1767320415.192454:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380007296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192486:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380007296:12345-0@lo:400:kworker.0 Request processed in 32us (151us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320415.192500:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4829
00000100:00100000:3.0:1767320415.192511:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4830
00000100:00100000:3.0:1767320415.192518:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380007552:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192545:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380007552:12345-0@lo:400:kworker.0 Request processed in 28us (167us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320415.192550:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4830
00000100:00100000:3.0:1767320415.192574:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380007552:0@lo:400:kworker.0
00000100:00100000:3.0:1767320415.192583:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380007296:0@lo:400:kworker.0
00000100:00080000:1.0:1767320415.193001:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320415.193007:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320415.193010:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320415.193494:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380006784:0@lo:38:kworker.0
00000100:00100000:0.0:1767320415.193536:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320415.193567:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380006912:0@lo:38:kworker.0
00000100:00100000:0.0:1767320415.193592:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320415.193625:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380007424:0@lo:38:kworker.0
00000100:00100000:0.0:1767320415.193649:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320415.193663:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380007680:0@lo:38:kworker.0
00000100:00100000:0.0:1767320415.193681:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320415.193902:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006912
00000100:00100000:2.0:1767320415.193909:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006912
00000100:00100000:2.0:1767320415.193946:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175
00000100:00100000:2.0:1767320415.193953:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380006912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320415.193982:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320415.194437:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320415.194443:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320415.194447:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380006912:0@lo:38:kworker.0
00000100:00100000:2.0:1767320415.194594:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380006912:12345-0@lo:38:kworker.0 Request processed in 80us (441us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320415.194603:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175
00000100:00100000:1.0:1767320415.194745:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380006784
00000100:00100000:1.0:1767320415.194750:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380006784
00000100:00100000:1.0:1767320415.194780:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007424
00000100:00100000:1.0:1767320415.194784:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007424
00000100:00100000:1.0:1767320415.194800:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007680
00000100:00100000:1.0:1767320415.194803:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007680
00000100:00100000:1.0:1767320415.194828:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17742
00000100:00100000:1.0:1767320415.194834:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380006784:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320415.194931:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17743
00000100:00100000:0.0:1767320415.194936:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380007424:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320415.194949:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320415.195010:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380007424:12345-0@lo:38:kworker.0 Request processed in 71us (1358us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320415.195016:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17743
00000100:00100000:0.0:1767320415.195177:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17744
00000100:00100000:0.0:1767320415.195183:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380007680:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320415.195193:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320415.195220:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380007680:12345-0@lo:38:kworker.0 Request processed in 36us (1538us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320415.195226:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17744
00000100:00080000:0.0:1767320415.195256:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320415.195260:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320415.195264:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380007424:0@lo:38:kworker.0
00000100:00080000:0.0:1767320415.195272:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320415.195275:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320415.195279:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380007680:0@lo:38:kworker.0
00010000:00020000:1.0:1767320415.195460:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320415.195504:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380006784:12345-0@lo:38:kworker.0 Request processed in 669us (1966us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320415.195511:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17742
00000100:00080000:0.0:1767320415.195572:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320415.195577:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320415.195580:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380006784:0@lo:38:kworker.0
00010000:00010000:2.0:1767320415.767340:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320416.144496:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320416.144546:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320416.144626:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291972608
00000100:00100000:0.0:1767320416.144635:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291972608
00000100:00100000:0.0:1767320416.144724:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291972480
00000100:00100000:0.0:1767320416.144728:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291972480
00000100:00100000:0.0:1767320416.144753:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4831
00000100:00100000:0.0:1767320416.144765:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291972608:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320416.144846:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291972608:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320416.144855:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4831
00000100:00100000:0.0:1767320416.144923:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17745
00000100:00100000:0.0:1767320416.144928:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291972480:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320416.144949:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320416.144979:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291972480:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 48us (431us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320416.144986:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17745
00000100:00080000:2.0:1767320416.145789:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767320416.148907:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291972736 offset 0 length 520: 4
00010000:00010000:1.0:1767320416.791106:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320417.239404:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320417.239425:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007808:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320417.239497:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320417.240215:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007808
00000100:00100000:3.0:1767320417.240230:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007808
00000100:00100000:3.0:1767320417.240351:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668
00000100:00100000:3.0:1767320417.240362:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320417.240408:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320417.240474:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (978us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320417.240481:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668
00000100:00100000:1.0:1767320417.240574:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007808:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320417.244840:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320417.817721:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320418.776565:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007936:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320418.776653:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320418.776894:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380007936
00000100:00100000:0.0:1767320418.776903:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380007936
00000100:00100000:0.0:1767320418.776986:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669
00000100:00100000:0.0:1767320418.776996:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320418.777025:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320418.777076:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380007936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (423us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320418.777083:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669
00000100:00080000:1.0:1767320418.777236:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320418.777510:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380007936:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320418.842387:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320419.287761:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320394/real 1767320394]  req@ffff8b0e0bef4a80 x1853164380002560/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320419.287792:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0bef4a80 x1853164380002560/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320419.287903:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320419.287926:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320419.287930:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380002560:0@lo:250:kworker.0
00000100:00080000:1.0:1767320419.288006:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320419.288012:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320419.288015:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320419.288020:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5297
00000100:00080000:1.0:1767320419.288024:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320419.288031:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320419.288060:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a8380 x1853164380008064/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320419.288085:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320419.288089:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320419.288091:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320419.288094:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5317
00000100:00080000:1.0:1767320419.288097:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320419.288100:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320419.288115:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ab480 x1853164380008192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320419.288124:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320419.288127:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320419.288129:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320419.288132:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5317
00000100:00080000:1.0:1767320419.288135:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320419.288139:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320419.288150:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a8e00 x1853164380008320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320419.288179:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320419.288182:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320419.288184:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320419.288187:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5317
00000100:00080000:1.0:1767320419.288189:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320419.288192:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320419.288202:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9880 x1853164380008704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320419.288243:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320419.288257:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320419.288259:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320419.288262:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5317
00000100:00080000:1.0:1767320419.288264:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320419.288269:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320419.288280:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9180 x1853164380008960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320419.288304:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380008832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320419.288674:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320419.289921:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380008064:0@lo:250:kworker.0
00000400:00000100:0.0:1767320419.289968:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380008064 offset 0 length 520: 4
00000100:00100000:0.0:1767320419.289998:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380008192:0@lo:38:kworker.0
00000100:00100000:0.0:1767320419.290026:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320419.290048:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380008320:0@lo:38:kworker.0
00000100:00100000:0.0:1767320419.290070:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320419.290098:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380008704:0@lo:38:kworker.0
00000100:00100000:0.0:1767320419.290117:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320419.290133:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380008960:0@lo:38:kworker.0
00000100:00100000:0.0:1767320419.290150:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320419.290194:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380008832
00000100:00100000:0.0:1767320419.290203:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380008832
00000100:00100000:0.0:1767320419.290280:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380008192
00000100:00100000:0.0:1767320419.290283:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380008192
00000100:00100000:0.0:1767320419.290297:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380008704
00000100:00100000:0.0:1767320419.290300:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380008704
00000100:00100000:0.0:1767320419.290307:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380008960
00000100:00100000:0.0:1767320419.290309:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380008960
00000100:00100000:0.0:1767320419.290320:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4832
00000100:00100000:0.0:1767320419.290328:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380008832:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320419.290706:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380008448:0@lo:400:kworker.0
00000100:00100000:3.0:1767320419.290749:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320419.290778:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320419.290785:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380008576:0@lo:400:kworker.0
00000100:00100000:3.0:1767320419.290806:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320419.291575:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380008576
00000100:00100000:3.0:1767320419.291584:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380008576
00000100:00100000:3.0:1767320419.291623:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4833
00000100:00100000:3.0:1767320419.291631:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380008576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320419.292072:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17746
00000100:00100000:1.0:1767320419.292079:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380008192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320419.292103:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320419.292170:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380008192:12345-0@lo:38:kworker.0 Request processed in 89us (2141us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320419.292178:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17746
00000100:00100000:1.0:1767320419.292201:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17747
00000100:00100000:1.0:1767320419.292206:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380008704:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320419.292235:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320419.292266:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380008704:12345-0@lo:38:kworker.0 Request processed in 59us (2148us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320419.292272:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17747
00000100:00100000:1.0:1767320419.292282:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17748
00000100:00100000:1.0:1767320419.292286:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380008960:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320419.292295:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320419.292317:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380008960:12345-0@lo:38:kworker.0 Request processed in 30us (2166us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320419.292323:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17748
00000100:00100000:2.0:1767320419.292489:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380008320
00000100:00100000:2.0:1767320419.292495:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380008320
00000100:00100000:2.0:1767320419.292523:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176
00000100:00100000:2.0:1767320419.292528:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380008320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320419.292538:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320419.292574:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380008320:12345-0@lo:38:kworker.0 Request processed in 45us (2503us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320419.292581:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176
00000100:00100000:2.0:1767320419.292768:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380008448
00000100:00100000:2.0:1767320419.292773:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380008448
00000100:00100000:0.0:1767320419.292970:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380008832:12345-0@lo:400:kworker.0 Request processed in 2641us (4295us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320419.292979:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4832
00000100:00080000:0.0:1767320419.293008:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320419.293012:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320419.293079:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380008832:0@lo:400:kworker.0
00000100:00100000:0.0:1767320419.293121:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869
00000100:00100000:0.0:1767320419.293129:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380008448:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320419.293168:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380008448:12345-0@lo:400:kworker.0 Request processed in 41us (2418us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320419.293175:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869
00000100:00100000:0.0:1767320419.293210:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380008448:0@lo:400:kworker.0
00000100:00100000:3.0:1767320419.293608:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380008576:12345-0@lo:400:kworker.0 Request processed in 1976us (2799us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320419.293617:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4833
00000100:00080000:1.0:1767320419.295158:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320419.295170:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320419.295175:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380008192:0@lo:38:kworker.0
00000100:00080000:1.0:1767320419.295190:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320419.295193:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320419.295196:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380008320:0@lo:38:kworker.0
00000100:00080000:1.0:1767320419.295207:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320419.295211:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320419.295214:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380008704:0@lo:38:kworker.0
00000100:00080000:1.0:1767320419.295224:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320419.295227:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320419.295229:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380008960:0@lo:38:kworker.0
00000100:00100000:0.0:1767320419.295961:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380008576:0@lo:400:kworker.0
00010000:00010000:2.0:1767320419.863240:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320420.887958:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320421.266045:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320421.266092:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320421.266178:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291972992
00000100:00100000:3.0:1767320421.266190:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291972992
00000100:00100000:3.0:1767320421.266306:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291972864
00000100:00100000:3.0:1767320421.266310:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291972864
00000100:00080000:1.0:1767320421.266369:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320421.270570:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4834
00000100:00100000:0.0:1767320421.270604:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291972992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320421.270765:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291972992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 180us (4732us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320421.270774:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4834
00000100:00100000:0.0:1767320421.270810:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17749
00000100:00100000:0.0:1767320421.270816:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291972864:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320421.270839:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320421.270889:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291972864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (4777us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320421.270896:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17749
00010000:00010000:2.0:1767320421.911165:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320422.359288:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380009088:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320422.359367:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320422.359486:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009088
00000100:00100000:0.0:1767320422.359495:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009088
00000100:00100000:0.0:1767320422.359560:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670
00000100:00100000:0.0:1767320422.359570:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380009088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320422.359599:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767320422.359693:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320422.360263:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380009088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 692us (893us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320422.360272:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670
00000100:00100000:2.0:1767320422.360461:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380009088:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320422.936979:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320423.898118:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380009216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320423.898188:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320423.898319:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009216
00000100:00100000:0.0:1767320423.898329:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009216
00000100:00100000:0.0:1767320423.898418:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671
00000100:00100000:0.0:1767320423.898430:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380009216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320423.898460:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767320423.898577:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320423.900424:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380009216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1991us (2229us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320423.900438:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671
00000100:00100000:3.0:1767320423.903655:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380009216:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320423.959088:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320424.407150:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320424.407161:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320424.407164:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320424.407168:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320424.407172:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320424.407180:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5321
00000100:00080000:3.0:1767320424.407185:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320424.407192:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320424.407234:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f289180 x1853164380009344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320424.407295:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380009344:0@lo:38:kworker.0
00000100:00100000:1.0:1767320424.407365:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320424.407505:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009344
00000100:00100000:0.0:1767320424.407513:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009344
00000100:00100000:0.0:1767320424.407553:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17750
00000100:00100000:0.0:1767320424.407560:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380009344:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320424.407581:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320424.408158:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320424.408163:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320424.408165:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320424.408170:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5321
00000100:00080000:3.0:1767320424.408173:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320424.408177:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320424.408194:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f288380 x1853164380009472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320424.408903:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380009472:0@lo:38:kworker.0
00000100:00100000:1.0:1767320424.408948:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320424.409094:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380009344:12345-0@lo:38:kworker.0 Request processed in 1531us (1728us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320424.409105:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17750
00000100:00100000:2.0:1767320424.409388:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009472
00000100:00100000:2.0:1767320424.409395:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009472
00000100:00100000:2.0:1767320424.409431:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177
00000100:00100000:2.0:1767320424.409439:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380009472:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320424.409456:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320424.409493:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380009472:12345-0@lo:38:kworker.0 Request processed in 54us (545us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320424.409627:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177
00000100:00080000:3.0:1767320424.409750:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320424.409754:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320424.409757:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320424.409762:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5321
00000100:00080000:3.0:1767320424.409765:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320424.409770:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320424.409786:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edf80 x1853164380009856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320424.409804:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320424.409807:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320424.409809:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320424.409813:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5321
00000100:00080000:3.0:1767320424.409815:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320424.409819:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320424.409830:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edc00 x1853164380010112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320424.409855:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380009984:0@lo:400:kworker.0
00000100:00100000:3.0:1767320424.409906:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320424.409935:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320424.409940:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380009728:0@lo:400:kworker.0
00000100:00100000:3.0:1767320424.409960:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320424.409987:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009984
00000100:00100000:3.0:1767320424.409991:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009984
00000100:00100000:3.0:1767320424.410032:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009728
00000100:00100000:3.0:1767320424.410035:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009728
00000100:00100000:3.0:1767320424.410058:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4835
00000100:00100000:3.0:1767320424.410064:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380009984:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320424.410108:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380009984:12345-0@lo:400:kworker.0 Request processed in 45us (201us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320424.410124:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4835
00000100:00100000:3.0:1767320424.410137:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4836
00000100:00100000:3.0:1767320424.410144:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380009728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320424.410172:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380009728:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320424.410177:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4836
00000100:00080000:3.0:1767320424.410196:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320424.410225:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380009728:0@lo:400:kworker.0
00000100:00100000:3.0:1767320424.410236:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380009984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320424.410325:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380009600:0@lo:400:kworker.0
00000100:00100000:0.0:1767320424.410357:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320424.410570:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009600
00000100:00100000:3.0:1767320424.410575:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009600
00000100:00100000:3.0:1767320424.410747:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870
00000100:00100000:3.0:1767320424.410755:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380009600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320424.410795:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380009600:12345-0@lo:400:kworker.0 Request processed in 42us (437us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320424.410801:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870
00000100:00100000:2.0:1767320424.412126:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380009600:0@lo:400:kworker.0
00000100:00080000:1.0:1767320424.412359:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320424.412365:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320424.412369:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380009344:0@lo:38:kworker.0
00000100:00100000:1.0:1767320424.412389:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380009856:0@lo:38:kworker.0
00000100:00100000:1.0:1767320424.412434:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320424.412516:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380010112:0@lo:38:kworker.0
00000100:00100000:1.0:1767320424.412539:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320424.412588:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320424.412968:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320424.412973:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320424.412977:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380009472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320424.413088:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380009856
00000100:00100000:2.0:1767320424.413094:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380009856
00000100:00100000:2.0:1767320424.413137:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380010112
00000100:00100000:2.0:1767320424.413141:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380010112
00000100:00100000:2.0:1767320424.413167:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17751
00000100:00100000:2.0:1767320424.413173:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380009856:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320424.413194:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320424.413238:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380009856:12345-0@lo:38:kworker.0 Request processed in 64us (803us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320424.413245:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17751
00000100:00100000:2.0:1767320424.413260:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17752
00000100:00100000:2.0:1767320424.413264:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380010112:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320424.413273:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320424.413293:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380010112:12345-0@lo:38:kworker.0 Request processed in 28us (754us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320424.413299:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17752
00000100:00080000:1.0:1767320424.413450:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320424.413455:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320424.413459:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380009856:0@lo:38:kworker.0
00000100:00080000:1.0:1767320424.413467:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320424.413470:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320424.413473:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380010112:0@lo:38:kworker.0
00010000:00010000:2.0:1767320424.983202:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320426.007111:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320426.383565:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320426.383619:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320426.383702:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291973120
00000100:00100000:1.0:1767320426.383720:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291973120
00000100:00100000:1.0:1767320426.383789:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291973248
00000100:00100000:1.0:1767320426.383793:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291973248
00000100:00100000:1.0:1767320426.383857:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4837
00000100:00100000:1.0:1767320426.383905:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291973248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320426.383918:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17753
00000100:00100000:3.0:1767320426.383930:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291973120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320426.383960:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320426.383994:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291973248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 125us (370us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320426.384003:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4837
00000100:00080000:2.0:1767320426.384087:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320426.385853:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291973120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1909us (2286us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320426.385885:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17753
00010000:00010000:1.0:1767320427.031138:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320427.479206:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380010240:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320427.479285:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320427.479784:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380010240
00000100:00100000:3.0:1767320427.479794:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380010240
00000100:00100000:3.0:1767320427.480022:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672
00000100:00100000:3.0:1767320427.480033:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380010240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320427.480067:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320427.480123:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380010240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (838us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320427.480129:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672
00000100:00080000:2.0:1767320427.480184:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320427.480222:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380010240:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320428.055189:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320429.016438:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380010368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320429.016512:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320429.022052:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380010368
00000100:00100000:3.0:1767320429.022069:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380010368
00000100:00100000:3.0:1767320429.022223:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673
00000100:00100000:3.0:1767320429.022233:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380010368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320429.022267:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320429.022361:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380010368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (5848us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320429.022369:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673
00000100:00100000:0.0:1767320429.022483:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380010368:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320429.031473:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320429.079176:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320429.534065:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320429.534075:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320429.534078:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320429.534082:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320429.534086:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320429.534094:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5326
00000100:00080000:1.0:1767320429.534099:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320429.534106:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320429.534148:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a8700 x1853164380010496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320429.534166:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320429.534169:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320429.534171:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320429.534175:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5326
00000100:00080000:1.0:1767320429.534178:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320429.534181:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320429.534194:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9180 x1853164380010624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320429.534251:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320429.534254:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320429.534256:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320429.534260:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5326
00000100:00080000:1.0:1767320429.534262:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320429.534266:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320429.534276:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ab100 x1853164380011008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320429.534298:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320429.534302:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320429.534303:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320429.534306:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5326
00000100:00080000:1.0:1767320429.534307:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320429.534310:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320429.534319:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9f80 x1853164380011264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320429.534463:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380010752:0@lo:400:kworker.0
00000100:00100000:3.0:1767320429.534529:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320429.534632:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320429.534640:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380010880:0@lo:400:kworker.0
00000100:00100000:3.0:1767320429.534667:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320429.534701:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380010880
00000100:00100000:3.0:1767320429.534709:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380010880
00000100:00100000:3.0:1767320429.534760:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4838
00000100:00100000:3.0:1767320429.534769:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380010880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320429.534818:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380010880:12345-0@lo:400:kworker.0 Request processed in 51us (150us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320429.534826:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4838
00000100:00100000:3.0:1767320429.534889:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380010880:0@lo:400:kworker.0
00000100:00100000:1.0:1767320429.535133:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380010752
00000100:00100000:1.0:1767320429.535138:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380010752
00000100:00100000:1.0:1767320429.535177:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871
00000100:00100000:1.0:1767320429.535185:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380010752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320429.535224:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380010752:12345-0@lo:400:kworker.0 Request processed in 39us (692us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320429.535230:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871
00000100:00080000:2.0:1767320429.535301:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320429.535305:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320429.535315:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380011136:0@lo:400:kworker.0
00000100:00100000:2.0:1767320429.535346:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320429.535403:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380010496:0@lo:38:kworker.0
00000100:00100000:2.0:1767320429.535429:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320429.535448:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380010624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320429.535725:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011136
00000100:00100000:1.0:1767320429.535730:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011136
00000100:00100000:1.0:1767320429.535764:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380010496
00000100:00100000:1.0:1767320429.535768:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380010496
00000100:00100000:1.0:1767320429.535783:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4839
00000100:00100000:1.0:1767320429.535790:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380011136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320429.535826:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380011136:12345-0@lo:400:kworker.0 Request processed in 36us (479us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320429.535832:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4839
00000100:00100000:1.0:1767320429.535845:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17754
00000100:00100000:1.0:1767320429.535849:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380010496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320429.535866:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320429.535925:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380010496:12345-0@lo:38:kworker.0 Request processed in 74us (495us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320429.535932:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17754
00000100:00080000:1.0:1767320429.535973:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320429.535999:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380011136:0@lo:400:kworker.0
00000100:00100000:2.0:1767320429.536197:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320429.536235:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380011008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320429.536260:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320429.536280:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011008
00000100:00100000:2.0:1767320429.536284:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011008
00000100:00100000:2.0:1767320429.536307:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17755
00000100:00100000:2.0:1767320429.536311:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380011008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320429.536322:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320429.536348:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380011008:12345-0@lo:38:kworker.0 Request processed in 36us (87us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320429.536355:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17755
00000100:00080000:2.0:1767320429.536393:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320429.536398:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320429.536402:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380011008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320429.536408:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380011264:0@lo:38:kworker.0
00000100:00100000:2.0:1767320429.536431:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320429.536459:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320429.536464:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320429.536467:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380010496:0@lo:38:kworker.0
00000100:00100000:2.0:1767320429.536708:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011264
00000100:00100000:2.0:1767320429.536712:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011264
00000100:00100000:2.0:1767320429.536732:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17756
00000100:00100000:2.0:1767320429.536736:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380011264:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320429.536747:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320429.536776:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380011264:12345-0@lo:38:kworker.0 Request processed in 37us (343us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320429.536781:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17756
00000100:00080000:2.0:1767320429.536801:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320429.536805:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320429.536807:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380011264:0@lo:38:kworker.0
00000100:00100000:1.0:1767320429.539445:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380010624
00000100:00100000:1.0:1767320429.539457:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380010624
00000100:00100000:1.0:1767320429.539515:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178
00000100:00100000:1.0:1767320429.539521:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380010624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320429.539538:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320429.539623:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380010624:12345-0@lo:38:kworker.0 Request processed in 101us (3425us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320429.539630:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178
00000100:00100000:3.0:1767320429.539747:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380010752:0@lo:400:kworker.0
00000100:00080000:2.0:1767320429.540096:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320429.540102:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320429.540105:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380010624:0@lo:38:kworker.0
00010000:00010000:1.0:1767320430.103625:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320431.132296:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320431.503622:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320431.503707:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320431.503744:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291973504
00000100:00100000:0.0:1767320431.503763:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291973504
00000100:00100000:0.0:1767320431.503856:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291973376
00000100:00100000:0.0:1767320431.503861:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291973376
00000100:00100000:0.0:1767320431.503927:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4840
00000100:00100000:0.0:1767320431.503939:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291973504:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320431.504020:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291973504:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (414us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320431.504028:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4840
00000100:00100000:0.0:1767320431.504050:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17757
00000100:00100000:0.0:1767320431.504055:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291973376:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320431.504074:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320431.504099:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291973376:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (397us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320431.504105:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17757
00000100:00080000:2.0:1767320431.504315:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320432.151108:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320432.603827:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380011392:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320432.603933:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320432.604053:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011392
00000100:00100000:0.0:1767320432.604062:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011392
00000100:00100000:0.0:1767320432.604122:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674
00000100:00100000:0.0:1767320432.604130:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380011392:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320432.604154:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320432.604187:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380011392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (255us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320432.604192:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674
00000100:00080000:1.0:1767320432.604371:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320432.604410:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380011392:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320433.175148:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320434.137245:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320434.137289:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380011520:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320434.137371:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320434.137810:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011520
00000100:00100000:1.0:1767320434.137819:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011520
00000100:00100000:1.0:1767320434.137915:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675
00000100:00100000:1.0:1767320434.137925:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380011520:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320434.137954:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320434.138010:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380011520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (638us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320434.138017:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675
00000100:00080000:2.0:1767320434.138081:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320434.138158:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380011520:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320434.199550:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320434.647093:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320434.647105:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320434.647109:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320434.647113:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320434.647117:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320434.647125:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5331
00000100:00080000:3.0:1767320434.647130:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320434.647136:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320434.647174:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef800 x1853164380011648/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320434.647198:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320434.647202:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320434.647204:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320434.647208:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5331
00000100:00080000:3.0:1767320434.647210:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320434.647213:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320434.647225:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eed80 x1853164380011776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320434.647296:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380011904:0@lo:400:kworker.0
00000100:00100000:0.0:1767320434.647373:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320434.647473:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011904
00000100:00100000:1.0:1767320434.647480:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011904
00000100:00100000:1.0:1767320434.647560:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872
00000100:00100000:1.0:1767320434.647570:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380011904:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767320434.647596:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320434.647599:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320434.647602:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320434.647605:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5331
00000100:00080000:3.0:1767320434.647608:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320434.647611:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320434.647622:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eca80 x1853164380012288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320434.647701:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380011648:0@lo:38:kworker.0
00000100:00100000:2.0:1767320434.647737:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320434.647761:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380011776:0@lo:38:kworker.0
00000100:00100000:2.0:1767320434.647785:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320434.647822:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011648
00000100:00100000:2.0:1767320434.647826:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011648
00000100:00100000:2.0:1767320434.647850:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17758
00000100:00100000:2.0:1767320434.647856:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380011648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320434.647896:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320434.647932:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380011648:12345-0@lo:38:kworker.0 Request processed in 75us (194us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320434.647938:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17758
00000100:00080000:2.0:1767320434.647971:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320434.647975:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320434.647978:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380011648:0@lo:38:kworker.0
00000100:00080000:2.0:1767320434.648027:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320434.648039:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380012032:0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648063:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320434.648080:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320434.648085:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380012160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648103:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320434.648121:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012032
00000100:00100000:2.0:1767320434.648125:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012032
00000100:00100000:2.0:1767320434.648147:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873
00000100:00100000:2.0:1767320434.648152:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380012032:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648337:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380012032:12345-0@lo:400:kworker.0 Request processed in 183us (272us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320434.648345:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873
00000100:00100000:2.0:1767320434.648376:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380012032:0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648391:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012160
00000100:00100000:2.0:1767320434.648394:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012160
00000100:00100000:2.0:1767320434.648423:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4841
00000100:00100000:2.0:1767320434.648429:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380012160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648461:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380012160:12345-0@lo:400:kworker.0 Request processed in 32us (357us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320434.648466:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4841
00000100:00080000:2.0:1767320434.648483:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320434.648498:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380012160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648539:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380012288:0@lo:38:kworker.0
00000100:00100000:2.0:1767320434.648564:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320434.648587:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012288
00000100:00100000:2.0:1767320434.648591:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012288
00000100:00100000:2.0:1767320434.648609:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17759
00000100:00100000:2.0:1767320434.648614:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380012288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320434.648626:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320434.648630:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380011904:12345-0@lo:400:kworker.0 Request processed in 1062us (1258us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320434.648638:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872
00000100:00100000:2.0:1767320434.648655:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380012288:12345-0@lo:38:kworker.0 Request processed in 39us (91us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320434.648661:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17759
00000100:00100000:1.0:1767320434.648676:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380011776
00000100:00100000:1.0:1767320434.648679:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380011776
00000100:00080000:2.0:1767320434.648680:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320434.648684:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320434.648687:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380012288:0@lo:38:kworker.0
00000100:00100000:2.0:1767320434.648708:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380012416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648734:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320434.648759:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012416
00000100:00100000:2.0:1767320434.648763:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012416
00000100:00100000:2.0:1767320434.648788:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4842
00000100:00100000:2.0:1767320434.648794:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380012416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320434.648824:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380012416:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320434.648830:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4842
00000100:00080000:2.0:1767320434.648843:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320434.648859:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380012416:0@lo:400:kworker.0
00000100:00100000:1.0:1767320434.648913:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179
00000100:00100000:1.0:1767320434.648927:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380011776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320434.648938:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320434.648976:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380011776:12345-0@lo:38:kworker.0 Request processed in 48us (1190us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320434.648981:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179
00000100:00080000:2.0:1767320434.649635:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320434.649641:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320434.649645:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380011776:0@lo:38:kworker.0
00000100:00100000:0.0:1767320434.652105:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380011904:0@lo:400:kworker.0
00000100:00080000:3.0:1767320434.652615:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320434.652621:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320434.652625:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320434.652630:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5331
00000100:00080000:3.0:1767320434.652634:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320434.652640:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320434.652677:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edf80 x1853164380012544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320434.654756:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380012544:0@lo:38:kworker.0
00000100:00100000:2.0:1767320434.654831:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320434.655695:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012544
00000100:00100000:3.0:1767320434.655704:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012544
00000100:00100000:3.0:1767320434.655757:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17760
00000100:00100000:3.0:1767320434.655765:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380012544:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320434.655789:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320434.655856:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380012544:12345-0@lo:38:kworker.0 Request processed in 90us (1024us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320434.655862:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17760
00000100:00080000:0.0:1767320434.655924:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320434.655936:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320434.655944:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380012544:0@lo:38:kworker.0
00010000:00010000:3.0:1767320435.223282:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320436.247364:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320436.624653:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320436.624704:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320436.624914:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291973632
00000100:00100000:0.0:1767320436.624927:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291973632
00000100:00100000:0.0:1767320436.624979:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291973760
00000100:00100000:0.0:1767320436.624983:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291973760
00000100:00100000:0.0:1767320436.625052:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4843
00000100:00100000:0.0:1767320436.625063:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291973760:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320436.625101:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17761
00000100:00100000:0.0:1767320436.625144:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291973760:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (437us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320436.625152:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4843
00000100:00100000:1.0:1767320436.625204:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291973632:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320436.625229:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320436.625260:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291973632:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 151us (622us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320436.625266:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17761
00000100:00080000:2.0:1767320436.625667:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320437.271216:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320437.719472:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320437.720908:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380012672:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320437.720979:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320437.723736:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012672
00000100:00100000:0.0:1767320437.723751:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012672
00000100:00100000:0.0:1767320437.723896:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676
00000100:00100000:0.0:1767320437.723907:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380012672:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320437.723940:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320437.724170:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380012672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 265us (3190us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320437.724179:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676
00000100:00100000:3.0:1767320437.724338:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380012672:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320437.724532:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320438.297320:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320439.255202:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380012800:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320439.255276:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320439.255432:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012800
00000100:00100000:0.0:1767320439.255443:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012800
00000100:00080000:3.0:1767320439.255543:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320439.255555:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677
00000100:00100000:0.0:1767320439.255567:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380012800:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320439.255599:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320439.258174:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380012800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2600us (2887us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320439.258193:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677
00000100:00100000:2.0:1767320439.262654:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380012800:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320439.321169:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320439.767304:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320439.767316:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320439.767319:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320439.767323:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320439.767328:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320439.767336:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5337
00000100:00080000:2.0:1767320439.767340:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320439.767347:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320439.767387:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44e00 x1853164380012928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320439.767413:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320439.767416:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320439.767418:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320439.767422:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5337
00000100:00080000:2.0:1767320439.767424:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320439.767428:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320439.767453:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164380013056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320439.767539:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320439.767543:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320439.767545:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320439.767549:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5337
00000100:00080000:2.0:1767320439.767551:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320439.767555:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320439.767567:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46680 x1853164380013568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320439.767583:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320439.767587:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320439.767589:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320439.767592:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5337
00000100:00080000:2.0:1767320439.767595:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320439.767599:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320439.767608:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45180 x1853164380013824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320439.767643:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380013440:0@lo:400:kworker.0
00000100:00100000:2.0:1767320439.767714:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320439.767781:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320439.767786:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380013312:0@lo:400:kworker.0
00000100:00100000:2.0:1767320439.767812:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320439.767981:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380013184:0@lo:400:kworker.0
00000100:00100000:3.0:1767320439.768012:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320439.768042:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320439.768047:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380013696:0@lo:400:kworker.0
00000100:00100000:3.0:1767320439.768071:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320439.768103:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013440
00000100:00100000:3.0:1767320439.768110:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013440
00000100:00100000:3.0:1767320439.768160:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013696
00000100:00100000:3.0:1767320439.768164:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013696
00000100:00100000:3.0:1767320439.768193:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4844
00000100:00100000:3.0:1767320439.768201:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380013440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320439.768255:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380013440:12345-0@lo:400:kworker.0 Request processed in 54us (540us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320439.768262:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4844
00000100:00100000:3.0:1767320439.768279:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4845
00000100:00100000:3.0:1767320439.768285:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380013696:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320439.768316:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380013696:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320439.768321:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4845
00000100:00080000:3.0:1767320439.768339:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320439.768379:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380013696:0@lo:400:kworker.0
00000100:00100000:3.0:1767320439.768406:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380013440:0@lo:400:kworker.0
00000100:00100000:1.0:1767320439.768933:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013312
00000100:00100000:1.0:1767320439.768939:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013312
00000100:00100000:1.0:1767320439.768970:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013184
00000100:00100000:1.0:1767320439.768974:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013184
00000100:00100000:1.0:1767320439.769004:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874
00000100:00100000:1.0:1767320439.769011:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380013312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320439.769060:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380013312:12345-0@lo:400:kworker.0 Request processed in 49us (1246us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320439.769066:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874
00000100:00100000:1.0:1767320439.769083:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875
00000100:00100000:1.0:1767320439.769089:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380013184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320439.769125:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380013184:12345-0@lo:400:kworker.0 Request processed in 36us (1112us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320439.769131:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875
00000100:00080000:1.0:1767320439.769150:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320439.769174:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380013184:0@lo:400:kworker.0
00000100:00100000:1.0:1767320439.769201:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380013312:0@lo:400:kworker.0
00000100:00100000:0.0:1767320439.769398:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380012928:0@lo:38:kworker.0
00000100:00100000:0.0:1767320439.769435:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320439.769480:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380013056:0@lo:38:kworker.0
00000100:00100000:0.0:1767320439.769505:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320439.769538:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380013568:0@lo:38:kworker.0
00000100:00100000:0.0:1767320439.769558:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320439.769575:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380013824:0@lo:38:kworker.0
00000100:00100000:0.0:1767320439.769596:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320439.769626:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380012928
00000100:00100000:0.0:1767320439.769630:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380012928
00000100:00100000:0.0:1767320439.769651:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013568
00000100:00100000:0.0:1767320439.769653:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013568
00000100:00100000:0.0:1767320439.769663:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013824
00000100:00100000:0.0:1767320439.769666:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013824
00000100:00100000:0.0:1767320439.769677:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17762
00000100:00100000:0.0:1767320439.769682:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380012928:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320439.769700:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320439.769734:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380012928:12345-0@lo:38:kworker.0 Request processed in 51us (299us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320439.769741:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17762
00000100:00100000:0.0:1767320439.769755:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17763
00000100:00100000:0.0:1767320439.769759:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380013568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320439.769768:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320439.769789:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380013568:12345-0@lo:38:kworker.0 Request processed in 29us (230us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320439.769796:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17763
00000100:00100000:0.0:1767320439.769806:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17764
00000100:00100000:0.0:1767320439.769809:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380013824:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320439.769818:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320439.769838:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380013824:12345-0@lo:38:kworker.0 Request processed in 27us (240us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320439.769843:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17764
00000100:00100000:2.0:1767320439.769940:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013056
00000100:00100000:2.0:1767320439.769945:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013056
00000100:00100000:2.0:1767320439.769968:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180
00000100:00100000:2.0:1767320439.769973:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380013056:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320439.769983:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320439.770013:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380013056:12345-0@lo:38:kworker.0 Request processed in 39us (507us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320439.770018:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180
00000100:00080000:2.0:1767320439.776586:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320439.776598:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320439.776603:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380012928:0@lo:38:kworker.0
00000100:00080000:2.0:1767320439.776618:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320439.776622:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320439.776625:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380013056:0@lo:38:kworker.0
00000100:00080000:2.0:1767320439.776635:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320439.776639:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320439.776642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380013568:0@lo:38:kworker.0
00000100:00080000:2.0:1767320439.776652:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320439.776656:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320439.776659:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380013824:0@lo:38:kworker.0
00010000:00010000:2.0:1767320440.343235:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320440.719349:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767320440.719556:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291973888 offset 0 length 520: 4
00000100:00100000:3.0:1767320440.719576:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320440.725001:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974144
00000100:00100000:1.0:1767320440.725016:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974144
00000100:00080000:3.0:1767320440.725166:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320440.725289:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974016
00000100:00100000:1.0:1767320440.725294:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974016
00000100:00100000:0.0:1767320440.726066:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4846
00000100:00100000:0.0:1767320440.726081:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291974144:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320440.726169:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291974144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 94us (6829us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320440.726177:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4846
00000100:00100000:0.0:1767320440.726204:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17765
00000100:00100000:0.0:1767320440.726208:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291974016:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320440.726228:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320440.726250:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291974016:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (6672us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320440.726256:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17765
00010000:00010000:2.0:1767320441.367510:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320442.392321:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320442.839340:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320442.839358:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380013952:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320442.839431:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320442.839714:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380013952
00000100:00100000:0.0:1767320442.839722:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380013952
00000100:00100000:0.0:1767320442.839841:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678
00000100:00100000:0.0:1767320442.839851:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380013952:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320442.839901:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320442.839948:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380013952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (516us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320442.839956:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678
00000100:00100000:2.0:1767320442.840084:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380013952:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320442.840138:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767320443.415180:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320444.375106:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320444.381051:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380014080:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320444.381129:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320444.381986:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380014080
00000100:00100000:3.0:1767320444.381997:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380014080
00000100:00100000:3.0:1767320444.382074:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679
00000100:00100000:3.0:1767320444.382086:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380014080:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320444.382117:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320444.382201:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380014080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (1072us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320444.382209:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679
00000100:00080000:0.0:1767320444.382846:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320444.382996:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380014080:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320444.440092:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320444.886992:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320419/real 1767320419]  req@ffff8b0f380a8380 x1853164380008064/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320444 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320444.887026:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f380a8380 x1853164380008064/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320444 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320444.887045:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320444.887064:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320444.887068:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380008064:0@lo:250:kworker.0
00000100:00080000:2.0:1767320444.887187:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320444.887192:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320444.887195:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320444.887200:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5321
00000100:00080000:2.0:1767320444.887204:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320444.887209:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320444.887241:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46680 x1853164380014208/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320444.887274:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320444.887277:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320444.887279:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320444.887282:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320444.887284:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320444.887287:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320444.887299:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164380014336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320444.887316:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320444.887320:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320444.887321:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767320444.887463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380014208:0@lo:250:kworker.0
00000400:00000100:1.0:1767320444.887516:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380014208 offset 0 length 520: 4
00000100:00100000:1.0:1767320444.887560:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380014336:0@lo:38:kworker.0
00000100:00100000:1.0:1767320444.887589:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320444.887665:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320444.887668:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320444.887672:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320444.887688:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44e00 x1853164380014464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320444.887746:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320444.887749:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320444.887751:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320444.887755:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320444.887757:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320444.887760:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320444.887770:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46a00 x1853164380014976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320444.887784:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320444.887787:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320444.887788:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320444.887791:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5342
00000100:00080000:2.0:1767320444.887794:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320444.887797:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320444.887809:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebf800 x1853164380015232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320444.887829:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380015104:0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.887857:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320444.887902:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320444.887912:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380014592:0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.887938:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320444.887944:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380014720:0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.887960:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380014848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320444.887973:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320444.887980:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320444.888006:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380015104
00000100:00100000:2.0:1767320444.888006:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380014336
00000100:00100000:0.0:1767320444.888013:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380015104
00000100:00100000:2.0:1767320444.888013:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380014336
00000100:00100000:2.0:1767320444.888041:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380014848
00000100:00100000:2.0:1767320444.888043:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380014848
00000100:00100000:0.0:1767320444.888055:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4847
00000100:00100000:0.0:1767320444.888063:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380015104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320444.888115:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380015104:12345-0@lo:400:kworker.0 Request processed in 53us (256us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320444.888141:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380014464:0@lo:38:kworker.0
00000100:00100000:1.0:1767320444.888169:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320444.888188:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380014976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320444.888205:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320444.888220:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380015232:0@lo:38:kworker.0
00000100:00100000:1.0:1767320444.888236:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320444.888269:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320444.888289:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380014976
00000100:00100000:1.0:1767320444.888293:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380014976
00000100:00100000:2.0:1767320444.888336:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380015232
00000100:00100000:2.0:1767320444.888340:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380015232
00000100:00100000:2.0:1767320444.888354:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4848
00000100:00100000:2.0:1767320444.888361:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380014848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.888396:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380014848:12345-0@lo:400:kworker.0 Request processed in 36us (415us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320444.888404:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4848
00000100:00100000:2.0:1767320444.888420:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17766
00000100:00100000:2.0:1767320444.888433:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380014336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320444.888450:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320444.888484:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380014336:12345-0@lo:38:kworker.0 Request processed in 49us (894us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320444.888489:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17766
00000100:00100000:2.0:1767320444.888501:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17767
00000100:00100000:2.0:1767320444.888506:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380015232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320444.888514:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320444.888536:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380015232:12345-0@lo:38:kworker.0 Request processed in 29us (299us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320444.888541:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17767
00000100:00100000:2.0:1767320444.888561:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380014592
00000100:00100000:2.0:1767320444.888564:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380014592
00000100:00100000:2.0:1767320444.888593:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380014720
00000100:00100000:2.0:1767320444.888596:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380014720
00000100:00100000:2.0:1767320444.888612:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876
00000100:00100000:2.0:1767320444.888618:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380014592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.888646:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380014592:12345-0@lo:400:kworker.0 Request processed in 28us (707us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320444.888652:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876
00000100:00100000:2.0:1767320444.888661:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877
00000100:00100000:2.0:1767320444.888666:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380014720:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.888699:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380014720:12345-0@lo:400:kworker.0 Request processed in 33us (725us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320444.888705:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877
00000100:00100000:2.0:1767320444.888725:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380014464
00000100:00100000:2.0:1767320444.888729:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380014464
00000100:00100000:2.0:1767320444.888745:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181
00000100:00100000:2.0:1767320444.888749:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380014464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320444.888758:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320444.888782:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380014464:12345-0@lo:38:kworker.0 Request processed in 32us (612us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320444.888787:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181
00000100:00100000:2.0:1767320444.888822:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380014848:0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.888847:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380014592:0@lo:400:kworker.0
00000100:00100000:2.0:1767320444.888856:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380015104:0@lo:400:kworker.0
00000100:00080000:2.0:1767320444.888921:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320444.888939:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320444.888944:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320444.888946:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380014464:0@lo:38:kworker.0
00000100:00080000:2.0:1767320444.888954:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320444.888956:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320444.888959:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380015232:0@lo:38:kworker.0
00000100:00080000:2.0:1767320444.888967:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320444.888970:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320444.888972:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380014336:0@lo:38:kworker.0
00000100:00100000:2.0:1767320444.889014:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380014720:0@lo:400:kworker.0
00000100:00100000:0.0:1767320444.892055:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4847
00000100:00100000:1.0:1767320444.892169:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17768
00000100:00100000:1.0:1767320444.892187:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380014976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320444.892211:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320444.892369:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380014976:12345-0@lo:38:kworker.0 Request processed in 181us (4161us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320444.892376:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17768
00000100:00080000:2.0:1767320444.892579:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320444.892586:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320444.892591:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380014976:0@lo:38:kworker.0
00010000:00010000:2.0:1767320445.463346:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320445.839990:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320445.840037:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320445.840177:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974400
00000100:00100000:1.0:1767320445.840189:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974400
00000100:00100000:2.0:1767320445.840198:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974272
00000100:00100000:2.0:1767320445.840205:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974272
00000100:00100000:2.0:1767320445.840262:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4849
00000100:00100000:2.0:1767320445.840275:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291974400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767320445.840281:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320445.840382:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291974400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (404us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320445.840390:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4849
00000100:00100000:2.0:1767320445.840427:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17769
00000100:00100000:2.0:1767320445.840432:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291974272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320445.840451:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320445.840479:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291974272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (441us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320445.840497:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17769
00010000:00010000:1.0:1767320446.487211:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320447.511197:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320447.967205:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320447.967228:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380015360:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320447.967320:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320447.967391:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380015360
00000100:00100000:2.0:1767320447.967410:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380015360
00000100:00100000:2.0:1767320447.968145:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680
00000100:00100000:2.0:1767320447.968155:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380015360:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320447.968185:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320447.968303:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380015360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (995us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320447.968321:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680
00000100:00080000:3.0:1767320447.968830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320447.971612:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380015360:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320448.535119:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320449.495230:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320449.495257:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380015488:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320449.495328:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320449.495558:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380015488
00000100:00100000:3.0:1767320449.495566:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380015488
00000100:00080000:2.0:1767320449.495722:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320449.495913:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681
00000100:00100000:3.0:1767320449.495925:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380015488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320449.495954:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320449.496138:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380015488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 215us (808us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320449.496145:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681
00000100:00100000:2.0:1767320449.496234:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380015488:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320449.560585:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320450.007387:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320450.007398:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320450.007401:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320450.007404:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320450.007409:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320450.007417:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320450.007422:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320450.007430:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320450.007474:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef800 x1853164380015616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320450.007500:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320450.007503:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320450.007505:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320450.007509:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320450.007511:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320450.007515:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320450.007529:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eca80 x1853164380015744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320450.007607:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320450.007610:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320450.007612:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320450.007615:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320450.007618:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320450.007621:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320450.007630:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333480 x1853164380016256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320450.007645:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320450.007648:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320450.007650:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320450.007653:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5347
00000100:00080000:3.0:1767320450.007655:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320450.007659:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320450.007670:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332d80 x1853164380016512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320450.007696:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380016128:0@lo:400:kworker.0
00000100:00100000:3.0:1767320450.007768:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320450.007831:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320450.007837:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380016000:0@lo:400:kworker.0
00000100:00100000:3.0:1767320450.007861:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320450.007924:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016128
00000100:00100000:3.0:1767320450.007931:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016128
00000100:00100000:0.0:1767320450.008097:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380015872:0@lo:400:kworker.0
00000100:00100000:0.0:1767320450.008126:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320450.008142:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320450.008147:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380016384:0@lo:400:kworker.0
00000100:00100000:0.0:1767320450.008163:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320450.008206:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016000
00000100:00100000:2.0:1767320450.008211:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016000
00000100:00100000:2.0:1767320450.008240:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380015872
00000100:00100000:2.0:1767320450.008243:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380015872
00000100:00100000:2.0:1767320450.008266:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878
00000100:00100000:2.0:1767320450.008274:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380016000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320450.008326:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380016000:12345-0@lo:400:kworker.0 Request processed in 52us (463us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320450.008333:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878
00000100:00100000:2.0:1767320450.008349:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879
00000100:00100000:2.0:1767320450.008355:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380015872:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320450.008397:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380015872:12345-0@lo:400:kworker.0 Request processed in 42us (270us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320450.008403:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879
00000100:00100000:2.0:1767320450.008433:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380015616:0@lo:38:kworker.0
00000100:00080000:2.0:1767320450.008462:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320450.008467:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320450.008505:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380016000:0@lo:400:kworker.0
00000100:00100000:0.0:1767320450.014296:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380015872:0@lo:400:kworker.0
00000100:00100000:0.0:1767320450.014348:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320450.014474:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016384
00000100:00100000:3.0:1767320450.014482:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016384
00000100:00100000:3.0:1767320450.014545:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4850
00000100:00100000:3.0:1767320450.014553:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380016128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320450.014624:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380016128:12345-0@lo:400:kworker.0 Request processed in 72us (6857us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320450.014631:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4850
00000100:00100000:3.0:1767320450.014646:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4851
00000100:00100000:3.0:1767320450.014651:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380016384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320450.014676:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380016384:12345-0@lo:400:kworker.0 Request processed in 26us (6512us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320450.014682:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4851
00000100:00080000:3.0:1767320450.014700:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320450.014722:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380016128:0@lo:400:kworker.0
00000100:00100000:2.0:1767320450.017682:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380016384:0@lo:400:kworker.0
00000100:00100000:0.0:1767320450.018958:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380015744:0@lo:38:kworker.0
00000100:00100000:0.0:1767320450.019032:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320450.019075:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380016256:0@lo:38:kworker.0
00000100:00100000:0.0:1767320450.019101:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320450.019118:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380016512:0@lo:38:kworker.0
00000100:00100000:0.0:1767320450.019139:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320450.019282:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380015744
00000100:00100000:3.0:1767320450.019290:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380015744
00000100:00100000:3.0:1767320450.019344:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182
00000100:00100000:3.0:1767320450.019351:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380015744:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320450.019373:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320450.019428:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380015744:12345-0@lo:38:kworker.0 Request processed in 76us (395us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320450.019436:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182
00000100:00100000:3.0:1767320450.019460:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380015616
00000100:00100000:3.0:1767320450.019464:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380015616
00000100:00100000:3.0:1767320450.019483:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016256
00000100:00100000:3.0:1767320450.019485:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016256
00000100:00100000:3.0:1767320450.019497:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016512
00000100:00100000:3.0:1767320450.019499:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016512
00000100:00100000:3.0:1767320450.019509:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17770
00000100:00100000:3.0:1767320450.019513:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380015616:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320450.019523:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320450.019548:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380015616:12345-0@lo:38:kworker.0 Request processed in 33us (5201us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320450.019553:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17770
00000100:00100000:3.0:1767320450.019563:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17771
00000100:00100000:3.0:1767320450.019567:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380016256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320450.019576:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320450.019597:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380016256:12345-0@lo:38:kworker.0 Request processed in 28us (495us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320450.019602:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17771
00000100:00100000:3.0:1767320450.019612:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17772
00000100:00100000:3.0:1767320450.019616:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380016512:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320450.019623:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320450.019644:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380016512:12345-0@lo:38:kworker.0 Request processed in 27us (504us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320450.019650:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17772
00000100:00080000:0.0:1767320450.020098:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320450.020104:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320450.020108:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380015616:0@lo:38:kworker.0
00000100:00080000:0.0:1767320450.020119:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320450.020122:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320450.020124:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380015744:0@lo:38:kworker.0
00000100:00080000:0.0:1767320450.020133:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320450.020136:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320450.020139:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380016256:0@lo:38:kworker.0
00000100:00080000:0.0:1767320450.020146:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320450.020149:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320450.020152:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380016512:0@lo:38:kworker.0
00010000:00010000:1.0:1767320450.583716:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320450.958830:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320450.959390:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320450.960204:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974656
00000100:00100000:0.0:1767320450.960217:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974656
00000100:00100000:0.0:1767320450.960275:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974528
00000100:00100000:0.0:1767320450.960279:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974528
00000100:00100000:0.0:1767320450.960299:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4852
00000100:00100000:0.0:1767320450.960309:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291974656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320450.960394:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291974656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (1574us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320450.960402:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4852
00000100:00100000:0.0:1767320450.960422:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17773
00000100:00100000:0.0:1767320450.960427:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291974528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320450.960447:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320450.960475:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291974528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (1087us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320450.960482:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17773
00000100:00080000:3.0:1767320450.960645:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320451.609607:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320452.632816:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320453.081081:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320453.081099:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380016640:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320453.081185:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320453.081335:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016640
00000100:00100000:3.0:1767320453.081343:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016640
00000100:00100000:3.0:1767320453.081423:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682
00000100:00100000:3.0:1767320453.081431:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380016640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320453.081461:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320453.081509:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380016640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (323us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320453.081516:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682
00000100:00080000:1.0:1767320453.082301:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320453.082341:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380016640:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320453.655903:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320454.615698:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380016768:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320454.615774:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320454.615951:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016768
00000100:00100000:0.0:1767320454.615959:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016768
00000100:00100000:0.0:1767320454.616018:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683
00000100:00100000:0.0:1767320454.616027:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380016768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320454.616057:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320454.616109:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380016768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (335us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320454.616129:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683
00000100:00080000:1.0:1767320454.616444:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320454.616521:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380016768:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320454.679191:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320455.132882:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320455.132892:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320455.132896:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320455.132899:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320455.132903:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320455.132948:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320455.132953:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320455.132959:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320455.140009:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164380016896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320455.140049:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320455.140053:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320455.140057:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320455.140061:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320455.140066:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320455.140074:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320455.140102:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebce00 x1853164380017024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320455.140146:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380016896:0@lo:38:kworker.0
00000100:00080000:2.0:1767320455.140165:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320455.140169:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320455.140171:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320455.140174:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320455.140177:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320455.140180:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320455.140190:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44700 x1853164380017408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320455.140219:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320455.140222:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320455.140224:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320455.140227:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5352
00000100:00080000:2.0:1767320455.140229:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320455.140233:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320455.140254:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44e00 x1853164380017664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320455.140269:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320455.140291:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380017280:0@lo:400:kworker.0
00000100:00100000:2.0:1767320455.140318:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320455.140359:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380017024:0@lo:38:kworker.0
00000100:00100000:2.0:1767320455.140368:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320455.140373:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380017536:0@lo:400:kworker.0
00000100:00100000:1.0:1767320455.140427:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320455.140437:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380017152:0@lo:400:kworker.0
00000100:00100000:2.0:1767320455.141441:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320455.141534:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380016896
00000100:00100000:2.0:1767320455.141543:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380016896
00000100:00100000:2.0:1767320455.141577:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017280
00000100:00100000:2.0:1767320455.141581:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017280
00000100:00100000:2.0:1767320455.141618:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017536
00000100:00100000:2.0:1767320455.141633:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017536
00000100:00100000:2.0:1767320455.141656:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4853
00000100:00100000:2.0:1767320455.141664:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380017280:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320455.141719:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380017280:12345-0@lo:400:kworker.0 Request processed in 55us (1399us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320455.141727:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4853
00000100:00100000:2.0:1767320455.141744:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4854
00000100:00100000:2.0:1767320455.141752:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380017536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320455.141781:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380017536:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320455.141787:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4854
00000100:00100000:2.0:1767320455.141797:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17774
00000100:00100000:2.0:1767320455.141800:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380016896:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320455.141817:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320455.141842:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380016896:12345-0@lo:38:kworker.0 Request processed in 40us (1573us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320455.141847:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17774
00000100:00100000:2.0:1767320455.141903:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380017536:0@lo:400:kworker.0
00000100:00100000:2.0:1767320455.141913:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380017280:0@lo:400:kworker.0
00000100:00080000:2.0:1767320455.141942:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320455.147061:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320455.147145:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380017408:0@lo:38:kworker.0
00000100:00100000:0.0:1767320455.147256:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320455.147282:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380017664:0@lo:38:kworker.0
00000100:00100000:0.0:1767320455.147326:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320455.147371:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320455.147376:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320455.147379:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380016896:0@lo:38:kworker.0
00000100:00100000:3.0:1767320455.147619:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017408
00000100:00100000:3.0:1767320455.147627:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017408
00000100:00100000:3.0:1767320455.147668:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017664
00000100:00100000:3.0:1767320455.147672:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017664
00000100:00100000:3.0:1767320455.147711:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17775
00000100:00100000:3.0:1767320455.147719:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380017408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320455.147740:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320455.147748:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017024
00000100:00100000:2.0:1767320455.147755:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017024
00000100:00100000:2.0:1767320455.147785:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183
00000100:00100000:2.0:1767320455.147791:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3919cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380017024:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320455.147800:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380017408:12345-0@lo:38:kworker.0 Request processed in 80us (542us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767320455.147805:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320455.147810:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17775
00000100:00100000:3.0:1767320455.147845:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17776
00000100:00100000:2.0:1767320455.147851:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3919cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380017024:12345-0@lo:38:kworker.0 Request processed in 57us (795us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320455.147851:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380017664:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320455.147865:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183
00010000:00020000:3.0:1767320455.147890:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320455.147918:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380017664:12345-0@lo:38:kworker.0 Request processed in 67us (592us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320455.147924:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17776
00000100:00080000:0.0:1767320455.148220:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320455.148236:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320455.148239:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380017408:0@lo:38:kworker.0
00000100:00080000:0.0:1767320455.148250:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320455.148253:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320455.148256:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380017664:0@lo:38:kworker.0
00000100:00080000:0.0:1767320455.148264:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320455.148268:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320455.148270:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380017024:0@lo:38:kworker.0
00000100:00100000:1.0:1767320455.152770:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320455.153068:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017152
00000100:00100000:2.0:1767320455.153085:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017152
00000100:00100000:2.0:1767320455.153631:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880
00000100:00100000:2.0:1767320455.153642:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380017152:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320455.153721:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380017152:12345-0@lo:400:kworker.0 Request processed in 82us (956us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320455.153729:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880
00000100:00100000:1.0:1767320455.153821:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380017152:0@lo:400:kworker.0
00000100:00080000:3.0:1767320455.154828:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767320455.703514:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320456.086186:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320456.088468:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320456.088621:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974912
00000100:00100000:0.0:1767320456.088633:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974912
00000100:00100000:0.0:1767320456.088714:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291974784
00000100:00080000:2.0:1767320456.088716:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320456.088718:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291974784
00000100:00100000:0.0:1767320456.088746:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4855
00000100:00100000:2.0:1767320456.088759:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17777
00000100:00100000:0.0:1767320456.088761:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291974912:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320456.088771:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291974784:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320456.088796:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320456.088847:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291974912:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (2671us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320456.088856:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4855
00000100:00100000:2.0:1767320456.092933:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291974784:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 4150us (4461us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320456.092949:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17777
00010000:00010000:2.0:1767320456.727898:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320457.751603:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320458.199680:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320458.199698:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380017792:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320458.199757:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320458.200211:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017792
00000100:00100000:0.0:1767320458.200220:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017792
00000100:00100000:0.0:1767320458.200280:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684
00000100:00100000:0.0:1767320458.200288:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380017792:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320458.200326:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320458.200378:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380017792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (619us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320458.200385:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684
00000100:00100000:1.0:1767320458.200499:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380017792:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320458.201045:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320458.775657:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320459.735368:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380017920:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320459.735454:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320459.736001:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380017920
00000100:00100000:1.0:1767320459.736011:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380017920
00000100:00100000:1.0:1767320459.736084:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685
00000100:00100000:1.0:1767320459.736095:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380017920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320459.736124:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320459.736237:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380017920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (782us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320459.736244:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685
00000100:00100000:1.0:1767320459.736333:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380017920:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320459.736864:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320459.800149:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320460.247327:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320460.247347:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320460.247350:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320460.247369:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320460.247374:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320460.247394:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320460.247399:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320460.247418:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320460.247507:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331c00 x1853164380018048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320460.247555:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320460.247559:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320460.247561:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320460.247565:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320460.247568:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320460.247571:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320460.247585:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333800 x1853164380018176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320460.247589:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380018048:0@lo:38:kworker.0
00000100:00080000:3.0:1767320460.247635:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320460.247638:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320460.247639:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320460.247642:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320460.247645:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320460.247648:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320460.247654:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320460.247661:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331f80 x1853164380018560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320460.247676:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380018432:0@lo:400:kworker.0
00000100:00080000:3.0:1767320460.247689:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320460.247694:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320460.247696:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320460.247700:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5357
00000100:00080000:3.0:1767320460.247702:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320460.247707:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320460.247719:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380018176:0@lo:38:kworker.0
00000100:00100000:1.0:1767320460.247721:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320460.247723:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332d80 x1853164380018816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320460.247751:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380018688:0@lo:400:kworker.0
00000100:00100000:2.0:1767320460.247754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320460.247758:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320460.247767:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380018304:0@lo:400:kworker.0
00000100:00100000:3.0:1767320460.247786:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320460.247801:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320460.247856:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018048
00000100:00100000:1.0:1767320460.247863:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018048
00000100:00100000:0.0:1767320460.247892:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018432
00000100:00100000:0.0:1767320460.247898:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018432
00000100:00100000:1.0:1767320460.247921:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018688
00000100:00100000:1.0:1767320460.247926:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018688
00000100:00100000:3.0:1767320460.248569:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17778
00000100:00100000:3.0:1767320460.248577:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380018048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320460.248597:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320460.248644:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380018048:12345-0@lo:38:kworker.0 Request processed in 67us (990us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320460.248654:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17778
00000100:00100000:1.0:1767320460.251713:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4856
00000100:00100000:1.0:1767320460.251724:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380018688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320460.252039:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018176
00000100:00100000:3.0:1767320460.252048:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018176
00000100:00080000:2.0:1767320460.252077:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320460.252367:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184
00000100:00100000:3.0:1767320460.252374:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380018176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320460.252396:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320460.252449:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4857
00000100:00100000:3.0:1767320460.252453:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380018176:12345-0@lo:38:kworker.0 Request processed in 78us (4697us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320460.252459:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380018432:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320460.252461:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184
00000100:00100000:0.0:1767320460.252500:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380018432:12345-0@lo:400:kworker.0 Request processed in 44us (4782us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320460.252506:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4857
00000100:00080000:3.0:1767320460.252534:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320460.252539:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320460.252543:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380018176:0@lo:38:kworker.0
00000100:00100000:3.0:1767320460.252553:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380018560:0@lo:38:kworker.0
00000100:00100000:3.0:1767320460.252588:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320460.252613:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320460.252617:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320460.252619:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380018048:0@lo:38:kworker.0
00000100:00100000:0.0:1767320460.252644:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018560
00000100:00100000:3.0:1767320460.252644:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380018816:0@lo:38:kworker.0
00000100:00100000:0.0:1767320460.252648:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018560
00000100:00100000:3.0:1767320460.252666:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320460.252667:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17779
00000100:00100000:0.0:1767320460.252671:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380018560:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320460.252682:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320460.252685:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018816
00000100:00100000:3.0:1767320460.252688:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018816
00000100:00100000:0.0:1767320460.252706:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380018560:12345-0@lo:38:kworker.0 Request processed in 33us (118us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320460.252706:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17780
00000100:00100000:3.0:1767320460.252710:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380018816:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320460.252712:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17779
00010000:00020000:3.0:1767320460.252720:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320460.253010:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380018432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320460.253049:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018304
00000100:00100000:0.0:1767320460.253054:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018304
00000100:00100000:0.0:1767320460.253105:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881
00000100:00100000:0.0:1767320460.253112:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380018304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320460.253693:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380018816:12345-0@lo:38:kworker.0 Request processed in 979us (1024us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320460.253701:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17780
00000100:00080000:3.0:1767320460.253804:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320460.257329:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380018688:12345-0@lo:400:kworker.0 Request processed in 5597us (9534us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320460.257344:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4856
00000100:00100000:3.0:1767320460.257376:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380018688:0@lo:400:kworker.0
00000100:00080000:2.0:1767320460.258144:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320460.258152:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320460.258156:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380018560:0@lo:38:kworker.0
00000100:00080000:2.0:1767320460.258183:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320460.258187:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320460.258190:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380018816:0@lo:38:kworker.0
00000100:00100000:0.0:1767320460.259494:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380018304:12345-0@lo:400:kworker.0 Request processed in 6375us (11686us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320460.259509:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881
00000100:00100000:1.0:1767320460.259686:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380018304:0@lo:400:kworker.0
00010000:00010000:2.0:1767320460.827233:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320461.204153:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320461.204316:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320461.205501:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291975168
00000100:00100000:1.0:1767320461.205513:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291975168
00000100:00100000:1.0:1767320461.205596:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291975040
00000100:00100000:1.0:1767320461.205600:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291975040
00000100:00100000:1.0:1767320461.205623:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4858
00000100:00100000:1.0:1767320461.205639:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17781
00000100:00100000:1.0:1767320461.205645:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291975040:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320461.205669:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320461.205735:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291975040:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 89us (1418us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320461.205742:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17781
00000100:00100000:1.0:1767320461.206224:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291975168:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320461.206264:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291975168:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 635us (2122us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320461.206269:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4858
00000100:00080000:3.0:1767320461.206506:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320461.847310:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320462.871215:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320463.319548:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320463.319567:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380018944:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320463.319667:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320463.320029:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380018944
00000100:00100000:2.0:1767320463.320038:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380018944
00000100:00100000:2.0:1767320463.320105:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686
00000100:00100000:2.0:1767320463.320114:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380018944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320463.320141:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320463.320197:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380018944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (529us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320463.320204:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686
00000100:00100000:0.0:1767320463.320536:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380018944:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320463.320596:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767320463.895361:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320464.855887:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380019072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320464.855975:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320464.856285:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019072
00000100:00100000:1.0:1767320464.856294:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019072
00000100:00100000:1.0:1767320464.856395:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687
00000100:00100000:1.0:1767320464.856404:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380019072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320464.856444:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320464.856505:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380019072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (530us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320464.856512:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687
00000100:00100000:1.0:1767320464.856572:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380019072:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320464.856812:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320464.920348:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320465.367567:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320465.367579:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320465.367583:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320465.367587:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320465.367591:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320465.367600:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320465.367605:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320465.367612:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320465.367661:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332680 x1853164380019200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320465.367688:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320465.367692:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320465.367694:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320465.367698:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320465.367747:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320465.367751:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320465.367783:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331500 x1853164380019328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320465.367863:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380019456:0@lo:400:kworker.0
00000100:00100000:1.0:1767320465.367950:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320465.368072:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019456
00000100:00100000:2.0:1767320465.368080:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019456
00000100:00100000:2.0:1767320465.368134:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882
00000100:00100000:2.0:1767320465.368142:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380019456:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767320465.368250:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320465.368255:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320465.368257:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320465.368260:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320465.368263:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320465.368267:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320465.368279:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332300 x1853164380019712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320465.368322:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320465.368326:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320465.368327:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320465.368331:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5362
00000100:00080000:3.0:1767320465.368334:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320465.368338:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320465.368349:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fe680 x1853164380019968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320465.368382:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380019840:0@lo:400:kworker.0
00000100:00100000:3.0:1767320465.368431:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320465.368460:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380019584:0@lo:400:kworker.0
00000100:00100000:0.0:1767320465.368488:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320465.368490:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320465.368521:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019840
00000100:00100000:0.0:1767320465.368524:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019840
00000100:00100000:3.0:1767320465.368533:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019584
00000100:00100000:3.0:1767320465.368539:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019584
00000100:00100000:0.0:1767320465.368563:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4859
00000100:00100000:0.0:1767320465.368569:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380019840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320465.368593:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4860
00000100:00100000:0.0:1767320465.368600:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380019840:12345-0@lo:400:kworker.0 Request processed in 31us (168us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320465.368605:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380019584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320465.368610:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4859
00000100:00080000:0.0:1767320465.368653:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320465.368659:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380019584:12345-0@lo:400:kworker.0 Request processed in 55us (167us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320465.368667:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4860
00000100:00100000:0.0:1767320465.368678:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380019584:0@lo:400:kworker.0
00000100:00100000:3.0:1767320465.368697:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380019200:0@lo:38:kworker.0
00000100:00100000:0.0:1767320465.368711:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380019840:0@lo:400:kworker.0
00000100:00100000:3.0:1767320465.368727:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320465.368749:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019200
00000100:00100000:3.0:1767320465.368752:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380019328:0@lo:38:kworker.0
00000100:00100000:0.0:1767320465.368754:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019200
00000100:00100000:0.0:1767320465.368796:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17782
00000100:00100000:3.0:1767320465.368802:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320465.368803:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380019200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320465.368818:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320465.368832:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380019712:0@lo:38:kworker.0
00000100:00100000:0.0:1767320465.368847:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380019200:12345-0@lo:38:kworker.0 Request processed in 42us (120us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320465.368852:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17782
00000100:00100000:3.0:1767320465.368864:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320465.368898:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019712
00000100:00100000:0.0:1767320465.368902:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019712
00000100:00100000:3.0:1767320465.368912:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380019968:0@lo:38:kworker.0
00000100:00100000:0.0:1767320465.368919:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17783
00000100:00100000:0.0:1767320465.368922:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380019712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320465.368929:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320465.368938:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320465.369389:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320465.369395:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320465.369403:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380019200:0@lo:38:kworker.0
00000100:00100000:3.0:1767320465.369428:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019328
00000100:00100000:3.0:1767320465.369432:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019328
00000100:00100000:3.0:1767320465.369472:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185
00000100:00100000:3.0:1767320465.369476:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380019328:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320465.369488:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320465.369530:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380019328:12345-0@lo:38:kworker.0 Request processed in 52us (731us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320465.369536:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185
00000100:00100000:3.0:1767320465.369554:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380019968
00000100:00100000:3.0:1767320465.369558:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380019968
00000100:00100000:3.0:1767320465.369579:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17784
00000100:00100000:3.0:1767320465.369583:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380019968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320465.369593:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320465.369618:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380019968:12345-0@lo:38:kworker.0 Request processed in 34us (681us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320465.370329:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380019712:12345-0@lo:38:kworker.0 Request processed in 1404us (1466us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320465.370335:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17783
00000100:00100000:3.0:1767320465.370454:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17784
00000100:00100000:2.0:1767320465.370730:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380019456:12345-0@lo:400:kworker.0 Request processed in 2587us (2778us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320465.370739:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882
00000100:00100000:1.0:1767320465.370863:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380019456:0@lo:400:kworker.0
00000100:00080000:0.0:1767320465.371412:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320465.371418:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320465.371420:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380019328:0@lo:38:kworker.0
00000100:00080000:0.0:1767320465.371427:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320465.371429:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320465.371431:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380019712:0@lo:38:kworker.0
00000100:00080000:0.0:1767320465.371437:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320465.371439:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320465.371441:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380019968:0@lo:38:kworker.0
00010000:00010000:2.0:1767320465.943473:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320466.334295:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767320466.334336:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291975552 offset 0 length 520: 4
00000100:00100000:2.0:1767320466.334365:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291975296
00000100:00100000:0.0:1767320466.334366:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320466.334379:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291975296
00000100:00100000:2.0:1767320466.334425:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291975424
00000100:00100000:2.0:1767320466.334429:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291975424
00000100:00100000:2.0:1767320466.334480:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4861
00000100:00100000:2.0:1767320466.334491:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291975424:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767320466.334527:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320466.334571:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17785
00000100:00100000:2.0:1767320466.334574:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291975424:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (206us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320466.334592:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291975296:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320466.334625:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320466.334666:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291975296:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 74us (381us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320466.342565:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4861
00000100:00100000:3.0:1767320466.345546:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17785
00010000:00010000:1.0:1767320466.968839:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320467.991337:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320468.439405:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320468.439452:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380020096:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320468.439556:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320468.439772:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380020096
00000100:00100000:2.0:1767320468.439780:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380020096
00000100:00100000:2.0:1767320468.439850:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688
00000100:00100000:2.0:1767320468.439859:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380020096:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320468.439931:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320468.439983:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380020096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (426us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320468.439989:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688
00000100:00080000:1.0:1767320468.440050:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320468.440429:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380020096:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320469.016903:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320469.463767:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320444/real 1767320444]  req@ffff8b0e03c46680 x1853164380014208/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320469 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320469.463799:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e03c46680 x1853164380014208/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320469 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320469.463818:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320469.463855:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320469.463860:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380014208:0@lo:250:kworker.0
00000100:00080000:1.0:1767320469.464099:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320469.464105:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320469.464108:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320469.464112:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5347
00000100:00080000:1.0:1767320469.464116:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320469.464122:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320469.464149:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9c00 x1853164380020224/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320469.464166:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320469.464170:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320469.464172:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320469.464189:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320469.464191:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320469.464195:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320469.464218:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a8a80 x1853164380020352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320469.464227:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320469.464230:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320469.464232:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320469.464236:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320469.464239:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320469.464242:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320469.464255:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22680 x1853164380020480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320469.464315:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320469.464318:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320469.464320:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320469.464323:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320469.464325:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320469.464328:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320469.464337:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21500 x1853164380020992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320469.464350:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320469.464353:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320469.464355:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320469.464358:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5367
00000100:00080000:1.0:1767320469.464360:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320469.464376:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320469.464390:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22d80 x1853164380021248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320469.464469:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380020608:0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.464533:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320469.464585:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320469.464592:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380021120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.464616:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320469.464646:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380020736:0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.464683:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320469.464704:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320469.464709:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380020864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.464729:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320469.464760:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380020608
00000100:00100000:1.0:1767320469.464767:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380020608
00000100:00100000:1.0:1767320469.464806:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380020736
00000100:00100000:1.0:1767320469.464809:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380020736
00000100:00100000:1.0:1767320469.464842:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883
00000100:00100000:1.0:1767320469.464850:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380020608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.464933:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380020608:12345-0@lo:400:kworker.0 Request processed in 84us (400us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320469.464940:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883
00000100:00100000:1.0:1767320469.464959:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884
00000100:00100000:1.0:1767320469.464965:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380020736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.464993:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380020736:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320469.465229:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884
00000100:00100000:1.0:1767320469.465253:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380021120
00000100:00100000:1.0:1767320469.465257:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380021120
00000100:00100000:1.0:1767320469.465327:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380020864
00000100:00100000:1.0:1767320469.465330:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380020864
00000100:00100000:1.0:1767320469.465351:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4862
00000100:00100000:1.0:1767320469.465357:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380021120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.465408:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380021120:12345-0@lo:400:kworker.0 Request processed in 51us (790us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320469.465414:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4862
00000100:00100000:1.0:1767320469.465427:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863
00000100:00100000:1.0:1767320469.465432:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380020864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.465454:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380020864:12345-0@lo:400:kworker.0 Request processed in 23us (724us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320469.465459:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863
00000100:00080000:1.0:1767320469.465490:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320469.465494:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320469.465521:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380020864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.465531:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380020736:0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.465557:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380021120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320469.465565:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380020608:0@lo:400:kworker.0
00000100:00100000:3.0:1767320469.466510:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380020224:0@lo:250:kworker.0
00000400:00000100:3.0:1767320469.466551:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380020224 offset 0 length 520: 4
00000100:00100000:3.0:1767320469.466581:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380020352:0@lo:38:kworker.0
00000100:00100000:3.0:1767320469.466605:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320469.466663:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380020480:0@lo:38:kworker.0
00000100:00100000:3.0:1767320469.466684:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320469.466709:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380020992:0@lo:38:kworker.0
00000100:00100000:3.0:1767320469.466727:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320469.466760:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380020480
00000100:00100000:1.0:1767320469.466766:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380020480
00000100:00100000:1.0:1767320469.466798:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186
00000100:00100000:1.0:1767320469.466803:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380020480:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320469.466822:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320469.466857:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380020480:12345-0@lo:38:kworker.0 Request processed in 52us (171us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320469.466863:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186
00000100:00100000:3.0:1767320469.474371:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380021248:0@lo:38:kworker.0
00000100:00100000:3.0:1767320469.474435:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320469.480280:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380020352
00000100:00100000:0.0:1767320469.480296:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380020352
00000100:00100000:0.0:1767320469.480361:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380020992
00000100:00100000:0.0:1767320469.480365:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380020992
00000100:00080000:3.0:1767320469.487346:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320469.487362:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320469.487368:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380020480:0@lo:38:kworker.0
00000100:00100000:1.0:1767320469.487503:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380021248
00000100:00100000:1.0:1767320469.487512:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380021248
00000100:00100000:1.0:1767320469.487561:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17786
00000100:00100000:1.0:1767320469.487569:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380020352:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320469.487593:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320469.487661:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380020352:12345-0@lo:38:kworker.0 Request processed in 91us (21055us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320469.487668:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17786
00000100:00100000:1.0:1767320469.487687:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17787
00000100:00100000:1.0:1767320469.487692:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380020992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320469.487702:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320469.487726:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380020992:12345-0@lo:38:kworker.0 Request processed in 33us (20997us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320469.487732:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17787
00000100:00100000:1.0:1767320469.487745:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17788
00000100:00100000:1.0:1767320469.487801:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380021248:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320469.487813:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320469.487838:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380021248:12345-0@lo:38:kworker.0 Request processed in 88us (13404us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320469.487843:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17788
00000100:00080000:2.0:1767320469.491077:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320469.491091:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320469.491096:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380020352:0@lo:38:kworker.0
00000100:00080000:2.0:1767320469.491111:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320469.491114:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320469.491117:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380020992:0@lo:38:kworker.0
00000100:00080000:2.0:1767320469.491127:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320469.491131:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320469.491134:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380021248:0@lo:38:kworker.0
00000100:00100000:2.0:1767320469.977706:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380021376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320469.977780:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320469.978681:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380021376
00000100:00100000:3.0:1767320469.978691:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380021376
00000100:00100000:3.0:1767320469.978780:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689
00000100:00100000:3.0:1767320469.978788:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380021376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320469.978814:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320469.978886:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380021376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1106us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320469.978892:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689
00000100:00100000:1.0:1767320469.978963:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380021376:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320470.039561:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320471.064398:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320471.440833:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320471.440940:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320471.441154:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291975808
00000100:00100000:3.0:1767320471.441164:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291975808
00000100:00100000:3.0:1767320471.441259:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291975680
00000100:00100000:3.0:1767320471.441263:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291975680
00000100:00100000:3.0:1767320471.441283:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4864
00000100:00100000:3.0:1767320471.441294:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291975808:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320471.441378:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291975808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (555us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320471.441387:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4864
00000100:00100000:3.0:1767320471.441425:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17789
00000100:00100000:3.0:1767320471.441429:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291975680:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320471.441459:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320471.441486:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291975680:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (545us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320471.441493:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17789
00000100:00080000:1.0:1767320471.441550:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320472.087611:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320473.113403:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320473.562713:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320473.562774:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380021504:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320473.562845:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320473.563325:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380021504
00000100:00100000:3.0:1767320473.563334:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380021504
00000100:00100000:3.0:1767320473.563408:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690
00000100:00100000:3.0:1767320473.563418:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380021504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320473.563465:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320473.563525:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380021504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (678us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320473.563532:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690
00000100:00080000:1.0:1767320473.563864:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320473.564273:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380021504:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320474.135276:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320474.583468:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320474.583485:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320474.583488:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320474.583492:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320474.583497:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320474.583505:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5371
00000100:00080000:0.0:1767320474.583510:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320474.583516:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320474.583558:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680380 x1853164380021632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320474.583591:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320474.583594:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320474.583596:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320474.583601:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5371
00000100:00080000:0.0:1767320474.583603:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320474.583608:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320474.583622:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332300 x1853164380021760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320474.583697:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320474.583700:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320474.583702:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320474.583705:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5371
00000100:00080000:0.0:1767320474.583707:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320474.583711:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320474.583721:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07331f80 x1853164380022272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320474.583735:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320474.583738:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320474.583739:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320474.583742:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5371
00000100:00080000:0.0:1767320474.583744:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320474.583747:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320474.583769:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164380022528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320474.583799:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380022016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320474.583862:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320474.584052:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380022400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320474.584085:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320474.584121:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022016
00000100:00100000:3.0:1767320474.584128:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022016
00000100:00100000:3.0:1767320474.584253:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885
00000100:00100000:3.0:1767320474.584262:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380022016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320474.584308:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380022016:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320474.584314:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885
00000100:00100000:3.0:1767320474.584336:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022400
00000100:00100000:3.0:1767320474.584340:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022400
00000100:00100000:3.0:1767320474.584369:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4865
00000100:00100000:3.0:1767320474.584376:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380022400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320474.584410:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380022400:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320474.584415:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4865
00000100:00080000:3.0:1767320474.584431:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320474.584436:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320474.584533:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380022144:0@lo:400:kworker.0
00000100:00100000:1.0:1767320474.584562:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320474.584595:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380021888:0@lo:400:kworker.0
00000100:00100000:1.0:1767320474.584618:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320474.584639:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380021888
00000100:00100000:1.0:1767320474.584643:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380021888
00000100:00100000:1.0:1767320474.584668:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886
00000100:00100000:1.0:1767320474.584674:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380021888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320474.584706:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380021888:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320474.584712:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886
00000100:00100000:0.0:1767320474.584976:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380022016:0@lo:400:kworker.0
00000100:00100000:3.0:1767320474.585121:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022144
00000100:00100000:3.0:1767320474.585125:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022144
00000100:00100000:3.0:1767320474.585175:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4866
00000100:00100000:3.0:1767320474.585182:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380022144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320474.585220:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380022144:12345-0@lo:400:kworker.0 Request processed in 38us (657us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320474.585226:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4866
00000100:00100000:1.0:1767320474.585313:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380022400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320474.585385:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380022144:0@lo:400:kworker.0
00000100:00100000:1.0:1767320474.585445:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380021888:0@lo:400:kworker.0
00000100:00080000:0.0:1767320474.585681:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320474.587462:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380021632:0@lo:38:kworker.0
00000100:00100000:2.0:1767320474.587546:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320474.587592:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380021760:0@lo:38:kworker.0
00000100:00100000:2.0:1767320474.587617:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320474.587657:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380022272:0@lo:38:kworker.0
00000100:00100000:2.0:1767320474.587677:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320474.587704:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380022528:0@lo:38:kworker.0
00000100:00100000:2.0:1767320474.587723:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320474.587810:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380021632
00000100:00100000:2.0:1767320474.587817:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380021632
00000100:00100000:2.0:1767320474.587850:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022272
00000100:00100000:2.0:1767320474.587853:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022272
00000100:00100000:2.0:1767320474.587867:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022528
00000100:00100000:2.0:1767320474.587898:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022528
00000100:00100000:2.0:1767320474.587920:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17790
00000100:00100000:2.0:1767320474.587927:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380021632:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320474.588060:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17791
00000100:00100000:3.0:1767320474.588066:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380022272:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320474.588118:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17792
00000100:00100000:1.0:1767320474.588124:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380022528:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320474.588163:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320474.588212:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380021632:12345-0@lo:38:kworker.0 Request processed in 284us (665us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320474.588219:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17790
00000100:00080000:2.0:1767320474.588265:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320474.588270:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320474.588273:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380021632:0@lo:38:kworker.0
00010000:00020000:3.0:1767320474.588341:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320474.588421:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380022272:12345-0@lo:38:kworker.0 Request processed in 353us (742us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320474.588427:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17791
00010000:00020000:1.0:1767320474.588469:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320474.588502:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380022528:12345-0@lo:38:kworker.0 Request processed in 376us (777us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320474.588507:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17792
00000100:00080000:2.0:1767320474.588554:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320474.588558:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320474.588561:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380022272:0@lo:38:kworker.0
00000100:00080000:2.0:1767320474.588567:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320474.588570:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320474.588573:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380022528:0@lo:38:kworker.0
00000100:00100000:0.0:1767320474.588912:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380021760
00000100:00100000:0.0:1767320474.588922:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380021760
00000100:00100000:0.0:1767320474.588952:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187
00000100:00100000:0.0:1767320474.588958:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380021760:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320474.588981:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320474.589029:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380021760:12345-0@lo:38:kworker.0 Request processed in 69us (1409us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320474.589036:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187
00000100:00080000:2.0:1767320474.589112:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320474.589117:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320474.589121:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380021760:0@lo:38:kworker.0
00000100:00100000:2.0:1767320475.095219:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380022656:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320475.095300:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320475.095882:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022656
00000100:00100000:3.0:1767320475.095891:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022656
00000100:00100000:3.0:1767320475.095948:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691
00000100:00100000:3.0:1767320475.095957:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380022656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320475.095986:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320475.103712:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380022656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7747us (8402us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320475.103726:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691
00000100:00100000:2.0:1767320475.111038:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380022656:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320475.161355:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320476.184725:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320476.564009:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320476.564060:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320476.564246:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291976064
00000100:00100000:3.0:1767320476.564257:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291976064
00000100:00100000:3.0:1767320476.564335:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291975936
00000100:00100000:3.0:1767320476.564338:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291975936
00000100:00100000:3.0:1767320476.564355:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4867
00000100:00100000:3.0:1767320476.564365:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291976064:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320476.564435:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291976064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 71us (437us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320476.564442:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4867
00000100:00100000:3.0:1767320476.564459:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17793
00000100:00100000:3.0:1767320476.564463:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291975936:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320476.564482:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320476.564508:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291975936:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (448us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320476.564515:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17793
00000100:00080000:0.0:1767320476.564759:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320477.209904:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320478.232934:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320478.680389:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320478.680755:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380022784:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320478.680821:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320478.681132:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022784
00000100:00100000:2.0:1767320478.681140:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022784
00000100:00100000:2.0:1767320478.681248:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692
00000100:00100000:2.0:1767320478.681257:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380022784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320478.681286:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320478.681344:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380022784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (522us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320478.681351:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692
00000100:00100000:1.0:1767320478.681484:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380022784:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320478.681663:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320479.255298:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320479.703198:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320479.703208:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320479.703211:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320479.703215:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320479.703219:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320479.703226:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5376
00000100:00080000:2.0:1767320479.703231:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320479.703237:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320479.703280:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680380 x1853164380022912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320479.703304:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767320479.703336:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380022912:0@lo:38:kworker.0
00000100:00080000:2.0:1767320479.703441:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320479.703443:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320479.703449:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5376
00000100:00080000:2.0:1767320479.703453:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767320479.703458:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320479.703462:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320479.703481:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380abb80 x1853164380023040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320479.703578:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380023040:0@lo:38:kworker.0
00000100:00080000:2.0:1767320479.703578:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320479.703585:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320479.703588:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320479.703593:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5376
00000100:00080000:2.0:1767320479.703596:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320479.703601:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320479.703610:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320479.703617:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a8380 x1853164380023552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320479.703639:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767320479.703642:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380023552:0@lo:38:kworker.0
00000100:00080000:2.0:1767320479.703645:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320479.703648:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320479.703652:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5376
00000100:00080000:2.0:1767320479.703655:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320479.703662:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320479.703676:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c000 x1853164380023808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320479.703683:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320479.703735:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380023168:0@lo:400:kworker.0
00000100:00100000:0.0:1767320479.703768:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320479.703790:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320479.703795:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380023680:0@lo:400:kworker.0
00000100:00100000:0.0:1767320479.703834:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023040
00000100:00100000:0.0:1767320479.703841:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023040
00000100:00100000:0.0:1767320479.703889:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188
00000100:00100000:0.0:1767320479.703895:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380023040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320479.703914:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320479.703950:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380023040:12345-0@lo:38:kworker.0 Request processed in 54us (340us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320479.703957:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188
00000100:00100000:0.0:1767320479.703999:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023168
00000100:00080000:1.0:1767320479.704060:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320479.704065:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320479.704068:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380023040:0@lo:38:kworker.0
00000100:00100000:1.0:1767320479.704088:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380023808:0@lo:38:kworker.0
00000100:00100000:1.0:1767320479.704129:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320479.704205:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380022912
00000100:00100000:3.0:1767320479.704210:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380022912
00000100:00100000:3.0:1767320479.704234:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023552
00000100:00100000:3.0:1767320479.704236:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023552
00000100:00100000:3.0:1767320479.704249:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17794
00000100:00100000:3.0:1767320479.704254:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380022912:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320479.704265:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320479.704298:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380022912:12345-0@lo:38:kworker.0 Request processed in 42us (843us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320479.704304:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17794
00000100:00100000:3.0:1767320479.704315:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17795
00000100:00100000:3.0:1767320479.704319:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380023552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320479.704327:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320479.704347:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380023552:12345-0@lo:38:kworker.0 Request processed in 27us (668us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320479.704365:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17795
00000100:00100000:3.0:1767320479.704384:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380023296:0@lo:400:kworker.0
00000100:00100000:3.0:1767320479.704407:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320479.704427:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320479.704432:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380023424:0@lo:400:kworker.0
00000100:00100000:3.0:1767320479.704458:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023296
00000100:00100000:3.0:1767320479.704461:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023296
00000100:00100000:3.0:1767320479.704636:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887
00000100:00100000:3.0:1767320479.704643:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380023296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320479.704806:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380023296:12345-0@lo:400:kworker.0 Request processed in 163us (397us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320479.704813:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887
00000100:00080000:3.0:1767320479.704830:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320479.705248:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320479.705252:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320479.705256:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380023552:0@lo:38:kworker.0
00000100:00080000:1.0:1767320479.705263:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320479.705267:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320479.705269:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380022912:0@lo:38:kworker.0
00000100:00100000:1.0:1767320479.705295:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320479.705349:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380023296:0@lo:400:kworker.0
00000100:00100000:2.0:1767320479.705410:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320479.705452:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023168
00000100:00100000:0.0:1767320479.705485:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888
00000100:00100000:0.0:1767320479.705493:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380023168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320479.705633:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023808
00000100:00100000:3.0:1767320479.705639:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023808
00000100:00100000:3.0:1767320479.705671:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023424
00000100:00100000:3.0:1767320479.705674:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023424
00000100:00100000:3.0:1767320479.705697:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4868
00000100:00100000:3.0:1767320479.705704:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380023424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320479.705742:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380023424:12345-0@lo:400:kworker.0 Request processed in 39us (445us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320479.705748:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4868
00000100:00100000:3.0:1767320479.705761:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17796
00000100:00100000:3.0:1767320479.705765:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380023808:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320479.705779:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320479.705810:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380023808:12345-0@lo:38:kworker.0 Request processed in 43us (1680us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320479.705816:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17796
00000100:00080000:3.0:1767320479.705835:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320479.706078:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380023424:0@lo:400:kworker.0
00000100:00080000:1.0:1767320479.706460:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320479.706465:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320479.706469:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380023808:0@lo:38:kworker.0
00000100:00100000:0.0:1767320479.708894:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380023168:12345-0@lo:400:kworker.0 Request processed in 3393us (5116us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320479.708912:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888
00000100:00100000:2.0:1767320479.709094:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380023168:0@lo:400:kworker.0
00000100:00100000:1.0:1767320479.709325:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023680
00000100:00100000:1.0:1767320479.709332:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023680
00000100:00100000:1.0:1767320479.709636:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4869
00000100:00080000:2.0:1767320479.709644:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320479.709655:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380023680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320479.709731:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380023680:12345-0@lo:400:kworker.0 Request processed in 87us (4322us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320479.709738:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4869
00000100:00100000:2.0:1767320479.709770:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380023680:0@lo:400:kworker.0
00000100:00100000:2.0:1767320480.215060:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380023936:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320480.215149:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320480.215535:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380023936
00000100:00100000:0.0:1767320480.215544:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380023936
00000100:00100000:0.0:1767320480.215634:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693
00000100:00100000:0.0:1767320480.215645:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380023936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320480.215674:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320480.215727:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380023936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (578us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320480.215736:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693
00000100:00100000:3.0:1767320480.215825:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380023936:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320480.283278:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320481.303383:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320481.682332:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320481.682454:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291976320
00000100:00100000:0.0:1767320481.682473:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291976320
00000100:00080000:2.0:1767320481.682546:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320481.682547:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4870
00000100:00100000:0.0:1767320481.682560:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291976320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320481.682818:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291976320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 257us (493us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320481.682827:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4870
00000100:00100000:2.0:1767320481.685024:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320481.685391:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291976192
00000100:00100000:0.0:1767320481.685405:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291976192
00000100:00100000:0.0:1767320481.685514:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17797
00000100:00100000:0.0:1767320481.685525:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291976192:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320481.685556:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320481.685676:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291976192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 150us (664us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320481.685685:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17797
00010000:00010000:2.0:1767320482.327325:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320483.352950:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320483.800742:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320483.801193:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380024064:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320483.801292:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320483.801528:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024064
00000100:00100000:1.0:1767320483.801542:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024064
00000100:00100000:1.0:1767320483.801662:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694
00000100:00100000:1.0:1767320483.801674:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380024064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320483.801706:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320483.801789:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380024064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (497us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320483.801795:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694
00000100:00100000:0.0:1767320483.801922:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380024064:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320483.805598:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767320484.375331:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320484.823221:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320484.823232:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320484.823235:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320484.823239:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320484.823243:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320484.823251:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5382
00000100:00080000:3.0:1767320484.823256:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320484.823263:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320484.823303:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fe680 x1853164380024192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320484.823328:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320484.823332:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320484.823334:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320484.823339:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5382
00000100:00080000:3.0:1767320484.823341:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320484.823345:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320484.823360:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fdf80 x1853164380024320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320484.823421:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320484.823426:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320484.823428:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320484.823432:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5382
00000100:00080000:3.0:1767320484.823436:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320484.823440:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320484.823444:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380024192:0@lo:38:kworker.0
00000100:00100000:3.0:1767320484.823454:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44a300 x1853164380024832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320484.823470:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320484.823472:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320484.823473:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320484.823476:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5382
00000100:00080000:3.0:1767320484.823477:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320484.823481:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320484.823488:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45500 x1853164380025088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320484.823506:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380024960:0@lo:400:kworker.0
00000100:00100000:0.0:1767320484.823520:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320484.823537:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380024704:0@lo:400:kworker.0
00000100:00100000:3.0:1767320484.823556:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320484.823590:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380024320:0@lo:38:kworker.0
00000100:00100000:2.0:1767320484.823622:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380024448:0@lo:400:kworker.0
00000100:00100000:0.0:1767320484.823628:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320484.823673:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320484.823684:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380024832:0@lo:38:kworker.0
00000100:00100000:2.0:1767320484.823725:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024320
00000100:00100000:0.0:1767320484.823729:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320484.823733:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024320
00000100:00100000:0.0:1767320484.823753:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380025088:0@lo:38:kworker.0
00000100:00100000:2.0:1767320484.823771:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189
00000100:00100000:0.0:1767320484.823778:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320484.823782:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380024320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320484.823803:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320484.823815:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024192
00000100:00100000:0.0:1767320484.823820:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024192
00000100:00100000:2.0:1767320484.823844:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380024320:12345-0@lo:38:kworker.0 Request processed in 64us (219us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320484.823852:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189
00000100:00100000:0.0:1767320484.823894:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024704
00000100:00100000:0.0:1767320484.823899:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024704
00000100:00100000:2.0:1767320484.823900:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024832
00000100:00100000:2.0:1767320484.823906:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024832
00000100:00100000:2.0:1767320484.823929:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025088
00000100:00100000:2.0:1767320484.823933:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025088
00000100:00100000:0.0:1767320484.823938:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4871
00000100:00100000:0.0:1767320484.823947:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380024704:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320484.823953:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17798
00000100:00100000:2.0:1767320484.823959:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380024192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320484.823970:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320484.823996:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380024192:12345-0@lo:38:kworker.0 Request processed in 35us (477us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320484.824003:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17798
00000100:00100000:2.0:1767320484.824017:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17799
00000100:00100000:2.0:1767320484.824021:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380024832:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320484.824041:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024448
00010000:00020000:2.0:1767320484.824043:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320484.824045:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024448
00000100:00100000:2.0:1767320484.824076:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380024832:12345-0@lo:38:kworker.0 Request processed in 53us (349us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320484.824081:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17799
00000100:00100000:1.0:1767320484.824086:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889
00000100:00100000:2.0:1767320484.824091:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17800
00000100:00100000:1.0:1767320484.824092:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380024448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320484.824095:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380025088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320484.824103:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320484.824123:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380025088:12345-0@lo:38:kworker.0 Request processed in 27us (346us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320484.824128:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17800
00000100:00100000:1.0:1767320484.824130:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380024448:12345-0@lo:400:kworker.0 Request processed in 40us (461us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320484.824135:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889
00000100:00080000:2.0:1767320484.824143:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320484.824155:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320484.824173:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380024448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320484.824179:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024960
00000100:00100000:1.0:1767320484.824181:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024960
00000100:00080000:2.0:1767320484.824200:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320484.824204:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320484.824207:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380024832:0@lo:38:kworker.0
00000100:00080000:2.0:1767320484.824215:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320484.824218:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4872
00000100:00080000:2.0:1767320484.824218:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320484.824221:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380025088:0@lo:38:kworker.0
00000100:00100000:1.0:1767320484.824224:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380024960:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320484.824228:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320484.824230:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320484.824233:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380024192:0@lo:38:kworker.0
00000100:00080000:2.0:1767320484.824240:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320484.824243:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320484.824246:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380024320:0@lo:38:kworker.0
00000100:00100000:1.0:1767320484.824255:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380024960:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320484.824261:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4872
00000100:00080000:1.0:1767320484.824274:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320484.824284:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380024576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320484.824289:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380024960:0@lo:400:kworker.0
00000100:00100000:2.0:1767320484.824308:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320484.824329:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380024576
00000100:00100000:1.0:1767320484.824334:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380024576
00000100:00080000:2.0:1767320484.824348:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320484.824358:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890
00000100:00100000:1.0:1767320484.824364:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380024576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320484.824410:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380024576:12345-0@lo:400:kworker.0 Request processed in 47us (102us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320484.824416:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890
00000100:00100000:2.0:1767320484.824491:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380024576:0@lo:400:kworker.0
00000100:00100000:0.0:1767320484.825603:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380024704:12345-0@lo:400:kworker.0 Request processed in 1654us (2042us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320484.825614:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4871
00000100:00100000:3.0:1767320484.825808:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380024704:0@lo:400:kworker.0
00000100:00100000:2.0:1767320485.337271:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380025216:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320485.337347:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320485.337483:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025216
00000100:00100000:1.0:1767320485.337492:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025216
00000100:00100000:1.0:1767320485.337548:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695
00000100:00100000:1.0:1767320485.337558:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380025216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320485.337585:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320485.337631:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380025216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (284us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320485.337638:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695
00000100:00100000:0.0:1767320485.337739:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380025216:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320485.402103:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320486.423365:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320486.801094:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320486.801255:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320486.814679:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291976576
00000100:00100000:0.0:1767320486.814696:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291976576
00000100:00100000:0.0:1767320486.814802:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291976448
00000100:00100000:0.0:1767320486.814806:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291976448
00000100:00100000:0.0:1767320486.814831:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4873
00000100:00100000:0.0:1767320486.814852:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291976576:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320486.814958:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291976576:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (13873us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320486.814967:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4873
00000100:00080000:2.0:1767320486.815497:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320486.818374:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17801
00000100:00100000:0.0:1767320486.818386:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291976448:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320486.818409:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320486.818515:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291976448:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 129us (17259us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320486.818523:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17801
00010000:00010000:1.0:1767320487.449336:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320488.473840:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320488.919224:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320488.919251:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380025344:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320488.919331:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320488.919484:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025344
00000100:00100000:2.0:1767320488.919493:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025344
00000100:00100000:2.0:1767320488.919562:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696
00000100:00100000:2.0:1767320488.919572:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380025344:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320488.919602:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320488.919656:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380025344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (324us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320488.919664:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696
00000100:00080000:1.0:1767320488.919773:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320488.919935:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380025344:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320489.495885:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320489.943929:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320489.943939:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320489.943942:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320489.943946:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320489.943950:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320489.943958:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5387
00000100:00080000:1.0:1767320489.943963:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320489.943970:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320489.944009:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22680 x1853164380025472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320489.944045:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320489.944048:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320489.944050:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320489.944053:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5387
00000100:00080000:1.0:1767320489.944056:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320489.944059:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320489.944074:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21500 x1853164380025600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320489.944135:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320489.944138:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320489.944140:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320489.944144:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5387
00000100:00080000:1.0:1767320489.944147:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320489.944150:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320489.944161:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380aa680 x1853164380026112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320489.944168:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380025984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320489.944253:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320489.944282:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025984
00000100:00100000:3.0:1767320489.944290:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025984
00000100:00100000:0.0:1767320489.944312:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320489.944318:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380025856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320489.944345:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320489.944359:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4874
00000100:00100000:3.0:1767320489.944368:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380025984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320489.944375:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380025472:0@lo:38:kworker.0
00000100:00100000:0.0:1767320489.944396:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320489.944413:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380025600:0@lo:38:kworker.0
00000100:00100000:3.0:1767320489.944435:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380025984:12345-0@lo:400:kworker.0 Request processed in 64us (176us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320489.944442:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4874
00000100:00100000:3.0:1767320489.944457:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025472
00000100:00100000:3.0:1767320489.944460:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025472
00000100:00100000:3.0:1767320489.944477:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17802
00000100:00100000:3.0:1767320489.944482:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380025472:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320489.944499:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320489.944536:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320489.944540:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320489.944542:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320489.944546:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5387
00000100:00080000:1.0:1767320489.944548:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320489.944553:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320489.944564:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9180 x1853164380026368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320489.944587:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025856
00000100:00100000:1.0:1767320489.944590:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025856
00000100:00100000:2.0:1767320489.944665:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380026240:0@lo:400:kworker.0
00000100:00100000:1.0:1767320489.944747:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891
00000100:00100000:1.0:1767320489.944757:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380025856:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320489.948266:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320489.948338:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380026112:0@lo:38:kworker.0
00000100:00100000:0.0:1767320489.948382:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320489.948415:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380026368:0@lo:38:kworker.0
00000100:00100000:0.0:1767320489.948439:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320489.948487:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380026112
00000100:00100000:0.0:1767320489.948494:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380026112
00000100:00100000:0.0:1767320489.948531:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380026368
00000100:00100000:0.0:1767320489.948534:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380026368
00000100:00100000:0.0:1767320489.948547:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17803
00000100:00100000:0.0:1767320489.948554:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380026112:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320489.948575:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320489.948598:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380025472:12345-0@lo:38:kworker.0 Request processed in 4113us (4199us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320489.948605:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380026112:12345-0@lo:38:kworker.0 Request processed in 51us (224us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320489.948606:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17802
00000100:00100000:0.0:1767320489.948611:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17803
00000100:00100000:0.0:1767320489.948625:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17804
00000100:00100000:0.0:1767320489.948629:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380026368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320489.948638:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320489.948660:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380026368:12345-0@lo:38:kworker.0 Request processed in 30us (220us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320489.948665:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17804
00000100:00100000:0.0:1767320489.948688:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025600
00000100:00100000:0.0:1767320489.948691:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025600
00000100:00100000:0.0:1767320489.948709:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190
00000100:00100000:0.0:1767320489.948713:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380025600:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320489.948722:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320489.948749:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380025600:12345-0@lo:38:kworker.0 Request processed in 34us (491us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320489.948755:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190
00000100:00100000:0.0:1767320489.948795:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380025984:0@lo:400:kworker.0
00000100:00080000:0.0:1767320489.949364:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320489.949370:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320489.949385:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380025728:0@lo:400:kworker.0
00000100:00100000:0.0:1767320489.949419:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320489.949446:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380025728
00000100:00100000:0.0:1767320489.949449:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380025728
00000100:00100000:0.0:1767320489.949474:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892
00000100:00100000:0.0:1767320489.949480:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380025728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320489.949528:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380025728:12345-0@lo:400:kworker.0 Request processed in 48us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320489.949533:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892
00000100:00100000:0.0:1767320489.949558:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380025728:0@lo:400:kworker.0
00000100:00080000:0.0:1767320489.949599:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320489.949603:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320489.949606:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380026368:0@lo:38:kworker.0
00000100:00080000:0.0:1767320489.949615:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320489.949618:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320489.949621:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380025472:0@lo:38:kworker.0
00000100:00080000:0.0:1767320489.949630:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320489.949633:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320489.949636:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380025600:0@lo:38:kworker.0
00000100:00080000:0.0:1767320489.949643:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320489.949645:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320489.949649:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380026112:0@lo:38:kworker.0
00000100:00100000:2.0:1767320489.950590:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320489.950703:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380026240
00000100:00100000:0.0:1767320489.950710:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380026240
00000100:00100000:0.0:1767320489.950907:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4875
00000100:00100000:0.0:1767320489.950918:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380026240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320489.951323:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380026240:12345-0@lo:400:kworker.0 Request processed in 53us (380us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320489.951332:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4875
00000100:00080000:2.0:1767320489.951436:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320489.951469:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380026240:0@lo:400:kworker.0
00000100:00100000:1.0:1767320489.955824:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380025856:12345-0@lo:400:kworker.0 Request processed in 11059us (11467us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320489.955839:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891
00000100:00100000:0.0:1767320489.956129:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380025856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320490.455469:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380026496:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320490.455541:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320490.455679:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380026496
00000100:00100000:1.0:1767320490.455689:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380026496
00000100:00100000:1.0:1767320490.455747:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697
00000100:00100000:1.0:1767320490.455757:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380026496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320490.455789:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320490.455845:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380026496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (304us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320490.455853:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697
00000100:00100000:0.0:1767320490.456100:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380026496:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320490.519334:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320490.896128:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320490.896248:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291976960
00000100:00100000:3.0:1767320490.896259:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291976960
00000100:00080000:2.0:1767320490.896404:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320490.896787:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4876
00000100:00100000:3.0:1767320490.896800:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291976960:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320490.896915:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291976960:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 117us (796us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320490.896922:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4876
00000400:00000100:2.0:1767320490.897030:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291976704 offset 0 length 520: 4
00000100:00100000:2.0:1767320490.897123:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320490.900511:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291976832
00000100:00100000:0.0:1767320490.900528:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291976832
00000100:00100000:0.0:1767320490.900716:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17805
00000100:00100000:0.0:1767320490.900725:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291976832:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320490.900749:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320490.900816:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291976832:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 90us (3692us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320490.900823:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17805
00010000:00010000:1.0:1767320491.543319:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320492.567530:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320493.591350:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320494.040700:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320469/real 1767320469]  req@ffff8b0f380a9c00 x1853164380020224/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320494.040740:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f380a9c00 x1853164380020224/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320494.040762:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320494.042013:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320494.042022:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380020224:0@lo:250:kworker.0
00000100:00100000:3.0:1767320494.042195:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380026624:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320494.042262:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320494.042712:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380026624
00000100:00100000:0.0:1767320494.042721:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380026624
00000100:00100000:0.0:1767320494.042783:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698
00000100:00100000:0.0:1767320494.042791:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380026624:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320494.042819:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320494.042859:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380026624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (597us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320494.042866:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698
00000100:00080000:2.0:1767320494.042937:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320494.043111:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380026624:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320494.044187:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320494.044194:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320494.044198:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320494.044203:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5371
00000100:00080000:1.0:1767320494.044207:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320494.044213:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320494.044244:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380abb80 x1853164380026752/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320494.044437:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380026752:0@lo:250:kworker.0
00000400:00000100:0.0:1767320494.044481:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380026752 offset 0 length 520: 4
00000100:00080000:1.0:1767320494.044527:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320494.044531:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320494.044533:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320494.044536:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5392
00000100:00080000:1.0:1767320494.044539:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320494.044543:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320494.044558:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9c00 x1853164380026880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320494.048183:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380026880:0@lo:38:kworker.0
00000100:00100000:0.0:1767320494.048265:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320494.048446:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380026880
00000100:00100000:2.0:1767320494.048454:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380026880
00000100:00100000:2.0:1767320494.048506:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17806
00000100:00100000:2.0:1767320494.048513:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380026880:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320494.048535:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767320494.048701:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320494.048706:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320494.048710:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320494.048714:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5392
00000100:00080000:1.0:1767320494.048718:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320494.048723:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320494.048754:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a8380 x1853164380027008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320494.048807:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320494.048810:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320494.048812:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320494.048816:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5392
00000100:00080000:1.0:1767320494.048818:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320494.048821:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320494.048835:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380a9180 x1853164380027392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320494.048852:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320494.048855:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320494.048857:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320494.048860:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5392
00000100:00080000:1.0:1767320494.048862:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320494.048866:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320494.048894:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd500 x1853164380027648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320494.048922:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380027264:0@lo:400:kworker.0
00000100:00100000:3.0:1767320494.048999:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320494.049010:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380027136:0@lo:400:kworker.0
00000100:00100000:2.0:1767320494.054669:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380026880:12345-0@lo:38:kworker.0 Request processed in 6144us (6393us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320494.054685:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17806
00000100:00100000:2.0:1767320494.054761:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380027520:0@lo:400:kworker.0
00000100:00100000:2.0:1767320494.054803:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320494.054842:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027520
00000100:00100000:2.0:1767320494.054849:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027520
00000100:00100000:2.0:1767320494.054919:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4877
00000100:00100000:2.0:1767320494.054928:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380027520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320494.055008:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380027520:12345-0@lo:400:kworker.0 Request processed in 80us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320494.055016:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4877
00000100:00080000:2.0:1767320494.055033:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320494.055062:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380027520:0@lo:400:kworker.0
00000100:00080000:0.0:1767320494.057443:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320494.057455:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320494.057460:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380026880:0@lo:38:kworker.0
00000100:00100000:0.0:1767320494.057494:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380027008:0@lo:38:kworker.0
00000100:00100000:0.0:1767320494.057553:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320494.057591:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380027392:0@lo:38:kworker.0
00000100:00100000:0.0:1767320494.057616:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320494.057640:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380027648:0@lo:38:kworker.0
00000100:00100000:0.0:1767320494.057663:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320494.057707:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027392
00000100:00100000:0.0:1767320494.057714:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027392
00000100:00100000:0.0:1767320494.057746:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027648
00000100:00100000:0.0:1767320494.057749:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027648
00000100:00100000:0.0:1767320494.057768:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17807
00000100:00100000:0.0:1767320494.057775:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380027392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320494.057796:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320494.057840:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380027392:12345-0@lo:38:kworker.0 Request processed in 65us (223us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320494.057847:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17807
00000100:00100000:0.0:1767320494.057864:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17808
00000100:00100000:0.0:1767320494.057886:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380027648:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320494.057897:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320494.057921:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380027648:12345-0@lo:38:kworker.0 Request processed in 52us (257us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320494.057927:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17808
00000100:00100000:1.0:1767320494.058170:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320494.058226:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027008
00000100:00100000:2.0:1767320494.058230:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027008
00000100:00100000:3.0:1767320494.058313:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320494.059196:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027136
00000100:00100000:1.0:1767320494.059203:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027136
00000100:00100000:1.0:1767320494.059253:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893
00000100:00100000:1.0:1767320494.059261:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380027136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320494.059335:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380027136:12345-0@lo:400:kworker.0 Request processed in 75us (1020us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320494.059342:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893
00000100:00100000:2.0:1767320494.059420:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191
00000100:00100000:2.0:1767320494.059427:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380027008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320494.059444:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320494.059477:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380027008:12345-0@lo:38:kworker.0 Request processed in 50us (1924us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320494.059483:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191
00000100:00080000:2.0:1767320494.059536:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320494.059541:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320494.059544:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380027008:0@lo:38:kworker.0
00000100:00080000:2.0:1767320494.059553:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320494.059556:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320494.059559:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380027392:0@lo:38:kworker.0
00000100:00080000:2.0:1767320494.059568:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320494.059571:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320494.059573:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380027648:0@lo:38:kworker.0
00000100:00100000:3.0:1767320494.059660:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380027136:0@lo:400:kworker.0
00000100:00080000:3.0:1767320494.059686:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320494.060467:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027264
00000100:00100000:0.0:1767320494.060476:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027264
00000100:00100000:0.0:1767320494.060535:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4878
00000100:00100000:0.0:1767320494.060542:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380027264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320494.060601:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380027264:12345-0@lo:400:kworker.0 Request processed in 59us (2430us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320494.060607:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4878
00000100:00100000:0.0:1767320494.060659:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380027264:0@lo:400:kworker.0
00000100:00080000:3.0:1767320494.060737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320494.617225:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320495.577301:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380027776:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320495.577371:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320495.577499:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027776
00000100:00100000:1.0:1767320495.577508:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027776
00000100:00100000:1.0:1767320495.577562:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699
00000100:00100000:1.0:1767320495.577572:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380027776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320495.577600:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320495.577763:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380027776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 193us (392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320495.577771:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699
00000100:00100000:3.0:1767320495.578805:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380027776:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320495.641339:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320496.015221:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320496.015298:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977216
00000100:00100000:2.0:1767320496.015309:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977216
00000100:00100000:3.0:1767320496.015310:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:3.0:1767320496.015355:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320496.015374:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977088
00000100:00100000:2.0:1767320496.015378:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977088
00000100:00100000:2.0:1767320496.015404:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4879
00000100:00100000:2.0:1767320496.015416:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291977216:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320496.015428:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17809
00000100:00100000:2.0:1767320496.015492:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291977216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (281us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320496.015524:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291977088:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320496.015556:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320496.015588:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291977088:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 151us (278us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320496.021407:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4879
00000100:00100000:3.0:1767320496.024926:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17809
00010000:00010000:3.0:1767320496.667789:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320497.687123:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320498.711505:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320499.159158:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320499.159166:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320499.159180:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320499.159184:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320499.159188:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320499.159196:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5396
00000100:00080000:1.0:1767320499.159200:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320499.159206:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320499.159232:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd180 x1853164380028032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320499.159265:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767320499.159265:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380027904:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320499.159273:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320499.159276:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320499.159281:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5396
00000100:00080000:1.0:1767320499.159283:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320499.159287:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320499.159301:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcea00 x1853164380028160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320499.159343:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320499.159345:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320499.159349:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320499.159351:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320499.159355:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5396
00000100:00080000:1.0:1767320499.159358:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320499.159361:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320499.159373:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc700 x1853164380028672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320499.159391:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320499.159394:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320499.159396:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320499.159399:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5396
00000100:00080000:1.0:1767320499.159402:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320499.159406:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320499.159410:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380028800:0@lo:400:kworker.0
00000100:00100000:1.0:1767320499.159428:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdf80 x1853164380028928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320499.159442:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320499.159460:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380027904
00000100:00100000:2.0:1767320499.159465:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320499.159468:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380027904
00000100:00100000:2.0:1767320499.159474:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380028544:0@lo:400:kworker.0
00000100:00100000:2.0:1767320499.159500:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320499.159523:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700
00000100:00100000:2.0:1767320499.159533:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380028416:0@lo:400:kworker.0
00000100:00100000:1.0:1767320499.159535:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380027904:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320499.159564:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:1.0:1767320499.159580:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320499.159616:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320499.159624:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380028288:0@lo:400:kworker.0
00000100:00100000:1.0:1767320499.159633:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380027904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (291us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320499.159641:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700
00000100:00100000:2.0:1767320499.159650:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320499.159670:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028416
00000100:00100000:1.0:1767320499.159676:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028416
00000100:00100000:1.0:1767320499.159702:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028288
00000100:00100000:1.0:1767320499.159705:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028288
00000100:00100000:1.0:1767320499.159723:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894
00000100:00100000:1.0:1767320499.159729:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380028416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320499.159762:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380028416:12345-0@lo:400:kworker.0 Request processed in 33us (198us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320499.159769:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028800
00000100:00100000:1.0:1767320499.159774:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894
00000100:00100000:2.0:1767320499.159776:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028800
00000100:00100000:1.0:1767320499.159790:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895
00000100:00100000:1.0:1767320499.159797:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380028288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320499.159835:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380028288:12345-0@lo:400:kworker.0 Request processed in 39us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320499.159841:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895
00000100:00100000:1.0:1767320499.159905:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380027904:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320499.160060:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028544
00000100:00100000:2.0:1767320499.160064:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028544
00000100:00100000:0.0:1767320499.160149:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880
00000100:00100000:0.0:1767320499.160159:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380028800:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320499.160212:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380028800:12345-0@lo:400:kworker.0 Request processed in 56us (771us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320499.160219:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880
00000100:00100000:3.0:1767320499.160241:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380028032:0@lo:38:kworker.0
00000100:00080000:0.0:1767320499.160269:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320499.160274:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320499.160277:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320499.160280:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320499.160291:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028032
00000100:00100000:0.0:1767320499.160294:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028032
00000100:00100000:3.0:1767320499.160300:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380028160:0@lo:38:kworker.0
00000100:00100000:0.0:1767320499.160320:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17810
00000100:00100000:0.0:1767320499.160326:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380028032:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320499.160334:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:0.0:1767320499.160348:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320499.160361:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380028672:0@lo:38:kworker.0
00000100:00100000:0.0:1767320499.160381:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380028032:12345-0@lo:38:kworker.0 Request processed in 53us (107us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320499.160391:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17810
00000100:00100000:3.0:1767320499.160392:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320499.160414:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380028928:0@lo:38:kworker.0
00000100:00100000:0.0:1767320499.160427:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028672
00000100:00100000:0.0:1767320499.160431:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028672
00000100:00100000:3.0:1767320499.160452:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320499.160459:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028928
00000100:00100000:0.0:1767320499.160463:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028928
00000100:00080000:3.0:1767320499.160478:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320499.160483:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17811
00000100:00080000:3.0:1767320499.160487:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320499.160492:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380028672:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320499.160496:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380028032:0@lo:38:kworker.0
00010000:00020000:0.0:1767320499.160506:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320499.160523:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380028160
00000100:00100000:3.0:1767320499.160529:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380028160
00000100:00100000:0.0:1767320499.160539:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380028672:12345-0@lo:38:kworker.0 Request processed in 48us (149us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320499.160546:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17811
00000100:00100000:3.0:1767320499.160557:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192
00000100:00100000:0.0:1767320499.160565:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17812
00000100:00100000:3.0:1767320499.160566:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380028160:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320499.160573:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380028928:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320499.160581:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:0.0:1767320499.160586:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320499.160617:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380028160:12345-0@lo:38:kworker.0 Request processed in 51us (285us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320499.160624:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380028928:12345-0@lo:38:kworker.0 Request processed in 49us (170us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320499.160628:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192
00000100:00100000:0.0:1767320499.160635:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17812
00000100:00080000:3.0:1767320499.160664:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320499.160669:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320499.160673:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380028160:0@lo:38:kworker.0
00000100:00080000:3.0:1767320499.160684:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320499.160688:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320499.160696:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380028288:0@lo:400:kworker.0
00000100:00100000:0.0:1767320499.160706:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380028416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320499.160787:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881
00000100:00100000:1.0:1767320499.160953:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380028800:0@lo:400:kworker.0
00000100:00100000:2.0:1767320499.160963:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380028544:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320499.161016:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380028544:12345-0@lo:400:kworker.0 Request processed in 58us (1515us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320499.161022:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881
00000100:00100000:1.0:1767320499.161198:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380028544:0@lo:400:kworker.0
00000100:00100000:3.0:1767320499.161258:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380028672:0@lo:38:kworker.0
00000100:00080000:3.0:1767320499.161276:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320499.161280:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320499.161282:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380028928:0@lo:38:kworker.0
00010000:00010000:1.0:1767320499.735166:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320500.695237:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320500.695264:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380029056:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320500.695330:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320500.695448:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029056
00000100:00100000:0.0:1767320500.695456:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029056
00000100:00100000:0.0:1767320500.695510:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701
00000100:00100000:0.0:1767320500.695518:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380029056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320500.695548:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320500.695593:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380029056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (263us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320500.695600:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701
00000100:00100000:2.0:1767320500.695734:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380029056:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320500.759459:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320501.137371:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320501.137468:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320501.137807:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977472
00000100:00100000:0.0:1767320501.137817:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977472
00000100:00100000:0.0:1767320501.137935:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4882
00000100:00100000:0.0:1767320501.137946:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291977472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767320501.138077:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320501.138123:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977344
00000100:00100000:2.0:1767320501.138127:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977344
00000100:00100000:2.0:1767320501.138159:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17813
00000100:00100000:2.0:1767320501.138164:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291977344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320501.138184:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320501.138222:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291977344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 56us (753us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320501.138230:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17813
00000100:00100000:0.0:1767320501.138475:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291977472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 530us (1112us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320501.138483:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4882
00010000:00010000:2.0:1767320501.783458:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320502.812789:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320503.831557:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320504.279071:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320504.279080:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320504.279084:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320504.279088:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320504.279092:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320504.279100:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5401
00000100:00080000:1.0:1767320504.279105:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320504.279121:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320504.279165:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164380029184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320504.279187:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320504.279190:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320504.279192:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320504.279195:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5401
00000100:00080000:1.0:1767320504.279198:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320504.279203:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320504.279215:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc000 x1853164380029312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320504.279238:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380029184:0@lo:38:kworker.0
00000100:00080000:1.0:1767320504.279273:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320504.279277:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320504.279279:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320504.279283:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5401
00000100:00080000:1.0:1767320504.279285:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320504.279288:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320504.279297:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcf480 x1853164380029824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320504.279307:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320504.279310:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320504.279311:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320504.279313:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5401
00000100:00080000:1.0:1767320504.279315:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320504.279321:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320504.279321:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320504.279329:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc380 x1853164380030080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320504.279349:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380029696:0@lo:400:kworker.0
00000100:00100000:1.0:1767320504.279383:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320504.279386:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380029312:0@lo:38:kworker.0
00000100:00100000:1.0:1767320504.279410:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320504.279418:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380029568:0@lo:400:kworker.0
00000100:00100000:0.0:1767320504.279436:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320504.279449:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320504.279484:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029568
00000100:00100000:1.0:1767320504.279491:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029568
00000100:00100000:1.0:1767320504.279538:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896
00000100:00100000:1.0:1767320504.279544:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380029568:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320504.279581:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380029568:12345-0@lo:400:kworker.0 Request processed in 37us (132us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320504.279587:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896
00000100:00080000:1.0:1767320504.279608:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320504.279629:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380029568:0@lo:400:kworker.0
00000100:00100000:1.0:1767320504.279655:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380029952:0@lo:400:kworker.0
00000100:00100000:1.0:1767320504.279671:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320504.279686:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320504.279690:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380029440:0@lo:400:kworker.0
00000100:00100000:1.0:1767320504.279708:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320504.279727:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380029824:0@lo:38:kworker.0
00000100:00100000:1.0:1767320504.279731:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029184
00000100:00100000:1.0:1767320504.279736:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029184
00000100:00100000:1.0:1767320504.279755:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029696
00000100:00100000:0.0:1767320504.279760:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320504.279761:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029696
00000100:00100000:3.0:1767320504.280017:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029312
00000100:00100000:3.0:1767320504.280021:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029312
00000100:00100000:3.0:1767320504.280044:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193
00000100:00100000:0.0:1767320504.280110:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380030080:0@lo:38:kworker.0
00000100:00100000:0.0:1767320504.280136:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320504.280162:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029952
00000100:00100000:0.0:1767320504.280166:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029952
00000100:00100000:0.0:1767320504.280186:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029824
00000100:00100000:0.0:1767320504.280188:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029824
00000100:00100000:0.0:1767320504.280197:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030080
00000100:00100000:0.0:1767320504.280200:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030080
00000100:00100000:0.0:1767320504.280210:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4883
00000100:00100000:1.0:1767320504.280220:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884
00000100:00100000:1.0:1767320504.280231:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380029952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320504.280233:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380029696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320504.280280:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380029952:12345-0@lo:400:kworker.0 Request processed in 51us (605us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320504.280288:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884
00000100:00100000:1.0:1767320504.280304:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17814
00000100:00100000:1.0:1767320504.280309:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380029184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320504.280326:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320504.280357:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380029184:12345-0@lo:38:kworker.0 Request processed in 46us (1039us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320504.280362:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17814
00000100:00100000:1.0:1767320504.280376:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17815
00000100:00100000:1.0:1767320504.280379:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380029824:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320504.280388:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320504.280407:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380029696:12345-0@lo:400:kworker.0 Request processed in 69us (903us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320504.280410:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380029824:12345-0@lo:38:kworker.0 Request processed in 29us (652us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320504.280420:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17815
00000100:00100000:0.0:1767320504.280430:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4883
00000100:00100000:1.0:1767320504.280436:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17816
00000100:00100000:1.0:1767320504.280441:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380030080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320504.280450:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320504.280458:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380029440
00000100:00100000:0.0:1767320504.280462:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380029440
00000100:00100000:1.0:1767320504.280472:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380030080:12345-0@lo:38:kworker.0 Request processed in 30us (335us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320504.280478:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17816
00000100:00080000:1.0:1767320504.280494:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320504.280515:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380029952:0@lo:400:kworker.0
00000100:00100000:1.0:1767320504.280572:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380029696:0@lo:400:kworker.0
00000100:00100000:0.0:1767320504.280595:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897
00000100:00080000:1.0:1767320504.280598:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320504.280606:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380029440:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320504.280618:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320504.280624:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320504.280628:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380029824:0@lo:38:kworker.0
00000100:00080000:1.0:1767320504.280639:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320504.280643:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320504.280647:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380030080:0@lo:38:kworker.0
00000100:00100000:0.0:1767320504.280654:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380029440:12345-0@lo:400:kworker.0 Request processed in 49us (943us total) trans 0 rc 0/0
00000100:00080000:1.0:1767320504.280659:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320504.280663:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897
00000100:00080000:1.0:1767320504.280667:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320504.280674:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380029184:0@lo:38:kworker.0
00000100:00100000:0.0:1767320504.280698:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380029440:0@lo:400:kworker.0
00000100:00100000:0.0:1767320504.280762:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320504.280913:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380029312:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320504.280924:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320504.280928:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380030208:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320504.285288:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320504.285296:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320504.285301:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380029312:0@lo:38:kworker.0
00000100:00100000:3.0:1767320504.285360:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380029312:12345-0@lo:38:kworker.0 Request processed in 4133us (5610us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320504.285372:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193
00000100:00100000:0.0:1767320504.285793:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320504.287327:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030208
00000100:00100000:1.0:1767320504.287340:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030208
00000100:00100000:1.0:1767320504.287407:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702
00000100:00100000:1.0:1767320504.287418:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380030208:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320504.287452:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320504.287537:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380030208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (1744us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320504.287545:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702
00000100:00100000:2.0:1767320504.291174:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380030208:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320504.856985:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320505.815164:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320505.815190:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380030336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320505.815268:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320505.817523:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030336
00000100:00100000:1.0:1767320505.819760:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030336
00000100:00100000:1.0:1767320505.819860:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703
00000100:00100000:1.0:1767320505.819895:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380030336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320505.819936:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320505.820220:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380030336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 350us (4951us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320505.820230:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703
00000100:00100000:1.0:1767320505.820298:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380030336:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320505.879177:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320506.257855:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320506.258028:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320506.258106:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977728
00000100:00100000:0.0:1767320506.258116:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977728
00000100:00100000:0.0:1767320506.258182:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977600
00000100:00100000:0.0:1767320506.258185:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977600
00000100:00100000:0.0:1767320506.258220:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4885
00000100:00100000:0.0:1767320506.258231:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291977728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320506.258318:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291977728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (470us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320506.258326:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4885
00000100:00100000:0.0:1767320506.258346:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17817
00000100:00100000:0.0:1767320506.258351:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291977600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320506.258370:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320506.258395:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291977600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 42us (368us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320506.258402:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17817
00000100:00080000:2.0:1767320506.259130:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320506.903931:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320507.927254:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320508.955957:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320509.399363:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380030464:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320509.399449:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320509.399553:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030464
00000100:00100000:0.0:1767320509.399562:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030464
00000100:00100000:0.0:1767320509.399621:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704
00000100:00100000:0.0:1767320509.399630:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380030464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320509.399658:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767320509.399740:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320509.399889:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320509.399894:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320509.399896:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320509.399900:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320509.399904:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320509.399908:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5406
00000100:00080000:2.0:1767320509.399913:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320509.399918:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320509.399943:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05880 x1853164380030592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320509.399968:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320509.399971:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320509.399973:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320509.399977:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5406
00000100:00080000:2.0:1767320509.399979:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320509.399982:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320509.399996:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164380030720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320509.400029:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320509.400033:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320509.400034:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320509.400037:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5406
00000100:00080000:2.0:1767320509.400039:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320509.400042:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320509.400051:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28bb80 x1853164380031104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320509.400137:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380030592:0@lo:38:kworker.0
00000100:00100000:1.0:1767320509.400169:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320509.400189:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380030720:0@lo:38:kworker.0
00000100:00100000:1.0:1767320509.400209:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320509.400232:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380031104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320509.400250:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320509.400281:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030720
00000100:00100000:1.0:1767320509.400285:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030720
00000100:00100000:1.0:1767320509.400309:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194
00000100:00100000:1.0:1767320509.400314:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380030720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320509.400334:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320509.400369:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380030720:12345-0@lo:38:kworker.0 Request processed in 53us (158us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320509.400385:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194
00000100:00100000:1.0:1767320509.400416:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030592
00000100:00100000:1.0:1767320509.400419:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030592
00000100:00100000:1.0:1767320509.400441:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380031104
00000100:00100000:1.0:1767320509.400444:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380031104
00000100:00100000:1.0:1767320509.400460:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17818
00000100:00100000:1.0:1767320509.400466:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380030592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320509.400475:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320509.400502:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380030592:12345-0@lo:38:kworker.0 Request processed in 36us (332us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320509.400508:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17818
00000100:00100000:1.0:1767320509.400520:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17819
00000100:00100000:1.0:1767320509.400524:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380031104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320509.400533:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320509.400555:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380031104:12345-0@lo:38:kworker.0 Request processed in 29us (304us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320509.400561:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17819
00000100:00080000:1.0:1767320509.400603:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320509.400607:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320509.400611:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380030592:0@lo:38:kworker.0
00000100:00080000:1.0:1767320509.400620:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320509.400623:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320509.400625:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380030720:0@lo:38:kworker.0
00000100:00080000:1.0:1767320509.400631:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320509.400634:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320509.400637:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380031104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320509.400689:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380030976:0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.400714:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320509.400734:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320509.400739:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380030848:0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.400762:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320509.400786:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030848
00000100:00100000:1.0:1767320509.400790:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030848
00000100:00100000:1.0:1767320509.400823:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898
00000100:00100000:1.0:1767320509.400829:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380030848:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.400892:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380030848:12345-0@lo:400:kworker.0 Request processed in 63us (128us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320509.400899:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898
00000100:00100000:1.0:1767320509.400917:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380030976
00000100:00100000:1.0:1767320509.400920:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380030976
00000100:00100000:1.0:1767320509.400945:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4886
00000100:00100000:1.0:1767320509.400951:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380030976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.400978:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380030976:12345-0@lo:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320509.400983:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4886
00000100:00100000:1.0:1767320509.401000:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380031232:0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.401020:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320509.401043:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320509.401046:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320509.401053:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380031232
00000100:00100000:1.0:1767320509.401056:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380031232
00000100:00100000:1.0:1767320509.401080:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4887
00000100:00100000:1.0:1767320509.401085:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380031232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.401117:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380031232:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320509.401123:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4887
00000100:00080000:1.0:1767320509.401138:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320509.401157:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380031232:0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.401180:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380030848:0@lo:400:kworker.0
00000100:00100000:1.0:1767320509.401189:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380030976:0@lo:400:kworker.0
00000100:00100000:0.0:1767320509.403024:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380030464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3386us (3565us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320509.403037:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704
00000100:00080000:2.0:1767320509.403239:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320509.403244:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320509.403248:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320509.403253:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5406
00000100:00080000:2.0:1767320509.403258:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320509.403264:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320509.403318:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f28a300 x1853164380031360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320509.404698:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380031360:0@lo:38:kworker.0
00000100:00100000:1.0:1767320509.404769:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320509.404923:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380031360
00000100:00100000:2.0:1767320509.404931:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380031360
00000100:00100000:2.0:1767320509.404974:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17820
00000100:00100000:2.0:1767320509.404982:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380031360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320509.405004:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320509.405045:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380031360:12345-0@lo:38:kworker.0 Request processed in 63us (276us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320509.405051:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17820
00000100:00080000:1.0:1767320509.405191:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320509.405197:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320509.405200:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380031360:0@lo:38:kworker.0
00000100:00100000:3.0:1767320509.405754:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380030464:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320509.975074:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320510.935274:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320510.935300:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380031488:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320510.935372:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320510.935796:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380031488
00000100:00100000:1.0:1767320510.935805:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380031488
00000100:00100000:1.0:1767320510.935889:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705
00000100:00100000:1.0:1767320510.935899:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380031488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320510.935930:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320510.935984:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380031488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (611us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320510.935991:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705
00000100:00100000:0.0:1767320510.936123:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380031488:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320511.000204:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320511.376972:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320511.377062:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320511.377156:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977984
00000100:00100000:2.0:1767320511.377167:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977984
00000100:00100000:2.0:1767320511.377248:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291977856
00000100:00100000:2.0:1767320511.377251:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291977856
00000100:00100000:2.0:1767320511.377271:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4888
00000100:00100000:2.0:1767320511.377279:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291977984:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320511.377347:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291977984:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 69us (386us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320511.377354:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4888
00000100:00100000:2.0:1767320511.377372:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17821
00000100:00100000:2.0:1767320511.377376:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291977856:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320511.377396:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320511.377418:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291977856:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (357us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320511.377424:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17821
00000100:00080000:3.0:1767320511.377734:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320512.023111:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320513.048094:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320514.072711:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320514.519341:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767320514.519342:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380031616:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320514.519351:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320514.519355:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320514.519359:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320514.519363:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320514.519369:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5411
00000100:00080000:1.0:1767320514.519373:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320514.519379:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320514.519405:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd500 x1853164380031744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320514.519418:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320514.519442:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320514.519447:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320514.519449:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320514.519452:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5411
00000100:00080000:1.0:1767320514.519455:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320514.519459:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320514.519473:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcca80 x1853164380031872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320514.519517:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767320514.519518:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:1.0:1767320514.519522:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320514.519525:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320514.519530:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5411
00000100:00100000:0.0:1767320514.519531:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380032000:0@lo:400:kworker.0
00000100:00080000:1.0:1767320514.519533:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320514.519540:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320514.519554:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164380032256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320514.519568:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320514.519575:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320514.519578:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320514.519580:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320514.519584:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5411
00000100:00080000:1.0:1767320514.519586:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320514.519589:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320514.519599:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164380032512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320514.519617:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380032128:0@lo:400:kworker.0
00000100:00100000:1.0:1767320514.519643:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032000
00000100:00100000:0.0:1767320514.519649:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320514.519651:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032000
00000100:00100000:0.0:1767320514.519674:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320514.519682:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380032384:0@lo:400:kworker.0
00000100:00100000:1.0:1767320514.519709:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899
00000100:00100000:0.0:1767320514.519712:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320514.519721:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380032000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320514.519747:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032128
00000100:00100000:0.0:1767320514.519753:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032128
00000100:00100000:1.0:1767320514.519781:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380032000:12345-0@lo:400:kworker.0 Request processed in 60us (211us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320514.519799:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032384
00000100:00100000:0.0:1767320514.519805:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032384
00000100:00100000:1.0:1767320514.519805:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899
00000100:00100000:0.0:1767320514.519839:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4889
00000100:00100000:0.0:1767320514.519848:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380032128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320514.519854:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4890
00000100:00100000:1.0:1767320514.519864:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380032384:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320514.519924:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380032128:12345-0@lo:400:kworker.0 Request processed in 77us (275us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320514.519931:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380032384:12345-0@lo:400:kworker.0 Request processed in 69us (221us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320514.519932:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4889
00000100:00100000:1.0:1767320514.519942:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4890
00000100:00100000:0.0:1767320514.519984:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380032384:0@lo:400:kworker.0
00000100:00100000:1.0:1767320514.519992:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380032000:0@lo:400:kworker.0
00000100:00100000:0.0:1767320514.520003:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380032128:0@lo:400:kworker.0
00000100:00100000:3.0:1767320514.520096:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380031616
00000100:00100000:3.0:1767320514.520101:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380031616
00000100:00100000:2.0:1767320514.520120:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380031744:0@lo:38:kworker.0
00000100:00100000:3.0:1767320514.520141:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706
00000100:00100000:3.0:1767320514.520150:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380031616:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320514.520157:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00000024:3.0:1767320514.520174:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320514.520199:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380031872:0@lo:38:kworker.0
00000100:00100000:3.0:1767320514.520227:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380031616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (811us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320514.520233:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320514.520241:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706
00000100:00080000:3.0:1767320514.520263:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320514.520269:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320514.520271:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380032256:0@lo:38:kworker.0
00000100:00080000:3.0:1767320514.520273:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320514.520299:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f28f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380031616:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320514.520323:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380031744
00000100:00100000:0.0:1767320514.520329:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380031744
00000100:00100000:3.0:1767320514.520343:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380031872
00000100:00100000:3.0:1767320514.520349:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380031872
00000100:00100000:0.0:1767320514.520356:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17822
00000100:00100000:0.0:1767320514.520362:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380031744:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320514.520376:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195
00010000:00020000:0.0:1767320514.520380:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320514.520385:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380031872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320514.520397:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320514.525953:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320514.526008:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380032512:0@lo:38:kworker.0
00000100:00100000:2.0:1767320514.526041:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320514.526074:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032256
00000100:00100000:2.0:1767320514.526082:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032256
00000100:00100000:2.0:1767320514.526125:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032512
00000100:00100000:2.0:1767320514.526141:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032512
00000100:00100000:2.0:1767320514.526162:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17823
00000100:00100000:2.0:1767320514.526169:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380032256:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320514.526217:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17824
00000100:00100000:1.0:1767320514.526224:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380032512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320514.526245:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320514.526289:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380032512:12345-0@lo:38:kworker.0 Request processed in 64us (247us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320514.526297:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17824
00010000:00020000:2.0:1767320514.527930:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320514.527994:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380032256:12345-0@lo:38:kworker.0 Request processed in 1823us (2047us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320514.528005:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17823
00000100:00080000:2.0:1767320514.528064:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320514.528069:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320514.528074:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380032512:0@lo:38:kworker.0
00000100:00080000:2.0:1767320514.528106:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320514.528110:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320514.528114:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380032256:0@lo:38:kworker.0
00000100:00100000:0.0:1767320514.530392:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380031744:12345-0@lo:38:kworker.0 Request processed in 10020us (10227us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320514.530407:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17822
00000100:00080000:2.0:1767320514.533213:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320514.533227:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320514.533232:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380031744:0@lo:38:kworker.0
00000100:00100000:3.0:1767320514.535672:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380031872:12345-0@lo:38:kworker.0 Request processed in 15280us (15434us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320514.535687:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195
00000100:00080000:2.0:1767320514.535825:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320514.535830:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320514.535834:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380031872:0@lo:38:kworker.0
00010000:00010000:2.0:1767320515.095623:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320515.491722:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320515.491829:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291978368
00000100:00100000:2.0:1767320515.491840:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291978368
00000100:00100000:2.0:1767320515.491990:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4891
00000100:00100000:2.0:1767320515.492001:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291978368:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320515.492083:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291978368:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320515.492092:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4891
00000100:00080000:3.0:1767320515.492538:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:3.0:1767320515.499597:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291978112 offset 0 length 520: 4
00000100:00100000:3.0:1767320515.499660:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320515.499834:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291978240
00000100:00100000:1.0:1767320515.499846:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291978240
00000100:00100000:1.0:1767320515.499934:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17825
00000100:00100000:1.0:1767320515.499942:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291978240:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320515.499966:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320515.500043:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291978240:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 99us (382us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320515.500051:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17825
00000100:00100000:0.0:1767320516.055409:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320516.059107:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380032640:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320516.059210:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320516.059295:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032640
00000100:00100000:1.0:1767320516.059304:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032640
00000100:00100000:1.0:1767320516.059369:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707
00000100:00100000:1.0:1767320516.059388:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380032640:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320516.059421:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320516.059478:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380032640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (268us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320516.059486:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707
00000100:00080000:3.0:1767320516.059554:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320516.059578:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380032640:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320516.119140:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320517.144926:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320518.169007:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320519.191676:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320519.639993:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380032768:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320519.640071:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320519.640428:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032768
00000100:00100000:3.0:1767320519.640437:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032768
00000100:00100000:3.0:1767320519.640506:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708
00000100:00100000:3.0:1767320519.640516:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380032768:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320519.640544:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320519.640596:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380032768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (525us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320519.640602:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708
00000100:00100000:3.0:1767320519.640649:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380032768:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320519.642844:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320519.642855:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320519.642858:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320519.642862:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320519.642866:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320519.642901:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5416
00000100:00080000:1.0:1767320519.642906:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320519.642912:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320519.642950:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a680 x1853164380032896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320519.642967:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320519.642970:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320519.642973:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320519.642976:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5416
00000100:00080000:1.0:1767320519.642979:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320519.642982:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320519.642996:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164380033024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320519.643041:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320519.643044:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320519.643046:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320519.643050:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5416
00000100:00080000:1.0:1767320519.643052:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320519.643055:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320519.643068:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164380033408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320519.643093:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320519.643096:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320519.643098:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320519.643101:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5416
00000100:00080000:1.0:1767320519.643104:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767320519.643108:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320519.643119:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc000 x1853164380033664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320519.643162:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380033152:0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643220:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320519.643267:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320519.643272:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380033280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643297:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320519.643332:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380033152
00000100:00100000:1.0:1767320519.643339:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380033152
00000100:00100000:1.0:1767320519.643386:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900
00000100:00100000:1.0:1767320519.643394:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380033152:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643441:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380033152:12345-0@lo:400:kworker.0 Request processed in 47us (220us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320519.643448:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900
00000100:00100000:1.0:1767320519.643476:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380033536:0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643498:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320519.643524:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380033280
00000100:00100000:1.0:1767320519.643527:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380033280
00000100:00100000:1.0:1767320519.643549:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380033536
00000100:00100000:1.0:1767320519.643552:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380033536
00000100:00100000:1.0:1767320519.643571:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892
00000100:00100000:1.0:1767320519.643578:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380033280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643605:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380033280:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320519.643610:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892
00000100:00100000:1.0:1767320519.643622:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893
00000100:00100000:1.0:1767320519.643627:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380033536:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643654:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380033536:12345-0@lo:400:kworker.0 Request processed in 27us (155us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320519.643659:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893
00000100:00100000:1.0:1767320519.643699:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380033536:0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643723:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380033280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320519.643731:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380033152:0@lo:400:kworker.0
00000100:00080000:0.0:1767320519.644107:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320519.644112:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320519.644115:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320519.644510:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320494/real 1767320494]  req@ffff8b0f380abb80 x1853164380026752/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320519 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320519.644532:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f380abb80 x1853164380026752/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320519 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320519.644549:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380032896:0@lo:38:kworker.0
00000100:00100000:3.0:1767320519.644594:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320519.644629:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380033024:0@lo:38:kworker.0
00000100:00100000:3.0:1767320519.644653:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320519.644687:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380033408:0@lo:38:kworker.0
00000100:00100000:3.0:1767320519.644708:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320519.644727:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380033664:0@lo:38:kworker.0
00000100:00100000:3.0:1767320519.644757:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320519.644774:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320519.644787:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320519.644790:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380026752:0@lo:250:kworker.0
00000100:00100000:3.0:1767320519.644990:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380032896
00000100:00100000:3.0:1767320519.644998:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380032896
00000100:00100000:3.0:1767320519.645031:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380033408
00000100:00100000:3.0:1767320519.645035:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380033408
00000100:00100000:3.0:1767320519.645046:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380033664
00000100:00100000:3.0:1767320519.645048:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380033664
00000100:00100000:3.0:1767320519.645065:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17826
00000100:00100000:3.0:1767320519.645072:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380032896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320519.645096:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320519.645140:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380032896:12345-0@lo:38:kworker.0 Request processed in 67us (544us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320519.645146:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17826
00000100:00100000:3.0:1767320519.645328:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17827
00000100:00100000:3.0:1767320519.645332:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380033408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320519.645342:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320519.645367:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380033408:12345-0@lo:38:kworker.0 Request processed in 33us (657us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320519.645372:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17827
00000100:00100000:3.0:1767320519.645382:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17828
00000100:00100000:3.0:1767320519.645386:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380033664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320519.645394:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320519.645413:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380033664:12345-0@lo:38:kworker.0 Request processed in 26us (656us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320519.645419:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17828
00000100:00080000:3.0:1767320519.645466:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320519.645471:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320519.645474:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380032896:0@lo:38:kworker.0
00000100:00080000:3.0:1767320519.645483:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320519.645486:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320519.645489:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380033408:0@lo:38:kworker.0
00000100:00080000:3.0:1767320519.645497:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320519.645500:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320519.645503:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380033664:0@lo:38:kworker.0
00000100:00100000:0.0:1767320519.645603:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380033024
00000100:00100000:0.0:1767320519.645608:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380033024
00000100:00100000:0.0:1767320519.645642:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196
00000100:00100000:0.0:1767320519.645647:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380033024:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320519.645657:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320519.645693:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380033024:12345-0@lo:38:kworker.0 Request processed in 45us (1039us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320519.645698:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196
00000100:00080000:0.0:1767320519.645730:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320519.645735:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320519.645739:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380033024:0@lo:38:kworker.0
00000100:00080000:2.0:1767320519.645856:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320519.645863:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320519.645866:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320519.645898:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5396
00000100:00080000:2.0:1767320519.645903:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320519.645909:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320519.645938:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570e00 x1853164380033792/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320519.646115:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380033792:0@lo:250:kworker.0
00000400:00000100:0.0:1767320519.646146:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380033792 offset 0 length 520: 4
00010000:00010000:1.0:1767320520.217795:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320520.594624:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320520.594721:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320520.594857:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291978496
00000100:00100000:2.0:1767320520.595141:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291978496
00000100:00100000:2.0:1767320520.595299:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291978624
00000100:00100000:2.0:1767320520.595303:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291978624
00000100:00080000:3.0:1767320520.595383:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320520.597188:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4894
00000100:00100000:0.0:1767320520.598171:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291978624:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320520.600211:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291978624:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 2979us (5460us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320520.600232:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4894
00000100:00100000:0.0:1767320520.600362:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17829
00000100:00100000:0.0:1767320520.600370:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291978496:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320520.600396:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320520.600436:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291978496:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 65us (5823us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320520.600443:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17829
00000100:00100000:3.0:1767320521.175436:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380033920:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320521.175529:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320521.180560:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380033920
00000100:00100000:1.0:1767320521.180585:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380033920
00000100:00100000:1.0:1767320521.180821:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709
00000100:00100000:1.0:1767320521.180834:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380033920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320521.180894:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320521.181021:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380033920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 189us (5491us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320521.181029:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709
00000100:00100000:0.0:1767320521.181599:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380033920:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320521.184955:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320521.239154:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320522.266171:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320523.287472:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320524.311174:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320524.759284:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320524.759318:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380034048:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320524.759392:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320524.760273:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320524.760279:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320524.760282:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320524.760287:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320524.760292:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767320524.760296:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034048
00000100:00080000:0.0:1767320524.760299:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5422
00000100:00080000:0.0:1767320524.760305:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767320524.760307:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034048
00000100:00080000:0.0:1767320524.760312:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320524.760338:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3ffb80 x1853164380034176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320524.760359:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320524.760363:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320524.760365:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320524.760369:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5422
00000100:00080000:0.0:1767320524.760372:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320524.760377:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320524.760380:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710
00000100:00100000:2.0:1767320524.760393:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380034048:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320524.760402:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd500 x1853164380034304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00002000:00000024:2.0:1767320524.760435:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320524.760481:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380034048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (1090us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320524.760489:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710
00000100:00100000:1.0:1767320524.760540:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320524.760553:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380034432:0@lo:400:kworker.0
00000100:00100000:1.0:1767320524.760597:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320524.760650:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034432
00000100:00100000:1.0:1767320524.760656:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034432
00000100:00100000:1.0:1767320524.760724:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901
00000100:00100000:1.0:1767320524.760737:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380034432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320524.760798:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380034432:12345-0@lo:400:kworker.0 Request processed in 62us (198us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320524.760804:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901
00000100:00100000:1.0:1767320524.760857:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380034432:0@lo:400:kworker.0
00000100:00100000:1.0:1767320524.760939:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380034048:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320524.761145:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380034176:0@lo:38:kworker.0
00000100:00080000:3.0:1767320524.761176:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320524.761183:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320524.761236:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320524.761271:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380034304:0@lo:38:kworker.0
00000100:00100000:2.0:1767320524.761295:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320524.761333:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034304
00000100:00100000:2.0:1767320524.761337:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034304
00000100:00100000:2.0:1767320524.761361:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197
00000100:00100000:2.0:1767320524.761366:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380034304:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320524.761385:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320524.761483:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380034304:12345-0@lo:38:kworker.0 Request processed in 117us (187us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320524.761488:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197
00000100:00080000:2.0:1767320524.761510:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320524.761514:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320524.761516:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380034304:0@lo:38:kworker.0
00000100:00080000:0.0:1767320524.761554:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1767320524.761597:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034176
00000100:00100000:3.0:1767320524.761601:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034176
00000100:00100000:3.0:1767320524.761621:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17830
00000100:00100000:3.0:1767320524.761626:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380034176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320524.761637:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320524.761657:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380034560:0@lo:400:kworker.0
00000100:00100000:1.0:1767320524.761688:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320524.761735:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034560
00000100:00100000:1.0:1767320524.761740:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034560
00000100:00100000:1.0:1767320524.761785:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4895
00000100:00080000:2.0:1767320524.761791:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320524.761795:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380034560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320524.761847:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380034560:12345-0@lo:400:kworker.0 Request processed in 55us (159us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320524.761853:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4895
00000100:00080000:0.0:1767320524.761920:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320524.761923:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320524.761927:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5422
00000100:00080000:0.0:1767320524.761930:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320524.761934:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320524.761951:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a7800 x1853164380034688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320524.761999:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380034560:0@lo:400:kworker.0
00000100:00100000:2.0:1767320524.762070:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380034688:0@lo:38:kworker.0
00000100:00100000:2.0:1767320524.762095:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320524.762199:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034688
00000100:00100000:1.0:1767320524.762208:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034688
00000100:00100000:1.0:1767320524.762249:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17831
00000100:00100000:1.0:1767320524.762260:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380034688:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320524.762264:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380034176:12345-0@lo:38:kworker.0 Request processed in 634us (1025us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320524.762273:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17830
00010000:00020000:1.0:1767320524.762278:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320524.774980:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320524.774990:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320524.774994:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320524.775002:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5422
00000100:00080000:0.0:1767320524.775009:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767320524.775016:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320524.775036:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a5500 x1853164380034944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320524.775110:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320524.775134:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380034816:0@lo:400:kworker.0
00000100:00100000:0.0:1767320524.777422:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320524.777934:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034816
00000100:00100000:3.0:1767320524.777946:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034816
00000100:00100000:3.0:1767320524.778031:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4896
00000100:00100000:3.0:1767320524.778040:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380034816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320524.778111:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380034816:12345-0@lo:400:kworker.0 Request processed in 72us (695us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320524.778122:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4896
00000100:00100000:3.0:1767320524.778186:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380034816:0@lo:400:kworker.0
00000100:00080000:0.0:1767320524.778415:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320524.782742:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380034688:12345-0@lo:38:kworker.0 Request processed in 20472us (20634us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320524.782758:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17831
00000100:00080000:2.0:1767320524.791580:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320524.791596:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320524.791601:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380034176:0@lo:38:kworker.0
00000100:00100000:2.0:1767320524.791642:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380034944:0@lo:38:kworker.0
00000100:00100000:2.0:1767320524.791722:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320524.791774:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380034944
00000100:00100000:1.0:1767320524.791783:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380034944
00000100:00080000:2.0:1767320524.791795:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320524.791801:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320524.791804:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380034688:0@lo:38:kworker.0
00000100:00100000:1.0:1767320524.791837:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17832
00000100:00100000:1.0:1767320524.791846:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380034944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320524.791899:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320524.791975:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380034944:12345-0@lo:38:kworker.0 Request processed in 125us (250us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320524.791988:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17832
00000100:00080000:0.0:1767320524.792175:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320524.792202:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320524.792208:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380034944:0@lo:38:kworker.0
00010000:00010000:3.0:1767320525.339020:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320525.717904:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320525.717953:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320525.718117:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291978880
00000100:00100000:3.0:1767320525.718127:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291978880
00000100:00100000:3.0:1767320525.718209:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4897
00000100:00100000:3.0:1767320525.718221:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291978880:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320525.718298:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291978880:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (439us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320525.718305:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4897
00000100:00100000:3.0:1767320525.718321:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291978752
00000100:00100000:3.0:1767320525.718324:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291978752
00000100:00100000:3.0:1767320525.718346:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17833
00000100:00100000:3.0:1767320525.718351:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291978752:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320525.718373:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320525.718400:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291978752:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (447us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320525.718419:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17833
00000100:00080000:0.0:1767320525.719339:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320526.298235:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320526.298270:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380035072:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320526.298346:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320526.298597:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035072
00000100:00100000:1.0:1767320526.298607:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035072
00000100:00100000:1.0:1767320526.298673:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711
00000100:00100000:1.0:1767320526.298712:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380035072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320526.298744:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320526.298804:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380035072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (457us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320526.298811:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711
00000100:00100000:3.0:1767320526.298917:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380035072:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320526.299050:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320526.359933:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320527.383855:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320528.407284:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320529.431288:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320529.881002:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320529.881011:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320529.881014:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320529.881017:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320529.881021:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320529.881028:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5427
00000100:00080000:2.0:1767320529.881033:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320529.881042:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320529.881094:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd500 x1853164380035200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320529.882559:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380035200:0@lo:38:kworker.0
00000100:00080000:2.0:1767320529.882736:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320529.882742:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320529.882745:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320529.882749:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5427
00000100:00080000:2.0:1767320529.882752:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320529.882757:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320529.882782:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d180 x1853164380035328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320529.883418:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380035456:0@lo:400:kworker.0
00000100:00100000:1.0:1767320529.883461:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320529.883798:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380035584:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320529.883833:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320529.883860:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320529.883907:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380035328:0@lo:38:kworker.0
00000100:00100000:0.0:1767320529.883933:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320529.883942:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035584
00000100:00100000:3.0:1767320529.883953:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035584
00000100:00100000:0.0:1767320529.883966:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035200
00000100:00100000:0.0:1767320529.883971:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035200
00000100:00100000:0.0:1767320529.884010:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17834
00000100:00100000:0.0:1767320529.884018:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380035200:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320529.884020:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712
00000100:00100000:3.0:1767320529.884032:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380035584:12345-0@lo:13:osp-pre-1-1.0
00010000:00020000:0.0:1767320529.884043:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00002000:00000024:3.0:1767320529.884076:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320529.884093:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380035200:12345-0@lo:38:kworker.0 Request processed in 74us (1443us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320529.884103:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17834
00000100:00100000:3.0:1767320529.884127:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380035584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (291us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320529.884134:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035328
00000100:00100000:3.0:1767320529.884135:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712
00000100:00100000:0.0:1767320529.884140:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035328
00000100:00080000:3.0:1767320529.884165:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320529.884170:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198
00000100:00100000:0.0:1767320529.884176:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380035328:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320529.884187:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320529.884221:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380035328:12345-0@lo:38:kworker.0 Request processed in 44us (288us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320529.884228:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198
00000100:00100000:3.0:1767320529.884232:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380035584:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320529.884268:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320529.884275:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320529.884277:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035456
00000100:00100000:0.0:1767320529.884281:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380035328:0@lo:38:kworker.0
00000100:00100000:3.0:1767320529.884283:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035456
00000100:00080000:0.0:1767320529.884298:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320529.884303:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320529.884307:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380035200:0@lo:38:kworker.0
00000100:00100000:3.0:1767320529.884320:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902
00000100:00100000:3.0:1767320529.884328:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380035456:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320529.885508:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380035456:12345-0@lo:400:kworker.0 Request processed in 1176us (2042us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320529.885519:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902
00000100:00100000:3.0:1767320529.885572:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380035712:0@lo:400:kworker.0
00000100:00100000:3.0:1767320529.885619:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320529.885655:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380035840:0@lo:400:kworker.0
00000100:00100000:0.0:1767320529.885985:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320529.886014:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035840
00000100:00100000:0.0:1767320529.886019:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035840
00000100:00100000:0.0:1767320529.886057:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4898
00000100:00100000:0.0:1767320529.886064:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380035840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320529.886108:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380035840:12345-0@lo:400:kworker.0 Request processed in 45us (122us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320529.886112:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4898
00000100:00080000:0.0:1767320529.886130:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320529.886159:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380035840:0@lo:400:kworker.0
00000100:00100000:3.0:1767320529.886203:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035712
00000100:00100000:3.0:1767320529.886208:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035712
00000100:00100000:3.0:1767320529.886237:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903
00000100:00100000:3.0:1767320529.886244:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380035712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320529.886282:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380035712:12345-0@lo:400:kworker.0 Request processed in 38us (661us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320529.886288:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903
00000100:00100000:3.0:1767320529.886314:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380035712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320529.886516:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380035456:0@lo:400:kworker.0
00000100:00080000:2.0:1767320529.887094:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320529.887100:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320529.887104:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320529.887116:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5427
00000100:00080000:2.0:1767320529.887121:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320529.887126:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00080000:0.0:1767320529.887127:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320529.887156:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e680 x1853164380035968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320529.887222:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380035968:0@lo:38:kworker.0
00000100:00100000:0.0:1767320529.887258:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320529.887344:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380035968
00000100:00100000:3.0:1767320529.887350:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380035968
00000100:00100000:3.0:1767320529.887385:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17835
00000100:00100000:3.0:1767320529.887391:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380035968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320529.887492:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320529.887905:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320529.887910:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320529.887912:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320529.887916:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5427
00000100:00080000:2.0:1767320529.887920:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767320529.887924:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320529.887939:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e300 x1853164380036224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320529.887991:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380036224:0@lo:38:kworker.0
00000100:00100000:1.0:1767320529.887995:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380036096:0@lo:400:kworker.0
00000100:00100000:0.0:1767320529.888026:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320529.888044:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036224
00000100:00100000:1.0:1767320529.888049:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036224
00000100:00100000:1.0:1767320529.888082:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17836
00000100:00100000:1.0:1767320529.888087:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380036224:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320529.888099:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320529.888131:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380036224:12345-0@lo:38:kworker.0 Request processed in 43us (106us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320529.888138:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17836
00000100:00100000:1.0:1767320529.888197:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320529.888226:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036096
00000100:00100000:1.0:1767320529.888229:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036096
00000100:00100000:1.0:1767320529.888264:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4899
00000100:00100000:1.0:1767320529.888269:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380036096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320529.888320:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380036096:12345-0@lo:400:kworker.0 Request processed in 51us (122us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320529.888332:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4899
00000100:00080000:1.0:1767320529.888352:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320529.888381:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380036096:0@lo:400:kworker.0
00000100:00100000:3.0:1767320529.890523:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380035968:12345-0@lo:38:kworker.0 Request processed in 3120us (3253us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320529.890536:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17835
00000100:00080000:0.0:1767320529.891903:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320529.891914:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320529.891920:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380035968:0@lo:38:kworker.0
00000100:00080000:0.0:1767320529.891950:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320529.891953:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320529.891955:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380036224:0@lo:38:kworker.0
00010000:00010000:2.0:1767320530.455701:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320530.834184:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320530.834439:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291979136
00000100:00100000:3.0:1767320530.834449:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291979136
00000100:00100000:3.0:1767320530.834534:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4900
00000100:00100000:3.0:1767320530.834545:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291979136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320530.834627:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291979136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (466us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320530.834635:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4900
00000100:00080000:1.0:1767320530.834894:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320530.835505:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320530.835574:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291979008
00000100:00100000:1.0:1767320530.835580:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291979008
00000100:00100000:1.0:1767320530.835617:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17837
00000100:00100000:1.0:1767320530.835624:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291979008:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320530.835655:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320530.835713:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291979008:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 87us (208us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320530.835720:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17837
00000100:00100000:0.0:1767320531.416143:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320531.416183:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380036352:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320531.416326:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320531.417004:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036352
00000100:00100000:1.0:1767320531.417017:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036352
00000100:00100000:1.0:1767320531.417113:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713
00000100:00100000:1.0:1767320531.417134:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380036352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320531.417175:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320531.417800:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380036352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 676us (1473us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320531.417939:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380036352:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320531.418088:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713
00000100:00080000:0.0:1767320531.419858:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320531.479254:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320532.505180:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320533.529702:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320534.551378:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320534.999393:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380036480:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320534.999480:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320534.999696:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036480
00000100:00100000:2.0:1767320534.999705:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036480
00000100:00100000:2.0:1767320534.999788:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714
00000100:00100000:2.0:1767320534.999809:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380036480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320534.999853:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767320534.999979:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320534.999994:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320534.999999:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320535.000001:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320535.000005:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320535.000009:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320535.000014:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5432
00000100:00080000:3.0:1767320535.000019:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320535.000025:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320535.000058:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164380036608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320535.000075:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320535.000079:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320535.000081:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320535.000085:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5432
00000100:00080000:3.0:1767320535.000087:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320535.000100:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320535.000116:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a680 x1853164380036736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320535.000159:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320535.000169:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380036864:0@lo:400:kworker.0
00000100:00100000:0.0:1767320535.000918:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380036608:0@lo:38:kworker.0
00000100:00100000:0.0:1767320535.015252:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320535.015350:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380036736:0@lo:38:kworker.0
00000100:00100000:0.0:1767320535.015399:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320535.015449:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036736
00000100:00100000:0.0:1767320535.015457:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036736
00000100:00100000:0.0:1767320535.015491:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199
00000100:00100000:0.0:1767320535.015512:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380036736:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320535.015534:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320535.015587:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380036736:12345-0@lo:38:kworker.0 Request processed in 74us (186us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320535.015595:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199
00000100:00080000:0.0:1767320535.015675:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320535.015681:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320535.015685:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380036736:0@lo:38:kworker.0
00000100:00100000:0.0:1767320535.015710:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036608
00000100:00100000:0.0:1767320535.015714:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036608
00000100:00100000:0.0:1767320535.015736:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17838
00000100:00100000:0.0:1767320535.015741:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380036608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320535.017694:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320535.017992:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380036608:12345-0@lo:38:kworker.0 Request processed in 2245us (2745us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320535.018004:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17838
00000100:00100000:3.0:1767320535.018404:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320535.018480:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036864
00000100:00100000:3.0:1767320535.018492:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036864
00000100:00100000:3.0:1767320535.018561:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904
00000100:00100000:3.0:1767320535.018572:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380036864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320535.018643:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380036864:12345-0@lo:400:kworker.0 Request processed in 73us (239us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320535.018649:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904
00000100:00080000:3.0:1767320535.018671:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320535.018713:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380036864:0@lo:400:kworker.0
00000100:00080000:3.0:1767320535.018783:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320535.018787:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320535.018791:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320535.018798:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5432
00000100:00080000:3.0:1767320535.019372:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320535.019378:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320535.019393:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380036992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320535.019431:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320535.019469:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380036992
00000100:00100000:3.0:1767320535.019473:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380036992
00000100:00100000:3.0:1767320535.019520:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4901
00000100:00100000:3.0:1767320535.019528:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380036992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320535.019565:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380036992:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320535.019572:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4901
00000100:00080000:3.0:1767320535.019588:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320535.019619:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380036992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320535.019657:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5c00 x1853164380037120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320535.019686:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320535.019690:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320535.019692:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320535.019699:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5432
00000100:00080000:3.0:1767320535.019702:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320535.019705:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320535.019717:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380037248:0@lo:400:kworker.0
00000100:00100000:3.0:1767320535.019743:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320535.020054:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380036480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 20255us (20571us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320535.020063:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714
00000100:00100000:1.0:1767320535.029796:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380036480:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320535.031380:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d500 x1853164380037376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320535.033128:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380037248
00000100:00100000:0.0:1767320535.033245:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380037248
00000100:00100000:0.0:1767320535.033332:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4902
00000100:00100000:0.0:1767320535.033342:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380037248:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320535.033438:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380037248:12345-0@lo:400:kworker.0 Request processed in 97us (13693us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320535.033445:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4902
00000100:00100000:0.0:1767320535.033482:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380037120:0@lo:38:kworker.0
00000100:00100000:0.0:1767320535.033519:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320535.033541:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380037376:0@lo:38:kworker.0
00000100:00100000:0.0:1767320535.033563:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320535.033594:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320535.033599:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320535.033615:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380036608:0@lo:38:kworker.0
00000100:00100000:0.0:1767320535.033646:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380037120
00000100:00100000:0.0:1767320535.033650:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380037120
00000100:00100000:0.0:1767320535.033670:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380037376
00000100:00100000:0.0:1767320535.033672:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380037376
00000100:00100000:0.0:1767320535.033687:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17839
00000100:00100000:0.0:1767320535.033692:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380037120:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320535.033710:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320535.033740:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380037120:12345-0@lo:38:kworker.0 Request processed in 46us (220us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320535.033746:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17839
00000100:00100000:0.0:1767320535.033770:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17840
00000100:00100000:0.0:1767320535.033774:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380037376:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320535.033783:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320535.034037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320535.040627:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380037248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320535.041083:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380037376:12345-0@lo:38:kworker.0 Request processed in 7304us (7515us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320535.041095:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17840
00000100:00080000:1.0:1767320535.047341:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320535.047354:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320535.047360:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380037120:0@lo:38:kworker.0
00000100:00080000:0.0:1767320535.047493:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320535.047498:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320535.047502:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380037376:0@lo:38:kworker.0
00010000:00010000:1.0:1767320535.576945:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320535.952991:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320535.953072:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320535.953495:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291979392
00000100:00100000:0.0:1767320535.953505:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291979392
00000100:00100000:0.0:1767320535.953580:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291979264
00000100:00100000:0.0:1767320535.953583:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291979264
00000100:00100000:0.0:1767320535.953616:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4903
00000100:00100000:0.0:1767320535.953626:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291979392:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320535.953779:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17841
00000100:00100000:1.0:1767320535.953786:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291979264:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320535.953810:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320535.953858:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320535.954997:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291979392:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1368us (2019us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320535.955009:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4903
00000100:00100000:1.0:1767320535.960031:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291979264:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 6225us (6940us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320535.960048:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17841
00000100:00100000:3.0:1767320536.536790:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380037504:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320536.536899:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320536.537030:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380037504
00000100:00100000:1.0:1767320536.537039:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380037504
00000100:00100000:1.0:1767320536.537098:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715
00000100:00100000:1.0:1767320536.537108:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380037504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320536.537150:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320536.537197:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380037504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (328us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320536.537204:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715
00000100:00100000:3.0:1767320536.537604:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380037504:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320536.600033:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320537.623515:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320538.647689:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320539.671523:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320540.121744:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320540.121755:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320540.121758:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320540.121762:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320540.121767:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320540.121775:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5437
00000100:00080000:2.0:1767320540.121780:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320540.121790:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320540.121848:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d500 x1853164380037632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320540.121913:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320540.121917:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320540.121919:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320540.121923:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5437
00000100:00080000:2.0:1767320540.121926:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320540.121930:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320540.121949:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85e300 x1853164380037760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320540.122012:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320540.122016:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320540.122017:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320540.122021:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5437
00000100:00080000:2.0:1767320540.122024:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320540.122027:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320540.122040:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff480 x1853164380038272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320540.122056:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320540.122059:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320540.122061:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320540.122065:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5437
00000100:00080000:2.0:1767320540.122068:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320540.122072:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320540.122083:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafdc00 x1853164380038528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320540.122139:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380038144:0@lo:400:kworker.0
00000100:00100000:2.0:1767320540.122213:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320540.122285:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320540.122291:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380038400:0@lo:400:kworker.0
00000100:00100000:2.0:1767320540.122313:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320540.122313:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380038016:0@lo:400:kworker.0
00000100:00100000:3.0:1767320540.122346:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320540.122369:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380038144
00000100:00100000:2.0:1767320540.122377:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380038144
00000100:00100000:3.0:1767320540.122377:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320540.122382:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380037888:0@lo:400:kworker.0
00000100:00100000:3.0:1767320540.122403:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320540.122425:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380038016
00000100:00100000:3.0:1767320540.122428:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380038016
00000100:00100000:2.0:1767320540.122429:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380038400
00000100:00100000:2.0:1767320540.122431:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380038400
00000100:00100000:3.0:1767320540.122451:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380037888
00000100:00100000:2.0:1767320540.122452:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904
00000100:00100000:3.0:1767320540.122454:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380037888
00000100:00100000:2.0:1767320540.122460:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380038144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320540.122472:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905
00000100:00100000:3.0:1767320540.122477:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380038016:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320540.122512:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380038144:12345-0@lo:400:kworker.0 Request processed in 52us (298us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320540.122512:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380038016:12345-0@lo:400:kworker.0 Request processed in 33us (164us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320540.122520:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904
00000100:00100000:3.0:1767320540.122520:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905
00000100:00100000:2.0:1767320540.122536:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905
00000100:00100000:3.0:1767320540.122536:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906
00000100:00100000:2.0:1767320540.122542:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380038400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320540.122542:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380037888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320540.122581:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380038400:12345-0@lo:400:kworker.0 Request processed in 39us (266us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320540.122581:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380037888:12345-0@lo:400:kworker.0 Request processed in 38us (176us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320540.122587:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905
00000100:00100000:3.0:1767320540.122588:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906
00000100:00080000:2.0:1767320540.122604:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320540.122608:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320540.122611:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320540.122632:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380038400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320540.122632:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380037888:0@lo:400:kworker.0
00000100:00100000:2.0:1767320540.122642:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380038144:0@lo:400:kworker.0
00000100:00100000:3.0:1767320540.122643:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380038016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320540.122989:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380037632:0@lo:38:kworker.0
00000100:00100000:0.0:1767320540.123038:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320540.123067:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380037760:0@lo:38:kworker.0
00000100:00100000:0.0:1767320540.123090:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320540.123122:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380038272:0@lo:38:kworker.0
00000100:00100000:0.0:1767320540.123143:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320540.123160:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380038528:0@lo:38:kworker.0
00000100:00100000:0.0:1767320540.123179:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320540.123207:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380037632
00000100:00100000:0.0:1767320540.123211:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380037632
00000100:00100000:0.0:1767320540.123231:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380038272
00000100:00100000:0.0:1767320540.123235:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380038272
00000100:00100000:0.0:1767320540.123244:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380038528
00000100:00100000:0.0:1767320540.123247:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380038528
00000100:00100000:0.0:1767320540.123257:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17842
00000100:00100000:0.0:1767320540.123262:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380037632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320540.123283:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320540.123295:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380037760
00000100:00100000:3.0:1767320540.123299:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380037760
00000100:00100000:3.0:1767320540.123318:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200
00000100:00100000:0.0:1767320540.123320:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380037632:12345-0@lo:38:kworker.0 Request processed in 57us (282us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320540.123323:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380037760:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320540.123327:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17842
00010000:00020000:3.0:1767320540.123332:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320540.123340:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17843
00000100:00100000:0.0:1767320540.123344:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380038272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320540.123352:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320540.123358:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380037760:12345-0@lo:38:kworker.0 Request processed in 35us (268us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320540.123364:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200
00000100:00100000:0.0:1767320540.123369:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380038272:12345-0@lo:38:kworker.0 Request processed in 24us (226us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320540.123374:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17843
00000100:00100000:0.0:1767320540.123383:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17844
00000100:00100000:0.0:1767320540.123387:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380038528:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320540.123395:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320540.123416:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380038528:12345-0@lo:38:kworker.0 Request processed in 27us (235us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320540.123421:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17844
00000100:00080000:0.0:1767320540.123446:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320540.123451:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320540.123454:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380037632:0@lo:38:kworker.0
00000100:00080000:0.0:1767320540.123462:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320540.123465:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320540.123468:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380037760:0@lo:38:kworker.0
00000100:00080000:0.0:1767320540.123475:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320540.123477:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320540.123480:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380038272:0@lo:38:kworker.0
00000100:00080000:0.0:1767320540.123486:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320540.123489:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320540.123491:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380038528:0@lo:38:kworker.0
00000100:00100000:0.0:1767320540.126219:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320540.126249:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380038656:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320540.126330:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320540.126689:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380038656
00000100:00100000:3.0:1767320540.126698:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380038656
00000100:00100000:3.0:1767320540.126757:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716
00000100:00100000:3.0:1767320540.126767:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380038656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320540.126797:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320540.126861:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380038656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (530us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320540.126903:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716
00000100:00100000:0.0:1767320540.127010:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380038656:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320540.695548:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320541.074684:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767320541.074722:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291979520 offset 0 length 520: 4
00000100:00100000:0.0:1767320541.074742:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320541.074916:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291979776
00000100:00100000:1.0:1767320541.074931:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291979776
00000100:00100000:1.0:1767320541.075043:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291979648
00000100:00100000:1.0:1767320541.075047:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291979648
00000100:00100000:1.0:1767320541.075072:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4906
00000100:00100000:1.0:1767320541.075094:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291979776:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320541.075191:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291979776:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (519us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320541.075199:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4906
00000100:00100000:1.0:1767320541.075228:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17845
00000100:00100000:1.0:1767320541.075233:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291979648:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320541.075259:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320541.075287:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291979648:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (544us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320541.075293:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17845
00000100:00080000:3.0:1767320541.076726:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320541.655289:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380038784:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320541.655364:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320541.655490:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380038784
00000100:00100000:1.0:1767320541.655498:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380038784
00000100:00100000:1.0:1767320541.655580:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717
00000100:00100000:1.0:1767320541.655589:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380038784:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320541.656204:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320541.656283:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380038784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 694us (917us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320541.656292:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717
00000100:00100000:0.0:1767320541.656617:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380038784:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320541.719278:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320542.743204:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320543.767286:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320544.215012:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320519/real 1767320519]  req@ffff8b0e0c570e00 x1853164380033792/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320544 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320544.215038:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c570e00 x1853164380033792/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320544 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320544.215049:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320544.215106:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320544.215109:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380033792:0@lo:250:kworker.0
00000100:00080000:1.0:1767320544.219492:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320544.219503:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320544.219507:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320544.219515:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5422
00000100:00080000:1.0:1767320544.219529:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320544.219537:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320544.219579:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdc00 x1853164380038912/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320544.219614:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320544.219619:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320544.219620:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320544.219624:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5442
00000100:00080000:1.0:1767320544.219627:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320544.219631:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320544.219648:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcd500 x1853164380039040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320544.219657:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320544.219661:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320544.219662:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320544.219666:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5442
00000100:00080000:1.0:1767320544.219668:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320544.219672:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320544.219684:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcca80 x1853164380039168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320544.219953:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380039296:0@lo:400:kworker.0
00000100:00100000:2.0:1767320544.219994:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380038912:0@lo:250:kworker.0
00000400:00000100:2.0:1767320544.220021:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380038912 offset 0 length 520: 4
00000100:00100000:0.0:1767320544.220023:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320544.220065:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380039040:0@lo:38:kworker.0
00000100:00100000:2.0:1767320544.220091:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320544.220110:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380039168:0@lo:38:kworker.0
00000100:00100000:2.0:1767320544.220144:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320544.220167:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039296
00000100:00100000:3.0:1767320544.220174:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039296
00000100:00100000:2.0:1767320544.220182:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039040
00000100:00100000:2.0:1767320544.220185:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039040
00000100:00100000:3.0:1767320544.220222:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907
00000100:00100000:3.0:1767320544.220231:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380039296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320544.220237:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17846
00000100:00100000:2.0:1767320544.220242:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380039040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320544.220260:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320544.220289:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380039040:12345-0@lo:38:kworker.0 Request processed in 45us (197us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320544.220295:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17846
00000100:00080000:1.0:1767320544.220326:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320544.220330:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767320544.220331:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380039552:0@lo:400:kworker.0
00000100:00080000:1.0:1767320544.220332:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320544.220335:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5442
00000100:00080000:1.0:1767320544.220338:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320544.220342:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320544.220355:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddf80 x1853164380039680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320544.220355:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320544.220371:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1767320544.220372:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:1.0:1767320544.220374:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320544.220376:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767320544.220377:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380039808:0@lo:400:kworker.0
00000100:00080000:1.0:1767320544.220379:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5442
00000100:00080000:1.0:1767320544.220381:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320544.220385:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320544.220396:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320544.220409:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dfb80 x1853164380039936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320544.220417:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039552
00000100:00100000:2.0:1767320544.220420:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039552
00000100:00100000:1.0:1767320544.220431:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380039424:0@lo:400:kworker.0
00000100:00100000:2.0:1767320544.220445:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039808
00000100:00100000:2.0:1767320544.220448:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039808
00000100:00100000:1.0:1767320544.220456:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320544.220481:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907
00000100:00100000:1.0:1767320544.220485:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039424
00000100:00100000:2.0:1767320544.220488:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380039552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320544.220489:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039424
00000100:00100000:1.0:1767320544.220514:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908
00000100:00100000:1.0:1767320544.220532:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380039424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320544.220533:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380039552:12345-0@lo:400:kworker.0 Request processed in 46us (177us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320544.220540:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907
00000100:00100000:2.0:1767320544.220553:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908
00000100:00100000:2.0:1767320544.220559:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380039808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320544.220565:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380039424:12345-0@lo:400:kworker.0 Request processed in 45us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320544.220570:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908
00000100:00100000:2.0:1767320544.220583:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380039808:12345-0@lo:400:kworker.0 Request processed in 24us (186us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320544.220588:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908
00000100:00100000:1.0:1767320544.220609:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380039424:0@lo:400:kworker.0
00000100:00100000:2.0:1767320544.220615:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380039808:0@lo:400:kworker.0
00000100:00100000:2.0:1767320544.220623:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380039552:0@lo:400:kworker.0
00000100:00100000:2.0:1767320544.220643:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380039680:0@lo:38:kworker.0
00000100:00080000:1.0:1767320544.220654:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320544.220659:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320544.220661:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320544.220671:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039168
00000100:00100000:1.0:1767320544.220674:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039168
00000100:00100000:1.0:1767320544.220693:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201
00000100:00100000:1.0:1767320544.220781:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380039168:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320544.220794:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320544.220822:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380039168:12345-0@lo:38:kworker.0 Request processed in 40us (677us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320544.220828:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201
00000100:00100000:2.0:1767320544.220949:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320544.220982:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380039936:0@lo:38:kworker.0
00000100:00100000:2.0:1767320544.221006:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320544.221021:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380039296:12345-0@lo:400:kworker.0 Request processed in 791us (996us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320544.221027:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907
00000100:00080000:2.0:1767320544.221028:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320544.221032:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320544.221035:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380039040:0@lo:38:kworker.0
00000100:00080000:2.0:1767320544.221042:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320544.221045:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320544.221048:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380039168:0@lo:38:kworker.0
00000100:00100000:3.0:1767320544.221051:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039680
00000100:00100000:3.0:1767320544.221054:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039680
00000100:00100000:3.0:1767320544.221069:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380039936
00000100:00100000:3.0:1767320544.221072:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380039936
00000100:00100000:2.0:1767320544.221077:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17847
00000100:00100000:2.0:1767320544.221082:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380039680:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320544.221124:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380039296:0@lo:400:kworker.0
00010000:00020000:2.0:1767320544.221148:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320544.221191:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380039680:12345-0@lo:38:kworker.0 Request processed in 107us (241us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320544.221197:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17847
00000100:00100000:2.0:1767320544.221211:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17848
00000100:00100000:2.0:1767320544.221215:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380039936:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767320544.221256:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320544.221261:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320544.221264:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380039680:0@lo:38:kworker.0
00010000:00020000:2.0:1767320544.221300:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320544.221332:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380039936:12345-0@lo:38:kworker.0 Request processed in 111us (321us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320544.221339:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17848
00000100:00080000:0.0:1767320544.221359:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320544.221364:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320544.221367:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380039936:0@lo:38:kworker.0
00010000:00010000:1.0:1767320544.792607:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320545.241075:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380040064:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320545.241197:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320545.241646:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040064
00000100:00100000:2.0:1767320545.241656:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040064
00000100:00100000:2.0:1767320545.241717:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718
00000100:00100000:2.0:1767320545.241728:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380040064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320545.241761:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320545.241824:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380040064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (628us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320545.241835:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718
00000100:00100000:0.0:1767320545.242281:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380040064:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320545.815533:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320546.192532:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320546.192580:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320546.192658:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291980032
00000100:00100000:0.0:1767320546.192668:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291980032
00000100:00100000:0.0:1767320546.192744:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291979904
00000100:00100000:0.0:1767320546.192747:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291979904
00000100:00100000:0.0:1767320546.192770:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4909
00000100:00100000:0.0:1767320546.192780:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291980032:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320546.192858:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291980032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (335us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320546.192866:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4909
00000100:00100000:0.0:1767320546.192918:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17849
00000100:00100000:0.0:1767320546.192923:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291979904:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320546.192942:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320546.192965:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291979904:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (384us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320546.192990:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17849
00000100:00080000:1.0:1767320546.193464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320546.775177:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320546.775199:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380040192:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320546.775274:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320546.775519:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040192
00000100:00100000:3.0:1767320546.775527:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040192
00000100:00080000:1.0:1767320546.775572:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320546.775591:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719
00000100:00100000:3.0:1767320546.775601:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380040192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320546.775629:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320546.775685:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380040192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320546.775692:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719
00000100:00100000:1.0:1767320546.775920:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380040192:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320546.839379:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320547.864536:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320548.887102:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320549.336206:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320549.336217:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320549.336221:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320549.336225:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320549.336240:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320549.336248:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5446
00000100:00080000:0.0:1767320549.336252:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320549.336258:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320549.336292:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efce00 x1853164380040320/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320549.336317:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320549.336320:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320549.336321:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320549.336324:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5446
00000100:00080000:0.0:1767320549.336326:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320549.336329:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320549.336337:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164380040448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320549.336379:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320549.336381:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320549.336383:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320549.336385:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5446
00000100:00080000:0.0:1767320549.336386:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320549.336388:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320549.336398:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc380 x1853164380040960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320549.336441:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320549.336444:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320549.336446:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320549.336449:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5446
00000100:00080000:0.0:1767320549.336451:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320549.336455:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320549.336465:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906680 x1853164380041216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320549.336551:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380041088:0@lo:400:kworker.0
00000100:00100000:2.0:1767320549.336617:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320549.336668:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041088
00000100:00100000:0.0:1767320549.336675:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041088
00000100:00100000:2.0:1767320549.336699:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320549.336706:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380040832:0@lo:400:kworker.0
00000100:00100000:2.0:1767320549.336728:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320549.336783:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380040704:0@lo:400:kworker.0
00000100:00100000:1.0:1767320549.336818:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320549.336845:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320549.336850:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380040576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320549.336904:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320549.336940:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320549.336951:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040704
00000100:00100000:1.0:1767320549.336955:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040704
00000100:00100000:1.0:1767320549.336988:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040576
00000100:00100000:1.0:1767320549.336991:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040576
00000100:00100000:1.0:1767320549.337011:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909
00000100:00100000:1.0:1767320549.337018:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380040704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320549.337067:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380040704:12345-0@lo:400:kworker.0 Request processed in 49us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320549.337075:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909
00000100:00100000:1.0:1767320549.337097:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910
00000100:00100000:1.0:1767320549.337104:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380040576:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320549.337132:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380040576:12345-0@lo:400:kworker.0 Request processed in 29us (228us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320549.337138:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910
00000100:00080000:1.0:1767320549.337159:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320549.337162:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320549.337186:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380040576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320549.337196:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380040704:0@lo:400:kworker.0
00000100:00100000:0.0:1767320549.343275:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040832
00000100:00100000:0.0:1767320549.343294:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040832
00000100:00100000:2.0:1767320549.343366:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380040320:0@lo:38:kworker.0
00000100:00100000:0.0:1767320549.343388:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910
00000100:00100000:0.0:1767320549.343396:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380041088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320549.343426:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320549.343446:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380040448:0@lo:38:kworker.0
00000100:00100000:2.0:1767320549.343479:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320549.343508:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380040960:0@lo:38:kworker.0
00000100:00100000:2.0:1767320549.343530:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320549.343563:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380041216:0@lo:38:kworker.0
00000100:00100000:2.0:1767320549.343584:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320549.343613:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040320
00000100:00100000:2.0:1767320549.343617:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040320
00000100:00100000:2.0:1767320549.343634:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040960
00000100:00100000:2.0:1767320549.343636:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040960
00000100:00100000:2.0:1767320549.343642:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041216
00000100:00100000:2.0:1767320549.343644:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041216
00000100:00100000:2.0:1767320549.343653:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911
00000100:00100000:2.0:1767320549.343672:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380040832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320549.343949:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380041088:12345-0@lo:400:kworker.0 Request processed in 552us (7328us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320549.343957:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910
00000100:00100000:0.0:1767320549.343979:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17850
00000100:00100000:0.0:1767320549.343982:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380040320:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320549.344002:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320549.344035:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380040320:12345-0@lo:38:kworker.0 Request processed in 50us (608us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320549.344054:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17850
00000100:00100000:0.0:1767320549.344218:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17851
00000100:00100000:0.0:1767320549.344223:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380040960:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320549.344232:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320549.344260:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380040960:12345-0@lo:38:kworker.0 Request processed in 35us (728us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320549.344265:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17851
00000100:00100000:0.0:1767320549.344277:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17852
00000100:00100000:0.0:1767320549.344281:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380041216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320549.344290:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320549.344310:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380041216:12345-0@lo:38:kworker.0 Request processed in 28us (725us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320549.344315:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17852
00000100:00100000:2.0:1767320549.344319:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380040832:12345-0@lo:400:kworker.0 Request processed in 661us (7590us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320549.344325:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911
00000100:00100000:2.0:1767320549.344344:0:18390:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380040448
00000100:00100000:2.0:1767320549.344349:0:18390:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380040448
00000100:00080000:0.0:1767320549.344353:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320549.344369:0:18390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202
00000100:00100000:0.0:1767320549.344373:0:18391:0:(service.c:3434:ptlrpc_start_thread()) ost_out[0] started 2 min 2 max 16
00000100:00100000:2.0:1767320549.344373:0:18390:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380040448:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320549.344381:0:18391:0:(service.c:3493:ptlrpc_start_thread()) starting thread 'll_ost_out00_002'
00010000:00020000:2.0:1767320549.344382:0:18390:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320549.344406:0:18390:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380040448:12345-0@lo:38:kworker.0 Request processed in 32us (935us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320549.344412:0:18390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202
00000100:00080000:2.0:1767320549.344445:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320549.344450:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320549.344453:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380040320:0@lo:38:kworker.0
00000100:00080000:2.0:1767320549.344463:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320549.344466:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320549.344469:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380040448:0@lo:38:kworker.0
00000100:00080000:2.0:1767320549.344509:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320549.344513:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320549.344516:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380040960:0@lo:38:kworker.0
00000100:00080000:2.0:1767320549.344524:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320549.344528:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320549.344530:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380041216:0@lo:38:kworker.0
00000100:00100000:2.0:1767320549.344617:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380040832:0@lo:400:kworker.0
00000100:00100000:2.0:1767320549.344629:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380041088:0@lo:400:kworker.0
00010000:00010000:3.0:1767320549.911199:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320550.359070:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320550.359091:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380041344:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320550.359166:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320550.359214:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041344
00000100:00100000:0.0:1767320550.359224:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041344
00000100:00100000:0.0:1767320550.359446:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720
00000100:00100000:0.0:1767320550.359457:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380041344:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320550.359500:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320550.359545:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380041344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (379us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320550.359552:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720
00000100:00100000:1.0:1767320550.359629:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380041344:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320550.935517:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320551.312978:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320551.313835:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320551.316550:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291980160
00000100:00100000:1.0:1767320551.316570:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291980160
00000100:00100000:1.0:1767320551.316672:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291980288
00000100:00100000:1.0:1767320551.316677:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291980288
00000100:00080000:0.0:1767320551.316762:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320551.316862:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4912
00000100:00100000:3.0:1767320551.316906:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291980288:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320551.317018:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291980288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (3184us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320551.317027:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4912
00000100:00100000:3.0:1767320551.317056:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17853
00000100:00100000:3.0:1767320551.317061:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291980160:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320551.317081:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320551.317111:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291980160:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (4144us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320551.317485:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17853
00000100:00100000:3.0:1767320551.905129:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380041472:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320551.905205:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320551.905357:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041472
00000100:00100000:1.0:1767320551.905366:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041472
00000100:00100000:1.0:1767320551.905435:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721
00000100:00100000:1.0:1767320551.905443:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380041472:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320551.905483:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320551.905532:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380041472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320551.905539:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721
00000100:00100000:1.0:1767320551.905595:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380041472:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320551.905863:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320551.959223:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320552.983425:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320554.008172:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320554.456140:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320554.458618:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320554.458631:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320554.458637:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320554.458644:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320554.458664:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5451
00000100:00080000:1.0:1767320554.458671:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767320554.458679:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320554.458739:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd180 x1853164380041600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320554.458783:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320554.458787:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320554.458789:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320554.458793:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5451
00000100:00080000:1.0:1767320554.458796:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767320554.458799:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320554.458814:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164380041728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320554.459140:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320554.459144:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320554.459146:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320554.459151:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5451
00000100:00080000:1.0:1767320554.459155:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767320554.459159:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320554.459171:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efca80 x1853164380042240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320554.459187:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320554.459191:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320554.459193:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320554.459197:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5451
00000100:00080000:1.0:1767320554.459199:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320554.459204:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320554.459214:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efdf80 x1853164380042496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320554.459272:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380042112:0@lo:400:kworker.0
00000100:00100000:1.0:1767320554.459355:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320554.459450:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320554.459457:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380042368:0@lo:400:kworker.0
00000100:00100000:1.0:1767320554.459481:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320554.459526:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380042112
00000100:00100000:1.0:1767320554.459535:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380042112
00000100:00100000:1.0:1767320554.459596:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380042368
00000100:00100000:1.0:1767320554.459599:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380042368
00000100:00100000:1.0:1767320554.459624:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913
00000100:00100000:1.0:1767320554.459633:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380042112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.459792:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380041984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.459841:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320554.459886:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320554.459893:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380041856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.459916:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320554.459945:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041984
00000100:00100000:0.0:1767320554.459948:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041984
00000100:00100000:0.0:1767320554.459982:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041856
00000100:00100000:0.0:1767320554.459986:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041856
00000100:00100000:0.0:1767320554.460007:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911
00000100:00100000:0.0:1767320554.460013:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380041984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.460072:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380041984:12345-0@lo:400:kworker.0 Request processed in 59us (230us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320554.460080:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911
00000100:00100000:0.0:1767320554.460097:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912
00000100:00100000:0.0:1767320554.460103:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380041856:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.460132:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380041856:12345-0@lo:400:kworker.0 Request processed in 30us (216us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320554.460137:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912
00000100:00100000:0.0:1767320554.460186:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380041856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.460197:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380041984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.460251:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914
00000100:00100000:0.0:1767320554.460259:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380042368:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.460296:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380042368:12345-0@lo:400:kworker.0 Request processed in 39us (815us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320554.460303:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914
00000100:00100000:0.0:1767320554.460345:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380042368:0@lo:400:kworker.0
00000100:00100000:2.0:1767320554.461185:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380041600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320554.461294:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320554.461339:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380041728:0@lo:38:kworker.0
00000100:00100000:2.0:1767320554.461367:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320554.461397:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380042240:0@lo:38:kworker.0
00000100:00100000:2.0:1767320554.461420:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320554.461450:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380042496:0@lo:38:kworker.0
00000100:00100000:2.0:1767320554.461471:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320554.461512:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041600
00000100:00100000:2.0:1767320554.461522:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041600
00000100:00100000:2.0:1767320554.461553:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380042240
00000100:00100000:2.0:1767320554.461556:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380042240
00000100:00100000:2.0:1767320554.461564:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380042496
00000100:00100000:2.0:1767320554.461566:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380042496
00000100:00100000:2.0:1767320554.461575:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17854
00000100:00100000:2.0:1767320554.461582:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380041600:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320554.461609:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320554.463181:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320554.463196:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320554.463200:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320554.463314:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17855
00000100:00100000:3.0:1767320554.463326:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380042240:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320554.463349:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320554.463486:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380042240:12345-0@lo:38:kworker.0 Request processed in 161us (2064us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320554.463494:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17855
00000100:00100000:3.0:1767320554.463528:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17856
00000100:00100000:3.0:1767320554.463533:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380042496:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320554.463543:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320554.463570:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380042496:12345-0@lo:38:kworker.0 Request processed in 35us (2098us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320554.463575:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17856
00000100:00080000:3.0:1767320554.463623:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320554.463629:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320554.463634:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380042240:0@lo:38:kworker.0
00000100:00080000:3.0:1767320554.463645:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320554.463649:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320554.465370:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380042112:12345-0@lo:400:kworker.0 Request processed in 5726us (6004us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320554.465386:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913
00000100:00100000:0.0:1767320554.465637:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380042112:0@lo:400:kworker.0
00000100:00100000:0.0:1767320554.465695:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380041728
00000100:00100000:0.0:1767320554.465706:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380041728
00000100:00100000:0.0:1767320554.465755:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203
00000100:00100000:0.0:1767320554.465763:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380041728:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320554.465788:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320554.465848:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380041728:12345-0@lo:38:kworker.0 Request processed in 84us (4479us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320554.465855:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203
00000100:00100000:3.0:1767320554.466169:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380042496:0@lo:38:kworker.0
00000100:00080000:3.0:1767320554.466208:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320554.466216:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320554.466219:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380041728:0@lo:38:kworker.0
00000100:00100000:2.0:1767320554.498651:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380041600:12345-0@lo:38:kworker.0 Request processed in 37057us (37346us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320554.498664:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17854
00000100:00080000:3.0:1767320554.499919:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320554.499935:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320554.499940:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380041600:0@lo:38:kworker.0
00010000:00010000:2.0:1767320555.031123:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320555.510585:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380042624:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320555.510712:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320555.549639:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380042624
00000100:00100000:3.0:1767320555.549656:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380042624
00000100:00100000:3.0:1767320555.549756:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722
00000100:00100000:3.0:1767320555.549768:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380042624:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320555.549836:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320555.549985:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380042624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 218us (39272us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320555.549994:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722
00000100:00100000:1.0:1767320555.556170:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380042624:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320556.055206:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320556.432082:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320556.432507:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291980544
00000100:00100000:2.0:1767320556.432521:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291980544
00000100:00080000:3.0:1767320556.432597:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320556.432632:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4915
00000100:00100000:2.0:1767320556.432647:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291980544:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320556.432676:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320556.432717:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291980416
00000100:00100000:1.0:1767320556.432723:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291980416
00000100:00100000:1.0:1767320556.432759:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17857
00000100:00100000:2.0:1767320556.432763:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291980544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (699us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320556.432767:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291980416:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:2.0:1767320556.432771:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4915
00010000:00020000:1.0:1767320556.432795:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320556.432830:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291980416:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 62us (156us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320556.432838:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17857
00000100:00100000:3.0:1767320557.015568:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320557.015606:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380042752:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320557.015719:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320557.018151:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380042752
00000100:00100000:2.0:1767320557.018172:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380042752
00000100:00080000:3.0:1767320557.018253:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320557.018369:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723
00000100:00100000:2.0:1767320557.018382:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380042752:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320557.018430:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320557.018514:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380042752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (2794us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320557.018522:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723
00000100:00100000:3.0:1767320557.018579:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380042752:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320557.079414:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320558.103443:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320559.131461:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320559.576910:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320559.576921:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320559.576924:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320559.576928:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320559.576932:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320559.576948:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5456
00000100:00080000:0.0:1767320559.576954:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767320559.576960:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320559.576997:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906a00 x1853164380042880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320559.577028:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320559.577032:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320559.577034:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320559.577038:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5456
00000100:00080000:0.0:1767320559.577040:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767320559.577044:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320559.577054:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907800 x1853164380043008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320559.577118:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320559.577121:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320559.577123:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320559.577126:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5456
00000100:00080000:0.0:1767320559.577128:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s
00000100:00080000:0.0:1767320559.577131:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320559.577140:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904000 x1853164380043520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320559.577152:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320559.577156:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320559.577157:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320559.577160:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5456
00000100:00080000:0.0:1767320559.577162:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320559.577166:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320559.577172:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907100 x1853164380043776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320559.577200:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380043648:0@lo:400:kworker.0
00000100:00100000:0.0:1767320559.577259:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320559.577315:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320559.577320:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380043392:0@lo:400:kworker.0
00000100:00100000:0.0:1767320559.577338:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320559.577367:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043648
00000100:00100000:0.0:1767320559.577373:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043648
00000100:00100000:0.0:1767320559.577443:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043392
00000100:00100000:0.0:1767320559.577446:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043392
00000100:00100000:0.0:1767320559.577464:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4916
00000100:00100000:0.0:1767320559.577470:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380043648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320559.577510:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380043648:12345-0@lo:400:kworker.0 Request processed in 39us (250us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320559.577516:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4916
00000100:00100000:0.0:1767320559.577531:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4917
00000100:00100000:0.0:1767320559.577536:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380043392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320559.577555:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380043392:12345-0@lo:400:kworker.0 Request processed in 19us (217us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320559.577561:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4917
00000100:00100000:0.0:1767320559.577597:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380043392:0@lo:400:kworker.0
00000100:00100000:0.0:1767320559.577605:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380043648:0@lo:400:kworker.0
00000100:00100000:2.0:1767320559.577770:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380042880:0@lo:38:kworker.0
00000100:00100000:2.0:1767320559.577796:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320559.577826:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380043008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320559.577847:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320559.577866:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380043520:0@lo:38:kworker.0
00000100:00100000:2.0:1767320559.577913:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320559.577924:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380043776:0@lo:38:kworker.0
00000100:00100000:2.0:1767320559.577949:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320559.577975:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043008
00000100:00100000:2.0:1767320559.577978:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043008
00000100:00100000:2.0:1767320559.577996:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204
00000100:00100000:2.0:1767320559.578001:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380043008:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320559.578018:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320559.578045:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380043008:12345-0@lo:38:kworker.0 Request processed in 43us (197us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320559.578051:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204
00000100:00080000:2.0:1767320559.578071:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320559.578075:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320559.578078:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380043008:0@lo:38:kworker.0
00000100:00100000:3.0:1767320559.578261:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380043264:0@lo:400:kworker.0
00000100:00100000:3.0:1767320559.578289:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320559.578317:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320559.578387:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380043136:0@lo:400:kworker.0
00000100:00100000:3.0:1767320559.578409:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320559.578431:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320559.578641:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380042880
00000100:00100000:1.0:1767320559.578646:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380042880
00000100:00100000:1.0:1767320559.578673:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043520
00000100:00100000:1.0:1767320559.578675:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043520
00000100:00100000:1.0:1767320559.578685:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043776
00000100:00100000:1.0:1767320559.578687:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043776
00000100:00100000:1.0:1767320559.578695:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17858
00000100:00100000:1.0:1767320559.578700:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380042880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320559.578711:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320559.578742:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380042880:12345-0@lo:38:kworker.0 Request processed in 41us (945us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320559.578748:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17858
00000100:00100000:1.0:1767320559.578762:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17859
00000100:00100000:1.0:1767320559.578765:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380043520:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320559.578773:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320559.578789:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380043520:12345-0@lo:38:kworker.0 Request processed in 23us (876us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320559.578794:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17859
00000100:00100000:1.0:1767320559.578802:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17860
00000100:00100000:1.0:1767320559.578806:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380043776:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320559.578813:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320559.578829:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380043776:12345-0@lo:38:kworker.0 Request processed in 22us (879us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320559.578833:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17860
00000100:00080000:1.0:1767320559.578853:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320559.578857:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320559.578860:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380042880:0@lo:38:kworker.0
00000100:00080000:1.0:1767320559.578867:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320559.578888:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320559.578891:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380043520:0@lo:38:kworker.0
00000100:00080000:1.0:1767320559.578899:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320559.578902:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320559.578904:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380043776:0@lo:38:kworker.0
00000100:00100000:0.0:1767320559.579165:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043264
00000100:00100000:0.0:1767320559.579170:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043264
00000100:00100000:0.0:1767320559.579211:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043136
00000100:00100000:0.0:1767320559.579214:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043136
00000100:00100000:0.0:1767320559.579232:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913
00000100:00100000:0.0:1767320559.579238:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380043264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320559.579274:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380043264:12345-0@lo:400:kworker.0 Request processed in 36us (983us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320559.579283:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913
00000100:00100000:0.0:1767320559.579293:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914
00000100:00100000:0.0:1767320559.579297:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380043136:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320559.579317:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380043136:12345-0@lo:400:kworker.0 Request processed in 19us (907us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320559.579322:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914
00000100:00080000:3.0:1767320559.579511:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320559.579514:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320559.579540:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380043136:0@lo:400:kworker.0
00000100:00100000:3.0:1767320559.579549:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380043264:0@lo:400:kworker.0
00010000:00010000:2.0:1767320560.153853:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320560.599011:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320560.599028:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380043904:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320560.599086:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320560.601069:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380043904
00000100:00100000:3.0:1767320560.601083:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380043904
00000100:00100000:3.0:1767320560.601148:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724
00000100:00100000:3.0:1767320560.601158:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380043904:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320560.601199:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320560.601307:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380043904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (2219us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320560.601314:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724
00000100:00100000:1.0:1767320560.601462:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380043904:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320561.179009:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320561.551262:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320561.551306:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320561.551348:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291980800
00000100:00100000:2.0:1767320561.551375:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291980800
00000100:00100000:1.0:1767320561.551395:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291980672
00000100:00100000:1.0:1767320561.551401:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291980672
00000100:00080000:3.0:1767320561.551462:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320561.551514:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4918
00000100:00100000:1.0:1767320561.551527:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291980800:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320561.551538:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17861
00000100:00100000:2.0:1767320561.551546:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291980672:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320561.551569:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320561.551628:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291980672:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 80us (320us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320561.551636:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17861
00000100:00100000:1.0:1767320561.551735:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291980800:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 212us (483us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320561.551741:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4918
00000100:00100000:3.0:1767320562.135258:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380044032:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320562.135335:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320562.137926:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044032
00000100:00100000:2.0:1767320562.137949:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044032
00000100:00100000:2.0:1767320562.138040:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725
00000100:00100000:2.0:1767320562.138049:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380044032:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320562.138089:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320562.138166:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380044032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (2831us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320562.138174:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725
00000100:00100000:1.0:1767320562.138269:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380044032:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320562.138564:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320562.200922:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320563.223166:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320564.248460:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320564.695374:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320564.695388:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320564.695391:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320564.695395:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320564.695400:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320564.695955:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5461
00000100:00080000:2.0:1767320564.695963:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767320564.695970:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320564.696012:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fd880 x1853164380044160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320564.696119:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380044160:0@lo:38:kworker.0
00000100:00100000:3.0:1767320564.696254:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320564.697403:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044160
00000100:00100000:0.0:1767320564.697415:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044160
00000100:00100000:0.0:1767320564.697478:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17862
00000100:00100000:0.0:1767320564.697489:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380044160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320564.697519:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320564.697960:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320564.697968:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320564.697973:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320564.697981:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5461
00000100:00080000:2.0:1767320564.697987:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767320564.697994:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320564.698043:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fdf80 x1853164380044288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320564.698924:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380044288:0@lo:38:kworker.0
00000100:00100000:3.0:1767320564.699029:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320564.699262:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044288
00000100:00100000:1.0:1767320564.699276:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044288
00000100:00100000:1.0:1767320564.699339:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205
00000100:00100000:1.0:1767320564.699346:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380044288:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320564.699369:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320564.699425:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380044288:12345-0@lo:38:kworker.0 Request processed in 77us (395us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320564.699433:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205
00000100:00100000:0.0:1767320564.700069:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380044160:12345-0@lo:38:kworker.0 Request processed in 2579us (3813us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320564.700079:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17862
00000100:00080000:3.0:1767320564.700179:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320564.700185:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320564.700189:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380044160:0@lo:38:kworker.0
00000100:00080000:3.0:1767320564.700233:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320564.700237:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320564.700240:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380044288:0@lo:38:kworker.0
00000100:00080000:2.0:1767320564.700592:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320564.700601:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320564.700606:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320564.700614:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5461
00000100:00100000:1.0:1767320564.700960:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380044544:0@lo:400:kworker.0
00000100:00100000:1.0:1767320564.701014:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320564.701047:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320564.701052:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380044416:0@lo:400:kworker.0
00000100:00100000:1.0:1767320564.701073:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320564.701098:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320564.701106:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380044672:0@lo:400:kworker.0
00000100:00100000:1.0:1767320564.701133:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320564.701183:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044544
00000100:00100000:1.0:1767320564.701194:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044544
00000100:00100000:1.0:1767320564.701287:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044416
00000100:00100000:1.0:1767320564.701293:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044416
00000100:00100000:1.0:1767320564.701324:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915
00000100:00100000:1.0:1767320564.701342:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380044544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320564.701390:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380044544:12345-0@lo:400:kworker.0 Request processed in 58us (375us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320564.701398:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915
00000100:00100000:1.0:1767320564.701442:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916
00000100:00100000:1.0:1767320564.701448:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380044416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320564.701476:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380044416:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320564.701482:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916
00000100:00100000:1.0:1767320564.701521:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380044416:0@lo:400:kworker.0
00000100:00100000:1.0:1767320564.701532:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380044544:0@lo:400:kworker.0
00000100:00080000:2.0:1767320564.702233:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767320564.702248:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320564.702297:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fe300 x1853164380044800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320564.702348:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320564.702353:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320564.702356:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320564.702361:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5461
00000100:00080000:2.0:1767320564.702363:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320564.702367:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320564.702407:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083ffb80 x1853164380045056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320564.702611:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320564.702640:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380044928:0@lo:400:kworker.0
00000100:00100000:0.0:1767320564.702705:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320564.702850:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044672
00000100:00100000:0.0:1767320564.702863:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044672
00000100:00100000:0.0:1767320564.702935:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044928
00000100:00100000:0.0:1767320564.702938:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044928
00000100:00100000:0.0:1767320564.702974:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919
00000100:00100000:0.0:1767320564.702987:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380044672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320564.703066:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380044672:12345-0@lo:400:kworker.0 Request processed in 81us (1929us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320564.703078:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919
00000100:00100000:0.0:1767320564.703106:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920
00000100:00100000:0.0:1767320564.703119:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380044928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320564.703178:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380044928:12345-0@lo:400:kworker.0 Request processed in 61us (473us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320564.703189:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920
00000100:00100000:0.0:1767320564.703287:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380044928:0@lo:400:kworker.0
00000100:00100000:1.0:1767320564.704110:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380044672:0@lo:400:kworker.0
00000100:00080000:3.0:1767320564.704259:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320564.704272:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320564.704278:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320564.704312:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380044800:0@lo:38:kworker.0
00000100:00100000:3.0:1767320564.704373:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320564.704427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380045056:0@lo:38:kworker.0
00000100:00100000:3.0:1767320564.704450:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320564.705009:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380044800
00000100:00100000:2.0:1767320564.705023:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380044800
00000100:00100000:2.0:1767320564.705100:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380045056
00000100:00100000:2.0:1767320564.705108:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380045056
00000100:00100000:2.0:1767320564.705162:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17863
00000100:00100000:2.0:1767320564.705173:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380044800:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320564.705227:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320564.705308:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380044800:12345-0@lo:38:kworker.0 Request processed in 135us (933us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320564.705318:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17863
00000100:00100000:2.0:1767320564.705343:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17864
00000100:00100000:2.0:1767320564.705347:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380045056:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320564.705356:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320564.705378:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380045056:12345-0@lo:38:kworker.0 Request processed in 29us (928us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320564.705384:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17864
00000100:00080000:3.0:1767320564.706025:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320564.706033:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320564.706037:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380044800:0@lo:38:kworker.0
00000100:00080000:3.0:1767320564.706047:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320564.706050:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320564.706053:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380045056:0@lo:38:kworker.0
00010000:00010000:3.0:1767320565.274453:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320565.652383:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767320565.652418:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291980928 offset 0 length 520: 4
00000100:00100000:0.0:1767320565.652440:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320565.652506:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981184
00000100:00100000:2.0:1767320565.652526:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981184
00000100:00100000:3.0:1767320565.652611:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981056
00000100:00100000:3.0:1767320565.652617:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981056
00000100:00100000:2.0:1767320565.652657:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4921
00000100:00100000:2.0:1767320565.652665:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291981184:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320565.652782:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291981184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 113us (407us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320565.652791:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4921
00000100:00100000:2.0:1767320565.652820:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17865
00000100:00100000:2.0:1767320565.652828:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291981056:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320565.652863:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320565.652960:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291981056:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 129us (516us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320565.652971:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17865
00000100:00080000:0.0:1767320565.654556:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320565.719150:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380045184:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320565.719254:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320565.720945:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380045184
00000100:00100000:2.0:1767320565.720960:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380045184
00000100:00100000:2.0:1767320565.721129:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726
00000100:00100000:2.0:1767320565.721144:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380045184:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320565.721181:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320565.726518:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380045184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5357us (7264us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320565.726534:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726
00000100:00100000:1.0:1767320565.727799:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380045184:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320566.296998:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320567.255364:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320567.255404:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380045312:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320567.255488:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320567.255650:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380045312
00000100:00100000:1.0:1767320567.255660:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380045312
00000100:00100000:1.0:1767320567.255723:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727
00000100:00100000:1.0:1767320567.255732:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380045312:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320567.255760:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320567.255809:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380045312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (321us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320567.255816:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727
00000100:00100000:1.0:1767320567.255899:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380045312:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320567.256592:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320567.319188:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320568.343135:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320569.367314:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320569.815105:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320544/real 1767320544]  req@ffff8b0e0cfcdc00 x1853164380038912/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320569 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320569.815144:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0cfcdc00 x1853164380038912/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320569 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320569.815164:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320569.815186:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320569.815189:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380038912:0@lo:250:kworker.0
00000100:00080000:2.0:1767320569.816521:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320569.816531:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320569.816535:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320569.816540:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5446
00000100:00080000:2.0:1767320569.816544:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320569.816551:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320569.816603:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fc380 x1853164380045440/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320569.816633:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320569.816637:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320569.816638:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320569.816642:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5467
00000100:00080000:2.0:1767320569.816644:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320569.816648:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320569.816663:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083ffb80 x1853164380045568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320569.816671:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320569.816674:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320569.816676:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320569.816679:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5467
00000100:00080000:2.0:1767320569.816681:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320569.816685:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320569.816694:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fe300 x1853164380045696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320569.816759:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320569.816762:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320569.816763:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320569.816767:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5467
00000100:00080000:2.0:1767320569.816769:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320569.816773:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320569.816785:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fc000 x1853164380046208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320569.816798:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320569.816801:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320569.816803:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320569.816806:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5467
00000100:00080000:2.0:1767320569.816808:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320569.816812:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320569.816821:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fd880 x1853164380046464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320569.816921:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380046336:0@lo:400:kworker.0
00000100:00100000:2.0:1767320569.817014:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320569.817079:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320569.817679:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380045440:0@lo:250:kworker.0
00000400:00000100:0.0:1767320569.817715:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380045440 offset 0 length 520: 4
00000100:00100000:2.0:1767320569.817722:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380046080:0@lo:400:kworker.0
00000100:00100000:0.0:1767320569.817740:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380045568:0@lo:38:kworker.0
00000100:00100000:2.0:1767320569.817791:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320569.817918:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046336
00000100:00100000:2.0:1767320569.817929:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046336
00000100:00100000:0.0:1767320569.817936:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320569.817967:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380045696:0@lo:38:kworker.0
00000100:00100000:0.0:1767320569.817997:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320569.818014:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380046208:0@lo:38:kworker.0
00000100:00100000:2.0:1767320569.818017:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046080
00000100:00100000:2.0:1767320569.818026:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046080
00000100:00100000:0.0:1767320569.818038:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320569.818057:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380046464:0@lo:38:kworker.0
00000100:00100000:2.0:1767320569.818069:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380045568
00000100:00100000:2.0:1767320569.818076:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380045568
00000100:00100000:0.0:1767320569.818083:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320569.818103:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046208
00000100:00100000:2.0:1767320569.818110:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046208
00000100:00100000:2.0:1767320569.818131:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046464
00000100:00100000:2.0:1767320569.818137:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046464
00000100:00080000:0.0:1767320569.818141:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320569.818168:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922
00000100:00100000:2.0:1767320569.818184:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380046336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320569.818337:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923
00000100:00100000:0.0:1767320569.818346:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380046080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320569.818400:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380046080:12345-0@lo:400:kworker.0 Request processed in 56us (613us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320569.818408:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923
00000100:00100000:0.0:1767320569.818429:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17866
00000100:00100000:0.0:1767320569.818433:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380045568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320569.818449:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320569.818480:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380045568:12345-0@lo:38:kworker.0 Request processed in 45us (544us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320569.818486:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17866
00000100:00100000:0.0:1767320569.818497:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17867
00000100:00100000:0.0:1767320569.818500:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380046208:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320569.818510:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320569.818531:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380046208:12345-0@lo:38:kworker.0 Request processed in 29us (493us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320569.818537:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17867
00000100:00100000:0.0:1767320569.818548:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17868
00000100:00100000:0.0:1767320569.818552:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380046464:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320569.818562:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320569.818581:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380046464:12345-0@lo:38:kworker.0 Request processed in 28us (499us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320569.818586:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17868
00000100:00080000:0.0:1767320569.818620:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320569.818624:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320569.818627:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380045568:0@lo:38:kworker.0
00000100:00080000:0.0:1767320569.818636:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320569.818639:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320569.818642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380046208:0@lo:38:kworker.0
00000100:00080000:0.0:1767320569.818650:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320569.818653:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320569.818656:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380046464:0@lo:38:kworker.0
00000100:00100000:0.0:1767320569.818716:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380046080:0@lo:400:kworker.0
00000100:00100000:1.0:1767320569.818733:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380045824:0@lo:400:kworker.0
00000100:00100000:0.0:1767320569.818755:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380045952:0@lo:400:kworker.0
00000100:00100000:1.0:1767320569.818777:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320569.818827:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380045824
00000100:00100000:0.0:1767320569.818831:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380045696
00000100:00100000:1.0:1767320569.818831:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380045824
00000100:00100000:0.0:1767320569.818838:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380045696
00000100:00100000:0.0:1767320569.818893:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206
00000100:00100000:0.0:1767320569.818898:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380045696:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320569.818908:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917
00010000:00020000:0.0:1767320569.818910:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320569.818919:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380045824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320569.818950:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380045696:12345-0@lo:38:kworker.0 Request processed in 49us (952us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320569.818957:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206
00000100:00100000:1.0:1767320569.818969:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380045824:12345-0@lo:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320569.818977:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917
00000100:00080000:0.0:1767320569.818988:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320569.818994:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320569.818998:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380045696:0@lo:38:kworker.0
00000100:00080000:1.0:1767320569.819013:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320569.819028:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320569.819041:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380045824:0@lo:400:kworker.0
00000100:00100000:1.0:1767320569.819066:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380045952
00000100:00100000:1.0:1767320569.819069:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380045952
00000100:00080000:0.0:1767320569.819099:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320569.819100:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918
00000100:00100000:1.0:1767320569.819110:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380045952:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320569.819154:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380045952:12345-0@lo:400:kworker.0 Request processed in 45us (126us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320569.819161:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918
00000100:00100000:0.0:1767320569.821637:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380045952:0@lo:400:kworker.0
00000100:00100000:2.0:1767320569.824484:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380046336:12345-0@lo:400:kworker.0 Request processed in 6295us (7461us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320569.824500:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922
00000100:00100000:0.0:1767320569.826828:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380046336:0@lo:400:kworker.0
00010000:00010000:3.0:1767320570.392987:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320570.774574:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320570.774628:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320570.774815:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981312
00000100:00100000:0.0:1767320570.774833:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981312
00000100:00100000:0.0:1767320570.774990:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981440
00000100:00100000:0.0:1767320570.774994:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981440
00000100:00100000:2.0:1767320570.775070:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4924
00000100:00100000:2.0:1767320570.775085:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291981440:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320570.775196:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291981440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 114us (565us total) trans 0 rc 0/0
00000100:00080000:1.0:1767320570.775251:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320570.783324:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17869
00000100:00100000:0.0:1767320570.783363:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291981312:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320570.783417:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320570.783546:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291981312:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 187us (8980us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320570.783564:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17869
00000100:00100000:2.0:1767320570.788081:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4924
00000100:00100000:1.0:1767320570.839608:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380046592:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320570.839697:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320570.839925:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046592
00000100:00100000:2.0:1767320570.839937:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046592
00000100:00100000:2.0:1767320570.840002:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728
00000100:00100000:2.0:1767320570.840011:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380046592:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320570.840043:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320570.841478:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380046592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1458us (1770us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320570.841492:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728
00000100:00100000:1.0:1767320570.841658:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380046592:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320571.415397:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320572.375220:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320572.375248:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380046720:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320572.375694:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320572.376191:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046720
00000100:00100000:2.0:1767320572.376200:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046720
00000100:00100000:2.0:1767320572.376334:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729
00000100:00100000:2.0:1767320572.376345:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380046720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320572.376377:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320572.376442:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380046720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (749us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320572.376450:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729
00000100:00100000:0.0:1767320572.376548:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380046720:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320572.377084:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320572.441712:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320573.463328:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320574.487128:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320574.935284:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320574.935297:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320574.935300:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320574.935304:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320574.935309:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320574.935316:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5472
00000100:00080000:1.0:1767320574.935325:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320574.935333:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320574.935375:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ac000 x1853164380046848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320574.935404:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320574.935408:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320574.935409:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320574.935414:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5472
00000100:00080000:1.0:1767320574.935417:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320574.935421:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320574.935435:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ad180 x1853164380046976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320574.935508:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380046848:0@lo:38:kworker.0
00000100:00080000:1.0:1767320574.935517:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320574.935521:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320574.935523:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320574.935528:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5472
00000100:00080000:1.0:1767320574.935530:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320574.935535:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320574.935551:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380afb80 x1853164380047488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320574.935570:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320574.935574:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320574.935576:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1767320574.935582:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320574.935584:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5472
00000100:00080000:1.0:1767320574.935590:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320574.935594:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320574.935608:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ac380 x1853164380047744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320574.935644:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380047360:0@lo:400:kworker.0
00000100:00100000:0.0:1767320574.935646:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380046976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320574.935687:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320574.935692:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320574.935714:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320574.935721:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380047616:0@lo:400:kworker.0
00000100:00100000:1.0:1767320574.935748:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320574.935750:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380047488:0@lo:38:kworker.0
00000100:00100000:0.0:1767320574.935782:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320574.935822:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380047744:0@lo:38:kworker.0
00000100:00100000:2.0:1767320574.935831:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380047104:0@lo:400:kworker.0
00000100:00100000:0.0:1767320574.935846:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320574.935904:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380047232:0@lo:400:kworker.0
00000100:00100000:2.0:1767320574.935905:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320574.935942:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320574.935964:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380047104
00000100:00100000:2.0:1767320574.935972:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380047104
00000100:00100000:3.0:1767320574.935986:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380047232
00000100:00100000:3.0:1767320574.935992:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380047232
00000100:00100000:3.0:1767320574.936032:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919
00000100:00100000:3.0:1767320574.936040:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380047232:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320574.936090:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380047232:12345-0@lo:400:kworker.0 Request processed in 51us (148us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320574.936097:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919
00000100:00100000:3.0:1767320574.936113:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920
00000100:00100000:3.0:1767320574.936118:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380047104:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320574.936150:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380047104:12345-0@lo:400:kworker.0 Request processed in 31us (249us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320574.936155:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920
00000100:00080000:2.0:1767320574.938338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320574.938347:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320574.942377:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380047232:0@lo:400:kworker.0
00000100:00100000:3.0:1767320574.942444:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380047104:0@lo:400:kworker.0
00000100:00100000:1.0:1767320574.945330:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046848
00000100:00100000:1.0:1767320574.945347:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046848
00000100:00100000:1.0:1767320574.945413:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380047360
00000100:00100000:1.0:1767320574.945418:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380047360
00000100:00100000:1.0:1767320574.945455:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380047616
00000100:00100000:1.0:1767320574.945457:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380047616
00000100:00100000:1.0:1767320574.945475:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380047488
00000100:00100000:1.0:1767320574.945477:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380047488
00000100:00100000:1.0:1767320574.945486:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380047744
00000100:00100000:1.0:1767320574.945488:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380047744
00000100:00100000:1.0:1767320574.945504:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925
00000100:00100000:1.0:1767320574.945515:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380047360:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320574.945620:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380047360:12345-0@lo:400:kworker.0 Request processed in 107us (9932us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320574.945708:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925
00000100:00100000:1.0:1767320574.945734:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926
00000100:00100000:1.0:1767320574.945740:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380047616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320574.945774:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380047616:12345-0@lo:400:kworker.0 Request processed in 35us (10026us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320574.945780:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926
00000100:00100000:1.0:1767320574.945794:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17870
00000100:00100000:1.0:1767320574.945799:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380046848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320574.945820:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320574.946085:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380046848:12345-0@lo:38:kworker.0 Request processed in 283us (10505us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320574.946093:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17870
00000100:00100000:1.0:1767320574.946108:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17871
00000100:00100000:1.0:1767320574.946112:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380047488:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320574.946122:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320574.946147:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380047488:12345-0@lo:38:kworker.0 Request processed in 33us (10366us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320574.946152:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17871
00000100:00100000:1.0:1767320574.946162:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17872
00000100:00100000:1.0:1767320574.946165:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380047744:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320574.946174:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320574.946323:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380046976
00000100:00100000:2.0:1767320574.946329:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380046976
00000100:00100000:2.0:1767320574.946354:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207
00000100:00100000:2.0:1767320574.946359:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380046976:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320574.946369:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320574.946399:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380046976:12345-0@lo:38:kworker.0 Request processed in 39us (10709us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320574.946405:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207
00000100:00080000:2.0:1767320574.946456:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320574.946497:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380047616:0@lo:400:kworker.0
00000100:00100000:2.0:1767320574.946508:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380047360:0@lo:400:kworker.0
00000100:00080000:2.0:1767320574.946553:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320574.946559:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320574.946563:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380047488:0@lo:38:kworker.0
00000100:00080000:2.0:1767320574.946574:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320574.946577:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320574.946580:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380046848:0@lo:38:kworker.0
00000100:00080000:2.0:1767320574.946589:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320574.946592:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320574.946594:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380046976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320574.946746:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380047744:12345-0@lo:38:kworker.0 Request processed in 578us (10900us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320574.946753:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17872
00000100:00080000:1.0:1767320574.946779:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320574.946783:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320574.946786:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380047744:0@lo:38:kworker.0
00010000:00010000:2.0:1767320575.511594:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320575.892596:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320575.892662:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320575.893209:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981568
00000100:00100000:2.0:1767320575.893221:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981568
00000100:00100000:2.0:1767320575.893279:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981696
00000100:00100000:2.0:1767320575.893283:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981696
00000100:00100000:2.0:1767320575.893339:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4927
00000100:00100000:2.0:1767320575.893349:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291981696:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320575.893426:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291981696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (764us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320575.893434:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4927
00000100:00100000:2.0:1767320575.893453:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17873
00000100:00100000:2.0:1767320575.893457:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291981568:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320575.893479:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320575.893517:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291981568:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (933us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320575.893524:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17873
00000100:00080000:0.0:1767320575.893713:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320575.959459:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320575.959485:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380047872:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320575.959564:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320575.960110:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380047872
00000100:00100000:1.0:1767320575.960121:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380047872
00000100:00100000:1.0:1767320575.960184:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730
00000100:00100000:1.0:1767320575.960194:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380047872:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320575.960238:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320575.960296:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380047872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (731us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320575.960304:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730
00000100:00100000:0.0:1767320575.961051:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380047872:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320576.536021:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320577.495427:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380048000:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320577.495527:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320577.495741:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048000
00000100:00100000:3.0:1767320577.495750:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048000
00000100:00100000:3.0:1767320577.495818:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731
00000100:00100000:3.0:1767320577.495827:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380048000:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320577.495859:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320577.495936:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380048000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320577.495944:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731
00000100:00100000:3.0:1767320577.495992:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380048000:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320577.496167:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320577.559185:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320578.583182:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320579.607064:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320580.055168:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320580.055180:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320580.055184:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320580.055189:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320580.055204:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320580.055213:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5477
00000100:00080000:3.0:1767320580.055218:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320580.055226:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320580.055272:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8e00 x1853164380048128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320580.055330:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380048128:0@lo:38:kworker.0
00000100:00100000:1.0:1767320580.055398:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320580.055480:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320580.055484:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320580.055486:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320580.055490:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5477
00000100:00080000:3.0:1767320580.055493:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320580.055497:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320580.055512:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8a80 x1853164380048256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320580.055573:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048128
00000100:00100000:0.0:1767320580.055582:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048128
00000100:00100000:0.0:1767320580.055637:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17874
00000100:00100000:0.0:1767320580.055644:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380048128:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320580.055664:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320580.057632:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380048256:0@lo:38:kworker.0
00000100:00100000:1.0:1767320580.057730:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320580.057977:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320580.057985:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320580.057988:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320580.057993:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5477
00000100:00080000:3.0:1767320580.057998:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320580.058004:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320580.058022:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab800 x1853164380048768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320580.058039:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320580.058042:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320580.058043:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320580.058046:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5477
00000100:00080000:3.0:1767320580.058048:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320580.058051:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320580.058059:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9880 x1853164380049024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320580.058092:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380048640:0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058124:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320580.058155:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320580.058160:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380048896:0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058186:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320580.058230:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048640
00000100:00100000:3.0:1767320580.058238:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048640
00000100:00100000:3.0:1767320580.058300:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048896
00000100:00100000:3.0:1767320580.058304:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048896
00000100:00100000:3.0:1767320580.058331:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928
00000100:00100000:3.0:1767320580.058340:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380048640:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058398:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380048640:12345-0@lo:400:kworker.0 Request processed in 59us (272us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320580.058405:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928
00000100:00100000:3.0:1767320580.058423:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4929
00000100:00100000:3.0:1767320580.058429:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380048896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058457:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380048896:12345-0@lo:400:kworker.0 Request processed in 28us (269us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320580.058462:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4929
00000100:00100000:3.0:1767320580.058502:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380048896:0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058512:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380048640:0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058561:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380048384:0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058589:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320580.058611:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320580.058617:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380048512:0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058635:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320580.058659:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048384
00000100:00100000:3.0:1767320580.058663:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048384
00000100:00100000:3.0:1767320580.058691:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048512
00000100:00100000:3.0:1767320580.058693:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048512
00000100:00100000:3.0:1767320580.058712:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921
00000100:00100000:3.0:1767320580.058718:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380048384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058754:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380048384:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320580.058760:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921
00000100:00100000:3.0:1767320580.058771:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922
00000100:00100000:3.0:1767320580.058777:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380048512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058803:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380048512:12345-0@lo:400:kworker.0 Request processed in 27us (167us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320580.058809:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922
00000100:00100000:3.0:1767320580.058842:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380048512:0@lo:400:kworker.0
00000100:00100000:3.0:1767320580.058851:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380048384:0@lo:400:kworker.0
00000100:00080000:3.0:1767320580.058933:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320580.058937:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320580.058940:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320580.059326:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380048128:12345-0@lo:38:kworker.0 Request processed in 3678us (3924us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320580.059337:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17874
00000100:00100000:2.0:1767320580.059621:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048256
00000100:00100000:2.0:1767320580.059628:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048256
00000100:00100000:2.0:1767320580.059784:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208
00000100:00100000:2.0:1767320580.059791:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380048256:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320580.059812:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320580.059885:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380048256:12345-0@lo:38:kworker.0 Request processed in 78us (2141us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320580.059892:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208
00000100:00080000:1.0:1767320580.059981:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320580.059989:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320580.059993:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380048128:0@lo:38:kworker.0
00000100:00100000:1.0:1767320580.060025:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380048768:0@lo:38:kworker.0
00000100:00100000:1.0:1767320580.060064:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320580.060095:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380049024:0@lo:38:kworker.0
00000100:00100000:1.0:1767320580.060117:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320580.060143:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320580.060147:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320580.060150:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380048256:0@lo:38:kworker.0
00000100:00100000:1.0:1767320580.060176:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380048768
00000100:00100000:1.0:1767320580.060179:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380048768
00000100:00100000:1.0:1767320580.060210:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049024
00000100:00100000:1.0:1767320580.060213:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049024
00000100:00100000:1.0:1767320580.060229:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17875
00000100:00100000:1.0:1767320580.060233:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380048768:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320580.060244:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320580.060276:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380048768:12345-0@lo:38:kworker.0 Request processed in 41us (211us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320580.060281:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17875
00000100:00100000:1.0:1767320580.060297:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17876
00000100:00100000:1.0:1767320580.060301:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380049024:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320580.060310:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320580.060334:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380049024:12345-0@lo:38:kworker.0 Request processed in 32us (216us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320580.060339:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17876
00000100:00080000:1.0:1767320580.060370:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320580.060373:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320580.060377:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380048768:0@lo:38:kworker.0
00000100:00080000:1.0:1767320580.060384:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320580.060386:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320580.060389:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380049024:0@lo:38:kworker.0
00010000:00010000:2.0:1767320580.634630:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320581.019596:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320581.019653:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320581.019741:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981952
00000100:00100000:0.0:1767320581.019748:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291981824
00000100:00100000:1.0:1767320581.019754:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981952
00000100:00100000:0.0:1767320581.019755:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291981824
00000100:00100000:0.0:1767320581.019815:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4930
00000100:00100000:0.0:1767320581.019829:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291981952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320581.019832:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17877
00000100:00100000:1.0:1767320581.019843:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291981824:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320581.019900:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320581.020205:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291981952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 380us (620us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320581.020217:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4930
00000100:00080000:3.0:1767320581.020390:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320581.028750:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291981824:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 8887us (9077us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320581.028768:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17877
00000100:00100000:0.0:1767320581.079361:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320581.079383:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380049152:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320581.079470:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320581.079682:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049152
00000100:00100000:1.0:1767320581.079692:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049152
00000100:00100000:1.0:1767320581.079746:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732
00000100:00100000:1.0:1767320581.079756:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380049152:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320581.079789:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320581.079851:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380049152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (381us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320581.079859:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732
00000100:00100000:0.0:1767320581.079973:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380049152:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320581.659601:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320582.615452:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320582.615488:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380049280:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320582.615583:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320582.615951:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049280
00000100:00100000:2.0:1767320582.615959:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049280
00000100:00100000:2.0:1767320582.616027:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733
00000100:00100000:2.0:1767320582.616037:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380049280:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320582.616072:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320582.616126:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380049280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (543us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320582.616131:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733
00000100:00080000:3.0:1767320582.616193:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320582.616265:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380049280:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320582.679326:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320583.703104:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320584.729913:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320585.175903:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320585.175915:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320585.175918:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320585.175922:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320585.175927:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320585.175936:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5482
00000100:00080000:1.0:1767320585.175940:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320585.175947:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320585.176006:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae300 x1853164380049408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320585.176039:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320585.176043:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320585.176046:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320585.176049:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5482
00000100:00080000:1.0:1767320585.176051:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320585.176055:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320585.176068:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380af100 x1853164380049536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320585.176178:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320585.176182:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320585.176184:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320585.176188:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5482
00000100:00080000:1.0:1767320585.176192:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1767320585.176197:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380049920:0@lo:400:kworker.0
00000100:00080000:1.0:1767320585.176198:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320585.176215:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9f100 x1853164380050048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320585.176235:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320585.176237:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320585.176239:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320585.176241:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5482
00000100:00080000:1.0:1767320585.176243:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320585.176248:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320585.176256:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9f480 x1853164380050304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320585.176276:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320585.176277:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380050176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320585.176306:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320585.176376:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380049664:0@lo:400:kworker.0
00000100:00100000:2.0:1767320585.176376:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380049408:0@lo:38:kworker.0
00000100:00100000:2.0:1767320585.176411:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320585.176427:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320585.176436:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380049536:0@lo:38:kworker.0
00000100:00100000:2.0:1767320585.176461:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320585.176466:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320585.176475:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380049792:0@lo:400:kworker.0
00000100:00100000:2.0:1767320585.176491:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380050048:0@lo:38:kworker.0
00000100:00100000:0.0:1767320585.176513:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320585.176524:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320585.176546:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380050304:0@lo:38:kworker.0
00000100:00100000:0.0:1767320585.176559:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049920
00000100:00100000:2.0:1767320585.176568:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320585.176569:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049920
00000100:00100000:2.0:1767320585.176604:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050176
00000100:00100000:2.0:1767320585.176609:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050176
00000100:00100000:0.0:1767320585.176622:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049408
00000100:00100000:0.0:1767320585.176627:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049408
00000100:00100000:2.0:1767320585.176640:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050048
00000100:00100000:0.0:1767320585.176642:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050304
00000100:00100000:2.0:1767320585.176645:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050048
00000100:00100000:0.0:1767320585.176646:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050304
00000100:00100000:2.0:1767320585.176673:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931
00000100:00100000:3.0:1767320585.176741:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049664
00000100:00100000:3.0:1767320585.176746:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049664
00000100:00100000:3.0:1767320585.176775:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049792
00000100:00100000:3.0:1767320585.176778:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049792
00000100:00100000:3.0:1767320585.176797:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923
00000100:00100000:3.0:1767320585.176803:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380049664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320585.176848:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380049664:12345-0@lo:400:kworker.0 Request processed in 46us (424us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320585.176853:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923
00000100:00100000:3.0:1767320585.176863:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924
00000100:00100000:3.0:1767320585.176885:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380049792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320585.176916:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380049792:12345-0@lo:400:kworker.0 Request processed in 47us (403us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320585.176922:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924
00000100:00100000:2.0:1767320585.177521:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380049920:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320585.177572:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380049920:12345-0@lo:400:kworker.0 Request processed in 57us (1297us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320585.181470:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932
00000100:00100000:3.0:1767320585.181500:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17878
00000100:00100000:3.0:1767320585.181511:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380049408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320585.181535:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320585.181633:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380049408:12345-0@lo:38:kworker.0 Request processed in 122us (5219us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320585.181653:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17878
00000100:00100000:3.0:1767320585.181687:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17879
00000100:00100000:3.0:1767320585.181690:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380050048:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320585.181700:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320585.181915:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380050176:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320585.181972:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380050176:12345-0@lo:400:kworker.0 Request processed in 487us (5664us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320585.181980:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932
00000100:00100000:0.0:1767320585.182001:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17880
00000100:00100000:0.0:1767320585.182007:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380050304:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320585.182018:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320585.182044:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380050304:12345-0@lo:38:kworker.0 Request processed in 36us (5475us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320585.182050:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17880
00000100:00100000:0.0:1767320585.182101:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380049920:0@lo:400:kworker.0
00000100:00100000:0.0:1767320585.182168:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380050176:0@lo:400:kworker.0
00000100:00100000:0.0:1767320585.182215:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380049536
00000100:00100000:0.0:1767320585.182222:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380049536
00000100:00100000:0.0:1767320585.182251:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209
00000100:00100000:0.0:1767320585.182256:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380049536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320585.182266:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320585.182295:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380049536:12345-0@lo:38:kworker.0 Request processed in 38us (5834us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320585.182301:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209
00000100:00100000:3.0:1767320585.182540:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380050048:12345-0@lo:38:kworker.0 Request processed in 55us (5225us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320585.182551:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17879
00000100:00080000:3.0:1767320585.182585:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320585.182590:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320585.182593:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320585.182616:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380049792:0@lo:400:kworker.0
00000100:00100000:3.0:1767320585.182629:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380049664:0@lo:400:kworker.0
00000100:00080000:0.0:1767320585.184488:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320585.184500:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320585.184506:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380049408:0@lo:38:kworker.0
00000100:00080000:0.0:1767320585.184534:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320585.184537:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320585.184541:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380049536:0@lo:38:kworker.0
00000100:00080000:0.0:1767320585.184552:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320585.184555:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320585.184558:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380050048:0@lo:38:kworker.0
00000100:00080000:0.0:1767320585.184569:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320585.184573:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320585.184576:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380050304:0@lo:38:kworker.0
00000100:00100000:2.0:1767320585.188163:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931
00010000:00010000:3.0:1767320585.751122:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320586.128328:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320586.128432:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291982208
00000100:00100000:1.0:1767320586.128442:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291982208
00000100:00100000:1.0:1767320586.128534:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4933
00000100:00100000:1.0:1767320586.128545:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291982208:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767320586.128722:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320586.128840:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291982208:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 296us (525us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320586.128849:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4933
00000100:00100000:0.0:1767320586.140759:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320586.140856:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291982080
00000100:00100000:1.0:1767320586.140865:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291982080
00000100:00100000:1.0:1767320586.140924:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17881
00000100:00100000:1.0:1767320586.140932:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291982080:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320586.140956:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320586.141011:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291982080:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 79us (262us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320586.141018:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17881
00000100:00100000:2.0:1767320586.199261:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320586.200751:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380050432:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320586.200927:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320586.202013:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050432
00000100:00100000:1.0:1767320586.202187:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050432
00000100:00100000:1.0:1767320586.202308:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734
00000100:00100000:1.0:1767320586.202319:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380050432:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320586.202357:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320586.202453:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380050432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (1526us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320586.202462:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734
00000100:00100000:3.0:1767320586.202513:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380050432:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767320586.775274:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320587.735227:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380050560:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320587.735316:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320587.735391:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050560
00000100:00100000:1.0:1767320587.735400:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050560
00000100:00100000:1.0:1767320587.735474:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735
00000100:00100000:1.0:1767320587.735484:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380050560:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320587.735515:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320587.735565:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380050560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (249us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320587.735573:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735
00000100:00100000:0.0:1767320587.735664:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380050560:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320587.735678:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320587.799254:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320588.823436:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320589.847942:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320590.297644:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320590.297656:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320590.297659:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320590.297663:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320590.297668:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320590.297676:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5487
00000100:00080000:3.0:1767320590.297682:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320590.297689:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320590.297734:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9880 x1853164380050688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320590.297777:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320590.297781:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320590.297783:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320590.297787:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5487
00000100:00080000:3.0:1767320590.297789:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320590.297794:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320590.297809:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab800 x1853164380050816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320590.297864:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320590.297884:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320590.297886:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320590.297890:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5487
00000100:00080000:3.0:1767320590.297892:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320590.297896:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320590.297907:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae300 x1853164380051328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320590.297922:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320590.297926:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320590.297928:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320590.297931:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5487
00000100:00080000:3.0:1767320590.297933:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320590.297937:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320590.297946:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ac380 x1853164380051584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320590.298157:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380050944:0@lo:400:kworker.0
00000100:00100000:1.0:1767320590.298226:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320590.298311:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320590.298318:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380051072:0@lo:400:kworker.0
00000100:00100000:1.0:1767320590.298342:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320590.298424:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050944
00000100:00100000:3.0:1767320590.298432:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050944
00000100:00100000:3.0:1767320590.298506:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380051072
00000100:00100000:3.0:1767320590.298510:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380051072
00000100:00100000:0.0:1767320590.298530:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380051200:0@lo:400:kworker.0
00000100:00100000:3.0:1767320590.298533:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925
00000100:00100000:3.0:1767320590.298540:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380050944:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320590.298561:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320590.298579:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320590.298596:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380051456:0@lo:400:kworker.0
00000100:00100000:3.0:1767320590.298597:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380050944:12345-0@lo:400:kworker.0 Request processed in 57us (371us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320590.298604:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925
00000100:00100000:0.0:1767320590.298617:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320590.298619:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926
00000100:00100000:3.0:1767320590.298625:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380051072:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320590.298647:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380051200
00000100:00100000:0.0:1767320590.298650:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380051200
00000100:00100000:3.0:1767320590.298650:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380051072:12345-0@lo:400:kworker.0 Request processed in 26us (308us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320590.298656:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926
00000100:00100000:0.0:1767320590.298677:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380051456
00000100:00100000:0.0:1767320590.298680:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380051456
00000100:00100000:0.0:1767320590.298697:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934
00000100:00100000:0.0:1767320590.298703:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380051200:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320590.298706:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935
00000100:00100000:3.0:1767320590.298712:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380051456:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320590.298735:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380051200:12345-0@lo:400:kworker.0 Request processed in 32us (174us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320590.298741:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934
00000100:00080000:1.0:1767320590.298767:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320590.298771:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320590.298774:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320590.298786:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380050688:0@lo:38:kworker.0
00000100:00100000:1.0:1767320590.298818:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380051072:0@lo:400:kworker.0
00000100:00100000:2.0:1767320590.298825:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320590.298839:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380050944:0@lo:400:kworker.0
00000100:00100000:2.0:1767320590.298852:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380050816:0@lo:38:kworker.0
00000100:00100000:1.0:1767320590.298898:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050688
00000100:00100000:1.0:1767320590.298903:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050688
00000100:00100000:2.0:1767320590.298907:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320590.298932:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17882
00000100:00100000:2.0:1767320590.298938:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380051328:0@lo:38:kworker.0
00000100:00100000:1.0:1767320590.298939:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380050688:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320590.298960:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320590.298965:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320590.298984:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380051584:0@lo:38:kworker.0
00000100:00100000:1.0:1767320590.299002:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380050688:12345-0@lo:38:kworker.0 Request processed in 62us (179us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320590.299010:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17882
00000100:00100000:2.0:1767320590.299015:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320590.299035:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380051328
00000100:00100000:1.0:1767320590.299040:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380051328
00000100:00080000:2.0:1767320590.299047:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320590.299053:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320590.299058:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380050688:0@lo:38:kworker.0
00000100:00100000:1.0:1767320590.299059:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380051584
00000100:00100000:1.0:1767320590.299064:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380051584
00000100:00100000:1.0:1767320590.299080:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17883
00000100:00100000:1.0:1767320590.299085:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380051328:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320590.299086:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380050816
00000100:00100000:2.0:1767320590.299092:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380050816
00010000:00020000:1.0:1767320590.299110:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320590.299129:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210
00000100:00100000:2.0:1767320590.299135:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380050816:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320590.299145:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380051328:12345-0@lo:38:kworker.0 Request processed in 58us (179us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767320590.299148:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320590.299157:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17883
00000100:00100000:1.0:1767320590.299173:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17884
00000100:00100000:1.0:1767320590.299177:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380051584:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320590.299185:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380050816:12345-0@lo:38:kworker.0 Request processed in 48us (279us total) trans 0 rc -19/-19
00010000:00020000:1.0:1767320590.299188:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320590.299196:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210
00000100:00100000:1.0:1767320590.299224:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380051584:12345-0@lo:38:kworker.0 Request processed in 44us (209us total) trans 0 rc -19/-19
00000100:00080000:2.0:1767320590.299228:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320590.299232:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17884
00000100:00080000:2.0:1767320590.299237:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320590.299241:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380050816:0@lo:38:kworker.0
00000100:00080000:2.0:1767320590.299252:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320590.299255:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320590.299258:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380051328:0@lo:38:kworker.0
00000100:00080000:2.0:1767320590.299266:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320590.299271:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320590.299273:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380051584:0@lo:38:kworker.0
00000100:00100000:3.0:1767320590.299352:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380051456:12345-0@lo:400:kworker.0 Request processed in 640us (733us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320590.299359:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935
00000100:00100000:0.0:1767320590.299753:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380051456:0@lo:400:kworker.0
00000100:00100000:0.0:1767320590.300142:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380051200:0@lo:400:kworker.0
00010000:00010000:3.0:1767320590.871205:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320591.249012:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320591.249053:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:0.0:1767320591.249082:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291982592 offset 0 length 520: 4
00000100:00100000:3.0:1767320591.249303:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291982464
00000100:00100000:3.0:1767320591.249314:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291982464
00000100:00100000:3.0:1767320591.250563:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291982336
00000100:00100000:3.0:1767320591.250573:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291982336
00000100:00100000:3.0:1767320591.250596:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4936
00000100:00100000:3.0:1767320591.250608:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291982464:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320591.250750:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291982464:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 143us (1745us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320591.250759:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4936
00000100:00100000:3.0:1767320591.250779:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17885
00000100:00100000:3.0:1767320591.250783:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291982336:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320591.250803:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320591.250829:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291982336:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (1775us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320591.250834:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17885
00000100:00080000:2.0:1767320591.251137:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320591.321523:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320591.321837:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380051712:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320591.324401:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320591.326854:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380051712
00000100:00100000:2.0:1767320591.326890:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380051712
00000100:00100000:2.0:1767320591.327075:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736
00000100:00100000:2.0:1767320591.327086:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380051712:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320591.327128:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320591.327225:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380051712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (2831us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320591.327234:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736
00000100:00100000:3.0:1767320591.327670:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380051712:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320591.895199:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320592.855343:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380051840:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320592.855419:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320592.855795:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380051840
00000100:00100000:1.0:1767320592.855803:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380051840
00000100:00100000:1.0:1767320592.855907:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737
00000100:00100000:1.0:1767320592.855918:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380051840:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320592.855948:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320592.856017:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f380af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380051840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (597us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320592.856025:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737
00000100:00100000:1.0:1767320592.856113:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380051840:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320592.856497:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320592.919893:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320593.943214:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320594.391223:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320569/real 1767320569]  req@ffff8b0f083fc380 x1853164380045440/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320594 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320594.391258:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f083fc380 x1853164380045440/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320594 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320594.391273:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320594.391348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320594.391352:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380045440:0@lo:250:kworker.0
00000100:00080000:3.0:1767320594.391552:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320594.391558:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320594.391561:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320594.391566:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5472
00000100:00080000:3.0:1767320594.391571:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320594.391579:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320594.391615:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae680 x1853164380051968/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320594.391666:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380051968:0@lo:250:kworker.0
00000400:00000100:2.0:1767320594.391714:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380051968 offset 0 length 520: 4
00000100:00080000:3.0:1767320594.392002:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320594.392007:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320594.392009:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320594.392012:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5492
00000100:00080000:3.0:1767320594.392015:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320594.392019:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320594.392036:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ac380 x1853164380052096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320594.397494:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380052096:0@lo:38:kworker.0
00000100:00100000:2.0:1767320594.397586:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320594.399187:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320594.399198:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320594.399202:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320594.399208:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5492
00000100:00080000:3.0:1767320594.399213:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320594.399222:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320594.399267:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f380ae300 x1853164380052224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320594.399366:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320594.399369:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320594.399371:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320594.399375:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5492
00000100:00080000:3.0:1767320594.399378:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320594.399382:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320594.399394:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f6d80 x1853164380052736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320594.399408:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320594.399411:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320594.399412:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320594.399415:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5492
00000100:00080000:3.0:1767320594.399417:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320594.399421:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320594.399430:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f4a80 x1853164380052992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320594.399459:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380052480:0@lo:400:kworker.0
00000100:00100000:3.0:1767320594.399512:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320594.399542:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320594.399547:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380052352:0@lo:400:kworker.0
00000100:00100000:3.0:1767320594.399568:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320594.399592:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380052608:0@lo:400:kworker.0
00000100:00100000:3.0:1767320594.399621:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320594.399689:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380052864:0@lo:400:kworker.0
00000100:00100000:0.0:1767320594.399733:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052480
00000100:00100000:0.0:1767320594.399740:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052480
00000100:00100000:0.0:1767320594.399806:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052352
00000100:00100000:0.0:1767320594.399809:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052352
00000100:00100000:0.0:1767320594.399834:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927
00000100:00100000:0.0:1767320594.399842:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380052480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320594.399911:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380052480:12345-0@lo:400:kworker.0 Request processed in 70us (399us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320594.399918:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927
00000100:00100000:0.0:1767320594.399935:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928
00000100:00100000:0.0:1767320594.399941:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380052352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320594.399966:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380052352:12345-0@lo:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320594.399971:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928
00000100:00080000:0.0:1767320594.399995:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320594.400000:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320594.400031:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380052352:0@lo:400:kworker.0
00000100:00100000:0.0:1767320594.400041:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380052480:0@lo:400:kworker.0
00000100:00100000:2.0:1767320594.400316:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380052224:0@lo:38:kworker.0
00000100:00100000:2.0:1767320594.400352:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320594.400382:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380052736:0@lo:38:kworker.0
00000100:00100000:0.0:1767320594.403864:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052224
00000100:00100000:0.0:1767320594.403919:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052224
00000100:00100000:0.0:1767320594.403974:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211
00000100:00100000:0.0:1767320594.403984:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380052224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320594.404010:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320594.404121:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380052224:12345-0@lo:38:kworker.0 Request processed in 136us (3766us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320594.404129:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211
00000100:00100000:2.0:1767320594.405457:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320594.412733:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052096
00000100:00100000:1.0:1767320594.412751:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052096
00000100:00100000:1.0:1767320594.412842:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052608
00000100:00100000:1.0:1767320594.412846:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052608
00000100:00100000:1.0:1767320594.412917:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937
00000100:00100000:1.0:1767320594.412930:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380052608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320594.413032:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380052608:12345-0@lo:400:kworker.0 Request processed in 107us (13410us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320594.413041:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937
00000100:00100000:1.0:1767320594.413078:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17886
00000100:00100000:1.0:1767320594.413083:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380052096:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320594.413105:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320594.413136:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380052096:12345-0@lo:38:kworker.0 Request processed in 52us (15551us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320594.413142:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17886
00000100:00080000:1.0:1767320594.413193:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320594.413360:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380052608:0@lo:400:kworker.0
00000100:00100000:2.0:1767320594.415702:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380052992:0@lo:38:kworker.0
00000100:00100000:3.0:1767320594.415901:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320594.416009:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052736
00000100:00100000:1.0:1767320594.416019:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052736
00000100:00100000:1.0:1767320594.416058:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052864
00000100:00100000:1.0:1767320594.416070:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052864
00000100:00100000:1.0:1767320594.416119:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938
00000100:00100000:1.0:1767320594.416129:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380052864:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320594.416208:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380052864:12345-0@lo:400:kworker.0 Request processed in 81us (307us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320594.416216:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938
00000100:00100000:1.0:1767320594.416235:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17887
00000100:00100000:1.0:1767320594.416239:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380052736:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320594.416258:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320594.416289:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380052736:12345-0@lo:38:kworker.0 Request processed in 49us (10839us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320594.416295:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17887
00000100:00080000:1.0:1767320594.416311:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320594.416481:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380052864:0@lo:400:kworker.0
00000100:00100000:2.0:1767320594.416714:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320594.416752:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320594.416767:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320594.416911:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380052992
00000100:00100000:0.0:1767320594.416916:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380052992
00000100:00100000:0.0:1767320594.416949:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17888
00000100:00100000:0.0:1767320594.416954:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380052992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320594.416966:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320594.416998:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380052992:12345-0@lo:38:kworker.0 Request processed in 42us (284us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320594.417004:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17888
00000100:00100000:2.0:1767320594.418954:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380052096:0@lo:38:kworker.0
00000100:00080000:2.0:1767320594.419014:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320594.419020:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320594.419024:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380052224:0@lo:38:kworker.0
00000100:00080000:2.0:1767320594.419035:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320594.419038:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320594.419040:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380052736:0@lo:38:kworker.0
00000100:00080000:2.0:1767320594.419049:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320594.419052:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320594.419055:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380052992:0@lo:38:kworker.0
00010000:00010000:3.0:1767320594.969226:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320595.991199:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320596.368933:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320596.369020:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320596.369089:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291982720
00000100:00100000:3.0:1767320596.369101:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291982720
00000100:00100000:3.0:1767320596.369199:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291982848
00000100:00100000:3.0:1767320596.369203:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291982848
00000100:00080000:2.0:1767320596.369297:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320596.369516:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4939
00000100:00100000:1.0:1767320596.369607:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291982848:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320596.369719:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291982848:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 192us (697us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320596.369729:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4939
00000100:00100000:1.0:1767320596.369751:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17889
00000100:00100000:1.0:1767320596.369756:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291982720:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320596.369778:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320596.369805:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291982720:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (882us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320596.369811:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17889
00000100:00100000:3.0:1767320596.440667:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320596.441634:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380053120:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320596.441779:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320596.442339:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380053120
00000100:00100000:1.0:1767320596.442349:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380053120
00000100:00100000:1.0:1767320596.442461:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738
00000100:00100000:1.0:1767320596.442471:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380053120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320596.442503:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320596.442575:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380053120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (795us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320596.442583:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738
00000100:00100000:0.0:1767320596.442918:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380053120:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320596.443122:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320597.015237:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320597.975752:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320597.975777:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380053248:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320597.975854:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320597.976206:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380053248
00000100:00100000:3.0:1767320597.976216:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380053248
00000100:00100000:3.0:1767320597.976293:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739
00000100:00100000:3.0:1767320597.976305:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380053248:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320597.976344:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320597.976404:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380053248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (550us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320597.976411:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739
00000100:00100000:3.0:1767320597.976468:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380053248:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320597.979170:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320598.039424:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320599.063445:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320599.511214:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320599.511227:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320599.511230:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320599.511234:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320599.511239:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320599.511247:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5496
00000100:00080000:1.0:1767320599.511252:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320599.511259:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320599.511300:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9ea00 x1853164380053376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320599.511328:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320599.511331:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320599.511333:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320599.511337:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5496
00000100:00080000:1.0:1767320599.511340:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320599.511343:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320599.511356:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9f800 x1853164380053504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320599.511422:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320599.511426:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320599.511427:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320599.511431:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5496
00000100:00080000:1.0:1767320599.511433:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320599.511436:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320599.511447:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9c000 x1853164380054016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320599.511466:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320599.511469:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320599.511470:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320599.511474:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5496
00000100:00080000:1.0:1767320599.511476:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320599.511479:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320599.511488:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9d500 x1853164380054272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320599.511719:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380053760:0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.511785:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320599.511857:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320599.511864:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380053632:0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.511925:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320599.511960:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380053760
00000100:00100000:0.0:1767320599.511968:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380053760
00000100:00100000:0.0:1767320599.512040:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380053632
00000100:00100000:0.0:1767320599.512044:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380053632
00000100:00100000:0.0:1767320599.512065:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929
00000100:00100000:0.0:1767320599.512073:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380053760:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512121:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380053760:12345-0@lo:400:kworker.0 Request processed in 48us (335us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320599.512128:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929
00000100:00100000:0.0:1767320599.512144:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930
00000100:00100000:0.0:1767320599.512150:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380053632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512176:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380053632:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320599.512182:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930
00000100:00080000:0.0:1767320599.512209:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320599.512213:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320599.512246:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380053632:0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512257:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380053760:0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512283:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380054144:0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512309:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320599.512328:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320599.512333:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380053888:0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512351:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320599.512416:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054144
00000100:00100000:0.0:1767320599.512419:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054144
00000100:00100000:0.0:1767320599.512447:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380053888
00000100:00100000:0.0:1767320599.512450:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380053888
00000100:00100000:0.0:1767320599.512466:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4940
00000100:00100000:0.0:1767320599.512471:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380054144:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512515:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380054144:12345-0@lo:400:kworker.0 Request processed in 31us (193us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320599.512521:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4940
00000100:00100000:0.0:1767320599.512533:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941
00000100:00100000:0.0:1767320599.512539:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380053888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320599.512566:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380053376:0@lo:38:kworker.0
00000100:00100000:0.0:1767320599.512568:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380053888:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320599.512579:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941
00000100:00080000:0.0:1767320599.512596:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320599.512607:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320599.512617:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380053888:0@lo:400:kworker.0
00000100:00100000:0.0:1767320599.512633:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380054144:0@lo:400:kworker.0
00000100:00100000:2.0:1767320599.512636:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380053504:0@lo:38:kworker.0
00000100:00100000:0.0:1767320599.512657:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380053376
00000100:00100000:0.0:1767320599.512662:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380053376
00000100:00100000:2.0:1767320599.512667:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320599.512687:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17890
00000100:00100000:0.0:1767320599.512693:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380053376:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320599.512698:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380054016:0@lo:38:kworker.0
00010000:00020000:0.0:1767320599.512713:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320599.512722:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320599.512747:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380054272:0@lo:38:kworker.0
00000100:00100000:0.0:1767320599.512754:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380053376:12345-0@lo:38:kworker.0 Request processed in 59us (146us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320599.512762:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17890
00000100:00100000:2.0:1767320599.512771:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320599.512777:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054016
00000100:00100000:0.0:1767320599.512781:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054016
00000100:00100000:0.0:1767320599.512793:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054272
00000100:00100000:0.0:1767320599.512797:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054272
00000100:00080000:2.0:1767320599.512798:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320599.512808:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17891
00000100:00100000:0.0:1767320599.512811:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380054016:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767320599.512819:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00010000:00020000:0.0:1767320599.512826:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320599.512826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380053376:0@lo:38:kworker.0
00000100:00100000:2.0:1767320599.512853:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380053504
00000100:00100000:2.0:1767320599.512857:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380053504
00000100:00100000:0.0:1767320599.512862:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380054016:12345-0@lo:38:kworker.0 Request processed in 47us (139us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320599.512891:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17891
00000100:00100000:0.0:1767320599.512904:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17892
00000100:00100000:0.0:1767320599.512907:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380054272:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320599.512915:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320599.512934:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380054272:12345-0@lo:38:kworker.0 Request processed in 26us (165us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320599.512939:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17892
00000100:00100000:0.0:1767320599.512986:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212
00000100:00100000:0.0:1767320599.512990:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380053504:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320599.512998:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320599.513032:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380053504:12345-0@lo:38:kworker.0 Request processed in 40us (366us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320599.513037:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212
00000100:00080000:2.0:1767320599.513132:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320599.513136:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320599.513139:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380053504:0@lo:38:kworker.0
00000100:00080000:2.0:1767320599.513147:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320599.513149:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320599.513152:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380054016:0@lo:38:kworker.0
00000100:00080000:2.0:1767320599.513158:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320599.513161:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320599.513163:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380054272:0@lo:38:kworker.0
00010000:00010000:2.0:1767320600.087488:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320601.112296:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320601.490985:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320601.491051:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320601.491160:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291983104
00000100:00100000:0.0:1767320601.491172:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291983104
00000100:00100000:0.0:1767320601.491245:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291982976
00000100:00100000:0.0:1767320601.491249:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291982976
00000100:00100000:0.0:1767320601.491270:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4942
00000100:00100000:0.0:1767320601.491282:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291983104:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320601.491356:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291983104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 77us (382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320601.491365:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4942
00000100:00100000:0.0:1767320601.491399:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17893
00000100:00100000:0.0:1767320601.491405:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291982976:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320601.491426:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320601.491455:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291982976:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (404us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320601.491462:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17893
00000100:00080000:3.0:1767320601.491549:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320601.559506:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380054400:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320601.559574:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320601.559764:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054400
00000100:00100000:1.0:1767320601.559772:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054400
00000100:00100000:1.0:1767320601.559839:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740
00000100:00100000:1.0:1767320601.559850:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380054400:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320601.559897:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320601.559946:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380054400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (371us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320601.559953:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740
00000100:00100000:1.0:1767320601.560019:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380054400:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320601.560086:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320602.135353:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320603.095393:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380054528:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320603.095467:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320603.095639:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054528
00000100:00100000:2.0:1767320603.095655:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054528
00000100:00100000:2.0:1767320603.095730:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741
00000100:00100000:2.0:1767320603.095741:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380054528:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320603.095770:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320603.095817:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380054528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (349us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320603.095828:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741
00000100:00080000:3.0:1767320603.095968:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320603.096059:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380054528:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320603.163514:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320604.186378:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320604.631130:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320604.631142:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320604.631145:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320604.631148:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320604.631153:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320604.631161:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5501
00000100:00080000:2.0:1767320604.631165:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320604.631172:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320604.631212:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f128380 x1853164380054656/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320604.631245:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320604.631248:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320604.631250:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320604.631253:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5501
00000100:00080000:2.0:1767320604.631255:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320604.631259:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320604.631272:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f128a80 x1853164380054784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320604.631345:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380054912:0@lo:400:kworker.0
00000100:00100000:3.0:1767320604.631420:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320604.631531:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054912
00000100:00100000:1.0:1767320604.631539:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054912
00000100:00100000:1.0:1767320604.631597:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931
00000100:00100000:1.0:1767320604.631606:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380054912:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320604.631724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380054656:0@lo:38:kworker.0
00000100:00100000:0.0:1767320604.631754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320604.631773:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380054784:0@lo:38:kworker.0
00000100:00100000:0.0:1767320604.631791:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320604.631820:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f12aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380055040:0@lo:400:kworker.0
00000100:00100000:0.0:1767320604.631841:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320604.631864:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055040
00000100:00100000:0.0:1767320604.631886:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055040
00000100:00100000:0.0:1767320604.631913:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932
00000100:00100000:0.0:1767320604.631919:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380055040:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320604.631953:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380055040:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320604.631959:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932
00000100:00100000:0.0:1767320604.632027:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f12aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380055040:0@lo:400:kworker.0
00000100:00080000:0.0:1767320604.632064:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320604.632090:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054656
00000100:00100000:0.0:1767320604.632094:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054656
00000100:00100000:0.0:1767320604.632115:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17894
00000100:00100000:0.0:1767320604.632119:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380054656:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320604.632138:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320604.632171:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380054656:12345-0@lo:38:kworker.0 Request processed in 50us (416us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320604.632176:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17894
00000100:00080000:0.0:1767320604.632203:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320604.632207:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320604.632210:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380054656:0@lo:38:kworker.0
00000100:00100000:0.0:1767320604.632237:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380054784
00000100:00100000:0.0:1767320604.632241:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380054784
00000100:00100000:0.0:1767320604.632258:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213
00000100:00100000:0.0:1767320604.632263:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380054784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320604.632272:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320604.632300:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380054784:12345-0@lo:38:kworker.0 Request processed in 35us (507us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320604.632306:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213
00000100:00080000:0.0:1767320604.632329:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320604.632334:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320604.632337:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380054784:0@lo:38:kworker.0
00000100:00100000:1.0:1767320604.634297:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380054912:12345-0@lo:400:kworker.0 Request processed in 2683us (2867us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320604.634311:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931
00000100:00080000:2.0:1767320604.641846:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320604.641852:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320604.641856:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320604.641863:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5501
00000100:00080000:2.0:1767320604.641884:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320604.641891:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320604.641911:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f129880 x1853164380055296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320604.641937:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320604.641941:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320604.641943:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320604.641946:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5501
00000100:00080000:2.0:1767320604.641949:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320604.641952:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320604.641963:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f128a80 x1853164380055552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320604.642028:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380055296:0@lo:38:kworker.0
00000100:00100000:2.0:1767320604.642097:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320604.642130:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380055552:0@lo:38:kworker.0
00000100:00100000:2.0:1767320604.642150:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320604.642189:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055296
00000100:00100000:2.0:1767320604.642196:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055296
00000100:00100000:2.0:1767320604.642225:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055552
00000100:00100000:2.0:1767320604.642228:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055552
00000100:00100000:2.0:1767320604.642247:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17895
00000100:00100000:2.0:1767320604.642253:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380055296:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320604.642273:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320604.642312:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380055296:12345-0@lo:38:kworker.0 Request processed in 58us (215us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320604.642322:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17895
00000100:00100000:2.0:1767320604.642337:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17896
00000100:00100000:2.0:1767320604.642341:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380055552:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320604.642350:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320604.642372:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380055552:12345-0@lo:38:kworker.0 Request processed in 29us (220us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320604.642377:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17896
00000100:00080000:2.0:1767320604.642413:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320604.642418:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320604.642422:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f129880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380055296:0@lo:38:kworker.0
00000100:00080000:2.0:1767320604.642430:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320604.642433:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320604.642436:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380055552:0@lo:38:kworker.0
00000100:00100000:2.0:1767320604.642462:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380055424:0@lo:400:kworker.0
00000100:00100000:2.0:1767320604.642483:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320604.642990:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055424
00000100:00100000:0.0:1767320604.643005:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055424
00000100:00100000:0.0:1767320604.643049:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4943
00000100:00100000:0.0:1767320604.643057:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380055424:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320604.643098:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380055424:12345-0@lo:400:kworker.0 Request processed in 43us (614us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320604.643104:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4943
00000100:00080000:0.0:1767320604.643121:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320604.643419:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320604.643433:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380055168:0@lo:400:kworker.0
00000100:00100000:2.0:1767320604.643459:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320604.643487:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380055424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320604.643627:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055168
00000100:00100000:0.0:1767320604.643632:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055168
00000100:00100000:0.0:1767320604.643676:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944
00000100:00100000:0.0:1767320604.643683:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380055168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320604.643737:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380055168:12345-0@lo:400:kworker.0 Request processed in 55us (276us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320604.643742:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944
00000100:00080000:2.0:1767320604.643960:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320604.643991:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380055168:0@lo:400:kworker.0
00000100:00100000:3.0:1767320604.644163:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380054912:0@lo:400:kworker.0
00010000:00010000:2.0:1767320605.208573:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320606.231231:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320606.608541:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320606.609488:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291983232
00000100:00100000:0.0:1767320606.609498:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291983232
00000100:00100000:0.0:1767320606.609551:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17897
00000100:00100000:0.0:1767320606.609559:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291983232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320606.609584:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320606.609753:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291983232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 194us (1222us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320606.609758:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17897
00000100:00100000:2.0:1767320606.614377:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320606.614514:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291983360
00000100:00100000:0.0:1767320606.614523:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291983360
00000100:00100000:0.0:1767320606.614600:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4945
00000100:00100000:0.0:1767320606.614608:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291983360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767320606.614737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320606.614794:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291983360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 187us (425us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320606.614800:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4945
00000100:00100000:3.0:1767320606.679047:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380055680:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320606.679119:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320606.679372:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055680
00000100:00100000:1.0:1767320606.679381:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055680
00000100:00100000:1.0:1767320606.679576:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742
00000100:00100000:1.0:1767320606.679586:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380055680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320606.679623:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320606.679778:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380055680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (659us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320606.679787:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742
00000100:00100000:0.0:1767320606.679912:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380055680:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320606.680285:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:3.0:1767320607.255139:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320608.218481:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320608.218505:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380055808:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320608.218577:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320608.218724:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055808
00000100:00100000:3.0:1767320608.218743:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055808
00000100:00100000:3.0:1767320608.218805:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743
00000100:00100000:3.0:1767320608.218815:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380055808:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320608.218844:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320608.218914:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380055808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (335us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320608.218921:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743
00000100:00080000:2.0:1767320608.219062:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320608.219539:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380055808:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320608.279261:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320609.303823:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320609.751288:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320609.751295:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320609.751299:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320609.751301:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320609.751305:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320609.751311:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5507
00000100:00080000:1.0:1767320609.751314:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320609.751321:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320609.751354:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9ca80 x1853164380055936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320609.751374:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320609.751377:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320609.751379:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320609.751383:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5507
00000100:00080000:1.0:1767320609.751385:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320609.751389:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320609.751401:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9c380 x1853164380056064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320609.751404:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380055936:0@lo:38:kworker.0
00000100:00100000:2.0:1767320609.751470:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320609.751473:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320609.751476:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320609.751478:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320609.751482:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5507
00000100:00080000:1.0:1767320609.751484:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320609.751488:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320609.751498:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9e300 x1853164380056576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320609.751512:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320609.751515:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320609.751517:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320609.751520:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5507
00000100:00080000:1.0:1767320609.751522:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320609.751525:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320609.751534:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9ce00 x1853164380056832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320609.751537:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380056064:0@lo:38:kworker.0
00000100:00100000:1.0:1767320609.751557:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380056448:0@lo:400:kworker.0
00000100:00100000:2.0:1767320609.751561:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320609.751582:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320609.751582:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380056576:0@lo:38:kworker.0
00000100:00100000:2.0:1767320609.751600:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320609.751603:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320609.751607:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380056704:0@lo:400:kworker.0
00000100:00100000:2.0:1767320609.751617:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380056832:0@lo:38:kworker.0
00000100:00100000:1.0:1767320609.751627:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320609.751643:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380055936
00000100:00100000:2.0:1767320609.751650:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380055936
00000100:00100000:1.0:1767320609.751654:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056448
00000100:00100000:1.0:1767320609.751657:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056448
00000100:00100000:2.0:1767320609.751676:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056576
00000100:00100000:2.0:1767320609.751679:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056576
00000100:00100000:3.0:1767320609.751739:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380056192:0@lo:400:kworker.0
00000100:00100000:3.0:1767320609.751769:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320609.751792:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320609.751793:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056704
00000100:00100000:2.0:1767320609.751796:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056704
00000100:00100000:3.0:1767320609.751798:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380056320:0@lo:400:kworker.0
00000100:00100000:3.0:1767320609.751818:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320609.751830:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4946
00000100:00100000:2.0:1767320609.751838:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380056448:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320609.751842:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4947
00000100:00100000:3.0:1767320609.751848:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380056704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320609.751932:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17898
00000100:00100000:1.0:1767320609.751938:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380055936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320609.751955:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320609.752005:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380056448:12345-0@lo:400:kworker.0 Request processed in 166us (420us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320609.752012:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4946
00000100:00100000:2.0:1767320609.752034:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17899
00000100:00100000:2.0:1767320609.752038:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380056576:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320609.752044:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056064
00000100:00100000:0.0:1767320609.752048:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056064
00010000:00020000:2.0:1767320609.752048:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320609.752069:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214
00000100:00100000:0.0:1767320609.752074:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380056064:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320609.752086:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320609.754040:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380056576:12345-0@lo:38:kworker.0 Request processed in 1992us (2431us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320609.754054:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17899
00000100:00100000:1.0:1767320609.754088:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380055936:12345-0@lo:38:kworker.0 Request processed in 2148us (2616us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320609.754094:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17898
00000100:00080000:1.0:1767320609.754129:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320609.754150:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056192
00000100:00100000:1.0:1767320609.754158:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056192
00000100:00100000:1.0:1767320609.754206:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056320
00000100:00100000:1.0:1767320609.754209:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056320
00000100:00100000:1.0:1767320609.754230:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933
00000100:00100000:1.0:1767320609.754238:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380056192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320609.754256:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934
00000100:00100000:2.0:1767320609.754263:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380056320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320609.754292:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380056192:12345-0@lo:400:kworker.0 Request processed in 55us (2522us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320609.754292:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380056320:12345-0@lo:400:kworker.0 Request processed in 30us (2473us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320609.754298:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934
00000100:00100000:2.0:1767320609.754328:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320609.754351:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380056704:12345-0@lo:400:kworker.0 Request processed in 2502us (2722us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320609.754358:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4947
00000100:00100000:3.0:1767320609.754371:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056832
00000100:00100000:3.0:1767320609.754374:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056832
00000100:00080000:2.0:1767320609.754378:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320609.754383:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320609.754387:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380056576:0@lo:38:kworker.0
00000100:00100000:3.0:1767320609.754390:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17900
00000100:00100000:3.0:1767320609.754393:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380056832:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767320609.754398:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320609.754401:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320609.754404:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380055936:0@lo:38:kworker.0
00010000:00020000:3.0:1767320609.754409:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320609.754440:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380056832:12345-0@lo:38:kworker.0 Request processed in 45us (112us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320609.754447:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17900
00000100:00100000:2.0:1767320609.754453:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380056320:0@lo:400:kworker.0
00000100:00100000:2.0:1767320609.754464:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380056192:0@lo:400:kworker.0
00000100:00080000:3.0:1767320609.754464:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320609.754468:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320609.754470:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380056832:0@lo:38:kworker.0
00000100:00100000:2.0:1767320609.754510:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380056704:0@lo:400:kworker.0
00000100:00100000:2.0:1767320609.754521:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380056448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320609.755411:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933
00000100:00080000:1.0:1767320609.755446:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320609.756330:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380056064:12345-0@lo:38:kworker.0 Request processed in 4246us (4758us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320609.756341:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214
00000100:00080000:3.0:1767320609.758185:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320609.758195:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320609.758199:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380056064:0@lo:38:kworker.0
00010000:00010000:1.0:1767320610.327179:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320611.351637:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320611.727616:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320611.727755:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320611.733181:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291983488
00000100:00100000:1.0:1767320611.733197:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291983488
00000100:00100000:1.0:1767320611.733251:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291983616
00000100:00100000:1.0:1767320611.733255:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291983616
00000100:00100000:1.0:1767320611.733310:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4948
00000100:00100000:1.0:1767320611.733321:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291983616:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:2.0:1767320611.733509:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320611.733529:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17901
00000100:00100000:2.0:1767320611.733536:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291983488:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320611.733557:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320611.733609:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291983616:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 290us (5853us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320611.733619:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4948
00000100:00100000:2.0:1767320611.734613:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291983488:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1072us (7003us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320611.734624:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17901
00000100:00100000:0.0:1767320611.799352:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320611.799370:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380056960:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320611.799441:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320611.799587:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380056960
00000100:00100000:1.0:1767320611.799596:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380056960
00000100:00100000:1.0:1767320611.799665:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744
00000100:00100000:1.0:1767320611.799675:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380056960:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320611.799705:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320611.799753:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380056960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (310us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320611.799760:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744
00000100:00080000:3.0:1767320611.799833:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320611.799959:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380056960:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320612.375203:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320613.335089:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320613.335113:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380057088:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320613.335170:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320613.335208:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057088
00000100:00100000:0.0:1767320613.335218:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057088
00000100:00100000:0.0:1767320613.335290:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745
00000100:00100000:0.0:1767320613.335301:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380057088:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320613.335329:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320613.335377:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380057088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (205us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320613.335384:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745
00000100:00100000:1.0:1767320613.335403:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380057088:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320613.335430:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320613.399355:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320614.428157:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320614.875312:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320614.875324:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320614.875327:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320614.875331:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320614.875335:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320614.875345:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5512
00000100:00080000:3.0:1767320614.875350:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320614.875357:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320614.875397:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f7480 x1853164380057216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320614.875457:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380057216:0@lo:38:kworker.0
00000100:00100000:2.0:1767320614.875524:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320614.875910:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057216
00000100:00100000:0.0:1767320614.875919:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057216
00000100:00100000:0.0:1767320614.875953:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17902
00000100:00080000:3.0:1767320614.876285:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320614.876290:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320614.876292:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320614.876297:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5512
00000100:00080000:3.0:1767320614.876302:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320614.876306:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320614.876328:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f5500 x1853164380057344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320614.876378:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380057216:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320614.876400:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320614.877313:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380057344:0@lo:38:kworker.0
00000100:00100000:2.0:1767320614.877359:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320614.877504:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320614.877508:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320614.877510:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320614.877515:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5512
00000100:00080000:3.0:1767320614.877518:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320614.877522:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320614.877653:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f6a00 x1853164380057856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320614.877673:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320614.877676:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320614.877678:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320614.877682:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5512
00000100:00080000:3.0:1767320614.877684:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320614.877688:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320614.877699:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f6680 x1853164380058112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320614.877756:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380057600:0@lo:400:kworker.0
00000100:00100000:3.0:1767320614.877788:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320614.877815:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320614.877821:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380057472:0@lo:400:kworker.0
00000100:00100000:3.0:1767320614.877843:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320614.877909:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057600
00000100:00100000:3.0:1767320614.877915:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057600
00000100:00100000:3.0:1767320614.877956:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057472
00000100:00100000:0.0:1767320614.878150:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380057216:12345-0@lo:38:kworker.0 Request processed in 2187us (2624us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320614.878160:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17902
00000100:00100000:0.0:1767320614.878188:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380057984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320614.878217:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320614.878236:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320614.878242:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380057728:0@lo:400:kworker.0
00000100:00100000:0.0:1767320614.878261:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320614.878284:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057984
00000100:00100000:0.0:1767320614.878288:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057984
00000100:00100000:0.0:1767320614.878322:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057728
00000100:00100000:0.0:1767320614.878325:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057728
00000100:00100000:0.0:1767320614.878347:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4949
00000100:00100000:0.0:1767320614.878354:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380057984:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320614.878397:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380057984:12345-0@lo:400:kworker.0 Request processed in 44us (179us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320614.878403:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4949
00000100:00100000:0.0:1767320614.878415:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950
00000100:00100000:0.0:1767320614.878420:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380057728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320614.878444:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380057728:12345-0@lo:400:kworker.0 Request processed in 24us (182us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320614.878450:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950
00000100:00080000:0.0:1767320614.878464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320614.878494:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380057728:0@lo:400:kworker.0
00000100:00100000:0.0:1767320614.878504:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380057984:0@lo:400:kworker.0
00000100:00100000:0.0:1767320614.878557:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935
00000100:00100000:0.0:1767320614.878564:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380057600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320614.878609:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380057600:12345-0@lo:400:kworker.0 Request processed in 46us (820us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320614.878618:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935
00000100:00100000:0.0:1767320614.878693:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380057600:0@lo:400:kworker.0
00000100:00100000:3.0:1767320614.879788:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057472
00000100:00100000:3.0:1767320614.879851:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936
00000100:00100000:3.0:1767320614.879860:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380057472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320614.879953:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380057472:12345-0@lo:400:kworker.0 Request processed in 95us (2108us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320614.880099:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936
00000100:00100000:3.0:1767320614.880159:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380057472:0@lo:400:kworker.0
00000100:00080000:0.0:1767320614.880550:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320614.881246:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057344
00000100:00100000:1.0:1767320614.881255:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057344
00000100:00100000:1.0:1767320614.881294:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215
00000100:00100000:1.0:1767320614.881300:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380057344:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320614.881322:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320614.881376:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380057344:12345-0@lo:38:kworker.0 Request processed in 76us (4017us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320614.881382:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215
00000100:00080000:2.0:1767320614.882183:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320614.882191:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320614.882196:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380057216:0@lo:38:kworker.0
00000100:00100000:2.0:1767320614.882225:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380057856:0@lo:38:kworker.0
00000100:00100000:2.0:1767320614.882447:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320614.882533:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380058112:0@lo:38:kworker.0
00000100:00100000:2.0:1767320614.882568:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320614.882907:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320614.882912:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320614.882916:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380057344:0@lo:38:kworker.0
00000100:00100000:0.0:1767320614.883914:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380057856
00000100:00100000:0.0:1767320614.883925:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380057856
00000100:00100000:0.0:1767320614.884375:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380058112
00000100:00100000:0.0:1767320614.884381:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380058112
00000100:00100000:0.0:1767320614.884417:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17903
00000100:00100000:0.0:1767320614.884425:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380057856:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320614.884447:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320614.884515:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380057856:12345-0@lo:38:kworker.0 Request processed in 90us (2068us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320614.884523:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17903
00000100:00100000:3.0:1767320614.884651:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17904
00000100:00100000:3.0:1767320614.884658:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380058112:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320614.884668:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320614.884703:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380058112:12345-0@lo:38:kworker.0 Request processed in 45us (2135us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320614.884711:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17904
00000100:00080000:2.0:1767320614.885687:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320614.885694:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320614.885699:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380057856:0@lo:38:kworker.0
00000100:00080000:2.0:1767320614.885709:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320614.885712:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320614.885715:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380058112:0@lo:38:kworker.0
00010000:00010000:3.0:1767320615.449140:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320615.826935:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:2.0:1767320615.826976:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291983744 offset 0 length 520: 4
00000100:00100000:2.0:1767320615.826993:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320615.827075:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984000
00000100:00100000:1.0:1767320615.827090:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984000
00000100:00100000:1.0:1767320615.827148:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291983872
00000100:00100000:1.0:1767320615.827150:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291983872
00000100:00100000:1.0:1767320615.827170:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4951
00000100:00100000:1.0:1767320615.827179:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291984000:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320615.827199:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17905
00000100:00100000:3.0:1767320615.827209:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291983872:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320615.827245:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320615.827258:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291984000:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (337us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320615.827267:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4951
00000100:00100000:3.0:1767320615.827290:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291983872:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 77us (292us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320615.827297:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17905
00000100:00080000:2.0:1767320615.827469:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320616.471268:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320616.923211:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380058240:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320616.923290:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320616.923842:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380058240
00000100:00100000:1.0:1767320616.923851:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380058240
00000100:00100000:1.0:1767320616.923942:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746
00000100:00100000:1.0:1767320616.923952:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380058240:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320616.923982:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320616.924043:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380058240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (751us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320616.924050:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746
00000100:00100000:0.0:1767320616.924082:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380058240:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320616.927315:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320617.495150:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320618.455481:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320618.455503:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380058368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320618.455573:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320618.455794:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380058368
00000100:00100000:1.0:1767320618.455804:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380058368
00000100:00100000:1.0:1767320618.455903:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747
00000100:00100000:1.0:1767320618.455914:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380058368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320618.455945:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320618.455995:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380058368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (421us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320618.456002:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747
00000100:00100000:0.0:1767320618.456097:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380058368:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320618.456511:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320618.521102:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320619.543083:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320619.991207:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320619.991217:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320619.991220:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320619.991224:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320619.991228:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320619.991237:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320619.991242:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320619.991248:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320619.991289:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608700 x1853164380058496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320619.991326:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320619.991329:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320619.991331:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320619.991335:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320619.991337:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320619.991342:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320619.991355:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b100 x1853164380058624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320619.991428:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320619.991431:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320619.991433:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320619.991437:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320619.991440:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320619.991443:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320619.991453:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164380059136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320619.991467:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320619.991470:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320619.991472:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320619.991475:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5517
00000100:00080000:3.0:1767320619.991477:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320619.991481:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320619.991503:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164380059392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320619.991530:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380059264:0@lo:400:kworker.0
00000100:00100000:3.0:1767320619.991594:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320619.991659:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320619.991665:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380059008:0@lo:400:kworker.0
00000100:00100000:3.0:1767320619.991685:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320619.991714:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380059264
00000100:00100000:3.0:1767320619.991720:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380059264
00000100:00100000:3.0:1767320619.991764:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380059008
00000100:00100000:3.0:1767320619.991767:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380059008
00000100:00100000:3.0:1767320619.991790:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4952
00000100:00100000:3.0:1767320619.991798:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380059264:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320619.991861:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380059264:12345-0@lo:400:kworker.0 Request processed in 63us (265us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320619.991891:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4952
00000100:00100000:3.0:1767320619.991910:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4953
00000100:00100000:3.0:1767320619.991918:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380059008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320619.991934:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320594/real 1767320594]  req@ffff8b0f380ae680 x1853164380051968/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320619 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320619.991958:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f380ae680 x1853164380051968/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320619 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320619.991979:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380058496:0@lo:38:kworker.0
00000100:00100000:0.0:1767320619.992008:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320619.992033:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380058624:0@lo:38:kworker.0
00000100:00100000:0.0:1767320619.992057:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320619.992078:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380059136:0@lo:38:kworker.0
00000100:00100000:0.0:1767320619.992100:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320619.992106:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380058752:0@lo:400:kworker.0
00000100:00100000:0.0:1767320619.992123:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380059392:0@lo:38:kworker.0
00000100:00100000:1.0:1767320619.992147:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320619.992155:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320619.992176:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:0.0:1767320619.992179:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320619.992185:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380058880:0@lo:400:kworker.0
00000100:00080000:0.0:1767320619.992193:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320619.992198:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f380ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380051968:0@lo:250:kworker.0
00000100:00100000:1.0:1767320619.992212:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320619.992234:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380058496
00000100:00100000:0.0:1767320619.992239:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380058496
00000100:00100000:1.0:1767320619.992245:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380059136
00000100:00100000:1.0:1767320619.992251:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380059136
00000100:00100000:0.0:1767320619.992258:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380059392
00000100:00100000:0.0:1767320619.992262:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380059392
00000100:00100000:1.0:1767320619.992274:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17906
00000100:00100000:0.0:1767320619.992284:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17907
00000100:00100000:1.0:1767320619.992285:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380058496:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320619.992293:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380059136:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320619.992313:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320619.992355:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320619.992359:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380059136:12345-0@lo:38:kworker.0 Request processed in 65us (257us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320619.992368:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17907
00000100:00100000:0.0:1767320619.992386:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17908
00000100:00100000:0.0:1767320619.992391:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380059392:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320619.992396:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380058752
00000100:00100000:2.0:1767320619.992401:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380058752
00000100:00100000:3.0:1767320619.992443:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380059008:12345-0@lo:400:kworker.0 Request processed in 526us (756us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320619.992450:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4953
00000100:00100000:3.0:1767320619.992470:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380058880
00000100:00100000:3.0:1767320619.992473:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380058880
00000100:00100000:3.0:1767320619.992501:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937
00000100:00100000:3.0:1767320619.992508:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380058880:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320619.992540:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380058880:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320619.992546:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937
00000100:00080000:3.0:1767320619.992562:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320619.992566:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320619.992568:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320619.992571:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5496
00000100:00080000:3.0:1767320619.992574:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320619.992578:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320619.992594:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609c00 x1853164380059520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320619.992625:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380058624
00000100:00100000:3.0:1767320619.992628:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380058624
00000100:00100000:3.0:1767320619.992646:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216
00000100:00100000:3.0:1767320619.992650:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380058624:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320619.992904:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938
00000100:00100000:2.0:1767320619.992913:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380058752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320619.992960:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380058752:12345-0@lo:400:kworker.0 Request processed in 49us (813us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320619.992966:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938
00000100:00080000:2.0:1767320619.992985:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320619.993011:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380059008:0@lo:400:kworker.0
00000100:00100000:2.0:1767320619.993024:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380059264:0@lo:400:kworker.0
00000100:00100000:2.0:1767320619.993050:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380059520:0@lo:250:kworker.0
00000400:00000100:2.0:1767320619.993069:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380059520 offset 0 length 520: 4
00000100:00080000:2.0:1767320619.993092:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320619.993097:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320619.993100:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380059136:0@lo:38:kworker.0
00000100:00100000:2.0:1767320619.993159:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380058880:0@lo:400:kworker.0
00000100:00100000:2.0:1767320619.993169:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380058752:0@lo:400:kworker.0
00010000:00020000:1.0:1767320619.996601:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320619.996708:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380058496:12345-0@lo:38:kworker.0 Request processed in 4423us (4696us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320619.996721:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17906
00000100:00080000:2.0:1767320619.996857:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320619.996865:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320619.996890:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380058496:0@lo:38:kworker.0
00010000:00020000:0.0:1767320620.015960:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320620.016176:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380059392:12345-0@lo:38:kworker.0 Request processed in 23779us (24018us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320620.016192:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17908
00010000:00020000:3.0:1767320620.016970:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320620.017388:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320620.017394:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320620.017400:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380058624:0@lo:38:kworker.0
00000100:00080000:0.0:1767320620.017413:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320620.017417:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320620.017419:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380059392:0@lo:38:kworker.0
00000100:00100000:3.0:1767320620.018132:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380058624:12345-0@lo:38:kworker.0 Request processed in 25475us (26069us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320620.018143:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216
00010000:00010000:2.0:1767320620.567068:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320620.944245:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320620.944345:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984256
00000100:00100000:0.0:1767320620.944356:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984256
00000100:00100000:0.0:1767320620.944552:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4954
00000100:00100000:0.0:1767320620.944563:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291984256:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320620.944641:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291984256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (405us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320620.944648:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4954
00000100:00080000:2.0:1767320620.945256:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320620.952388:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320620.952987:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984128
00000100:00100000:2.0:1767320620.953000:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984128
00000100:00100000:2.0:1767320620.953052:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17909
00000100:00100000:2.0:1767320620.953060:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291984128:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320620.953083:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320620.953153:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291984128:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 92us (775us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320620.953162:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17909
00010000:00010000:2.0:1767320621.595180:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320622.039167:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380059648:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320622.039237:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320622.039399:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380059648
00000100:00100000:0.0:1767320622.039409:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380059648
00000100:00100000:0.0:1767320622.039470:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748
00000100:00100000:0.0:1767320622.039480:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380059648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320622.039507:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320622.039554:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380059648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (317us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320622.039562:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748
00000100:00080000:2.0:1767320622.039620:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320622.039835:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380059648:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320622.615439:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320623.577207:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320623.577230:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380059776:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320623.577301:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320623.577424:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380059776
00000100:00100000:1.0:1767320623.577433:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380059776
00000100:00100000:1.0:1767320623.577505:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749
00000100:00100000:1.0:1767320623.577515:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380059776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320623.577543:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320623.577602:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380059776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (300us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320623.577609:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749
00000100:00100000:1.0:1767320623.577661:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380059776:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320623.578410:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320623.639498:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320624.663402:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320625.112533:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320625.112543:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320625.112547:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320625.112551:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320625.112555:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320625.112564:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5522
00000100:00080000:2.0:1767320625.112568:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320625.112575:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320625.112618:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fc380 x1853164380059904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320625.112652:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320625.112656:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320625.112658:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320625.112662:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5522
00000100:00080000:2.0:1767320625.112665:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320625.112668:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320625.112687:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85c000 x1853164380060032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320625.112758:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320625.112762:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320625.112763:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320625.112767:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5522
00000100:00080000:2.0:1767320625.112770:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320625.112773:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320625.112800:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85d880 x1853164380060544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320625.112825:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320625.112833:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320625.112836:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767320625.112836:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380060288:0@lo:400:kworker.0
00000100:00080000:2.0:1767320625.112847:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5522
00000100:00080000:2.0:1767320625.112853:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320625.112858:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320625.112907:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85f800 x1853164380060800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320625.112995:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320625.113103:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320625.113112:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380060160:0@lo:400:kworker.0
00000100:00100000:3.0:1767320625.113138:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320625.113184:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060288
00000100:00100000:3.0:1767320625.113194:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060288
00000100:00100000:1.0:1767320625.113816:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380060416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320625.113835:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060160
00000100:00100000:2.0:1767320625.113843:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060160
00000100:00100000:1.0:1767320625.113934:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320625.113979:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320625.113986:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380060672:0@lo:400:kworker.0
00000100:00100000:1.0:1767320625.114007:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320625.114054:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060416
00000100:00100000:1.0:1767320625.114061:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060416
00000100:00100000:1.0:1767320625.114111:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060672
00000100:00100000:1.0:1767320625.114114:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060672
00000100:00100000:1.0:1767320625.114139:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4955
00000100:00100000:1.0:1767320625.114148:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380060416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320625.114197:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380060416:12345-0@lo:400:kworker.0 Request processed in 50us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320625.114205:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4955
00000100:00100000:1.0:1767320625.114225:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956
00000100:00100000:1.0:1767320625.114230:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380060672:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320625.114254:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380060672:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320625.114259:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956
00000100:00100000:1.0:1767320625.114308:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380060672:0@lo:400:kworker.0
00000100:00100000:1.0:1767320625.114318:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380060416:0@lo:400:kworker.0
00000100:00080000:1.0:1767320625.114366:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320625.114370:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320625.117099:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380059904:0@lo:38:kworker.0
00000100:00100000:0.0:1767320625.117203:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320625.117241:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380060032:0@lo:38:kworker.0
00000100:00100000:0.0:1767320625.117301:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320625.117338:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380060544:0@lo:38:kworker.0
00000100:00100000:0.0:1767320625.117364:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320625.117382:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380060800:0@lo:38:kworker.0
00000100:00100000:0.0:1767320625.117402:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320625.117442:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060032
00000100:00100000:0.0:1767320625.117453:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060032
00000100:00100000:0.0:1767320625.117487:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217
00000100:00100000:0.0:1767320625.117496:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380060032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320625.117533:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320625.117586:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380060032:12345-0@lo:38:kworker.0 Request processed in 88us (283us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320625.117593:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217
00000100:00100000:0.0:1767320625.117624:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380059904
00000100:00100000:0.0:1767320625.117628:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380059904
00000100:00100000:0.0:1767320625.117647:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060544
00000100:00100000:0.0:1767320625.117649:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060544
00000100:00100000:0.0:1767320625.117664:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060800
00000100:00100000:0.0:1767320625.117666:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060800
00000100:00080000:1.0:1767320625.117906:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320625.118965:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17910
00000100:00100000:0.0:1767320625.118986:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380059904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320625.119013:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320625.119103:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380059904:12345-0@lo:38:kworker.0 Request processed in 120us (1898us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320625.123210:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939
00000100:00100000:2.0:1767320625.123256:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380060288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320625.123412:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380060288:12345-0@lo:400:kworker.0 Request processed in 183us (10417us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320625.123421:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939
00000100:00100000:2.0:1767320625.123446:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940
00000100:00100000:2.0:1767320625.123455:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380060160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320625.123489:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380060160:12345-0@lo:400:kworker.0 Request processed in 36us (10349us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320625.123507:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940
00000100:00100000:3.0:1767320625.127236:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380060160:0@lo:400:kworker.0
00000100:00100000:3.0:1767320625.127535:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380060288:0@lo:400:kworker.0
00000100:00100000:1.0:1767320625.129501:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17911
00000100:00100000:1.0:1767320625.129517:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380060544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320625.129545:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320625.129636:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380060544:12345-0@lo:38:kworker.0 Request processed in 121us (12270us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320625.129644:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17911
00000100:00100000:1.0:1767320625.129678:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17912
00000100:00100000:1.0:1767320625.129683:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380060800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320625.129692:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320625.129718:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380060800:12345-0@lo:38:kworker.0 Request processed in 33us (12315us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320625.129723:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17912
00000100:00100000:0.0:1767320625.132637:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17910
00000100:00080000:2.0:1767320625.145487:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320625.145517:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320625.145531:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380059904:0@lo:38:kworker.0
00000100:00080000:2.0:1767320625.145551:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320625.145555:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320625.145558:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380060032:0@lo:38:kworker.0
00000100:00080000:2.0:1767320625.145570:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320625.145573:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320625.145576:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380060544:0@lo:38:kworker.0
00000100:00080000:2.0:1767320625.145587:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320625.145591:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320625.145593:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380060800:0@lo:38:kworker.0
00010000:00010000:1.0:1767320625.688492:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320626.070626:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320626.070673:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320626.075488:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984384
00000100:00100000:2.0:1767320626.075502:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984384
00000100:00100000:2.0:1767320626.075602:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984512
00000100:00100000:2.0:1767320626.075606:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984512
00000100:00100000:2.0:1767320626.075720:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4957
00000100:00100000:2.0:1767320626.075732:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291984512:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320626.075884:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291984512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 137us (5193us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320626.075893:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4957
00000100:00100000:2.0:1767320626.075915:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17913
00000100:00100000:2.0:1767320626.075920:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291984384:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320626.075942:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320626.077141:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291984384:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 1215us (6519us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320626.077151:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17913
00000100:00080000:0.0:1767320626.083661:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320626.711327:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320627.162229:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380060928:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320627.162322:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320627.162585:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380060928
00000100:00100000:1.0:1767320627.162594:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380060928
00000100:00100000:1.0:1767320627.162665:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750
00000100:00100000:1.0:1767320627.162677:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380060928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320627.162713:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320627.162775:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380060928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (453us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320627.162782:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750
00000100:00100000:1.0:1767320627.162857:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380060928:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320627.163200:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320627.737028:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320628.697621:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320628.697642:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380061056:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320628.697720:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320628.698096:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061056
00000100:00100000:3.0:1767320628.698106:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061056
00000100:00100000:3.0:1767320628.698163:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751
00000100:00100000:3.0:1767320628.698173:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380061056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320628.698202:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320628.698257:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380061056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (536us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320628.698264:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751
00000100:00100000:3.0:1767320628.698319:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380061056:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320628.698455:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320628.759063:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320629.783566:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320630.231202:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320630.231211:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320630.231214:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320630.231218:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320630.231222:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320630.231229:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5527
00000100:00080000:1.0:1767320630.231234:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320630.231240:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320630.231279:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9e680 x1853164380061184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320630.231305:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320630.231308:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320630.231310:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320630.231315:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5527
00000100:00080000:1.0:1767320630.231317:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320630.231320:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320630.231331:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9f480 x1853164380061312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320630.231398:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320630.231401:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320630.231402:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320630.231405:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5527
00000100:00080000:1.0:1767320630.231407:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320630.231410:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320630.231419:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9ea00 x1853164380061824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320630.231434:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320630.231436:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320630.231438:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320630.231441:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5527
00000100:00080000:1.0:1767320630.231443:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320630.231446:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320630.231456:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063aaa00 x1853164380062080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320630.231483:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380061696:0@lo:400:kworker.0
00000100:00100000:1.0:1767320630.231545:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320630.231611:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320630.231617:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380061952:0@lo:400:kworker.0
00000100:00100000:1.0:1767320630.231638:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320630.231672:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061696
00000100:00100000:1.0:1767320630.231678:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061696
00000100:00100000:1.0:1767320630.231726:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061952
00000100:00100000:1.0:1767320630.231729:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061952
00000100:00100000:1.0:1767320630.231783:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958
00000100:00100000:1.0:1767320630.231791:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380061696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320630.231840:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380061696:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320630.231847:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958
00000100:00100000:1.0:1767320630.231866:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959
00000100:00100000:1.0:1767320630.231902:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380061952:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320630.231929:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380061952:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320630.231934:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959
00000100:00100000:1.0:1767320630.231973:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380061952:0@lo:400:kworker.0
00000100:00100000:1.0:1767320630.231983:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380061696:0@lo:400:kworker.0
00000100:00100000:3.0:1767320630.232236:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380061440:0@lo:400:kworker.0
00000100:00100000:3.0:1767320630.232270:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320630.232313:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320630.232319:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380061568:0@lo:400:kworker.0
00000100:00100000:3.0:1767320630.232340:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320630.232366:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061440
00000100:00100000:3.0:1767320630.232370:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061440
00000100:00100000:3.0:1767320630.232396:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061568
00000100:00100000:3.0:1767320630.232399:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061568
00000100:00100000:3.0:1767320630.232417:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941
00000100:00100000:3.0:1767320630.232424:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380061440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320630.232460:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380061440:12345-0@lo:400:kworker.0 Request processed in 37us (189us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320630.232466:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941
00000100:00100000:3.0:1767320630.232478:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942
00000100:00100000:3.0:1767320630.232484:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380061568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320630.232524:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380061568:12345-0@lo:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320630.232531:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942
00000100:00100000:3.0:1767320630.232557:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380061568:0@lo:400:kworker.0
00000100:00100000:3.0:1767320630.232566:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380061440:0@lo:400:kworker.0
00000100:00100000:2.0:1767320630.233637:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380061184:0@lo:38:kworker.0
00000100:00100000:2.0:1767320630.233684:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320630.233720:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380061312:0@lo:38:kworker.0
00000100:00100000:3.0:1767320630.234298:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061184
00000100:00100000:3.0:1767320630.234306:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061184
00000100:00100000:3.0:1767320630.234345:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17914
00000100:00100000:3.0:1767320630.234351:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380061184:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320630.234372:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320630.235231:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320630.235238:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320630.235241:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320630.246294:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380061184:12345-0@lo:38:kworker.0 Request processed in 11933us (12599us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320630.246310:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17914
00000100:00100000:2.0:1767320630.246417:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320630.246477:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380061824:0@lo:38:kworker.0
00000100:00100000:2.0:1767320630.246518:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320630.246541:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380062080:0@lo:38:kworker.0
00000100:00100000:2.0:1767320630.246569:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320630.246623:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320630.246628:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320630.246632:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380061184:0@lo:38:kworker.0
00000100:00100000:0.0:1767320630.246726:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061312
00000100:00100000:0.0:1767320630.246742:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061312
00000100:00100000:0.0:1767320630.246778:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218
00000100:00100000:0.0:1767320630.246786:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380061312:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320630.246806:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320630.246848:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380061312:12345-0@lo:38:kworker.0 Request processed in 63us (433us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320630.246854:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218
00000100:00100000:1.0:1767320630.246943:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380061824
00000100:00100000:1.0:1767320630.246949:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380061824
00000100:00100000:1.0:1767320630.246978:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062080
00000100:00100000:1.0:1767320630.246981:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062080
00000100:00100000:1.0:1767320630.247009:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17915
00000100:00100000:1.0:1767320630.247014:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380061824:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320630.247025:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320630.247068:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380061824:12345-0@lo:38:kworker.0 Request processed in 52us (548us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320630.247074:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17915
00000100:00100000:1.0:1767320630.247092:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17916
00000100:00100000:1.0:1767320630.247096:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380062080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320630.247105:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320630.247126:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380062080:12345-0@lo:38:kworker.0 Request processed in 29us (557us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320630.247131:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17916
00000100:00080000:2.0:1767320630.247404:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320630.247409:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320630.247412:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380061312:0@lo:38:kworker.0
00000100:00080000:2.0:1767320630.247420:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320630.247423:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320630.247426:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380061824:0@lo:38:kworker.0
00000100:00080000:2.0:1767320630.247431:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320630.247434:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320630.247436:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380062080:0@lo:38:kworker.0
00010000:00010000:1.0:1767320630.807585:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320631.188193:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320631.188240:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320631.188341:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984640
00000100:00100000:0.0:1767320631.188352:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984640
00000100:00100000:0.0:1767320631.188398:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984768
00000100:00100000:0.0:1767320631.188400:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984768
00000100:00100000:0.0:1767320631.188453:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4960
00000100:00100000:0.0:1767320631.188463:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291984768:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320631.188543:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291984768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320631.188552:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4960
00000100:00100000:0.0:1767320631.188570:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17917
00000100:00100000:0.0:1767320631.188574:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291984640:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320631.188595:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320631.188620:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291984640:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (437us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320631.188625:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17917
00000100:00080000:2.0:1767320631.189083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320631.833175:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320632.279811:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380062208:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320632.280146:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320632.280549:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062208
00000100:00100000:1.0:1767320632.280559:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062208
00000100:00100000:1.0:1767320632.280725:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752
00000100:00100000:1.0:1767320632.280736:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380062208:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320632.280772:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320632.280837:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380062208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (692us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320632.280844:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752
00000100:00100000:0.0:1767320632.281473:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380062208:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320632.281601:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320632.855242:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320633.816168:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380062336:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320633.816240:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320633.816473:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062336
00000100:00100000:3.0:1767320633.816483:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062336
00000100:00100000:3.0:1767320633.816553:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753
00000100:00100000:3.0:1767320633.816563:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380062336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320633.816594:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767320633.816671:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320633.831725:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380062336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15151us (15472us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320633.831741:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753
00000100:00100000:0.0:1767320633.834038:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380062336:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320633.881074:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320634.903202:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320635.352750:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320635.352760:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320635.352763:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320635.352767:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320635.352772:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320635.352780:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5532
00000100:00080000:3.0:1767320635.352784:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320635.352792:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320635.352832:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164380062464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320635.352864:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320635.352887:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320635.352890:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320635.352897:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5532
00000100:00080000:3.0:1767320635.352900:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320635.352904:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320635.352921:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b800 x1853164380062592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320635.353014:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320635.353071:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380062464:0@lo:38:kworker.0
00000100:00100000:1.0:1767320635.353145:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320635.353218:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380062592:0@lo:38:kworker.0
00000100:00100000:1.0:1767320635.353243:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320635.353292:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062592
00000100:00100000:1.0:1767320635.353300:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062592
00000100:00100000:1.0:1767320635.353346:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219
00000100:00100000:1.0:1767320635.353352:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380062592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320635.353371:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320635.353412:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380062592:12345-0@lo:38:kworker.0 Request processed in 59us (168us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320635.353419:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219
00000100:00080000:1.0:1767320635.353465:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320635.353469:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320635.353473:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380062592:0@lo:38:kworker.0
00000100:00100000:2.0:1767320635.353729:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062464
00000100:00100000:2.0:1767320635.353734:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062464
00000100:00100000:2.0:1767320635.353766:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17918
00000100:00100000:2.0:1767320635.353771:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380062464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320635.353781:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320635.353817:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380062464:12345-0@lo:38:kworker.0 Request processed in 45us (672us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320635.353823:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17918
00000100:00080000:2.0:1767320635.353849:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320635.353852:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320635.353855:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380062464:0@lo:38:kworker.0
00000100:00100000:0.0:1767320635.354829:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380062848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320635.354889:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320635.354912:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380062720:0@lo:400:kworker.0
00000100:00100000:0.0:1767320635.354932:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320635.355139:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062848
00000100:00100000:1.0:1767320635.355146:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062848
00000100:00100000:1.0:1767320635.355207:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062720
00000100:00100000:1.0:1767320635.355210:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062720
00000100:00100000:1.0:1767320635.355235:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943
00000100:00100000:1.0:1767320635.355242:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380062848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320635.355316:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944
00000100:00100000:2.0:1767320635.355325:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380062720:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767320635.355436:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320635.355441:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320635.356867:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320635.356883:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1767320635.356884:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380062976:0@lo:400:kworker.0
00000100:00080000:3.0:1767320635.356887:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320635.356891:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5532
00000100:00080000:3.0:1767320635.356894:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320635.356900:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320635.356925:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1aa00 x1853164380063104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320635.356948:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320635.356951:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320635.356953:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320635.356957:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5532
00000100:00080000:3.0:1767320635.356959:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320635.356963:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320635.357195:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b480 x1853164380063360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320635.357237:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380063104:0@lo:38:kworker.0
00000100:00100000:1.0:1767320635.357337:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380062848:12345-0@lo:400:kworker.0 Request processed in 2093us (2446us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320635.357346:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943
00000100:00100000:1.0:1767320635.357383:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380063232:0@lo:400:kworker.0
00000100:00100000:1.0:1767320635.357408:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320635.357447:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380063232
00000100:00100000:1.0:1767320635.357452:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380063232
00000100:00100000:1.0:1767320635.357496:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4961
00000100:00100000:1.0:1767320635.357504:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380063232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320635.357560:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380063232:12345-0@lo:400:kworker.0 Request processed in 57us (151us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320635.357566:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4961
00000100:00080000:1.0:1767320635.357583:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320635.359764:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380063232:0@lo:400:kworker.0
00000100:00100000:1.0:1767320635.360184:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380062848:0@lo:400:kworker.0
00000100:00100000:2.0:1767320635.360426:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380062720:12345-0@lo:400:kworker.0 Request processed in 5100us (5489us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320635.360437:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944
00000100:00100000:1.0:1767320635.362046:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380062720:0@lo:400:kworker.0
00000100:00100000:3.0:1767320635.363542:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320635.363715:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380063104
00000100:00100000:1.0:1767320635.363724:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380063104
00000100:00100000:1.0:1767320635.363771:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17919
00000100:00100000:1.0:1767320635.363779:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380063104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320635.363809:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320635.363856:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380063104:12345-0@lo:38:kworker.0 Request processed in 78us (319us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320635.363863:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17919
00000100:00100000:3.0:1767320635.364047:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380063360:0@lo:38:kworker.0
00000100:00100000:3.0:1767320635.364082:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320635.364149:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320635.364154:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320635.364158:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380063104:0@lo:38:kworker.0
00000100:00100000:2.0:1767320635.367155:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380063360
00000100:00100000:2.0:1767320635.367172:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380063360
00000100:00100000:2.0:1767320635.367219:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17920
00000100:00100000:2.0:1767320635.367227:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380063360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320635.367250:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320635.367297:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320635.367382:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380062976
00000100:00100000:1.0:1767320635.367388:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380062976
00000100:00100000:1.0:1767320635.367446:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4962
00000100:00100000:1.0:1767320635.367453:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380062976:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767320635.367558:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320635.367564:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320635.367567:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380063360:0@lo:38:kworker.0
00000100:00080000:3.0:1767320635.367708:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320635.369783:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380063360:12345-0@lo:38:kworker.0 Request processed in 2547us (5691us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320635.369806:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17920
00000100:00100000:1.0:1767320635.372818:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380062976:12345-0@lo:400:kworker.0 Request processed in 5354us (5510us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320635.372837:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4962
00000100:00100000:0.0:1767320635.373050:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380062976:0@lo:400:kworker.0
00010000:00010000:1.0:1767320635.927172:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320636.306032:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320636.306149:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320636.306257:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291985024
00000100:00100000:3.0:1767320636.306269:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291985024
00000100:00100000:3.0:1767320636.306348:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291984896
00000100:00100000:3.0:1767320636.306352:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291984896
00000100:00100000:3.0:1767320636.306376:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4963
00000100:00100000:3.0:1767320636.306387:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291985024:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320636.306470:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291985024:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 85us (449us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320636.306479:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4963
00000100:00100000:3.0:1767320636.306501:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17921
00000100:00100000:3.0:1767320636.306505:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291984896:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320636.306525:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320636.306551:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291984896:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (402us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320636.306559:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17921
00000100:00080000:2.0:1767320636.307181:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320636.951186:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320637.400351:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380063488:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320637.400442:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320637.400935:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380063488
00000100:00100000:3.0:1767320637.400944:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380063488
00000100:00100000:3.0:1767320637.401018:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754
00000100:00100000:3.0:1767320637.401029:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380063488:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320637.401059:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320637.401110:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380063488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (668us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320637.401118:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754
00000100:00080000:0.0:1767320637.402161:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320637.402220:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380063488:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320637.975377:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320638.937896:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380063616:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320638.937968:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320638.938098:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380063616
00000100:00100000:3.0:1767320638.938106:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380063616
00000100:00100000:3.0:1767320638.938171:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755
00000100:00100000:3.0:1767320638.938182:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380063616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320638.938213:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320638.938292:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320638.949290:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380063616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 11100us (11311us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320638.949305:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755
00000100:00100000:2.0:1767320638.950111:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380063616:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320638.999619:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320640.023315:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320640.406051:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767320640.406082:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291985152 offset 0 length 520: 4
00000100:00100000:1.0:1767320640.406101:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320640.406175:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291985408
00000100:00100000:2.0:1767320640.406186:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291985408
00000100:00100000:2.0:1767320640.406272:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291985280
00000100:00100000:2.0:1767320640.406276:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291985280
00000100:00100000:3.0:1767320640.406278:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4964
00000100:00100000:3.0:1767320640.406289:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291985408:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320640.406297:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17922
00000100:00100000:2.0:1767320640.406302:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291985280:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320640.406322:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320640.406372:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291985408:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (330us total) trans 0 rc 0/0
00000100:00080000:1.0:1767320640.406378:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320640.406380:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4964
00000100:00100000:2.0:1767320640.407247:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291985280:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 938us (1139us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320640.407256:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17922
00000100:00080000:1.0:1767320640.471102:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320640.471113:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320640.471117:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320640.471120:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320640.471124:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320640.471143:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5537
00000100:00080000:1.0:1767320640.471149:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320640.471157:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320640.471198:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9880 x1853164380063744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320640.471226:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320640.471230:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320640.471232:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320640.471236:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5537
00000100:00080000:1.0:1767320640.471238:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320640.471242:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320640.471255:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab800 x1853164380063872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320640.471332:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320640.471335:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320640.471337:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320640.471341:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5537
00000100:00080000:1.0:1767320640.471343:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320640.471347:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320640.471371:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164380064384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320640.471387:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320640.471391:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320640.471393:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320640.471396:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5537
00000100:00080000:1.0:1767320640.471398:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320640.471402:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320640.471413:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b800 x1853164380064640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320640.471504:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380063744:0@lo:38:kworker.0
00000100:00100000:3.0:1767320640.471572:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320640.471652:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380063872:0@lo:38:kworker.0
00000100:00100000:3.0:1767320640.471679:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320640.471706:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380064384:0@lo:38:kworker.0
00000100:00100000:3.0:1767320640.471729:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320640.471746:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380064640:0@lo:38:kworker.0
00000100:00100000:3.0:1767320640.471765:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320640.471806:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380063872
00000100:00100000:3.0:1767320640.471814:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380063872
00000100:00100000:3.0:1767320640.471850:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220
00000100:00100000:3.0:1767320640.471858:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380063872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320640.471904:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320640.472016:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380063872:12345-0@lo:38:kworker.0 Request processed in 156us (334us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320640.472023:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220
00000100:00100000:3.0:1767320640.472047:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380063744
00000100:00100000:3.0:1767320640.472051:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380063744
00000100:00100000:3.0:1767320640.472068:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064384
00000100:00100000:3.0:1767320640.472070:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064384
00000100:00100000:3.0:1767320640.472085:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064640
00000100:00100000:3.0:1767320640.472088:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064640
00000100:00100000:3.0:1767320640.472106:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17923
00000100:00100000:3.0:1767320640.472110:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380063744:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320640.472121:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320640.472147:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380063744:12345-0@lo:38:kworker.0 Request processed in 35us (574us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320640.472153:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17923
00000100:00100000:3.0:1767320640.472164:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17924
00000100:00100000:3.0:1767320640.472168:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380064384:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320640.472177:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320640.472200:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380064384:12345-0@lo:38:kworker.0 Request processed in 30us (470us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320640.472206:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17924
00000100:00100000:3.0:1767320640.472217:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17925
00000100:00100000:3.0:1767320640.472221:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380064640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320640.472230:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320640.472252:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380064640:12345-0@lo:38:kworker.0 Request processed in 29us (485us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320640.472257:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17925
00000100:00080000:3.0:1767320640.472306:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320640.472310:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320640.472314:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380063744:0@lo:38:kworker.0
00000100:00080000:3.0:1767320640.472324:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320640.472327:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320640.472330:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380063872:0@lo:38:kworker.0
00000100:00080000:3.0:1767320640.472337:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320640.472340:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320640.472342:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380064384:0@lo:38:kworker.0
00000100:00080000:3.0:1767320640.472350:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320640.472353:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320640.472355:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380064640:0@lo:38:kworker.0
00000100:00100000:2.0:1767320640.472447:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064128:0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.472479:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320640.472513:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320640.472520:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064000:0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.472541:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320640.472569:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380064512:0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.472592:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320640.472611:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320640.472617:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380064256:0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.472636:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320640.472674:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064128
00000100:00100000:2.0:1767320640.472678:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064128
00000100:00100000:2.0:1767320640.472719:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064000
00000100:00100000:2.0:1767320640.472722:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064000
00000100:00100000:2.0:1767320640.472741:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945
00000100:00100000:2.0:1767320640.472747:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064128:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.472788:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064128:12345-0@lo:400:kworker.0 Request processed in 40us (307us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320640.472794:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945
00000100:00100000:2.0:1767320640.472808:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946
00000100:00100000:2.0:1767320640.472814:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.472841:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064000:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320640.472847:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946
00000100:00080000:2.0:1767320640.472864:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320640.472897:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320640.472911:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064512
00000100:00100000:2.0:1767320640.472915:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064512
00000100:00100000:2.0:1767320640.472942:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4965
00000100:00100000:2.0:1767320640.472948:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380064512:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.472980:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380064512:12345-0@lo:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320640.472986:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4965
00000100:00100000:2.0:1767320640.472995:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064256
00000100:00100000:2.0:1767320640.472998:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064256
00000100:00100000:2.0:1767320640.473019:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4966
00000100:00100000:2.0:1767320640.473025:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380064256:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.473051:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380064256:12345-0@lo:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320640.473059:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4966
00000100:00080000:2.0:1767320640.473076:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320640.473095:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380064256:0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.473105:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380064512:0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.473127:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064000:0@lo:400:kworker.0
00000100:00100000:2.0:1767320640.473136:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064128:0@lo:400:kworker.0
00010000:00010000:2.0:1767320641.049433:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320642.073382:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320642.522731:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320642.522753:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064768:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320642.522827:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320642.522911:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064768
00000100:00100000:3.0:1767320642.522919:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064768
00000100:00100000:3.0:1767320642.523144:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756
00000100:00100000:3.0:1767320642.523155:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064768:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320642.523183:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320642.523253:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (425us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320642.523260:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756
00000100:00100000:1.0:1767320642.523413:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064768:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320642.523718:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767320643.095215:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320644.057911:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064896:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320644.057992:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320644.058166:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380064896
00000100:00100000:3.0:1767320644.058174:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380064896
00000100:00100000:3.0:1767320644.058245:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757
00000100:00100000:3.0:1767320644.058256:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064896:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320644.058285:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320644.058339:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380064896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (346us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320644.058347:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757
00000100:00080000:2.0:1767320644.060732:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320644.060809:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380064896:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320644.119120:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320644.567023:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320619/real 1767320619]  req@ffff8b0e03609c00 x1853164380059520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320644 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320644.567062:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e03609c00 x1853164380059520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320644 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320644.567088:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320644.567129:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320644.567134:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380059520:0@lo:250:kworker.0
00000100:00080000:1.0:1767320644.567591:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320644.567617:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320644.567621:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320644.567626:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5522
00000100:00080000:1.0:1767320644.567630:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320644.567638:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320644.567676:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b800 x1853164380065024/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320644.567701:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320644.567705:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320644.567707:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320644.567710:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5542
00000100:00080000:1.0:1767320644.567713:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320644.567716:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320644.567731:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164380065152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320644.567740:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320644.567742:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320644.567744:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320644.567748:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5542
00000100:00080000:1.0:1767320644.567750:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320644.567753:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320644.567762:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609c00 x1853164380065280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320644.567840:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320644.567887:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320644.567925:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380065024:0@lo:250:kworker.0
00000400:00000100:0.0:1767320644.567985:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380065024 offset 0 length 520: 4
00000100:00100000:0.0:1767320644.568024:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380065152:0@lo:38:kworker.0
00000100:00100000:0.0:1767320644.568057:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320644.568078:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380065280:0@lo:38:kworker.0
00000100:00100000:0.0:1767320644.568102:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320644.568153:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380065152
00000100:00100000:0.0:1767320644.568161:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380065152
00000100:00100000:0.0:1767320644.568199:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17926
00000100:00100000:0.0:1767320644.568206:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380065152:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320644.568227:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320644.568281:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380065152:12345-0@lo:38:kworker.0 Request processed in 73us (223us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320644.568288:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17926
00000100:00080000:0.0:1767320644.568328:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320644.568332:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320644.568336:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380065152:0@lo:38:kworker.0
00000100:00100000:0.0:1767320644.568374:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380065280
00000100:00100000:0.0:1767320644.568378:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380065280
00000100:00100000:2.0:1767320644.568776:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380065536:0@lo:400:kworker.0
00000100:00100000:2.0:1767320644.568809:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320644.568842:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380065536
00000100:00100000:3.0:1767320644.568842:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380065408:0@lo:400:kworker.0
00000100:00100000:2.0:1767320644.568846:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380065536
00000100:00100000:3.0:1767320644.568890:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320644.568907:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4967
00000100:00100000:2.0:1767320644.568914:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380065536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320644.568962:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221
00000100:00100000:0.0:1767320644.568968:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380065280:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320644.568981:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320644.569014:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380065280:12345-0@lo:38:kworker.0 Request processed in 45us (911us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767320644.569027:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320644.569031:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320644.569034:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320644.569039:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5542
00000100:00080000:1.0:1767320644.569042:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320644.569046:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320644.569052:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380065536:12345-0@lo:400:kworker.0 Request processed in 140us (242us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320644.569059:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4967
00000100:00100000:1.0:1767320644.569068:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9f480 x1853164380065664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320644.569078:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320644.569100:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380065408
00000100:00100000:2.0:1767320644.569104:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380065408
00000100:00100000:2.0:1767320644.569151:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947
00000100:00100000:2.0:1767320644.569158:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380065408:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320644.569189:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380065408:12345-0@lo:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320644.569195:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947
00000100:00080000:2.0:1767320644.569213:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320644.569257:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380065408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320644.569319:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380065792:0@lo:400:kworker.0
00000100:00100000:3.0:1767320644.569347:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320644.569415:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320644.569419:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320644.569421:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320644.569425:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5542
00000100:00080000:1.0:1767320644.569428:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320644.569432:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320644.569446:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9ca80 x1853164380065920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320644.569483:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380065536:0@lo:400:kworker.0
00000100:00100000:0.0:1767320644.569496:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221
00000100:00100000:1.0:1767320644.569738:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380065664:0@lo:38:kworker.0
00000100:00100000:1.0:1767320644.569765:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320644.570307:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380065920:0@lo:38:kworker.0
00000100:00100000:1.0:1767320644.570334:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320644.570433:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380065792
00000100:00100000:2.0:1767320644.570440:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380065792
00000100:00100000:2.0:1767320644.570483:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380065664
00000100:00100000:2.0:1767320644.570487:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380065664
00000100:00100000:2.0:1767320644.570504:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968
00000100:00100000:2.0:1767320644.570685:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380065792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320644.570741:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380065792:12345-0@lo:400:kworker.0 Request processed in 61us (1392us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320644.570748:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968
00000100:00100000:2.0:1767320644.570765:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17927
00000100:00100000:2.0:1767320644.570769:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380065664:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320644.570786:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320644.570814:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380065664:12345-0@lo:38:kworker.0 Request processed in 43us (1048us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320644.570820:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17927
00000100:00080000:2.0:1767320644.570849:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320644.570915:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380065792:0@lo:400:kworker.0
00000100:00080000:1.0:1767320644.571204:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320644.571210:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320644.571213:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380065280:0@lo:38:kworker.0
00000100:00080000:1.0:1767320644.571232:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320644.571236:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320644.571239:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380065664:0@lo:38:kworker.0
00000100:00100000:3.0:1767320644.571294:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380065920
00000100:00100000:3.0:1767320644.571300:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380065920
00000100:00100000:3.0:1767320644.571338:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17928
00000100:00100000:3.0:1767320644.571343:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380065920:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320644.571357:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320644.571394:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380065920:12345-0@lo:38:kworker.0 Request processed in 49us (1058us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320644.571400:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17928
00000100:00080000:1.0:1767320644.571469:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320644.571473:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320644.571477:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380065920:0@lo:38:kworker.0
00010000:00010000:2.0:1767320645.144896:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320645.531496:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320645.531539:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320645.531768:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291985664
00000100:00100000:3.0:1767320645.531779:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291985664
00000100:00100000:3.0:1767320645.531856:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291985536
00000100:00100000:3.0:1767320645.531859:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291985536
00000100:00100000:3.0:1767320645.531910:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4969
00000100:00100000:3.0:1767320645.531923:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291985664:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320645.531995:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291985664:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 75us (507us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320645.532002:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4969
00000100:00100000:3.0:1767320645.532021:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17929
00000100:00100000:3.0:1767320645.532025:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291985536:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320645.532045:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320645.532084:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291985536:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 56us (543us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320645.532090:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17929
00000100:00080000:0.0:1767320645.532901:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320646.167368:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320647.191495:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320647.639469:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320647.639495:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380066048:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320647.639607:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320647.640336:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066048
00000100:00100000:1.0:1767320647.640347:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066048
00000100:00100000:1.0:1767320647.640424:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758
00000100:00100000:1.0:1767320647.640433:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380066048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320647.640476:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320647.640534:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380066048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (956us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320647.640542:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758
00000100:00080000:0.0:1767320647.640905:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320647.640953:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380066048:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320648.217241:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320649.175720:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320649.180929:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380066176:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320649.181021:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320649.181326:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066176
00000100:00100000:2.0:1767320649.181345:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066176
00000100:00100000:2.0:1767320649.181410:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759
00000100:00100000:2.0:1767320649.181420:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380066176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320649.181450:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320649.181509:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380066176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (487us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320649.181515:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759
00000100:00100000:3.0:1767320649.181849:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380066176:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320649.182038:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320649.240960:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320649.687128:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320649.687149:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320649.687153:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320649.687157:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320649.687163:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320649.687171:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5546
00000100:00080000:0.0:1767320649.687176:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320649.687185:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320649.687240:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dca80 x1853164380066304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320649.687270:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320649.687274:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320649.687276:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320649.687280:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5546
00000100:00080000:0.0:1767320649.687282:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320649.687286:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320649.687300:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0de300 x1853164380066432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320649.687369:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320649.687372:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320649.687374:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320649.687378:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5546
00000100:00080000:0.0:1767320649.687380:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320649.687384:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320649.687396:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164380066944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320649.687411:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320649.687414:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320649.687417:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320649.687420:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5546
00000100:00080000:0.0:1767320649.687422:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320649.687426:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320649.687435:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df100 x1853164380067200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320649.687478:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380066688:0@lo:400:kworker.0
00000100:00100000:0.0:1767320649.687566:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320649.687641:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320649.687647:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380066816:0@lo:400:kworker.0
00000100:00100000:2.0:1767320649.687797:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380066560:0@lo:400:kworker.0
00000100:00100000:2.0:1767320649.687830:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320649.687855:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320649.687861:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380067072:0@lo:400:kworker.0
00000100:00100000:2.0:1767320649.687918:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320649.687951:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066688
00000100:00100000:2.0:1767320649.687959:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066688
00000100:00100000:2.0:1767320649.687999:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066560
00000100:00100000:2.0:1767320649.688002:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066560
00000100:00100000:2.0:1767320649.688032:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948
00000100:00100000:2.0:1767320649.688040:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380066688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320649.688085:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380066688:12345-0@lo:400:kworker.0 Request processed in 45us (527us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320649.688092:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948
00000100:00100000:2.0:1767320649.688109:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949
00000100:00100000:2.0:1767320649.688115:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380066560:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320649.688144:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380066560:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320649.688150:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949
00000100:00100000:2.0:1767320649.688170:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067072
00000100:00100000:2.0:1767320649.688173:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067072
00000100:00100000:2.0:1767320649.688199:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4970
00000100:00100000:2.0:1767320649.688205:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380067072:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320649.688233:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380067072:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320649.688239:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4970
00000100:00100000:2.0:1767320649.688286:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380067072:0@lo:400:kworker.0
00000100:00100000:2.0:1767320649.688296:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380066560:0@lo:400:kworker.0
00000100:00080000:2.0:1767320649.688362:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320649.688367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320649.688536:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320649.688576:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380066688:0@lo:400:kworker.0
00000100:00100000:1.0:1767320649.688666:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380066304:0@lo:38:kworker.0
00000100:00100000:1.0:1767320649.688696:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320649.688723:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380066432:0@lo:38:kworker.0
00000100:00100000:1.0:1767320649.688747:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320649.688772:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380066944:0@lo:38:kworker.0
00000100:00100000:1.0:1767320649.688792:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320649.688807:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380067200:0@lo:38:kworker.0
00000100:00100000:1.0:1767320649.688826:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320649.688856:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066432
00000100:00100000:1.0:1767320649.688861:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066432
00000100:00100000:1.0:1767320649.688904:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222
00000100:00100000:1.0:1767320649.688909:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380066432:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320649.688930:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320649.688967:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380066432:12345-0@lo:38:kworker.0 Request processed in 56us (219us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320649.688973:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222
00000100:00080000:1.0:1767320649.689005:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320649.689010:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320649.689013:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380066432:0@lo:38:kworker.0
00000100:00100000:3.0:1767320649.689236:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066816
00000100:00100000:3.0:1767320649.689241:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066816
00000100:00100000:3.0:1767320649.689294:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066304
00000100:00100000:3.0:1767320649.689298:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066304
00000100:00100000:3.0:1767320649.689311:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380066944
00000100:00100000:3.0:1767320649.689314:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380066944
00000100:00100000:3.0:1767320649.689321:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067200
00000100:00100000:3.0:1767320649.689323:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067200
00000100:00100000:3.0:1767320649.689334:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971
00000100:00100000:3.0:1767320649.689340:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380066816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320649.689386:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380066816:12345-0@lo:400:kworker.0 Request processed in 46us (850us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320649.689392:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971
00000100:00100000:3.0:1767320649.689405:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17930
00000100:00100000:3.0:1767320649.689409:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380066304:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320649.689420:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320649.689445:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380066304:12345-0@lo:38:kworker.0 Request processed in 35us (748us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320649.689451:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17930
00000100:00100000:3.0:1767320649.689463:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17931
00000100:00100000:3.0:1767320649.689466:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380066944:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320649.689476:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320649.689499:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380066944:12345-0@lo:38:kworker.0 Request processed in 31us (706us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320649.689504:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17931
00000100:00100000:3.0:1767320649.689515:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17932
00000100:00100000:3.0:1767320649.689519:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380067200:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320649.689528:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320649.689566:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380067200:12345-0@lo:38:kworker.0 Request processed in 34us (727us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320649.689572:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17932
00000100:00100000:0.0:1767320649.689991:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380066816:0@lo:400:kworker.0
00000100:00080000:1.0:1767320649.690461:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320649.690489:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320649.690495:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320649.690499:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380066304:0@lo:38:kworker.0
00000100:00080000:1.0:1767320649.690510:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320649.690513:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320649.690515:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380066944:0@lo:38:kworker.0
00000100:00080000:1.0:1767320649.690524:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320649.690527:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320649.690530:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380067200:0@lo:38:kworker.0
00010000:00010000:2.0:1767320650.264062:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320650.649129:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320650.649187:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320650.649287:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291985792
00000100:00100000:2.0:1767320650.649297:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291985792
00000100:00100000:2.0:1767320650.649346:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291985920
00000100:00100000:2.0:1767320650.649349:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291985920
00000100:00100000:2.0:1767320650.649399:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4972
00000100:00100000:2.0:1767320650.649409:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291985920:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320650.649475:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291985920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 67us (287us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320650.649496:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4972
00000100:00100000:2.0:1767320650.649525:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17933
00000100:00100000:2.0:1767320650.649529:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291985792:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320650.649577:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320650.649604:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291985792:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 73us (486us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320650.649611:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17933
00000100:00080000:1.0:1767320650.651105:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767320651.287637:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320652.311134:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320652.759291:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320652.759311:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380067328:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320652.759388:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320652.759847:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067328
00000100:00100000:1.0:1767320652.759856:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067328
00000100:00100000:1.0:1767320652.759985:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760
00000100:00100000:1.0:1767320652.759995:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380067328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320652.760037:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320652.760101:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380067328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (712us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320652.760108:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760
00000100:00100000:0.0:1767320652.760213:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380067328:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320652.760472:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320653.335202:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320654.295297:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320654.295328:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380067456:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320654.295401:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320654.295631:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067456
00000100:00100000:3.0:1767320654.295641:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067456
00000100:00100000:3.0:1767320654.295704:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761
00000100:00100000:3.0:1767320654.295717:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380067456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320654.295751:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320654.295806:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380067456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (405us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320654.295814:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761
00000100:00080000:2.0:1767320654.295904:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320654.295943:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380067456:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320654.359191:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320654.807010:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320654.807021:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320654.807024:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320654.807029:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320654.807034:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320654.807041:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5552
00000100:00080000:0.0:1767320654.807046:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320654.807053:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320654.807094:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164380067584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320654.807124:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320654.807128:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320654.807130:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320654.807133:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5552
00000100:00080000:0.0:1767320654.807136:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320654.807140:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320654.807155:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ded80 x1853164380067712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320654.807197:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320654.807200:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320654.807202:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320654.807205:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5552
00000100:00080000:0.0:1767320654.807207:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320654.807211:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320654.807220:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc000 x1853164380068224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320654.807236:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320654.807239:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320654.807241:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320654.807244:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5552
00000100:00080000:0.0:1767320654.807246:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320654.807250:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320654.807260:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dd500 x1853164380068480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320654.807294:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380068352:0@lo:400:kworker.0
00000100:00100000:0.0:1767320654.807376:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320654.807461:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320654.807468:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380067840:0@lo:400:kworker.0
00000100:00100000:0.0:1767320654.807495:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320654.807618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380067584:0@lo:38:kworker.0
00000100:00100000:2.0:1767320654.807650:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320654.807676:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380067712:0@lo:38:kworker.0
00000100:00100000:2.0:1767320654.807701:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320654.807724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380068224:0@lo:38:kworker.0
00000100:00100000:2.0:1767320654.807743:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320654.807759:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380068480:0@lo:38:kworker.0
00000100:00100000:2.0:1767320654.807778:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320654.807806:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380068096:0@lo:400:kworker.0
00000100:00100000:2.0:1767320654.807829:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320654.807846:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320654.807851:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380067968:0@lo:400:kworker.0
00000100:00100000:2.0:1767320654.807907:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320654.807936:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067840
00000100:00100000:2.0:1767320654.807943:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067840
00000100:00100000:2.0:1767320654.807994:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067968
00000100:00100000:2.0:1767320654.807997:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067968
00000100:00100000:2.0:1767320654.808018:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950
00000100:00100000:2.0:1767320654.808026:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380067840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320654.808072:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380067840:12345-0@lo:400:kworker.0 Request processed in 47us (576us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320654.808080:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950
00000100:00100000:2.0:1767320654.808097:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951
00000100:00100000:2.0:1767320654.808102:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380067968:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320654.808132:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380067968:12345-0@lo:400:kworker.0 Request processed in 30us (225us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320654.808137:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951
00000100:00100000:2.0:1767320654.808155:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067712
00000100:00100000:2.0:1767320654.808159:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067712
00000100:00100000:2.0:1767320654.808180:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223
00000100:00100000:2.0:1767320654.808185:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380067712:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320654.808203:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320654.808238:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380067712:12345-0@lo:38:kworker.0 Request processed in 51us (535us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320654.808243:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223
00000100:00100000:2.0:1767320654.808261:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068352
00000100:00100000:2.0:1767320654.808264:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068352
00000100:00100000:2.0:1767320654.808289:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380067584
00000100:00100000:2.0:1767320654.808292:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380067584
00000100:00100000:2.0:1767320654.808300:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068224
00000100:00100000:2.0:1767320654.808302:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068224
00000100:00100000:2.0:1767320654.808309:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068480
00000100:00100000:2.0:1767320654.808311:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068480
00000100:00100000:2.0:1767320654.808318:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068096
00000100:00100000:2.0:1767320654.808320:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068096
00000100:00100000:2.0:1767320654.808334:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4973
00000100:00100000:2.0:1767320654.808339:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380068352:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320654.808370:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380068352:12345-0@lo:400:kworker.0 Request processed in 30us (994us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320654.808376:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4973
00000100:00100000:2.0:1767320654.808386:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974
00000100:00100000:2.0:1767320654.808392:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380068096:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320654.808416:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380068096:12345-0@lo:400:kworker.0 Request processed in 24us (586us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320654.808421:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974
00000100:00100000:2.0:1767320654.808434:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17934
00000100:00100000:2.0:1767320654.808437:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380067584:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320654.808448:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320654.808471:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380067584:12345-0@lo:38:kworker.0 Request processed in 32us (821us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320654.808476:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17934
00000100:00100000:2.0:1767320654.808487:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17935
00000100:00100000:2.0:1767320654.808490:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380068224:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320654.808498:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320654.808536:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380068224:12345-0@lo:38:kworker.0 Request processed in 43us (791us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320654.808542:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17935
00000100:00100000:2.0:1767320654.808552:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17936
00000100:00100000:2.0:1767320654.808556:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380068480:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320654.808565:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320654.808587:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380068480:12345-0@lo:38:kworker.0 Request processed in 29us (808us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320654.808593:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17936
00000100:00080000:2.0:1767320654.808622:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320654.808627:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320654.808656:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380067968:0@lo:400:kworker.0
00000100:00100000:2.0:1767320654.808667:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380068096:0@lo:400:kworker.0
00000100:00080000:2.0:1767320654.808699:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320654.808704:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320654.808707:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380067584:0@lo:38:kworker.0
00000100:00080000:2.0:1767320654.808716:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320654.808719:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320654.808721:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380067712:0@lo:38:kworker.0
00000100:00080000:2.0:1767320654.808728:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320654.808730:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320654.808733:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380068224:0@lo:38:kworker.0
00000100:00080000:2.0:1767320654.808739:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320654.808742:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320654.808745:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380068480:0@lo:38:kworker.0
00000100:00100000:0.0:1767320654.809499:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380067840:0@lo:400:kworker.0
00000100:00100000:0.0:1767320654.809523:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380068352:0@lo:400:kworker.0
00010000:00010000:3.0:1767320655.383526:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320655.763075:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320655.763176:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320655.763266:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291986176
00000100:00100000:2.0:1767320655.763277:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291986176
00000100:00100000:2.0:1767320655.763356:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291986048
00000100:00100000:2.0:1767320655.763360:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291986048
00000100:00100000:2.0:1767320655.763380:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4975
00000100:00100000:2.0:1767320655.763390:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291986176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320655.763476:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291986176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (412us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320655.763484:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4975
00000100:00100000:2.0:1767320655.763515:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17937
00000100:00100000:2.0:1767320655.763520:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291986048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320655.763544:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320655.763576:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291986048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 54us (400us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320655.763583:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17937
00000100:00080000:0.0:1767320655.763792:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320656.410926:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320657.431386:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320657.879404:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380068608:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320657.879477:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320657.880000:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068608
00000100:00100000:1.0:1767320657.880008:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068608
00000100:00100000:1.0:1767320657.880077:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762
00000100:00100000:1.0:1767320657.880087:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380068608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320657.880117:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320657.880178:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380068608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (700us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320657.880186:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762
00000100:00100000:2.0:1767320657.880397:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380068608:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320657.880525:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320658.456022:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320659.415714:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380068736:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320659.415820:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320659.416013:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068736
00000100:00100000:3.0:1767320659.416023:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068736
00000100:00100000:3.0:1767320659.416100:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763
00000100:00100000:3.0:1767320659.416110:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380068736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320659.416144:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767320659.416777:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320659.418217:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380068736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2097us (2386us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320659.418231:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763
00000100:00100000:0.0:1767320659.419787:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380068736:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320659.479043:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320659.928533:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320659.928545:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320659.928549:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320659.928554:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320659.928558:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320659.928567:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5557
00000100:00080000:2.0:1767320659.928572:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320659.928580:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320659.928625:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f1f80 x1853164380068864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320659.928658:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320659.928662:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320659.928663:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320659.928667:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5557
00000100:00080000:2.0:1767320659.928670:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320659.928673:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320659.928685:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f0000 x1853164380068992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320659.928760:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320659.928763:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320659.928765:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320659.928768:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5557
00000100:00080000:2.0:1767320659.928771:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320659.928774:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320659.928787:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f5500 x1853164380069504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320659.928807:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320659.928810:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320659.928811:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320659.928814:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5557
00000100:00080000:2.0:1767320659.928817:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320659.928820:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320659.928832:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f5c00 x1853164380069760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320659.928862:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380069376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320659.928915:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380069632:0@lo:400:kworker.0
00000100:00100000:3.0:1767320659.928989:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380069120:0@lo:400:kworker.0
00000100:00100000:0.0:1767320659.929016:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380069248:0@lo:400:kworker.0
00000100:00100000:1.0:1767320659.935328:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320659.935453:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380069632
00000100:00100000:1.0:1767320659.935473:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380069632
00000100:00100000:1.0:1767320659.935539:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976
00000100:00100000:1.0:1767320659.935550:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380069632:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320659.935625:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380069632:12345-0@lo:400:kworker.0 Request processed in 77us (306us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320659.935632:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976
00000100:00080000:1.0:1767320659.935658:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320659.935709:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380069632:0@lo:400:kworker.0
00000100:00100000:1.0:1767320659.935758:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380068864:0@lo:38:kworker.0
00000100:00100000:1.0:1767320659.935792:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320659.935816:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380068992:0@lo:38:kworker.0
00000100:00100000:1.0:1767320659.935841:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320659.935863:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380069504:0@lo:38:kworker.0
00000100:00100000:1.0:1767320659.935910:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320659.935926:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380069760:0@lo:38:kworker.0
00000100:00100000:1.0:1767320659.935947:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320659.935983:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068992
00000100:00100000:1.0:1767320659.935986:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068992
00000100:00100000:1.0:1767320659.936011:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224
00000100:00100000:1.0:1767320659.936015:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380068992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320659.936032:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320659.936064:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380068992:12345-0@lo:38:kworker.0 Request processed in 47us (221us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320659.936155:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224
00000100:00100000:1.0:1767320659.936175:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380068864
00000100:00100000:1.0:1767320659.936179:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380068864
00000100:00100000:1.0:1767320659.936198:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380069504
00000100:00100000:1.0:1767320659.936201:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380069504
00000100:00100000:1.0:1767320659.936214:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380069760
00000100:00100000:1.0:1767320659.936217:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380069760
00000100:00100000:1.0:1767320659.936233:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17938
00000100:00100000:1.0:1767320659.936237:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380068864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320659.936247:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320659.936275:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380068864:12345-0@lo:38:kworker.0 Request processed in 35us (482us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320659.936280:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17938
00000100:00100000:1.0:1767320659.936292:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17939
00000100:00100000:1.0:1767320659.936296:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380069504:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320659.936305:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320659.936332:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380069504:12345-0@lo:38:kworker.0 Request processed in 35us (422us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320659.936337:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17939
00000100:00100000:1.0:1767320659.936349:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17940
00000100:00100000:1.0:1767320659.936353:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380069760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320659.936362:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320659.936384:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380069760:12345-0@lo:38:kworker.0 Request processed in 29us (436us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320659.936389:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17940
00000100:00080000:1.0:1767320659.936417:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320659.936422:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320659.936426:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380068864:0@lo:38:kworker.0
00000100:00080000:1.0:1767320659.936434:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320659.936437:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320659.936440:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380068992:0@lo:38:kworker.0
00000100:00080000:1.0:1767320659.936447:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320659.936450:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320659.936453:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380069504:0@lo:38:kworker.0
00000100:00080000:1.0:1767320659.936459:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320659.936476:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320659.936479:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380069760:0@lo:38:kworker.0
00000100:00100000:2.0:1767320659.939812:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320659.940300:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380069376
00000100:00100000:1.0:1767320659.940311:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380069376
00000100:00100000:1.0:1767320659.940388:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4977
00000100:00100000:1.0:1767320659.940399:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380069376:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320659.940487:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380069376:12345-0@lo:400:kworker.0 Request processed in 89us (681us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320659.940494:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4977
00000100:00080000:2.0:1767320659.940814:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320659.940865:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380069376:0@lo:400:kworker.0
00000100:00100000:3.0:1767320659.948601:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320659.953413:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380069120
00000100:00100000:1.0:1767320659.953431:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380069120
00000100:00100000:1.0:1767320659.953552:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952
00000100:00100000:1.0:1767320659.953563:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380069120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320659.953672:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380069120:12345-0@lo:400:kworker.0 Request processed in 110us (5078us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320659.953680:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952
00000100:00080000:2.0:1767320659.953862:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320659.954572:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380069120:0@lo:400:kworker.0
00000100:00100000:0.0:1767320659.962076:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320659.963654:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380069248
00000100:00100000:3.0:1767320659.963666:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380069248
00000100:00100000:3.0:1767320659.963739:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953
00000100:00100000:3.0:1767320659.963750:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380069248:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320659.963843:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380069248:12345-0@lo:400:kworker.0 Request processed in 95us (1776us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320659.963851:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953
00000100:00100000:0.0:1767320659.964300:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380069248:0@lo:400:kworker.0
00010000:00010000:2.0:1767320660.505130:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320660.888327:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320660.888385:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320660.888542:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291986432
00000100:00100000:2.0:1767320660.888553:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291986432
00000100:00100000:2.0:1767320660.888633:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291986304
00000100:00100000:2.0:1767320660.888637:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291986304
00000100:00100000:2.0:1767320660.888657:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4978
00000100:00100000:2.0:1767320660.888667:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291986432:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320660.888744:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291986432:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (444us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320660.888753:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4978
00000100:00100000:2.0:1767320660.888774:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17941
00000100:00100000:2.0:1767320660.888778:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291986304:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320660.888801:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320660.888830:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291986304:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 50us (444us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320660.888836:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17941
00000100:00080000:3.0:1767320660.889064:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320661.527381:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320662.551936:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320663.002813:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320663.002834:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380069888:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320663.002934:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320663.002975:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380069888
00000100:00100000:0.0:1767320663.002984:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380069888
00000100:00080000:1.0:1767320663.003020:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320663.003037:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764
00000100:00100000:0.0:1767320663.003046:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380069888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320663.003075:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320663.003124:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380069888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (189us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320663.004133:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380069888:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320663.005356:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764
00010000:00010000:3.0:1767320663.579478:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320664.536396:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380070016:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320664.536838:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320664.537153:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070016
00000100:00100000:3.0:1767320664.537161:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070016
00000100:00100000:3.0:1767320664.537276:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765
00000100:00100000:3.0:1767320664.537285:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380070016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320664.537323:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320664.537388:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380070016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (550us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320664.537395:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765
00000100:00100000:2.0:1767320664.537491:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380070016:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320664.537799:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320664.599223:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320665.047599:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320665.047611:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320665.047615:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320665.047619:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320665.047623:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320665.047631:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320665.047635:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320665.047642:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320665.047685:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18a80 x1853164380070144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320665.047713:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320665.047717:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320665.047718:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320665.047723:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320665.047725:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320665.047729:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320665.047742:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1bb80 x1853164380070272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320665.047804:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320665.047807:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320665.047809:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320665.047812:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320665.047815:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320665.047819:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320665.047829:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164380070784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320665.047848:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320665.047851:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320665.047852:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320665.047855:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5562
00000100:00080000:3.0:1767320665.047857:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320665.047859:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320665.047901:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8380 x1853164380071040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320665.047903:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380070912:0@lo:400:kworker.0
00000100:00100000:3.0:1767320665.047937:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380070528:0@lo:400:kworker.0
00000100:00100000:3.0:1767320665.047982:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320665.047985:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320665.048077:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380070400:0@lo:400:kworker.0
00000100:00100000:0.0:1767320665.048113:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320665.048113:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380070144:0@lo:38:kworker.0
00000100:00100000:0.0:1767320665.048153:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380070656:0@lo:400:kworker.0
00000100:00100000:2.0:1767320665.048155:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320665.048190:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320665.048202:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070528
00000100:00100000:2.0:1767320665.048211:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070528
00000100:00100000:0.0:1767320665.048224:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070912
00000100:00100000:0.0:1767320665.048230:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070912
00000100:00100000:2.0:1767320665.048272:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070400
00000100:00100000:2.0:1767320665.048276:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070400
00000100:00100000:0.0:1767320665.048282:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070144
00000100:00100000:0.0:1767320665.048287:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070144
00000100:00100000:0.0:1767320665.048310:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070656
00000100:00100000:2.0:1767320665.048313:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954
00000100:00100000:0.0:1767320665.048314:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070656
00000100:00100000:2.0:1767320665.048326:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380070528:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320665.048343:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4979
00000100:00100000:0.0:1767320665.048352:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380070912:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320665.048374:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380070528:12345-0@lo:400:kworker.0 Request processed in 51us (393us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320665.048383:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954
00000100:00100000:0.0:1767320665.048396:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380070912:12345-0@lo:400:kworker.0 Request processed in 44us (414us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320665.048403:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955
00000100:00100000:0.0:1767320665.048407:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4979
00000100:00100000:2.0:1767320665.048414:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380070400:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320665.048437:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980
00000100:00100000:0.0:1767320665.048448:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380070656:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320665.048459:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380070400:12345-0@lo:400:kworker.0 Request processed in 48us (346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320665.048466:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955
00000100:00100000:0.0:1767320665.048494:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380070656:12345-0@lo:400:kworker.0 Request processed in 48us (303us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320665.048501:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980
00000100:00100000:1.0:1767320665.048503:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380070912:0@lo:400:kworker.0
00000100:00100000:0.0:1767320665.048517:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17942
00000100:00100000:0.0:1767320665.048521:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380070144:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767320665.048533:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320665.048539:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:0.0:1767320665.048542:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320665.048572:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380070144:12345-0@lo:38:kworker.0 Request processed in 49us (419us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320665.048576:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380070400:0@lo:400:kworker.0
00000100:00100000:0.0:1767320665.048579:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17942
00000100:00080000:2.0:1767320665.048584:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320665.048591:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320665.048595:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380070144:0@lo:38:kworker.0
00000100:00100000:2.0:1767320665.048605:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380070272:0@lo:38:kworker.0
00000100:00100000:0.0:1767320665.048610:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380070656:0@lo:400:kworker.0
00000100:00100000:2.0:1767320665.048632:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320665.048666:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380070784:0@lo:38:kworker.0
00000100:00100000:2.0:1767320665.048686:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320665.048713:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380071040:0@lo:38:kworker.0
00000100:00100000:0.0:1767320665.048726:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070784
00000100:00100000:1.0:1767320665.048727:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380070272
00000100:00100000:0.0:1767320665.048732:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070784
00000100:00100000:1.0:1767320665.048732:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380070272
00000100:00100000:2.0:1767320665.048737:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320665.048755:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380071040
00000100:00100000:1.0:1767320665.048757:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225
00000100:00100000:0.0:1767320665.048758:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380071040
00000100:00100000:1.0:1767320665.048762:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380070272:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320665.048776:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17943
00010000:00020000:1.0:1767320665.048776:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320665.048782:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380070784:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320665.048783:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17944
00000100:00100000:2.0:1767320665.048793:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380071040:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320665.048797:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:2.0:1767320665.048808:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320665.048813:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380070272:12345-0@lo:38:kworker.0 Request processed in 48us (179us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320665.048819:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380070784:12345-0@lo:38:kworker.0 Request processed in 38us (133us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320665.048822:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225
00000100:00100000:0.0:1767320665.048825:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17943
00000100:00100000:2.0:1767320665.048845:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380071040:12345-0@lo:38:kworker.0 Request processed in 51us (108us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320665.048853:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17944
00000100:00080000:1.0:1767320665.049027:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320665.049033:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320665.049037:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380070272:0@lo:38:kworker.0
00000100:00080000:1.0:1767320665.049051:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320665.049054:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320665.049057:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380070784:0@lo:38:kworker.0
00000100:00080000:1.0:1767320665.049066:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320665.049068:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320665.049071:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380071040:0@lo:38:kworker.0
00000100:00100000:3.0:1767320665.058080:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380070528:0@lo:400:kworker.0
00010000:00010000:2.0:1767320665.623097:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320666.001260:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320666.001360:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291986816
00000100:00100000:2.0:1767320666.001372:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291986816
00000100:00100000:2.0:1767320666.001466:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4981
00000100:00100000:2.0:1767320666.001477:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291986816:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320666.001561:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291986816:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (310us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320666.001570:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4981
00000100:00080000:1.0:1767320666.001629:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:1.0:1767320666.002702:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291986560 offset 0 length 520: 4
00000100:00100000:1.0:1767320666.002736:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320666.002804:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291986688
00000100:00100000:3.0:1767320666.002812:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291986688
00000100:00100000:3.0:1767320666.002962:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17945
00000100:00100000:3.0:1767320666.002970:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291986688:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320666.003001:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320666.003058:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291986688:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 87us (321us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320666.003066:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17945
00010000:00010000:2.0:1767320666.650779:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320667.671224:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320668.119308:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320668.119330:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380071168:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320668.119445:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320668.119847:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380071168
00000100:00100000:0.0:1767320668.119855:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380071168
00000100:00100000:0.0:1767320668.119951:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766
00000100:00100000:0.0:1767320668.119962:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380071168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320668.120002:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320668.120062:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380071168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (616us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320668.120070:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766
00000100:00100000:2.0:1767320668.120126:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380071168:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320668.120529:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320668.695091:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320669.142991:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320644/real 1767320644]  req@ffff8b0e0360b800 x1853164380065024/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320669 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320669.143019:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0360b800 x1853164380065024/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320669 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320669.143034:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320669.143060:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320669.143064:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380065024:0@lo:250:kworker.0
00000100:00080000:1.0:1767320669.143391:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320669.143398:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320669.143401:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320669.143406:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5546
00000100:00080000:1.0:1767320669.143411:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320669.143418:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320669.143453:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19c00 x1853164380071296/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320669.143483:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320669.143487:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320669.143489:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320669.143493:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5567
00000100:00080000:1.0:1767320669.143496:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320669.143499:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320669.143514:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1bb80 x1853164380071424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320669.143524:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320669.143527:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320669.143528:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320669.143532:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5567
00000100:00080000:1.0:1767320669.143534:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320669.143538:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320669.143549:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18a80 x1853164380071552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320669.143606:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320669.143609:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320669.143611:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320669.143615:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5567
00000100:00080000:1.0:1767320669.143617:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320669.143621:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320669.143634:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f0000 x1853164380072064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320669.143648:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320669.143650:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320669.143652:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320669.143655:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5567
00000100:00080000:1.0:1767320669.143657:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320669.143661:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320669.143672:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baffb80 x1853164380072320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320669.143697:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380071936:0@lo:400:kworker.0
00000100:00100000:1.0:1767320669.143758:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320669.143814:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320669.143820:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380072192:0@lo:400:kworker.0
00000100:00100000:1.0:1767320669.143841:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320669.143885:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380071936
00000100:00100000:1.0:1767320669.143894:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380071936
00000100:00100000:1.0:1767320669.143944:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072192
00000100:00100000:1.0:1767320669.143947:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072192
00000100:00100000:1.0:1767320669.143970:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4982
00000100:00100000:1.0:1767320669.143978:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380071936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320669.144029:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380071936:12345-0@lo:400:kworker.0 Request processed in 51us (270us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320669.144037:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4982
00000100:00100000:1.0:1767320669.144056:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4983
00000100:00100000:1.0:1767320669.144063:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380072192:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320669.144229:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380071680:0@lo:400:kworker.0
00000100:00100000:3.0:1767320669.144262:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320669.144296:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320669.144301:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380071808:0@lo:400:kworker.0
00000100:00100000:3.0:1767320669.144322:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320669.144348:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380071680
00000100:00100000:3.0:1767320669.144352:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380071680
00000100:00100000:3.0:1767320669.144389:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380071808
00000100:00100000:3.0:1767320669.144401:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380071808
00000100:00100000:3.0:1767320669.144426:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956
00000100:00100000:3.0:1767320669.144432:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380071680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320669.144469:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380071680:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320669.144475:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956
00000100:00100000:3.0:1767320669.144486:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957
00000100:00100000:3.0:1767320669.144492:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380071808:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320669.144517:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380071808:12345-0@lo:400:kworker.0 Request processed in 25us (194us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320669.144522:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957
00000100:00100000:3.0:1767320669.144565:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380071808:0@lo:400:kworker.0
00000100:00100000:3.0:1767320669.144576:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380071680:0@lo:400:kworker.0
00000100:00080000:3.0:1767320669.144611:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320669.144616:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320669.144641:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380071936:0@lo:400:kworker.0
00000100:00100000:1.0:1767320669.145348:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380072192:12345-0@lo:400:kworker.0 Request processed in 1282us (1502us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320669.145358:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4983
00000100:00100000:0.0:1767320669.145371:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380072192:0@lo:400:kworker.0
00000100:00100000:2.0:1767320669.145460:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380071296:0@lo:250:kworker.0
00000400:00000100:2.0:1767320669.145492:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380071296 offset 0 length 520: 4
00000100:00100000:2.0:1767320669.145513:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380071424:0@lo:38:kworker.0
00000100:00100000:2.0:1767320669.145536:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320669.145565:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380071552:0@lo:38:kworker.0
00000100:00100000:2.0:1767320669.145589:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320669.145611:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380072064:0@lo:38:kworker.0
00000100:00100000:2.0:1767320669.145632:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320669.145647:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380072320:0@lo:38:kworker.0
00000100:00100000:2.0:1767320669.145668:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320669.145697:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380071424
00000100:00100000:2.0:1767320669.145702:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380071424
00000100:00100000:2.0:1767320669.145726:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072064
00000100:00100000:2.0:1767320669.145729:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072064
00000100:00100000:2.0:1767320669.145740:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072320
00000100:00100000:2.0:1767320669.145742:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072320
00000100:00100000:2.0:1767320669.145755:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17946
00000100:00100000:2.0:1767320669.145761:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380071424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320669.145778:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320669.145820:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380071424:12345-0@lo:38:kworker.0 Request processed in 58us (283us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320669.145826:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17946
00000100:00100000:2.0:1767320669.145842:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17947
00000100:00100000:2.0:1767320669.145845:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380072064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320669.145854:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320669.145895:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380072064:12345-0@lo:38:kworker.0 Request processed in 48us (262us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320669.145900:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17947
00000100:00100000:2.0:1767320669.145910:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17948
00000100:00100000:2.0:1767320669.145913:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380072320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320669.145922:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320669.145946:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380072320:12345-0@lo:38:kworker.0 Request processed in 31us (277us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320669.145951:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17948
00000100:00080000:2.0:1767320669.145983:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320669.145988:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320669.145991:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380071424:0@lo:38:kworker.0
00000100:00080000:2.0:1767320669.145999:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320669.146001:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320669.146004:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380072064:0@lo:38:kworker.0
00000100:00080000:2.0:1767320669.146010:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320669.146013:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320669.146015:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380072320:0@lo:38:kworker.0
00000100:00100000:1.0:1767320669.146318:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380071552
00000100:00100000:1.0:1767320669.146323:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380071552
00000100:00100000:1.0:1767320669.146353:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226
00000100:00100000:1.0:1767320669.146358:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380071552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320669.146368:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320669.147472:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380071552:12345-0@lo:38:kworker.0 Request processed in 1106us (1876us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320669.147483:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226
00000100:00080000:0.0:1767320669.150435:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320669.150449:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320669.150454:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380071552:0@lo:38:kworker.0
00000100:00100000:2.0:1767320669.656343:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380072448:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320669.656427:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320669.656675:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072448
00000100:00100000:1.0:1767320669.656683:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072448
00000100:00100000:1.0:1767320669.656728:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767
00000100:00100000:1.0:1767320669.656735:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380072448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320669.656759:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320669.656807:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380072448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320669.656813:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767
00000100:00100000:2.0:1767320669.658120:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380072448:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320669.719135:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320670.743080:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320671.121321:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320671.121386:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320671.121493:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291987072
00000100:00100000:1.0:1767320671.121503:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291987072
00000100:00100000:1.0:1767320671.121582:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291986944
00000100:00100000:1.0:1767320671.121586:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291986944
00000100:00100000:1.0:1767320671.121610:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4984
00000100:00100000:1.0:1767320671.121621:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291987072:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:3.0:1767320671.121634:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320671.121674:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17949
00000100:00100000:3.0:1767320671.121681:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291986944:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:1.0:1767320671.121700:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291987072:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 80us (400us total) trans 0 rc 0/0
00010000:00020000:3.0:1767320671.121704:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320671.121715:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4984
00000100:00100000:3.0:1767320671.121743:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291986944:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 61us (356us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320671.121752:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17949
00010000:00010000:3.0:1767320671.767120:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320672.791224:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320673.239902:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320673.240527:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380072576:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320673.240601:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320673.241220:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072576
00000100:00100000:0.0:1767320673.241230:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072576
00000100:00100000:0.0:1767320673.241303:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768
00000100:00100000:0.0:1767320673.241313:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380072576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320673.241486:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320673.241599:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380072576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 287us (997us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320673.241607:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768
00000100:00080000:3.0:1767320673.241698:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320673.242260:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380072576:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320673.818663:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320674.263217:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320674.263226:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320674.263239:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320674.263244:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320674.263248:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320674.263255:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5571
00000100:00080000:3.0:1767320674.263260:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320674.263265:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320674.263302:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063abb80 x1853164380072704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320674.263325:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320674.263330:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320674.263339:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320674.263343:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5571
00000100:00080000:3.0:1767320674.263346:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320674.263349:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320674.263362:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063aaa00 x1853164380072832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320674.263432:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320674.263435:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320674.263437:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320674.263441:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5571
00000100:00080000:3.0:1767320674.263444:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320674.263447:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320674.263458:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18a80 x1853164380073344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320674.263472:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320674.263476:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320674.263477:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320674.263481:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5571
00000100:00080000:3.0:1767320674.263483:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320674.263486:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320674.263496:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19500 x1853164380073600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320674.263524:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380073216:0@lo:400:kworker.0
00000100:00100000:2.0:1767320674.263532:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380073088:0@lo:400:kworker.0
00000100:00100000:0.0:1767320674.263606:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380073472:0@lo:400:kworker.0
00000100:00100000:1.0:1767320674.263680:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380072960:0@lo:400:kworker.0
00000100:00100000:2.0:1767320674.270621:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320674.270739:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073088
00000100:00100000:2.0:1767320674.270749:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073088
00000100:00100000:2.0:1767320674.270808:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958
00000100:00100000:2.0:1767320674.270819:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380073088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320674.270903:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380073088:12345-0@lo:400:kworker.0 Request processed in 86us (288us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320674.270911:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958
00000100:00080000:2.0:1767320674.270935:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320674.270972:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380073088:0@lo:400:kworker.0
00000100:00100000:2.0:1767320674.271191:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380072704:0@lo:38:kworker.0
00000100:00100000:2.0:1767320674.271293:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320674.271353:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380072832:0@lo:38:kworker.0
00000100:00100000:2.0:1767320674.271393:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320674.271952:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380073344:0@lo:38:kworker.0
00000100:00100000:2.0:1767320674.271987:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320674.272007:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380073600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320674.272028:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320674.272067:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072704
00000100:00100000:2.0:1767320674.272073:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072704
00000100:00100000:2.0:1767320674.272098:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073344
00000100:00100000:2.0:1767320674.272101:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073344
00000100:00100000:2.0:1767320674.272113:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073600
00000100:00100000:2.0:1767320674.272114:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073600
00000100:00100000:2.0:1767320674.272129:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17950
00000100:00100000:2.0:1767320674.272134:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380072704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320674.272154:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320674.272191:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380072704:12345-0@lo:38:kworker.0 Request processed in 55us (911us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320674.272198:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17950
00000100:00100000:2.0:1767320674.272213:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17951
00000100:00100000:2.0:1767320674.272217:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380073344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320674.272226:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320674.272251:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380073344:12345-0@lo:38:kworker.0 Request processed in 33us (264us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320674.272257:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17951
00000100:00100000:2.0:1767320674.272268:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17952
00000100:00100000:2.0:1767320674.272272:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380073600:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320674.272281:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320674.272302:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380073600:12345-0@lo:38:kworker.0 Request processed in 28us (273us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320674.272307:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17952
00000100:00080000:2.0:1767320674.272357:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320674.272362:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320674.272366:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380072704:0@lo:38:kworker.0
00000100:00080000:2.0:1767320674.272375:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320674.272378:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320674.272381:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380073344:0@lo:38:kworker.0
00000100:00080000:2.0:1767320674.272388:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320674.272392:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320674.272394:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380073600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320674.275245:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072832
00000100:00100000:2.0:1767320674.275281:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072832
00000100:00100000:2.0:1767320674.275343:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227
00000100:00100000:2.0:1767320674.275353:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380072832:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320674.275376:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320674.284777:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320674.284861:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073472
00000100:00100000:0.0:1767320674.284884:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073472
00000100:00100000:0.0:1767320674.284953:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4985
00000100:00100000:0.0:1767320674.284973:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380073472:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320674.285039:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380073472:12345-0@lo:400:kworker.0 Request processed in 78us (268us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320674.285046:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4985
00000100:00080000:0.0:1767320674.285068:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320674.285106:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380073472:0@lo:400:kworker.0
00000100:00100000:3.0:1767320674.285420:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320674.285517:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320674.285564:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073216
00000100:00100000:0.0:1767320674.285569:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073216
00000100:00100000:0.0:1767320674.285602:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4986
00000100:00080000:1.0:1767320674.285604:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320674.285610:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380073216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320674.285649:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380072960
00000100:00100000:0.0:1767320674.285661:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380073216:12345-0@lo:400:kworker.0 Request processed in 51us (241us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320674.285663:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380072960
00000100:00100000:0.0:1767320674.285667:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4986
00000100:00100000:3.0:1767320674.285691:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959
00000100:00100000:3.0:1767320674.285697:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380072960:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320674.285761:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380073216:0@lo:400:kworker.0
00000100:00100000:3.0:1767320674.285791:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380072960:12345-0@lo:400:kworker.0 Request processed in 94us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320674.285798:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959
00000100:00100000:0.0:1767320674.286260:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380072960:0@lo:400:kworker.0
00000100:00100000:2.0:1767320674.291416:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380072832:12345-0@lo:38:kworker.0 Request processed in 16053us (20011us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320674.291445:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227
00000100:00080000:0.0:1767320674.291996:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320674.292003:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320674.292007:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380072832:0@lo:38:kworker.0
00000100:00100000:2.0:1767320674.777208:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320674.777232:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380073728:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320674.777305:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320674.777779:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073728
00000100:00100000:1.0:1767320674.777788:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073728
00000100:00100000:1.0:1767320674.777842:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769
00000100:00100000:1.0:1767320674.777851:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380073728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320674.777902:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320674.777966:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380073728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (660us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320674.777974:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769
00000100:00100000:2.0:1767320674.778063:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380073728:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320674.839363:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320675.863577:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320676.239357:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320676.241381:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291987328
00000100:00100000:0.0:1767320676.241527:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291987328
00000100:00100000:0.0:1767320676.241708:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4987
00000100:00100000:0.0:1767320676.241721:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291987328:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320676.241821:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291987328:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 103us (2475us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320676.241829:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4987
00000100:00100000:3.0:1767320676.244450:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320676.244605:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291987200
00000100:00100000:2.0:1767320676.244615:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291987200
00000100:00100000:2.0:1767320676.244665:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17953
00000100:00100000:2.0:1767320676.244674:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291987200:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320676.244696:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320676.244766:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291987200:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 92us (334us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320676.244774:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17953
00000100:00080000:1.0:1767320676.246990:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320676.887712:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320677.911236:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320678.361566:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380073856:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320678.361642:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320678.361804:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073856
00000100:00100000:3.0:1767320678.361814:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073856
00000100:00100000:3.0:1767320678.361925:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770
00000100:00100000:3.0:1767320678.361936:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380073856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320678.361966:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320678.362022:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380073856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (380us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320678.362029:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770
00000100:00080000:1.0:1767320678.362094:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320678.362165:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380073856:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320678.942637:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320679.383215:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320679.383226:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320679.383230:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320679.383233:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320679.383237:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320679.383245:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5576
00000100:00080000:1.0:1767320679.383250:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320679.383257:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320679.383309:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164380073984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320679.383336:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320679.383340:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320679.383341:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320679.383346:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5576
00000100:00080000:1.0:1767320679.383348:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320679.383353:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320679.383367:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafce00 x1853164380074112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320679.383450:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320679.383453:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320679.383455:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320679.383459:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5576
00000100:00080000:1.0:1767320679.383470:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320679.383473:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320679.383485:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff480 x1853164380074624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320679.383500:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320679.383502:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320679.383504:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320679.383507:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5576
00000100:00080000:1.0:1767320679.383509:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320679.383513:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320679.383522:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff100 x1853164380074880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320679.383553:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380074496:0@lo:400:kworker.0
00000100:00100000:1.0:1767320679.383619:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320679.383688:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320679.383694:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380074752:0@lo:400:kworker.0
00000100:00100000:1.0:1767320679.383718:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320679.384062:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380074368:0@lo:400:kworker.0
00000100:00100000:2.0:1767320679.384098:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320679.384099:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380074496
00000100:00100000:0.0:1767320679.384109:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380074496
00000100:00100000:2.0:1767320679.384125:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320679.384131:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380074240:0@lo:400:kworker.0
00000100:00100000:2.0:1767320679.384151:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320679.384197:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380074752
00000100:00100000:2.0:1767320679.384201:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380074752
00000100:00100000:2.0:1767320679.384235:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988
00000100:00100000:2.0:1767320679.384243:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380074496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320679.384302:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989
00000100:00100000:2.0:1767320679.384303:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380074496:12345-0@lo:400:kworker.0 Request processed in 60us (682us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320679.384311:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380074752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320679.384311:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988
00000100:00100000:3.0:1767320679.384585:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380073984:0@lo:38:kworker.0
00000100:00100000:2.0:1767320679.384794:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380074752:0@lo:400:kworker.0
00000100:00100000:1.0:1767320679.384906:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380074368
00000100:00100000:1.0:1767320679.384911:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380074368
00000100:00100000:1.0:1767320679.384943:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380074240
00000100:00100000:1.0:1767320679.384946:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380074240
00000100:00100000:1.0:1767320679.384967:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960
00000100:00100000:1.0:1767320679.384974:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380074368:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320679.389526:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380074752:12345-0@lo:400:kworker.0 Request processed in 5205us (5795us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320679.389544:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989
00000100:00100000:3.0:1767320679.389587:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320679.389598:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380074496:0@lo:400:kworker.0
00000100:00100000:0.0:1767320679.389630:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380073984
00000100:00100000:0.0:1767320679.389637:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380073984
00000100:00100000:3.0:1767320679.389643:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380074112:0@lo:38:kworker.0
00000100:00100000:2.0:1767320679.389653:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961
00000100:00100000:0.0:1767320679.389671:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17954
00000100:00100000:0.0:1767320679.389676:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380073984:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320679.389677:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380074240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320679.389697:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320679.389737:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380074624:0@lo:38:kworker.0
00010000:00020000:0.0:1767320679.389744:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320679.389744:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380074240:12345-0@lo:400:kworker.0 Request processed in 81us (5591us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320679.389751:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961
00000100:00100000:3.0:1767320679.389774:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320679.389777:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380074112
00000100:00100000:2.0:1767320679.389782:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380074112
00000100:00100000:0.0:1767320679.389784:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380073984:12345-0@lo:38:kworker.0 Request processed in 106us (199us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320679.389790:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17954
00000100:00100000:0.0:1767320679.389804:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380074624
00000100:00100000:2.0:1767320679.389806:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228
00000100:00100000:0.0:1767320679.389807:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380074624
00000100:00100000:2.0:1767320679.389811:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380074112:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320679.389815:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380074880:0@lo:38:kworker.0
00010000:00020000:2.0:1767320679.389824:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320679.389850:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320679.389861:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380074112:12345-0@lo:38:kworker.0 Request processed in 48us (163us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320679.389890:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228
00000100:00080000:3.0:1767320679.389922:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320679.389927:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320679.389932:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380073984:0@lo:38:kworker.0
00000100:00080000:3.0:1767320679.389944:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320679.389958:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320679.389963:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380074112:0@lo:38:kworker.0
00000100:00100000:1.0:1767320679.389971:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380074368:12345-0@lo:400:kworker.0 Request processed in 4996us (5870us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320679.389981:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960
00000100:00100000:3.0:1767320679.390003:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380074880
00000100:00100000:3.0:1767320679.390009:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380074880
00000100:00100000:3.0:1767320679.390028:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17955
00000100:00100000:3.0:1767320679.390035:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380074624:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320679.390042:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17956
00010000:00020000:3.0:1767320679.390048:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320679.390050:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380074880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320679.390063:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320679.390088:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380074624:12345-0@lo:38:kworker.0 Request processed in 51us (313us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320679.390096:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17955
00000100:00100000:1.0:1767320679.390102:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380074880:12345-0@lo:38:kworker.0 Request processed in 50us (250us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320679.390110:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17956
00000100:00080000:3.0:1767320679.390129:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320679.390135:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320679.390139:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380074624:0@lo:38:kworker.0
00000100:00080000:3.0:1767320679.390151:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320679.390155:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320679.390158:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380074880:0@lo:38:kworker.0
00000100:00080000:1.0:1767320679.390166:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320679.390173:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320679.390623:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380074240:0@lo:400:kworker.0
00000100:00100000:2.0:1767320679.390635:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380074368:0@lo:400:kworker.0
00000100:00100000:2.0:1767320679.898581:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320679.898604:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380075008:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320679.898675:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320679.898791:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075008
00000100:00100000:1.0:1767320679.898799:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075008
00000100:00100000:1.0:1767320679.898841:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771
00000100:00100000:1.0:1767320679.898849:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380075008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320679.898904:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320679.898954:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380075008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (278us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320679.898961:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771
00000100:00100000:2.0:1767320679.899682:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380075008:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320679.959303:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320680.983130:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320681.362990:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320681.363483:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291987456
00000100:00100000:0.0:1767320681.363495:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291987456
00000100:00100000:0.0:1767320681.363561:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17957
00000100:00100000:0.0:1767320681.363571:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291987456:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320681.363596:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320681.363688:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291987456:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 116us (708us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320681.363696:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17957
00000100:00100000:3.0:1767320681.367328:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320681.368664:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291987584
00000100:00100000:2.0:1767320681.368676:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291987584
00000100:00080000:1.0:1767320681.368844:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320681.369092:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4990
00000100:00100000:2.0:1767320681.369105:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291987584:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320681.369197:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291987584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (1881us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320681.369203:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4990
00010000:00010000:2.0:1767320682.007567:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320683.031277:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320683.479261:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380075136:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320683.479476:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320683.484701:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075136
00000100:00100000:0.0:1767320683.484717:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075136
00000100:00100000:0.0:1767320683.485059:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772
00000100:00100000:0.0:1767320683.485075:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380075136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320683.485112:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320683.485204:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380075136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (5728us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320683.485404:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380075136:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320683.489508:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320683.489697:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772
00010000:00010000:3.0:1767320684.055217:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320684.503410:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320684.503422:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320684.503425:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320684.503429:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320684.503434:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320684.503441:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5581
00000100:00080000:1.0:1767320684.503446:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320684.503454:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320684.503497:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd500 x1853164380075264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320684.503528:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320684.503532:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320684.503533:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320684.503537:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5581
00000100:00080000:1.0:1767320684.503539:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320684.503543:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320684.503559:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafed80 x1853164380075392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320684.503619:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320684.503623:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320684.503625:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320684.503628:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5581
00000100:00080000:1.0:1767320684.503631:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320684.503634:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320684.503645:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164380075904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320684.503659:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320684.503662:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320684.503663:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320684.503667:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5581
00000100:00080000:1.0:1767320684.503669:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320684.503673:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320684.503682:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafea00 x1853164380076160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320684.503698:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380075520:0@lo:400:kworker.0
00000100:00100000:1.0:1767320684.503702:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380076032:0@lo:400:kworker.0
00000100:00100000:0.0:1767320684.503759:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380075264:0@lo:38:kworker.0
00000100:00100000:3.0:1767320684.504542:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380075648:0@lo:400:kworker.0
00000100:00100000:0.0:1767320684.508931:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320684.509115:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320684.509212:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380075776:0@lo:400:kworker.0
00000100:00100000:3.0:1767320684.509484:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075648
00000100:00100000:3.0:1767320684.509492:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075648
00000100:00100000:3.0:1767320684.509548:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962
00000100:00100000:3.0:1767320684.509557:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380075648:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320684.509615:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380075648:12345-0@lo:400:kworker.0 Request processed in 58us (498us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320684.509622:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962
00000100:00100000:3.0:1767320684.509663:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380075648:0@lo:400:kworker.0
00000100:00100000:2.0:1767320684.509665:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320684.509700:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075520
00000100:00100000:3.0:1767320684.509704:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075520
00000100:00080000:2.0:1767320684.509716:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320684.509726:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963
00000100:00100000:3.0:1767320684.509732:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380075520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320684.509765:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380075520:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320684.509770:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963
00000100:00100000:3.0:1767320684.509793:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380075520:0@lo:400:kworker.0
00000100:00100000:0.0:1767320684.510596:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380075392:0@lo:38:kworker.0
00000100:00100000:0.0:1767320684.510635:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320684.510662:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380075904:0@lo:38:kworker.0
00000100:00100000:0.0:1767320684.510682:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320684.510697:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380076160:0@lo:38:kworker.0
00000100:00100000:0.0:1767320684.510715:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320684.510744:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075264
00000100:00100000:0.0:1767320684.510749:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075264
00000100:00100000:0.0:1767320684.510769:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075904
00000100:00100000:0.0:1767320684.510771:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075904
00000100:00100000:0.0:1767320684.510780:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076160
00000100:00100000:0.0:1767320684.510782:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076160
00000100:00100000:0.0:1767320684.510795:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17958
00000100:00100000:0.0:1767320684.510800:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380075264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320684.510819:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320684.510849:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380075264:12345-0@lo:38:kworker.0 Request processed in 48us (1930us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320684.510855:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17958
00000100:00100000:0.0:1767320684.510889:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17959
00000100:00100000:0.0:1767320684.510895:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380075904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320684.510904:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320684.510925:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380075904:12345-0@lo:38:kworker.0 Request processed in 29us (241us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320684.510930:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17959
00000100:00100000:0.0:1767320684.510939:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17960
00000100:00100000:0.0:1767320684.510943:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380076160:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320684.510962:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320684.510983:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380076160:12345-0@lo:38:kworker.0 Request processed in 39us (267us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320684.510988:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17960
00000100:00100000:0.0:1767320684.511006:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075392
00000100:00100000:0.0:1767320684.511009:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075392
00000100:00100000:0.0:1767320684.511025:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229
00000100:00100000:0.0:1767320684.511030:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3919c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380075392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320684.511039:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320684.511064:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3919c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380075392:12345-0@lo:38:kworker.0 Request processed in 33us (428us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320684.511081:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229
00000100:00080000:0.0:1767320684.511461:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320684.511467:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320684.511470:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380075264:0@lo:38:kworker.0
00000100:00080000:0.0:1767320684.511478:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320684.511481:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320684.511483:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380075392:0@lo:38:kworker.0
00000100:00080000:0.0:1767320684.511489:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320684.511492:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320684.511494:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380075904:0@lo:38:kworker.0
00000100:00080000:0.0:1767320684.511500:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320684.511502:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320684.511504:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380076160:0@lo:38:kworker.0
00000100:00100000:3.0:1767320684.511627:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320684.511925:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380075776
00000100:00100000:0.0:1767320684.511929:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380075776
00000100:00100000:0.0:1767320684.511977:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991
00000100:00100000:0.0:1767320684.511985:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380075776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320684.512032:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380075776:12345-0@lo:400:kworker.0 Request processed in 48us (404us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320684.512038:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991
00000100:00100000:3.0:1767320684.512191:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380075776:0@lo:400:kworker.0
00000100:00080000:2.0:1767320684.512253:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320684.512589:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320684.512849:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076032
00000100:00100000:3.0:1767320684.512854:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076032
00000100:00100000:3.0:1767320684.512938:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4992
00000100:00100000:3.0:1767320684.512947:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380076032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320684.513011:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380076032:12345-0@lo:400:kworker.0 Request processed in 65us (422us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320684.513019:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4992
00000100:00100000:1.0:1767320684.513048:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380076032:0@lo:400:kworker.0
00000100:00080000:2.0:1767320684.513182:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320685.016950:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380076288:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320685.017036:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320685.017281:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076288
00000100:00100000:1.0:1767320685.017292:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076288
00000100:00100000:1.0:1767320685.017352:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773
00000100:00100000:1.0:1767320685.017362:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380076288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320685.017393:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320685.017444:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380076288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (408us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320685.017452:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773
00000100:00100000:2.0:1767320685.017587:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380076288:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320685.079214:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320686.103345:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320686.482212:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320686.482284:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320686.482364:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291987840
00000100:00100000:0.0:1767320686.482376:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291987840
00000100:00100000:3.0:1767320686.482446:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291987712
00000100:00100000:3.0:1767320686.482451:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291987712
00000100:00100000:3.0:1767320686.482495:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17961
00000100:00100000:3.0:1767320686.482503:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291987712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320686.482525:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320686.482592:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291987712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 89us (308us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320686.482600:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17961
00000100:00080000:2.0:1767320686.482721:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320686.482905:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4993
00000100:00100000:0.0:1767320686.482917:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291987840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320686.482984:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291987840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 65us (776us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320686.482991:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4993
00010000:00010000:2.0:1767320687.127751:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320688.151481:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320688.599630:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320688.599655:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380076416:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320688.599733:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320688.599902:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076416
00000100:00100000:3.0:1767320688.599919:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076416
00000100:00100000:3.0:1767320688.599992:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774
00000100:00100000:3.0:1767320688.600004:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380076416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320688.600034:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320688.600095:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380076416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (360us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320688.600103:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774
00000100:00100000:0.0:1767320688.600159:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380076416:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320688.600397:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320689.175052:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320689.622984:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320689.622997:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320689.623000:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320689.623004:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320689.623009:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320689.623017:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5586
00000100:00080000:1.0:1767320689.623022:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320689.623030:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320689.623070:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafd500 x1853164380076544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320689.623097:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320689.623101:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320689.623102:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320689.623107:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5586
00000100:00080000:1.0:1767320689.623116:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320689.623120:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320689.623133:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff800 x1853164380076672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320689.623205:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320689.623208:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320689.623211:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320689.623214:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5586
00000100:00080000:1.0:1767320689.623217:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320689.623221:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320689.623232:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafed80 x1853164380077184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320689.623247:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320689.623251:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320689.623253:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320689.623256:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5586
00000100:00080000:1.0:1767320689.623258:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320689.623262:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320689.623276:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08d7a680 x1853164380077440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320689.623302:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380077056:0@lo:400:kworker.0
00000100:00100000:1.0:1767320689.623366:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320689.623423:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320689.623429:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380077312:0@lo:400:kworker.0
00000100:00100000:1.0:1767320689.623451:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320689.623485:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380077056
00000100:00100000:1.0:1767320689.623493:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380077056
00000100:00100000:1.0:1767320689.623542:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380077312
00000100:00100000:1.0:1767320689.623545:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380077312
00000100:00100000:1.0:1767320689.623568:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4994
00000100:00100000:1.0:1767320689.623576:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380077056:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320689.623624:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380077056:12345-0@lo:400:kworker.0 Request processed in 48us (258us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320689.623632:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4994
00000100:00100000:1.0:1767320689.623652:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4995
00000100:00100000:1.0:1767320689.623657:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380077312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320689.623683:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380077312:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320689.623688:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380076928:0@lo:400:kworker.0
00000100:00100000:1.0:1767320689.623689:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4995
00000100:00080000:1.0:1767320689.623706:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320689.623720:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320689.623741:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380077312:0@lo:400:kworker.0
00000100:00100000:1.0:1767320689.623751:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380077056:0@lo:400:kworker.0
00000100:00100000:0.0:1767320689.624008:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380076544:0@lo:38:kworker.0
00000100:00100000:0.0:1767320689.624038:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320689.624066:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380076672:0@lo:38:kworker.0
00000100:00100000:0.0:1767320689.624087:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320689.624118:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380077184:0@lo:38:kworker.0
00000100:00100000:0.0:1767320689.624137:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320689.624151:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380077440:0@lo:38:kworker.0
00000100:00100000:0.0:1767320689.624167:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320689.624202:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076672
00000100:00100000:0.0:1767320689.624207:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076672
00000100:00100000:0.0:1767320689.624229:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230
00000100:00100000:0.0:1767320689.624234:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380076672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320689.624251:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320689.624281:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380076672:12345-0@lo:38:kworker.0 Request processed in 46us (193us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320689.624286:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230
00000100:00100000:0.0:1767320689.624305:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076544
00000100:00100000:0.0:1767320689.624308:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076544
00000100:00100000:0.0:1767320689.624324:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380077184
00000100:00100000:0.0:1767320689.624326:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380077184
00000100:00100000:0.0:1767320689.624335:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380077440
00000100:00100000:0.0:1767320689.624337:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380077440
00000100:00100000:0.0:1767320689.624346:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17962
00000100:00100000:0.0:1767320689.624350:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380076544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320689.624358:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320689.624382:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380076544:12345-0@lo:38:kworker.0 Request processed in 31us (343us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320689.624387:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17962
00000100:00100000:0.0:1767320689.624397:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17963
00000100:00100000:0.0:1767320689.624400:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380077184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320689.624409:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320689.624431:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380077184:12345-0@lo:38:kworker.0 Request processed in 28us (293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320689.624436:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17963
00000100:00100000:0.0:1767320689.624445:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17964
00000100:00100000:0.0:1767320689.624448:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380077440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320689.624457:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320689.624479:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380077440:12345-0@lo:38:kworker.0 Request processed in 28us (310us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320689.624483:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17964
00000100:00080000:0.0:1767320689.624514:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320689.624519:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320689.624522:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380076544:0@lo:38:kworker.0
00000100:00080000:0.0:1767320689.624530:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320689.624532:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320689.624535:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380076672:0@lo:38:kworker.0
00000100:00080000:0.0:1767320689.624542:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320689.624544:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320689.624547:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380077184:0@lo:38:kworker.0
00000100:00080000:0.0:1767320689.624553:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320689.624556:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320689.624559:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380077440:0@lo:38:kworker.0
00000100:00100000:3.0:1767320689.624704:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076928
00000100:00100000:3.0:1767320689.624709:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076928
00000100:00100000:3.0:1767320689.624754:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964
00000100:00100000:3.0:1767320689.624761:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380076928:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320689.624800:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380076928:12345-0@lo:400:kworker.0 Request processed in 41us (1080us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320689.624806:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964
00000100:00100000:3.0:1767320689.624829:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380076800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320689.624853:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320689.624899:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380076800
00000100:00100000:3.0:1767320689.624914:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380076800
00000100:00100000:3.0:1767320689.624937:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965
00000100:00100000:3.0:1767320689.624943:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380076800:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320689.624975:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380076800:12345-0@lo:400:kworker.0 Request processed in 33us (121us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320689.624981:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965
00000100:00100000:3.0:1767320689.625008:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380076800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320689.625272:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380076928:0@lo:400:kworker.0
00000100:00080000:0.0:1767320689.625424:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320690.135249:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320690.135273:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380077568:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320690.135344:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320690.135554:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380077568
00000100:00100000:1.0:1767320690.135564:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380077568
00000100:00100000:1.0:1767320690.135620:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775
00000100:00100000:1.0:1767320690.135629:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380077568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320690.135658:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320690.135713:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380077568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (368us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320690.135720:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775
00000100:00100000:2.0:1767320690.135815:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380077568:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320690.199097:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:1.0:1767320690.576665:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291987968 offset 0 length 520: 4
00000100:00100000:1.0:1767320690.576731:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320690.576827:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988096
00000100:00100000:2.0:1767320690.576836:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988096
00000100:00100000:2.0:1767320690.576909:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17965
00000100:00100000:2.0:1767320690.576917:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291988096:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320690.576941:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320690.577012:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291988096:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (279us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320690.577020:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17965
00000100:00100000:2.0:1767320690.587928:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320690.588007:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988224
00000100:00100000:1.0:1767320690.588016:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988224
00000100:00080000:0.0:1767320690.588123:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320690.588155:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4996
00000100:00100000:1.0:1767320690.588163:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291988224:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320690.588253:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291988224:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (332us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320690.588261:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4996
00010000:00010000:2.0:1767320691.224390:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320692.247307:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320693.271443:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320693.721301:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320693.721319:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380077696:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320693.721387:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320693.721706:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380077696
00000100:00100000:0.0:1767320693.721714:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380077696
00000100:00100000:0.0:1767320693.721787:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776
00000100:00100000:0.0:1767320693.721797:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380077696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320693.721837:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320693.721915:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380077696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (527us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320693.721923:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776
00000100:00100000:2.0:1767320693.722070:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380077696:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320693.722325:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320694.295616:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320694.743041:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320669/real 1767320669]  req@ffff8b0e04c19c00 x1853164380071296/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320694 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320694.743077:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e04c19c00 x1853164380071296/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320694 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320694.743098:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320694.743116:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320694.743120:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380071296:0@lo:250:kworker.0
00000100:00080000:2.0:1767320694.743334:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320694.743339:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320694.743358:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320694.743362:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5571
00000100:00080000:2.0:1767320694.743366:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320694.743372:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320694.743398:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570e00 x1853164380077824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320694.743421:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320694.743424:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320694.743426:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320694.743429:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5592
00000100:00080000:2.0:1767320694.743431:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320694.743434:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320694.743446:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571f80 x1853164380077952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320694.743455:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320694.743458:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320694.743460:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320694.743463:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5592
00000100:00080000:2.0:1767320694.743465:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320694.743468:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320694.743477:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8000 x1853164380078080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320694.743524:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320694.743527:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320694.743529:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320694.743533:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5592
00000100:00080000:2.0:1767320694.743535:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320694.743538:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320694.743547:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab800 x1853164380078592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320694.743560:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320694.743563:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320694.743565:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320694.743568:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5592
00000100:00080000:2.0:1767320694.743570:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320694.743573:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320694.743583:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063abb80 x1853164380078848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320694.743610:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380078720:0@lo:400:kworker.0
00000100:00100000:2.0:1767320694.743669:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320694.743714:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320694.743719:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380078464:0@lo:400:kworker.0
00000100:00100000:0.0:1767320694.743970:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380077824:0@lo:250:kworker.0
00000400:00000100:0.0:1767320694.743992:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380077824 offset 0 length 520: 4
00000100:00100000:0.0:1767320694.744009:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380077952:0@lo:38:kworker.0
00000100:00100000:1.0:1767320694.744362:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380078208:0@lo:400:kworker.0
00000100:00100000:1.0:1767320694.744396:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320694.744426:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320694.744432:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380078336:0@lo:400:kworker.0
00000100:00100000:1.0:1767320694.744451:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320694.744482:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078720
00000100:00100000:1.0:1767320694.744488:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078720
00000100:00100000:1.0:1767320694.744538:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4997
00000100:00100000:1.0:1767320694.744547:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380078720:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320694.744593:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380078720:12345-0@lo:400:kworker.0 Request processed in 47us (923us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320694.744600:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4997
00000100:00080000:1.0:1767320694.744624:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320694.744688:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078208
00000100:00100000:3.0:1767320694.744693:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078208
00000100:00100000:3.0:1767320694.744729:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078336
00000100:00100000:3.0:1767320694.744732:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078336
00000100:00100000:3.0:1767320694.744758:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966
00000100:00100000:3.0:1767320694.744765:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380078208:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320694.744806:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380078208:12345-0@lo:400:kworker.0 Request processed in 41us (409us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320694.744812:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966
00000100:00100000:3.0:1767320694.744824:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967
00000100:00100000:3.0:1767320694.744831:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380078336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320694.744857:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380078336:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320694.744862:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967
00000100:00080000:1.0:1767320694.745031:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320694.745061:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380078336:0@lo:400:kworker.0
00000100:00100000:1.0:1767320694.745072:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380078208:0@lo:400:kworker.0
00000100:00100000:2.0:1767320694.745138:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320694.745186:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380078720:0@lo:400:kworker.0
00000100:00100000:3.0:1767320694.745205:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078464
00000100:00100000:3.0:1767320694.745210:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078464
00000100:00100000:3.0:1767320694.745256:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4998
00000100:00100000:3.0:1767320694.745263:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380078464:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320694.745301:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380078464:12345-0@lo:400:kworker.0 Request processed in 39us (163us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320694.745306:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4998
00000100:00100000:3.0:1767320694.745333:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380078464:0@lo:400:kworker.0
00000100:00080000:0.0:1767320694.745384:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320694.745427:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320694.745455:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380078080:0@lo:38:kworker.0
00000100:00100000:1.0:1767320694.745483:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320694.745508:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380078592:0@lo:38:kworker.0
00000100:00100000:1.0:1767320694.745529:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320694.745548:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380078848:0@lo:38:kworker.0
00000100:00100000:1.0:1767320694.745568:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320694.745593:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380077952
00000100:00100000:1.0:1767320694.745596:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380077952
00000100:00100000:1.0:1767320694.745614:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078592
00000100:00100000:1.0:1767320694.745616:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078592
00000100:00100000:1.0:1767320694.745627:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078848
00000100:00100000:1.0:1767320694.745629:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078848
00000100:00100000:1.0:1767320694.745638:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17966
00000100:00100000:1.0:1767320694.745642:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380077952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320694.745659:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320694.745692:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380077952:12345-0@lo:38:kworker.0 Request processed in 48us (264us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320694.745698:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17966
00000100:00100000:1.0:1767320694.745712:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17967
00000100:00100000:1.0:1767320694.745716:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380078592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320694.745725:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320694.745748:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380078592:12345-0@lo:38:kworker.0 Request processed in 30us (217us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320694.745753:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17967
00000100:00100000:1.0:1767320694.745764:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17968
00000100:00100000:1.0:1767320694.745767:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380078848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320694.745776:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320694.745797:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380078848:12345-0@lo:38:kworker.0 Request processed in 28us (228us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320694.745933:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078080
00000100:00100000:0.0:1767320694.745938:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078080
00000100:00100000:0.0:1767320694.745969:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231
00000100:00100000:0.0:1767320694.745974:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380078080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320694.745984:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320694.746012:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380078080:12345-0@lo:38:kworker.0 Request processed in 37us (529us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320694.746018:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231
00000100:00080000:0.0:1767320694.746064:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320694.746069:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320694.746073:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380077952:0@lo:38:kworker.0
00000100:00080000:0.0:1767320694.746081:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320694.746084:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320694.746087:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380078080:0@lo:38:kworker.0
00000100:00080000:0.0:1767320694.746093:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320694.746096:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320694.746099:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380078592:0@lo:38:kworker.0
00000100:00080000:0.0:1767320694.746105:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320694.746108:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320694.746110:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380078848:0@lo:38:kworker.0
00000100:00100000:1.0:1767320694.746224:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17968
00000100:00100000:2.0:1767320695.255112:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380078976:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320695.255199:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320695.255309:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380078976
00000100:00100000:1.0:1767320695.255319:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380078976
00000100:00100000:1.0:1767320695.255371:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777
00000100:00100000:1.0:1767320695.255381:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380078976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320695.255409:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320695.255462:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380078976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320695.255470:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777
00000100:00100000:2.0:1767320695.255566:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380078976:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320695.319118:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320695.698756:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320695.698806:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320695.699297:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988480
00000100:00100000:0.0:1767320695.699308:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988480
00000100:00100000:0.0:1767320695.699378:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988352
00000100:00100000:0.0:1767320695.699382:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988352
00000100:00100000:0.0:1767320695.699400:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 4999
00000100:00100000:0.0:1767320695.699410:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291988480:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320695.699477:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291988480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 69us (730us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320695.699484:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 4999
00000100:00100000:0.0:1767320695.699502:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17969
00000100:00100000:0.0:1767320695.699506:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291988352:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320695.699525:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320695.699547:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291988352:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (749us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320695.699553:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17969
00000100:00080000:3.0:1767320695.700940:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767320696.346342:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320697.367531:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320698.391820:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320698.839296:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320698.839323:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380079104:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320698.839394:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320698.839469:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380079104
00000100:00100000:2.0:1767320698.839478:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380079104
00000100:00100000:2.0:1767320698.839527:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778
00000100:00100000:2.0:1767320698.839537:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380079104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320698.839576:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320698.839629:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380079104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (233us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320698.839635:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778
00000100:00100000:2.0:1767320698.839681:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08d7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380079104:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320698.840173:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320699.415794:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320699.879187:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320699.879199:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320699.879204:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320699.879207:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320699.879212:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320699.879220:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5597
00000100:00080000:0.0:1767320699.879225:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320699.879232:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320699.879269:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571f80 x1853164380079232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320699.879290:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320699.879293:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320699.879294:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320699.879298:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5597
00000100:00080000:0.0:1767320699.879300:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320699.879304:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320699.879316:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fce00 x1853164380079360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320699.879415:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380079488:0@lo:400:kworker.0
00000100:00100000:2.0:1767320699.879493:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320699.882076:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320699.882083:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320699.882086:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320699.882093:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5597
00000100:00080000:0.0:1767320699.882096:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320699.882112:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320699.882132:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fc700 x1853164380079872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320699.882158:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320699.882162:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320699.882164:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320699.882167:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5597
00000100:00080000:0.0:1767320699.882169:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320699.882173:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320699.882183:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f3100 x1853164380080128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320699.882227:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380079744:0@lo:400:kworker.0
00000100:00100000:0.0:1767320699.882289:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320699.882321:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320699.882326:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380080000:0@lo:400:kworker.0
00000100:00100000:0.0:1767320699.882367:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320699.882397:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380079744
00000100:00100000:0.0:1767320699.882404:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380079744
00000100:00100000:0.0:1767320699.882456:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080000
00000100:00100000:0.0:1767320699.882460:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080000
00000100:00100000:0.0:1767320699.882485:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5000
00000100:00100000:0.0:1767320699.882493:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380079744:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320699.882543:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380079744:12345-0@lo:400:kworker.0 Request processed in 50us (252us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320699.882550:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5000
00000100:00100000:0.0:1767320699.882567:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5001
00000100:00100000:0.0:1767320699.882573:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380080000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320699.882598:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380080000:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320699.882604:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5001
00000100:00100000:0.0:1767320699.882652:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380080000:0@lo:400:kworker.0
00000100:00100000:0.0:1767320699.882662:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380079744:0@lo:400:kworker.0
00000100:00080000:0.0:1767320699.882687:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320699.882698:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320699.882705:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380079616:0@lo:400:kworker.0
00000100:00100000:0.0:1767320699.882732:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320699.882810:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380079232:0@lo:38:kworker.0
00000100:00100000:1.0:1767320699.882843:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320699.882863:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380079360:0@lo:38:kworker.0
00000100:00100000:1.0:1767320699.882910:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320699.882934:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380079872:0@lo:38:kworker.0
00000100:00100000:1.0:1767320699.882952:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320699.882964:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380080128:0@lo:38:kworker.0
00000100:00100000:1.0:1767320699.882981:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320699.883010:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380079360
00000100:00100000:1.0:1767320699.883013:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380079360
00000100:00100000:1.0:1767320699.883035:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232
00000100:00100000:1.0:1767320699.883041:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380079360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320699.883057:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320699.883091:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380079360:12345-0@lo:38:kworker.0 Request processed in 49us (180us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320699.883096:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232
00000100:00080000:1.0:1767320699.883137:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320699.883142:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320699.883146:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380079360:0@lo:38:kworker.0
00000100:00100000:1.0:1767320699.885708:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380079232
00000100:00100000:1.0:1767320699.885733:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380079232
00000100:00100000:1.0:1767320699.885793:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380079872
00000100:00100000:1.0:1767320699.885796:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380079872
00000100:00100000:1.0:1767320699.885812:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080128
00000100:00100000:1.0:1767320699.885815:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080128
00000100:00100000:1.0:1767320699.885838:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17970
00000100:00100000:1.0:1767320699.885846:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380079232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320699.885883:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320699.885982:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380079232:12345-0@lo:38:kworker.0 Request processed in 136us (3137us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320699.885989:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17970
00000100:00100000:1.0:1767320699.886010:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17971
00000100:00100000:1.0:1767320699.886013:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380079872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320699.886022:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320699.886046:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380079872:12345-0@lo:38:kworker.0 Request processed in 31us (3092us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320699.886051:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17971
00000100:00100000:1.0:1767320699.886062:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17972
00000100:00100000:1.0:1767320699.886065:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380080128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320699.886074:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320699.886096:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380080128:12345-0@lo:38:kworker.0 Request processed in 29us (3114us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320699.886112:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17972
00000100:00080000:1.0:1767320699.886161:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320699.886168:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320699.886172:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380079232:0@lo:38:kworker.0
00000100:00080000:1.0:1767320699.886182:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320699.886185:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320699.886188:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380079872:0@lo:38:kworker.0
00000100:00080000:1.0:1767320699.886195:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320699.886198:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320699.886201:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380080128:0@lo:38:kworker.0
00000100:00100000:3.0:1767320699.890832:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380079488
00000100:00100000:3.0:1767320699.890850:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380079488
00000100:00100000:3.0:1767320699.891173:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380079616
00000100:00100000:3.0:1767320699.891179:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380079616
00000100:00080000:0.0:1767320699.892231:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320699.892797:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968
00000100:00100000:2.0:1767320699.892818:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380079488:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320699.892939:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380079488:12345-0@lo:400:kworker.0 Request processed in 129us (13444us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320699.892946:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968
00000100:00100000:0.0:1767320699.893188:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380079488:0@lo:400:kworker.0
00000100:00100000:2.0:1767320699.893260:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969
00000100:00100000:2.0:1767320699.893271:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380079616:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320699.893317:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380079616:12345-0@lo:400:kworker.0 Request processed in 50us (10584us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320699.893323:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969
00000100:00100000:0.0:1767320699.893398:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380079616:0@lo:400:kworker.0
00000100:00100000:1.0:1767320700.375347:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320700.375376:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380080256:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320700.375459:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320700.375538:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080256
00000100:00100000:1.0:1767320700.375546:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080256
00000100:00100000:1.0:1767320700.375595:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779
00000100:00100000:1.0:1767320700.375603:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380080256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320700.375631:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320700.375694:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380080256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (225us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320700.375701:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779
00000100:00100000:1.0:1767320700.375754:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380080256:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320700.439219:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320700.831970:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320700.832003:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320700.832195:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988608
00000100:00100000:1.0:1767320700.832205:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988608
00000100:00100000:1.0:1767320700.832249:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988736
00000100:00100000:1.0:1767320700.832252:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988736
00000100:00100000:1.0:1767320700.832309:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5002
00000100:00100000:1.0:1767320700.832320:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291988736:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320700.832390:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291988736:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 72us (385us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320700.832399:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5002
00000100:00100000:1.0:1767320700.832420:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17973
00000100:00100000:1.0:1767320700.832424:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291988608:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320700.832444:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320700.832471:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291988608:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (512us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320700.832477:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17973
00000100:00080000:0.0:1767320700.832644:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320701.463449:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320702.487116:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320703.512254:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320703.961076:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320703.961105:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380080384:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320703.961184:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320703.961624:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080384
00000100:00100000:1.0:1767320703.961634:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080384
00000100:00100000:1.0:1767320703.961719:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780
00000100:00100000:1.0:1767320703.961730:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380080384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320703.961769:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320703.961832:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380080384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (647us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320703.961839:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780
00000100:00080000:0.0:1767320703.961928:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320703.962075:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380080384:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320704.535044:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320704.984828:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320704.984840:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320704.984843:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320704.984847:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320704.984852:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320704.984860:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5602
00000100:00080000:1.0:1767320704.984865:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320704.984889:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320704.984930:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063aaa00 x1853164380080512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320704.984964:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320704.984968:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320704.984970:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320704.984974:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5602
00000100:00080000:1.0:1767320704.984976:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320704.984980:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320704.984993:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8380 x1853164380080640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320704.985070:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320704.985074:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320704.985075:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320704.985079:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5602
00000100:00080000:1.0:1767320704.985081:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320704.985084:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320704.985096:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571f80 x1853164380081152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320704.985110:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320704.985113:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320704.985115:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320704.985118:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5602
00000100:00080000:1.0:1767320704.985120:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320704.985124:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320704.985131:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff100 x1853164380081408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320704.985158:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380081280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320704.985234:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320704.985302:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320704.985308:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380081024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320704.985331:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320704.985409:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380080768:0@lo:400:kworker.0
00000100:00100000:0.0:1767320704.985440:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320704.985469:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320704.985474:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380080896:0@lo:400:kworker.0
00000100:00100000:0.0:1767320704.985496:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320704.985525:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081280
00000100:00100000:0.0:1767320704.985534:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081280
00000100:00100000:0.0:1767320704.985597:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081024
00000100:00100000:0.0:1767320704.985601:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081024
00000100:00100000:0.0:1767320704.985626:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5003
00000100:00100000:0.0:1767320704.985635:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380081280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320704.985686:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380081280:12345-0@lo:400:kworker.0 Request processed in 52us (452us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320704.985698:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5003
00000100:00100000:0.0:1767320704.985714:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5004
00000100:00100000:0.0:1767320704.985719:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380081024:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320704.985741:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380081024:12345-0@lo:400:kworker.0 Request processed in 22us (409us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320704.985746:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5004
00000100:00080000:0.0:1767320704.985762:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320704.985799:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380081024:0@lo:400:kworker.0
00000100:00100000:0.0:1767320704.985810:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380081280:0@lo:400:kworker.0
00000100:00100000:3.0:1767320704.986265:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080768
00000100:00100000:3.0:1767320704.986270:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080768
00000100:00100000:3.0:1767320704.986321:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080896
00000100:00100000:3.0:1767320704.986324:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080896
00000100:00100000:3.0:1767320704.986350:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970
00000100:00100000:3.0:1767320704.986357:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380080768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320704.986406:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380080768:12345-0@lo:400:kworker.0 Request processed in 49us (965us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320704.986412:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970
00000100:00100000:3.0:1767320704.986423:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971
00000100:00100000:3.0:1767320704.986428:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380080896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320704.986453:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380080896:12345-0@lo:400:kworker.0 Request processed in 25us (956us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320704.986459:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971
00000100:00080000:3.0:1767320704.986471:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320704.986489:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380080896:0@lo:400:kworker.0
00000100:00100000:3.0:1767320704.986498:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380080768:0@lo:400:kworker.0
00000100:00100000:2.0:1767320704.986755:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380080512:0@lo:38:kworker.0
00000100:00100000:2.0:1767320704.986791:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320704.986819:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380080640:0@lo:38:kworker.0
00000100:00100000:2.0:1767320704.986840:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320704.986901:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380081152:0@lo:38:kworker.0
00000100:00100000:2.0:1767320704.986922:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320704.986943:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380081408:0@lo:38:kworker.0
00000100:00100000:2.0:1767320704.986962:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320704.986991:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080512
00000100:00100000:2.0:1767320704.986995:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080512
00000100:00100000:2.0:1767320704.987016:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081152
00000100:00100000:2.0:1767320704.987019:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081152
00000100:00100000:2.0:1767320704.987032:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081408
00000100:00100000:2.0:1767320704.987035:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081408
00000100:00100000:2.0:1767320704.987047:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17974
00000100:00100000:2.0:1767320704.987062:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380080512:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320704.987081:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320704.987115:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380080512:12345-0@lo:38:kworker.0 Request processed in 62us (324us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320704.987122:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17974
00000100:00100000:2.0:1767320704.987135:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17975
00000100:00100000:2.0:1767320704.987139:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380081152:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320704.987148:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320704.987655:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17976
00000100:00100000:3.0:1767320704.987662:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380081408:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320704.987675:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320704.987693:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380080640
00000100:00100000:0.0:1767320704.987700:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380080640
00000100:00100000:3.0:1767320704.987709:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380081408:12345-0@lo:38:kworker.0 Request processed in 46us (745us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320704.987717:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17976
00000100:00100000:0.0:1767320704.987726:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233
00000100:00100000:0.0:1767320704.987732:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380080640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320704.987743:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320704.987776:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1767320704.987783:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380080640:12345-0@lo:38:kworker.0 Request processed in 47us (939us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767320704.987785:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320704.987792:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380080512:0@lo:38:kworker.0
00000100:00100000:0.0:1767320704.987797:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233
00000100:00080000:3.0:1767320704.987808:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320704.987813:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320704.987817:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380080640:0@lo:38:kworker.0
00000100:00080000:3.0:1767320704.987827:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320704.987832:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320704.987835:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380081152:0@lo:38:kworker.0
00000100:00080000:3.0:1767320704.987843:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320704.987846:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320704.987849:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380081408:0@lo:38:kworker.0
00000100:00100000:2.0:1767320704.987947:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380081152:12345-0@lo:38:kworker.0 Request processed in 30us (247us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320704.987955:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17975
00000100:00100000:3.0:1767320705.495132:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380081536:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320705.495207:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320705.495362:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081536
00000100:00100000:1.0:1767320705.495372:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081536
00000100:00100000:1.0:1767320705.495432:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781
00000100:00100000:1.0:1767320705.495442:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380081536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320705.495473:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320705.495526:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380081536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (317us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320705.495533:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781
00000100:00100000:1.0:1767320705.495589:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380081536:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320705.560615:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320705.937460:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320705.937560:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988864
00000100:00100000:1.0:1767320705.937568:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988864
00000100:00100000:1.0:1767320705.937612:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17977
00000100:00100000:1.0:1767320705.937618:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291988864:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320705.937639:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320705.937695:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291988864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 77us (247us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320705.937701:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17977
00000100:00100000:3.0:1767320705.944414:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320705.944564:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291988992
00000100:00100000:1.0:1767320705.944573:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291988992
00000100:00100000:1.0:1767320705.944634:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5005
00000100:00100000:1.0:1767320705.944641:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291988992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320705.944709:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291988992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 69us (304us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320705.944714:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5005
00000100:00080000:3.0:1767320705.945474:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320706.583208:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320707.607262:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320708.631333:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320709.079226:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380081664:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320709.079288:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320709.079392:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081664
00000100:00100000:1.0:1767320709.079399:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081664
00000100:00100000:1.0:1767320709.079456:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782
00000100:00100000:1.0:1767320709.079477:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380081664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320709.079503:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320709.079538:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380081664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (249us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320709.079543:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782
00000100:00080000:2.0:1767320709.079697:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320709.079727:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380081664:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320709.667918:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320710.103442:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320710.103458:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320710.103461:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320710.104218:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320710.104224:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320710.104233:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5607
00000100:00080000:0.0:1767320710.104239:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320710.104250:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320710.104311:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc380 x1853164380081792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320710.104345:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320710.104349:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320710.104351:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320710.104355:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5607
00000100:00080000:0.0:1767320710.104357:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320710.104361:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320710.104376:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164380081920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320710.104452:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380082048:0@lo:400:kworker.0
00000100:00100000:3.0:1767320710.104554:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320710.104691:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082048
00000100:00100000:1.0:1767320710.104703:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082048
00000100:00100000:1.0:1767320710.104770:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972
00000100:00100000:1.0:1767320710.104782:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380082048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320710.104984:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380081792:0@lo:38:kworker.0
00000100:00100000:2.0:1767320710.105051:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320710.105078:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380081920:0@lo:38:kworker.0
00000100:00100000:2.0:1767320710.105105:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320710.105161:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081920
00000100:00100000:2.0:1767320710.105166:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081920
00000100:00100000:2.0:1767320710.105196:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234
00000100:00100000:2.0:1767320710.105201:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380081920:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320710.105226:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320710.105265:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380081920:12345-0@lo:38:kworker.0 Request processed in 62us (159us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320710.105273:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234
00000100:00100000:2.0:1767320710.105302:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380081792
00000100:00100000:2.0:1767320710.105308:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380081792
00000100:00100000:2.0:1767320710.105332:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17978
00000100:00100000:2.0:1767320710.105337:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380081792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320710.105348:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320710.105374:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380081792:12345-0@lo:38:kworker.0 Request processed in 35us (322us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320710.105380:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17978
00000100:00080000:2.0:1767320710.105422:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320710.105428:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320710.105432:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380081792:0@lo:38:kworker.0
00000100:00080000:2.0:1767320710.105443:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320710.105446:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320710.105449:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380081920:0@lo:38:kworker.0
00000100:00100000:2.0:1767320710.105510:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380082176:0@lo:400:kworker.0
00000100:00100000:2.0:1767320710.105540:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320710.105571:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082176
00000100:00100000:2.0:1767320710.105574:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082176
00000100:00100000:2.0:1767320710.105615:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973
00000100:00100000:2.0:1767320710.105622:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380082176:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320710.105658:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380082176:12345-0@lo:400:kworker.0 Request processed in 36us (117us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320710.105664:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973
00000100:00080000:2.0:1767320710.105684:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320710.105712:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380082176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320710.109289:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380082048:12345-0@lo:400:kworker.0 Request processed in 4489us (4714us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320710.109311:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972
00000100:00080000:0.0:1767320710.112778:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320710.112787:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320710.112791:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320710.112801:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5607
00000100:00080000:0.0:1767320710.112808:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320710.112817:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320710.112847:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc700 x1853164380082432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320710.112894:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320710.112898:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320710.112900:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320710.112904:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5607
00000100:00080000:0.0:1767320710.112906:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320710.112912:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320710.112923:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08effb80 x1853164380082688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320710.112975:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380082560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320710.113088:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320710.113138:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320710.113144:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380082304:0@lo:400:kworker.0
00000100:00100000:0.0:1767320710.113168:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320710.113205:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082560
00000100:00100000:0.0:1767320710.113225:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082560
00000100:00100000:0.0:1767320710.113292:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082304
00000100:00100000:0.0:1767320710.113296:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082304
00000100:00100000:0.0:1767320710.113334:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5006
00000100:00100000:0.0:1767320710.113344:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380082560:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320710.113404:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380082560:12345-0@lo:400:kworker.0 Request processed in 62us (317us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320710.113413:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5006
00000100:00100000:0.0:1767320710.113434:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007
00000100:00100000:0.0:1767320710.113442:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380082304:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320710.113480:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380082304:12345-0@lo:400:kworker.0 Request processed in 39us (311us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320710.113486:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007
00000100:00080000:0.0:1767320710.113505:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320710.113544:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380082304:0@lo:400:kworker.0
00000100:00100000:0.0:1767320710.113555:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380082560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320710.113588:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380082432:0@lo:38:kworker.0
00000100:00100000:0.0:1767320710.113612:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320710.113628:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380082688:0@lo:38:kworker.0
00000100:00100000:0.0:1767320710.113646:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320710.113668:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082432
00000100:00100000:0.0:1767320710.113671:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082432
00000100:00100000:0.0:1767320710.113696:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082688
00000100:00100000:0.0:1767320710.113699:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082688
00000100:00100000:0.0:1767320710.113713:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17979
00000100:00100000:0.0:1767320710.113718:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380082432:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320710.113740:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320710.113781:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380082432:12345-0@lo:38:kworker.0 Request processed in 60us (167us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320710.113788:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17979
00000100:00100000:0.0:1767320710.113800:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17980
00000100:00100000:0.0:1767320710.113804:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380082688:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320710.113814:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320710.113837:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380082688:12345-0@lo:38:kworker.0 Request processed in 31us (190us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320710.113843:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17980
00000100:00080000:0.0:1767320710.113893:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320710.113898:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320710.113901:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380082432:0@lo:38:kworker.0
00000100:00080000:0.0:1767320710.113910:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320710.113913:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320710.113916:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380082688:0@lo:38:kworker.0
00000100:00100000:3.0:1767320710.116735:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380082048:0@lo:400:kworker.0
00000100:00100000:2.0:1767320710.615368:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320710.615981:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380082816:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320710.616096:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320710.616369:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082816
00000100:00100000:1.0:1767320710.616393:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082816
00000100:00100000:1.0:1767320710.616470:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783
00000100:00100000:1.0:1767320710.616482:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380082816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320710.616688:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320710.616748:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380082816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 269us (653us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320710.616756:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783
00000100:00100000:2.0:1767320710.616947:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380082816:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320710.682580:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320711.056289:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320711.056769:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291989248
00000100:00100000:1.0:1767320711.056786:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291989248
00000100:00100000:1.0:1767320711.056952:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5008
00000100:00100000:1.0:1767320711.056965:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291989248:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767320711.057021:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320711.057105:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291989248:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 141us (824us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320711.057116:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5008
00000100:00100000:2.0:1767320711.060332:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320711.060750:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291989120
00000100:00100000:1.0:1767320711.060763:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291989120
00000100:00100000:1.0:1767320711.060830:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17981
00000100:00100000:1.0:1767320711.060840:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291989120:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320711.060909:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320711.061007:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291989120:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 157us (690us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320711.061017:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17981
00010000:00010000:1.0:1767320711.704649:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320712.727241:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320713.751418:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320714.199245:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320714.199273:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380082944:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320714.199373:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320714.199561:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380082944
00000100:00100000:1.0:1767320714.199573:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380082944
00000100:00100000:1.0:1767320714.199673:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784
00000100:00100000:1.0:1767320714.199685:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380082944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320714.199735:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320714.199805:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380082944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (431us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320714.199812:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784
00000100:00100000:3.0:1767320714.200007:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380082944:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320714.200266:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320714.777504:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320715.223234:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320715.223246:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320715.223250:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320715.223255:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320715.223260:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320715.223270:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5612
00000100:00080000:1.0:1767320715.223275:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320715.223284:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320715.223339:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafdc00 x1853164380083072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320715.223373:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320715.223377:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320715.223379:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320715.223383:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5612
00000100:00080000:1.0:1767320715.223385:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320715.223389:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320715.223400:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baffb80 x1853164380083200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320715.223466:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320715.223470:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320715.223472:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320715.223476:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5612
00000100:00080000:1.0:1767320715.223478:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320715.223481:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320715.223494:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ff100 x1853164380083712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320715.223508:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320715.223511:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320715.223513:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320715.223516:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5612
00000100:00080000:1.0:1767320715.223518:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320715.223522:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320715.223530:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fc000 x1853164380083968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320715.223560:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380083840:0@lo:400:kworker.0
00000100:00100000:1.0:1767320715.223643:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320715.223712:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320715.223719:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380083584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320715.223742:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320715.223774:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083840
00000100:00100000:1.0:1767320715.223782:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083840
00000100:00100000:1.0:1767320715.223842:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083584
00000100:00100000:1.0:1767320715.223845:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083584
00000100:00100000:2.0:1767320715.224113:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380083072:0@lo:38:kworker.0
00000100:00100000:2.0:1767320715.224151:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320715.224176:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380083200:0@lo:38:kworker.0
00000100:00100000:2.0:1767320715.224208:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320715.224233:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380083712:0@lo:38:kworker.0
00000100:00100000:2.0:1767320715.224250:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320715.224261:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380083968:0@lo:38:kworker.0
00000100:00100000:2.0:1767320715.224276:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320715.224300:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083200
00000100:00100000:2.0:1767320715.224303:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083200
00000100:00100000:2.0:1767320715.224327:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235
00000100:00100000:2.0:1767320715.224334:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380083200:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320715.224370:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320715.224412:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380083200:12345-0@lo:38:kworker.0 Request processed in 77us (202us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320715.224419:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235
00000100:00080000:2.0:1767320715.224462:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320715.224467:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320715.224471:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380083200:0@lo:38:kworker.0
00000100:00100000:0.0:1767320715.224617:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380083456:0@lo:400:kworker.0
00000100:00100000:0.0:1767320715.224648:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320715.224677:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320715.224683:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380083328:0@lo:400:kworker.0
00000100:00100000:0.0:1767320715.224703:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320715.224728:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320715.224743:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083072
00000100:00100000:0.0:1767320715.224746:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083072
00000100:00100000:0.0:1767320715.224759:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083712
00000100:00100000:0.0:1767320715.224761:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083712
00000100:00100000:0.0:1767320715.224765:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083968
00000100:00100000:0.0:1767320715.224767:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083968
00000100:00100000:0.0:1767320715.224773:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5009
00000100:00100000:0.0:1767320715.224779:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380083840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320715.224829:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380083840:12345-0@lo:400:kworker.0 Request processed in 50us (1184us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320715.224835:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5009
00000100:00100000:0.0:1767320715.224855:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010
00000100:00100000:0.0:1767320715.224862:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380083584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320715.224929:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380083584:12345-0@lo:400:kworker.0 Request processed in 68us (1186us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320715.224936:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010
00000100:00100000:0.0:1767320715.224954:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17982
00000100:00100000:0.0:1767320715.224966:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380083072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320715.224979:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320715.225010:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380083072:12345-0@lo:38:kworker.0 Request processed in 50us (858us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320715.225015:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17982
00000100:00100000:0.0:1767320715.225029:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17983
00000100:00100000:0.0:1767320715.225033:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380083712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320715.225041:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320715.225059:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380083712:12345-0@lo:38:kworker.0 Request processed in 25us (808us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320715.225064:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17983
00000100:00100000:0.0:1767320715.225073:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17984
00000100:00100000:0.0:1767320715.225076:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380083968:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320715.225083:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320715.225099:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380083968:12345-0@lo:38:kworker.0 Request processed in 22us (821us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320715.225104:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17984
00000100:00100000:0.0:1767320715.225151:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380083584:0@lo:400:kworker.0
00000100:00100000:0.0:1767320715.225163:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380083840:0@lo:400:kworker.0
00000100:00100000:2.0:1767320715.227448:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083456
00000100:00100000:2.0:1767320715.227467:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083456
00000100:00100000:2.0:1767320715.227557:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380083328
00000100:00100000:2.0:1767320715.227561:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380083328
00000100:00100000:2.0:1767320715.227600:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974
00000100:00100000:2.0:1767320715.227611:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380083456:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320715.227736:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380083456:12345-0@lo:400:kworker.0 Request processed in 127us (3085us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320715.227745:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974
00000100:00100000:2.0:1767320715.227799:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975
00000100:00100000:2.0:1767320715.227807:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380083328:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320715.227841:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380083328:12345-0@lo:400:kworker.0 Request processed in 36us (3138us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320715.227847:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975
00000100:00080000:2.0:1767320715.227941:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320715.227948:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320715.227952:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380083072:0@lo:38:kworker.0
00000100:00080000:2.0:1767320715.227978:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320715.227982:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320715.227986:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380083712:0@lo:38:kworker.0
00000100:00080000:2.0:1767320715.227999:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320715.228003:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320715.228006:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380083968:0@lo:38:kworker.0
00000100:00080000:0.0:1767320715.228566:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320715.228609:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380083328:0@lo:400:kworker.0
00000100:00100000:0.0:1767320715.228626:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380083456:0@lo:400:kworker.0
00000100:00100000:3.0:1767320715.735732:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380084096:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320715.735842:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320715.736268:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380084096
00000100:00100000:2.0:1767320715.736280:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380084096
00000100:00100000:2.0:1767320715.736436:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785
00000100:00100000:2.0:1767320715.736448:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380084096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320715.736493:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320715.736569:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380084096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (727us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320715.736577:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785
00000100:00100000:3.0:1767320715.736677:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380084096:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320715.800340:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1767320716.176065:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291989376 offset 0 length 520: 4
00000100:00100000:3.0:1767320716.176109:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320716.176150:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320716.176300:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291989504
00000100:00100000:0.0:1767320716.176309:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291989504
00000100:00100000:0.0:1767320716.176352:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291989632
00000100:00100000:0.0:1767320716.176355:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291989632
00000100:00100000:0.0:1767320716.176400:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5011
00000100:00100000:0.0:1767320716.176410:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291989632:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320716.176491:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291989632:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (340us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320716.176500:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5011
00000100:00100000:0.0:1767320716.176520:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17985
00000100:00100000:0.0:1767320716.176525:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291989504:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320716.176782:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320716.176866:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320716.176937:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291989504:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 410us (827us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320716.176945:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17985
00010000:00010000:1.0:1767320716.823822:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320717.851394:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320718.871320:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320719.319021:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320694/real 1767320694]  req@ffff8b0e0c570e00 x1853164380077824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320719.319054:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0c570e00 x1853164380077824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320719.319074:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320719.319101:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320719.319105:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380077824:0@lo:250:kworker.0
00000100:00080000:1.0:1767320719.319230:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320719.319236:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320719.319239:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320719.319246:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5597
00000100:00080000:1.0:1767320719.319250:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320719.319256:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320719.319269:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320719.319281:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ff480 x1853164380084352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320719.319284:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380084224:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320719.319307:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320719.319311:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320719.319313:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320719.319317:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5617
00000100:00080000:1.0:1767320719.319320:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320719.319324:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320719.319341:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fdc00 x1853164380084480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320719.319346:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320719.319357:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320719.319360:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320719.319362:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320719.319366:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5617
00000100:00080000:1.0:1767320719.319369:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320719.319372:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320719.319385:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd880 x1853164380084608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320719.319417:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320719.319422:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320719.319423:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320719.319428:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5617
00000100:00080000:1.0:1767320719.319430:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320719.319434:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320719.319438:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380084224
00000100:00100000:1.0:1767320719.319446:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fca80 x1853164380084992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320719.319447:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380084224
00000100:00080000:2.0:1767320719.319673:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320719.319689:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320719.319694:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320719.319696:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320719.319701:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5617
00000100:00080000:1.0:1767320719.319703:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320719.319709:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320719.319723:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fdf80 x1853164380085248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320719.319733:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786
00000100:00100000:3.0:1767320719.319747:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380084224:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320719.319753:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380084352:0@lo:250:kworker.0
00002000:00000024:3.0:1767320719.319778:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000400:00000100:1.0:1767320719.319779:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380084352 offset 0 length 520: 4
00000100:00100000:0.0:1767320719.319837:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380084864:0@lo:400:kworker.0
00000100:00100000:3.0:1767320719.319855:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380084224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (508us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320719.319864:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786
00000100:00100000:0.0:1767320719.319890:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320719.319915:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380085120:0@lo:400:kworker.0
00000100:00100000:3.0:1767320719.319959:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320719.320356:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380084864
00000100:00100000:2.0:1767320719.320362:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380084864
00000100:00100000:2.0:1767320719.320403:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380085120
00000100:00100000:2.0:1767320719.320405:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380085120
00000100:00100000:2.0:1767320719.320418:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5012
00000100:00100000:2.0:1767320719.320423:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380084864:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320719.320456:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380084864:12345-0@lo:400:kworker.0 Request processed in 33us (567us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320719.320469:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5012
00000100:00100000:2.0:1767320719.320480:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5013
00000100:00100000:2.0:1767320719.320484:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380085120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320719.320508:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380085120:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320719.320511:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5013
00000100:00080000:2.0:1767320719.320527:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320719.320541:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380084736:0@lo:400:kworker.0
00000100:00100000:2.0:1767320719.320562:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320719.324382:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380084480:0@lo:38:kworker.0
00000100:00100000:1.0:1767320719.324464:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320719.324507:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380084608:0@lo:38:kworker.0
00000100:00100000:1.0:1767320719.324534:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320719.324553:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380084992:0@lo:38:kworker.0
00000100:00100000:1.0:1767320719.324574:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320719.324728:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380084864:0@lo:400:kworker.0
00000100:00100000:0.0:1767320719.324799:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380084736
00000100:00100000:0.0:1767320719.324807:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380084736
00000100:00100000:0.0:1767320719.324865:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976
00000100:00100000:0.0:1767320719.324894:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380084736:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320719.324957:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380084736:12345-0@lo:400:kworker.0 Request processed in 65us (4393us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320719.324964:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976
00000100:00100000:1.0:1767320719.325727:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380085248:0@lo:38:kworker.0
00000100:00100000:1.0:1767320719.325765:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320719.329728:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380085120:0@lo:400:kworker.0
00000100:00100000:3.0:1767320719.329761:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380084224:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320719.329900:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380084608
00000100:00100000:3.0:1767320719.329908:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380084608
00000100:00100000:3.0:1767320719.329966:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236
00000100:00100000:3.0:1767320719.329973:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380084608:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320719.329991:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320719.330065:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380084608:12345-0@lo:38:kworker.0 Request processed in 91us (5529us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320719.330073:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236
00000100:00080000:1.0:1767320719.330288:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320719.330295:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320719.330299:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380084608:0@lo:38:kworker.0
00000100:00100000:0.0:1767320719.330365:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380084480
00000100:00100000:0.0:1767320719.330370:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380084480
00000100:00100000:0.0:1767320719.330394:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380084992
00000100:00100000:0.0:1767320719.330397:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380084992
00000100:00100000:0.0:1767320719.330408:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380085248
00000100:00100000:0.0:1767320719.330410:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380085248
00000100:00100000:0.0:1767320719.330420:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17986
00000100:00100000:0.0:1767320719.330424:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380084480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320719.330435:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320719.330468:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380084480:12345-0@lo:38:kworker.0 Request processed in 43us (6005us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320719.330474:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17986
00000100:00100000:0.0:1767320719.330486:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17987
00000100:00100000:0.0:1767320719.330489:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380084992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320719.330497:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320719.330518:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380084992:12345-0@lo:38:kworker.0 Request processed in 27us (5944us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320719.330523:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17987
00000100:00100000:0.0:1767320719.330534:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17988
00000100:00100000:0.0:1767320719.330538:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380085248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320719.330546:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320719.330570:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380085248:12345-0@lo:38:kworker.0 Request processed in 31us (4805us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320719.330576:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17988
00000100:00080000:0.0:1767320719.330612:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767320719.330644:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320719.330649:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320719.330652:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380084480:0@lo:38:kworker.0
00000100:00080000:0.0:1767320719.330662:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320719.330665:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320719.330668:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380084992:0@lo:38:kworker.0
00000100:00080000:0.0:1767320719.330675:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320719.330678:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320719.330680:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380085248:0@lo:38:kworker.0
00000100:00100000:2.0:1767320719.333181:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380084736:0@lo:400:kworker.0
00010000:00010000:1.0:1767320719.895103:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320720.855292:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320720.855317:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380085376:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320720.855406:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320720.855610:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380085376
00000100:00100000:1.0:1767320720.855620:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380085376
00000100:00100000:1.0:1767320720.855683:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787
00000100:00100000:1.0:1767320720.855695:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380085376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320720.855740:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320720.855790:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380085376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (383us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320720.855797:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787
00000100:00100000:3.0:1767320720.856855:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380085376:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767320720.919409:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320721.295768:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320721.295959:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320721.315190:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291989888
00000100:00100000:1.0:1767320721.315213:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291989888
00000100:00100000:1.0:1767320721.315322:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291989760
00000100:00100000:1.0:1767320721.315326:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291989760
00000100:00100000:1.0:1767320721.315360:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5014
00000100:00100000:1.0:1767320721.315371:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291989888:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320721.315467:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291989888:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 97us (19710us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320721.315475:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5014
00000100:00100000:1.0:1767320721.315498:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17989
00000100:00100000:1.0:1767320721.315503:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291989760:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320721.315523:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320721.315552:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291989760:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (19605us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320721.315558:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17989
00000100:00080000:0.0:1767320721.316389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320721.945305:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767320722.968749:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320723.991272:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320724.439267:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320724.439279:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320724.439291:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320724.439295:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320724.439298:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320724.439307:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5621
00000100:00080000:0.0:1767320724.439312:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320724.439318:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320724.439360:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd500 x1853164380085504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320724.439395:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320724.439398:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320724.439400:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320724.439403:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5621
00000100:00080000:0.0:1767320724.439406:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320724.439409:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320724.439421:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164380085632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320724.439472:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320724.439475:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320724.439477:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320724.439481:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5621
00000100:00080000:0.0:1767320724.439483:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320724.439486:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320724.439495:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063aaa00 x1853164380086144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320724.439509:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320724.439511:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320724.439513:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320724.439516:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5621
00000100:00080000:0.0:1767320724.439518:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320724.439521:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320724.439530:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9880 x1853164380086400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320724.439670:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380085504:0@lo:38:kworker.0
00000100:00100000:1.0:1767320724.439742:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320724.439818:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380085632:0@lo:38:kworker.0
00000100:00100000:1.0:1767320724.439845:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320724.439865:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380086144:0@lo:38:kworker.0
00000100:00100000:1.0:1767320724.439953:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320724.439969:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380086400:0@lo:38:kworker.0
00000100:00100000:1.0:1767320724.439997:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320724.440032:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380085504
00000100:00100000:1.0:1767320724.440040:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380085504
00000100:00100000:1.0:1767320724.440071:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086144
00000100:00100000:1.0:1767320724.440074:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086144
00000100:00100000:1.0:1767320724.440089:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086400
00000100:00100000:1.0:1767320724.440091:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086400
00000100:00100000:1.0:1767320724.440110:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17990
00000100:00100000:1.0:1767320724.440117:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380085504:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320724.440138:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320724.440179:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380085504:12345-0@lo:38:kworker.0 Request processed in 60us (437us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320724.440186:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17990
00000100:00100000:1.0:1767320724.440205:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17991
00000100:00100000:1.0:1767320724.440209:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380086144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320724.440219:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320724.440244:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380086144:12345-0@lo:38:kworker.0 Request processed in 33us (290us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320724.440250:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17991
00000100:00100000:1.0:1767320724.440262:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17992
00000100:00100000:1.0:1767320724.440266:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380086400:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320724.440276:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320724.440545:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380085888:0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.440581:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320724.440610:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320724.440616:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380085760:0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.440638:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320724.440666:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380085632
00000100:00100000:3.0:1767320724.440670:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380085632
00000100:00100000:3.0:1767320724.440693:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237
00000100:00100000:3.0:1767320724.440699:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380085632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320724.440709:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320724.440738:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380085632:12345-0@lo:38:kworker.0 Request processed in 38us (892us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320724.440745:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237
00000100:00100000:3.0:1767320724.440763:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380085888
00000100:00100000:3.0:1767320724.440782:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380085888
00000100:00100000:3.0:1767320724.440822:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380085760
00000100:00100000:3.0:1767320724.440825:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380085760
00000100:00100000:3.0:1767320724.440847:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977
00000100:00100000:3.0:1767320724.440853:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380085888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.440924:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380085888:12345-0@lo:400:kworker.0 Request processed in 71us (342us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320724.440930:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977
00000100:00100000:3.0:1767320724.440953:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978
00000100:00100000:3.0:1767320724.440958:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380085760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.440985:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380085760:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320724.440990:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978
00000100:00080000:3.0:1767320724.441010:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320724.441013:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320724.441082:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380085760:0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.441092:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380085888:0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.441107:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320724.441113:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380086528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320724.441136:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320724.441164:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086528
00000100:00100000:3.0:1767320724.441167:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086528
00000100:00100000:3.0:1767320724.441193:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788
00000100:00100000:3.0:1767320724.441198:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380086528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320724.441219:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320724.441255:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380086528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (118us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320724.441261:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788
00000100:00100000:3.0:1767320724.441300:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380086528:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320724.441318:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380086016:0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.441342:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320724.441361:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320724.441367:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380086272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.441386:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320724.441403:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086016
00000100:00100000:3.0:1767320724.441407:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086016
00000100:00100000:3.0:1767320724.441433:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086272
00000100:00100000:3.0:1767320724.441436:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086272
00000100:00100000:3.0:1767320724.441448:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5015
00000100:00100000:3.0:1767320724.441453:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380086016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.441484:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380086016:12345-0@lo:400:kworker.0 Request processed in 30us (141us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320724.441490:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5015
00000100:00100000:3.0:1767320724.441500:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5016
00000100:00100000:3.0:1767320724.441506:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380086272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.441531:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380086272:12345-0@lo:400:kworker.0 Request processed in 25us (144us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320724.441536:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5016
00000100:00080000:3.0:1767320724.441548:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320724.441562:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380086272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320724.441570:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380086016:0@lo:400:kworker.0
00000100:00080000:3.0:1767320724.441633:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320724.441638:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320724.441642:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380085504:0@lo:38:kworker.0
00000100:00080000:3.0:1767320724.441650:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320724.441652:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320724.441655:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380085632:0@lo:38:kworker.0
00000100:00080000:3.0:1767320724.441662:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320724.441665:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320724.441669:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380086144:0@lo:38:kworker.0
00000100:00100000:1.0:1767320724.442003:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380086400:12345-0@lo:38:kworker.0 Request processed in 1733us (2003us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320724.442010:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17992
00000100:00080000:3.0:1767320724.443981:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320724.444000:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320724.444004:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380086400:0@lo:38:kworker.0
00010000:00010000:3.0:1767320725.015221:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320725.975378:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320725.975403:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380086656:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320725.975476:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320725.978999:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086656
00000100:00100000:0.0:1767320725.979020:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086656
00000100:00100000:0.0:1767320725.979102:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789
00000100:00100000:0.0:1767320725.979115:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380086656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320725.979152:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320725.979536:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380086656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 423us (4057us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320725.979545:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789
00000100:00100000:2.0:1767320725.981124:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380086656:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320726.039240:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320726.415136:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320726.415361:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291990144
00000100:00100000:0.0:1767320726.415373:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291990144
00000100:00100000:0.0:1767320726.415466:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5017
00000100:00100000:0.0:1767320726.415478:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291990144:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320726.415481:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00080000:1.0:1767320726.415485:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320726.415510:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291990016
00000100:00100000:3.0:1767320726.415514:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291990016
00000100:00100000:3.0:1767320726.415542:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17993
00000100:00100000:3.0:1767320726.415547:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291990016:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:0.0:1767320726.415560:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291990144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (433us total) trans 0 rc 0/0
00010000:00020000:3.0:1767320726.415566:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320726.415571:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5017
00000100:00100000:3.0:1767320726.418306:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291990016:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 2745us (2815us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320726.418319:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17993
00010000:00010000:2.0:1767320727.064848:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320728.090097:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320729.117780:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320729.559225:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00080000:3.0:1767320729.560418:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320729.560428:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320729.560439:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320729.560443:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320729.560448:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320729.560974:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5626
00000100:00080000:3.0:1767320729.560979:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320729.561000:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320729.561039:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec000 x1853164380086912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320729.561072:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320729.561076:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320729.561078:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320729.561082:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5626
00000100:00080000:3.0:1767320729.561085:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320729.561090:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320729.561103:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eca80 x1853164380087040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320729.561171:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380087296:0@lo:400:kworker.0
00000100:00100000:2.0:1767320729.561213:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380086784:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320729.561240:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320729.561243:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320729.561310:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086784
00000100:00100000:1.0:1767320729.561347:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380086912:0@lo:38:kworker.0
00000100:00100000:0.0:1767320729.561475:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086784
00000100:00100000:0.0:1767320729.561564:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790
00000100:00100000:0.0:1767320729.561575:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380086784:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320729.561622:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320729.563978:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087296
00000100:00100000:3.0:1767320729.563992:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087296
00000100:00100000:3.0:1767320729.564062:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979
00000100:00100000:3.0:1767320729.564072:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380087296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320729.564145:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380087296:12345-0@lo:400:kworker.0 Request processed in 75us (2904us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320729.564152:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979
00000100:00100000:3.0:1767320729.564197:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380087296:0@lo:400:kworker.0
00000100:00080000:3.0:1767320729.564245:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320729.564249:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320729.564252:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320729.564257:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5626
00000100:00100000:2.0:1767320729.564308:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380087168:0@lo:400:kworker.0
00000100:00100000:2.0:1767320729.564344:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320729.564371:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320729.564385:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380087424:0@lo:400:kworker.0
00000100:00100000:1.0:1767320729.564393:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380087040:0@lo:38:kworker.0
00000100:00100000:2.0:1767320729.564408:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320729.564435:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380086912
00000100:00100000:2.0:1767320729.564440:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380086912
00000100:00100000:2.0:1767320729.564468:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087424
00000100:00100000:2.0:1767320729.564471:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087424
00000100:00100000:2.0:1767320729.564498:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5018
00000100:00100000:2.0:1767320729.564505:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380087424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320729.564540:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380087424:12345-0@lo:400:kworker.0 Request processed in 35us (130us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320729.564546:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5018
00000100:00100000:2.0:1767320729.564559:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17994
00000100:00100000:2.0:1767320729.564563:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380086912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320729.564600:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320729.564641:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380086912:12345-0@lo:38:kworker.0 Request processed in 76us (270us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320729.564648:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17994
00000100:00100000:2.0:1767320729.564683:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380087424:0@lo:400:kworker.0
00000100:00100000:2.0:1767320729.564707:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087168
00000100:00100000:2.0:1767320729.564711:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087168
00000100:00100000:2.0:1767320729.564733:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980
00000100:00100000:2.0:1767320729.564738:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:7018:x1853164380087168:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320729.564770:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:7018:x1853164380087168:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320729.564775:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980
00000100:00100000:2.0:1767320729.564800:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380087168:0@lo:400:kworker.0
00000100:00080000:2.0:1767320729.564884:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320729.564890:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320729.564892:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320729.564919:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320729.564968:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320729.564973:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320729.564976:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380086912:0@lo:38:kworker.0
00000100:00080000:3.0:1767320729.565035:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320729.565040:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320729.565064:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efc380 x1853164380087552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320729.565104:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320729.565108:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320729.565110:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320729.565114:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5626
00000100:00080000:3.0:1767320729.565116:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320729.565120:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320729.565127:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320729.565136:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380087680:0@lo:400:kworker.0
00000100:00100000:3.0:1767320729.565164:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320729.565206:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087680
00000100:00100000:3.0:1767320729.565211:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087680
00000100:00100000:3.0:1767320729.565242:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5019
00000100:00100000:3.0:1767320729.565249:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380087680:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320729.565312:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087040
00000100:00100000:2.0:1767320729.565316:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087040
00000100:00100000:2.0:1767320729.565338:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238
00000100:00100000:2.0:1767320729.565343:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380087040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320729.565354:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320729.565355:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380086784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3782us (4110us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320729.565363:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790
00000100:00100000:2.0:1767320729.565379:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380087040:12345-0@lo:38:kworker.0 Request processed in 35us (566us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320729.565384:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238
00000100:00100000:0.0:1767320729.565412:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380086784:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320729.565422:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed5880 x1853164380087808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320729.565778:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320729.565932:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380087552:0@lo:38:kworker.0
00000100:00100000:1.0:1767320729.565964:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320729.565993:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380087808:0@lo:38:kworker.0
00000100:00100000:1.0:1767320729.566013:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320729.566042:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320729.566047:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320729.566050:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380087040:0@lo:38:kworker.0
00000100:00100000:3.0:1767320729.566196:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380087680:12345-0@lo:400:kworker.0 Request processed in 946us (1029us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320729.566204:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5019
00000100:00100000:2.0:1767320729.566205:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087552
00000100:00100000:2.0:1767320729.566211:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087552
00000100:00100000:3.0:1767320729.566216:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087808
00000100:00100000:3.0:1767320729.566218:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087808
00000100:00100000:2.0:1767320729.566235:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17995
00000100:00100000:2.0:1767320729.566239:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380087552:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320729.566252:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320729.566435:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380087552:12345-0@lo:38:kworker.0 Request processed in 194us (469us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320729.566442:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17995
00000100:00100000:2.0:1767320729.566454:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17996
00000100:00100000:2.0:1767320729.566458:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380087808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320729.566468:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320729.566489:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380087808:12345-0@lo:38:kworker.0 Request processed in 29us (475us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320729.566494:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17996
00000100:00080000:3.0:1767320729.567108:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320729.567115:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320729.567119:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380087552:0@lo:38:kworker.0
00000100:00080000:3.0:1767320729.567128:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320729.567132:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320729.567134:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380087808:0@lo:38:kworker.0
00000100:00100000:1.0:1767320729.567227:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380087680:0@lo:400:kworker.0
00010000:00010000:2.0:1767320730.135087:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320731.095416:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380087936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320731.095507:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320731.095662:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380087936
00000100:00100000:1.0:1767320731.095672:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380087936
00000100:00100000:1.0:1767320731.095746:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791
00000100:00100000:1.0:1767320731.095756:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380087936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320731.095788:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320731.095926:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380087936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (418us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320731.095934:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791
00000100:00080000:0.0:1767320731.096003:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320731.096042:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380087936:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320731.159238:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320731.536555:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320731.536675:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291990400
00000100:00100000:2.0:1767320731.536686:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291990400
00000100:00100000:2.0:1767320731.536773:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5020
00000100:00100000:2.0:1767320731.536784:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291990400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320731.536906:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291990400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 123us (359us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320731.536915:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5020
00000100:00080000:3.0:1767320731.537226:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320731.544401:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320731.544735:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291990272
00000100:00100000:1.0:1767320731.544747:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291990272
00000100:00100000:1.0:1767320731.544816:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 17997
00000100:00100000:1.0:1767320731.544825:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291990272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320731.544849:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320731.544946:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291990272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 120us (557us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320731.544954:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 17997
00010000:00010000:1.0:1767320732.183844:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320733.208331:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320734.231282:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320734.679225:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320734.679236:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320734.679239:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320734.679280:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320734.679285:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320734.679292:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5631
00000100:00080000:1.0:1767320734.679296:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320734.679303:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320734.679358:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eea00 x1853164380088064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320734.679374:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320734.679378:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320734.679380:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320734.679384:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5631
00000100:00080000:1.0:1767320734.679386:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320734.679390:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320734.679407:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec000 x1853164380088192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320734.679468:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320734.679471:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320734.679473:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320734.679476:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5631
00000100:00080000:1.0:1767320734.679479:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320734.679482:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320734.679492:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44000 x1853164380088704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320734.679508:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320734.679512:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320734.679513:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320734.679516:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5631
00000100:00080000:1.0:1767320734.679519:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320734.679522:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320734.679533:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164380088960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320734.679833:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380088320:0@lo:400:kworker.0
00000100:00100000:0.0:1767320734.679928:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320734.679990:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320734.679996:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380088448:0@lo:400:kworker.0
00000100:00100000:0.0:1767320734.680019:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320734.680043:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380088832:0@lo:400:kworker.0
00000100:00100000:0.0:1767320734.680068:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320734.680085:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320734.680090:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380088576:0@lo:400:kworker.0
00000100:00100000:0.0:1767320734.680106:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320734.680277:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088320
00000100:00100000:1.0:1767320734.680285:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088320
00000100:00080000:0.0:1767320734.680421:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320734.680448:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088832
00000100:00100000:0.0:1767320734.680452:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088832
00000100:00100000:0.0:1767320734.680488:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088576
00000100:00100000:0.0:1767320734.680491:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088576
00000100:00100000:0.0:1767320734.680512:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5021
00000100:00100000:0.0:1767320734.680520:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380088832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320734.680585:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380088832:12345-0@lo:400:kworker.0 Request processed in 65us (515us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320734.680592:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5021
00000100:00100000:0.0:1767320734.680610:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5022
00000100:00100000:0.0:1767320734.680616:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380088576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320734.680642:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380088576:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320734.680647:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5022
00000100:00080000:0.0:1767320734.680660:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320734.680696:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380088576:0@lo:400:kworker.0
00000100:00100000:0.0:1767320734.680705:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380088832:0@lo:400:kworker.0
00000100:00100000:1.0:1767320734.680997:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088448
00000100:00100000:1.0:1767320734.681001:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088448
00000100:00100000:1.0:1767320734.681030:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981
00000100:00100000:1.0:1767320734.681037:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380088320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320734.681079:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380088320:12345-0@lo:400:kworker.0 Request processed in 43us (1151us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320734.681085:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981
00000100:00100000:1.0:1767320734.681098:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982
00000100:00100000:1.0:1767320734.681103:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380088448:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320734.681126:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380088448:12345-0@lo:400:kworker.0 Request processed in 24us (1106us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320734.681131:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982
00000100:00080000:1.0:1767320734.681143:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320734.681159:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380088448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320734.681169:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380088320:0@lo:400:kworker.0
00000100:00100000:2.0:1767320734.681251:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380088064:0@lo:38:kworker.0
00000100:00100000:2.0:1767320734.681284:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320734.681310:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380088192:0@lo:38:kworker.0
00000100:00100000:2.0:1767320734.681331:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320734.681366:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380088704:0@lo:38:kworker.0
00000100:00100000:2.0:1767320734.681386:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320734.681400:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380088960:0@lo:38:kworker.0
00000100:00100000:2.0:1767320734.681427:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320734.681464:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088064
00000100:00100000:2.0:1767320734.681469:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088064
00000100:00100000:2.0:1767320734.681483:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088704
00000100:00100000:2.0:1767320734.681485:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088704
00000100:00100000:2.0:1767320734.681493:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17998
00000100:00100000:2.0:1767320734.681498:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380088064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320734.681516:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320734.681559:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380088064:12345-0@lo:38:kworker.0 Request processed in 59us (274us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320734.681566:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17998
00000100:00100000:2.0:1767320734.681578:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088960
00000100:00100000:2.0:1767320734.681581:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088960
00000100:00100000:2.0:1767320734.681593:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17999
00000100:00100000:2.0:1767320734.681596:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380088704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320734.681606:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320734.681629:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380088704:12345-0@lo:38:kworker.0 Request processed in 31us (242us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320734.681635:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17999
00000100:00100000:2.0:1767320734.681645:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18000
00000100:00100000:2.0:1767320734.681648:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380088960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320734.681660:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320734.682036:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380088192
00000100:00100000:1.0:1767320734.682041:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380088192
00000100:00100000:1.0:1767320734.682063:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239
00000100:00100000:1.0:1767320734.682069:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380088192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320734.682079:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320734.682110:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380088192:12345-0@lo:38:kworker.0 Request processed in 40us (777us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320734.682116:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239
00000100:00080000:1.0:1767320734.682150:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320734.682155:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320734.682158:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380088064:0@lo:38:kworker.0
00000100:00080000:1.0:1767320734.682165:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320734.682167:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320734.682170:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380088192:0@lo:38:kworker.0
00000100:00080000:1.0:1767320734.682177:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320734.682179:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320734.682181:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380088704:0@lo:38:kworker.0
00000100:00100000:2.0:1767320734.682290:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380088960:12345-0@lo:38:kworker.0 Request processed in 639us (862us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320734.682295:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18000
00000100:00080000:2.0:1767320734.682317:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320734.682321:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320734.682324:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380088960:0@lo:38:kworker.0
00000100:00100000:3.0:1767320734.683198:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320734.683214:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380089088:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320734.683254:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320734.683293:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089088
00000100:00100000:3.0:1767320734.683299:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089088
00000100:00100000:3.0:1767320734.683383:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792
00000100:00100000:3.0:1767320734.683391:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380089088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320734.683841:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320734.683919:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380089088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 528us (663us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320734.683925:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792
00000100:00100000:1.0:1767320734.684738:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380089088:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320735.259081:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320736.215367:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380089216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320736.215489:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320736.215607:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089216
00000100:00100000:0.0:1767320736.215631:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089216
00000100:00100000:0.0:1767320736.215696:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793
00000100:00100000:0.0:1767320736.215706:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380089216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320736.215749:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767320736.215928:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320736.216254:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380089216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 549us (763us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320736.216264:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793
00000100:00100000:3.0:1767320736.217101:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380089216:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320736.279196:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320736.658283:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320736.658436:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291990656
00000100:00100000:3.0:1767320736.658446:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291990656
00000100:00100000:3.0:1767320736.658554:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5023
00000100:00100000:3.0:1767320736.658565:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291990656:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320736.658633:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291990656:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 71us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320736.658641:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5023
00000100:00080000:2.0:1767320736.661845:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320736.669954:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320736.672964:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291990528
00000100:00100000:1.0:1767320736.672984:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291990528
00000100:00100000:1.0:1767320736.673051:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18001
00000100:00100000:1.0:1767320736.673060:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291990528:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320736.673120:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320736.673208:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291990528:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 147us (3264us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320736.673216:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18001
00010000:00010000:1.0:1767320737.303365:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320738.327394:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320739.351229:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320739.799565:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320739.799577:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320739.799580:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320739.799583:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320739.799588:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320739.799617:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5637
00000100:00080000:1.0:1767320739.799622:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320739.799641:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320739.799688:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45c00 x1853164380089344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320739.799703:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320739.799705:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320739.799707:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320739.799722:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5637
00000100:00080000:1.0:1767320739.799725:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320739.799728:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320739.799752:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46300 x1853164380089472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320739.799818:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320739.799822:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320739.799823:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320739.799838:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5637
00000100:00080000:1.0:1767320739.799842:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320739.799845:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320739.799857:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47100 x1853164380089984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320739.799911:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767320739.800038:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380089600:0@lo:400:kworker.0
00000100:00100000:0.0:1767320739.800125:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320739.800182:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320739.800188:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380089728:0@lo:400:kworker.0
00000100:00100000:0.0:1767320739.800210:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320739.800247:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089600
00000100:00100000:0.0:1767320739.800254:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089600
00000100:00100000:0.0:1767320739.800333:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089728
00000100:00100000:0.0:1767320739.800337:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089728
00000100:00100000:0.0:1767320739.800363:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983
00000100:00100000:0.0:1767320739.800371:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380089600:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320739.800419:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380089600:12345-0@lo:400:kworker.0 Request processed in 48us (295us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320739.800426:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983
00000100:00100000:0.0:1767320739.800441:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984
00000100:00100000:0.0:1767320739.800448:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380089728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320739.800473:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380089728:12345-0@lo:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320739.800478:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984
00000100:00100000:0.0:1767320739.800517:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380089728:0@lo:400:kworker.0
00000100:00100000:0.0:1767320739.800527:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380089600:0@lo:400:kworker.0
00000100:00080000:1.0:1767320739.800689:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320739.800691:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320739.800695:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5637
00000100:00080000:1.0:1767320739.800698:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320739.800702:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320739.800718:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46a00 x1853164380090240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320739.800810:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380089344:0@lo:38:kworker.0
00000100:00100000:2.0:1767320739.800859:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320739.800926:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380089472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320739.800966:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320739.800991:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380089984:0@lo:38:kworker.0
00000100:00100000:2.0:1767320739.801011:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320739.801028:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380090240:0@lo:38:kworker.0
00000100:00100000:2.0:1767320739.801047:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320739.801072:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380089856:0@lo:400:kworker.0
00000100:00100000:2.0:1767320739.801094:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320739.801111:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320739.801116:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380090112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320739.801138:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320739.801160:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320739.801164:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320739.801179:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089344
00000100:00100000:2.0:1767320739.801183:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089344
00000100:00100000:2.0:1767320739.801204:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089984
00000100:00100000:2.0:1767320739.801207:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089984
00000100:00100000:2.0:1767320739.801216:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380090240
00000100:00100000:2.0:1767320739.801218:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380090240
00000100:00100000:2.0:1767320739.801224:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089856
00000100:00100000:2.0:1767320739.801226:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089856
00000100:00100000:2.0:1767320739.801246:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380090112
00000100:00100000:2.0:1767320739.801249:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380090112
00000100:00100000:2.0:1767320739.801262:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5024
00000100:00100000:2.0:1767320739.801268:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380089856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320739.801305:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380089856:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320739.801311:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5024
00000100:00100000:2.0:1767320739.801326:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5025
00000100:00100000:2.0:1767320739.801331:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380090112:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320739.801357:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380090112:12345-0@lo:400:kworker.0 Request processed in 26us (218us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320739.801363:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5025
00000100:00100000:2.0:1767320739.801374:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18002
00000100:00100000:2.0:1767320739.801378:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380089344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320739.801395:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320739.801424:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380089344:12345-0@lo:38:kworker.0 Request processed in 44us (565us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320739.801432:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18002
00000100:00100000:2.0:1767320739.801444:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18003
00000100:00100000:2.0:1767320739.801447:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380089984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320739.801455:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320739.801492:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380089984:12345-0@lo:38:kworker.0 Request processed in 43us (480us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320739.801498:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18003
00000100:00100000:2.0:1767320739.801508:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18004
00000100:00100000:2.0:1767320739.801512:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380090240:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320739.801520:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320739.801541:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380090240:12345-0@lo:38:kworker.0 Request processed in 28us (493us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320739.801546:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18004
00000100:00080000:2.0:1767320739.801569:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320739.801588:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380090112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320739.801611:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380089856:0@lo:400:kworker.0
00000100:00080000:2.0:1767320739.801637:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320739.801641:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320739.801644:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380089344:0@lo:38:kworker.0
00000100:00080000:2.0:1767320739.801650:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320739.801652:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320739.801655:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380089984:0@lo:38:kworker.0
00000100:00080000:2.0:1767320739.801661:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320739.801664:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320739.801666:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380090240:0@lo:38:kworker.0
00000100:00100000:3.0:1767320739.802339:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380090368:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320739.802393:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320739.802493:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380090368
00000100:00100000:3.0:1767320739.802499:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380090368
00000100:00100000:3.0:1767320739.802533:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794
00000100:00100000:3.0:1767320739.802540:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380090368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320739.802564:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320739.803718:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380089472
00000100:00100000:0.0:1767320739.803726:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380089472
00000100:00100000:0.0:1767320739.803766:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240
00000100:00100000:0.0:1767320739.803772:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380089472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320739.803790:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320739.803846:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380089472:12345-0@lo:38:kworker.0 Request processed in 72us (2878us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320739.803852:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240
00000100:00080000:0.0:1767320739.803931:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320739.803937:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320739.803940:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380089472:0@lo:38:kworker.0
00000100:00100000:3.0:1767320739.805208:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380090368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2662us (2807us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320739.805219:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794
00000100:00100000:0.0:1767320739.805498:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380090368:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320740.377048:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320740.754139:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767320740.757624:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291990784 offset 0 length 520: 4
00000100:00100000:1.0:1767320740.759161:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991040
00000100:00100000:1.0:1767320740.759187:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991040
00000100:00100000:1.0:1767320740.759286:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5026
00000100:00100000:1.0:1767320740.759297:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291991040:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320740.759548:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291991040:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 251us (5417us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320740.759556:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5026
00000100:00080000:2.0:1767320740.759659:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320740.771262:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320740.771547:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291990912
00000100:00100000:1.0:1767320740.771556:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291990912
00000100:00100000:1.0:1767320740.771614:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18005
00000100:00100000:1.0:1767320740.771623:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291990912:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320740.771646:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320740.771724:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291990912:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 100us (470us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320740.771742:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18005
00000100:00100000:1.0:1767320741.336205:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320741.336228:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380090496:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320741.336315:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320741.336368:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380090496
00000100:00100000:3.0:1767320741.336379:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380090496
00000100:00100000:3.0:1767320741.336518:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795
00000100:00100000:3.0:1767320741.336529:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380090496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320741.336569:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320741.336641:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380090496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (325us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320741.336649:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795
00000100:00100000:0.0:1767320741.336666:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380090496:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320741.337181:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767320741.405942:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320742.423212:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320743.447953:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320744.471110:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320744.918995:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320719/real 1767320719]  req@ffff8b0e035ff480 x1853164380084352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320744 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320744.919084:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e035ff480 x1853164380084352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320744 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320744.919106:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320744.919205:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320744.919209:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380084352:0@lo:250:kworker.0
00000100:00080000:2.0:1767320744.919957:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320744.919963:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320744.919966:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320744.920018:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5621
00000100:00080000:2.0:1767320744.920023:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320744.920030:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320744.920064:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164380090624/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320744.920131:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380090624:0@lo:250:kworker.0
00000400:00000100:3.0:1767320744.920262:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380090624 offset 0 length 520: 4
00000100:00080000:2.0:1767320744.920433:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320744.920438:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320744.920440:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320744.920444:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320744.920447:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320744.920450:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320744.920466:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21f80 x1853164380090752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320744.920503:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380090752:0@lo:38:kworker.0
00000100:00100000:3.0:1767320744.920551:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320744.920673:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767320744.920775:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380090752
00000100:00100000:0.0:1767320744.920783:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380090752
00000100:00080000:2.0:1767320744.920828:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320744.920831:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320744.920835:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320744.920838:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320744.920842:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320744.920850:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18006
00000100:00100000:2.0:1767320744.920857:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21c00 x1853164380091008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320744.920858:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380090752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320744.920904:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320744.920997:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380090880:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320744.921052:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320744.921055:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380091008:0@lo:38:kworker.0
00000100:00100000:1.0:1767320744.921088:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380090880
00000100:00100000:1.0:1767320744.921092:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380090880
00000100:00100000:3.0:1767320744.921097:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320744.921146:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796
00000100:00100000:1.0:1767320744.921164:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380090880:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320744.921197:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320744.921236:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380090880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (182us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320744.921243:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796
00000100:00080000:2.0:1767320744.921266:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320744.921270:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320744.921272:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320744.921276:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320744.921279:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1767320744.921280:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091008
00000100:00080000:2.0:1767320744.921282:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320744.921283:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091008
00000100:00100000:2.0:1767320744.921294:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22a00 x1853164380091392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320744.921301:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241
00000100:00100000:1.0:1767320744.921306:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380091008:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320744.921322:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320744.928641:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320744.928647:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320744.928651:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320744.928657:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5642
00000100:00080000:2.0:1767320744.928663:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320744.928724:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320744.928744:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20e00 x1853164380091648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320744.928788:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380091520:0@lo:400:kworker.0
00000100:00100000:2.0:1767320744.928859:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320744.929160:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320744.929168:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380091264:0@lo:400:kworker.0
00000100:00100000:2.0:1767320744.929190:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320744.929232:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091520
00000100:00100000:2.0:1767320744.929238:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091520
00000100:00100000:2.0:1767320744.929279:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091264
00000100:00100000:2.0:1767320744.929281:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091264
00000100:00100000:2.0:1767320744.929298:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5027
00000100:00100000:2.0:1767320744.929304:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380091520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320744.929506:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380091520:12345-0@lo:400:kworker.0 Request processed in 201us (645us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320744.929513:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5027
00000100:00100000:2.0:1767320744.929530:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5028
00000100:00100000:2.0:1767320744.929536:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380091264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320744.929563:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380091264:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320744.929568:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5028
00000100:00100000:2.0:1767320744.929626:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380091264:0@lo:400:kworker.0
00000100:00100000:2.0:1767320744.929637:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380091520:0@lo:400:kworker.0
00000100:00080000:2.0:1767320744.929698:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320744.929704:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320744.929733:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380090880:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320744.929748:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320744.929756:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380091136:0@lo:400:kworker.0
00000100:00100000:2.0:1767320744.929785:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320744.929813:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091136
00000100:00100000:2.0:1767320744.929817:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091136
00000100:00100000:2.0:1767320744.929904:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985
00000100:00100000:2.0:1767320744.929911:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380091136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320744.929947:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380091136:12345-0@lo:400:kworker.0 Request processed in 37us (160us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320744.929953:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985
00000100:00080000:2.0:1767320744.929967:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320744.930251:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380091136:0@lo:400:kworker.0
00000100:00100000:1.0:1767320744.933312:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380091008:12345-0@lo:38:kworker.0 Request processed in 11994us (12202us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320744.933326:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241
00000100:00100000:0.0:1767320744.941375:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380090752:12345-0@lo:38:kworker.0 Request processed in 20505us (20812us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320744.941391:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18006
00000100:00080000:3.0:1767320744.941639:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320744.941646:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320744.941651:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380090752:0@lo:38:kworker.0
00000100:00100000:3.0:1767320744.941695:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380091392:0@lo:38:kworker.0
00000100:00100000:3.0:1767320744.941758:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320744.941793:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380091648:0@lo:38:kworker.0
00000100:00100000:3.0:1767320744.941815:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320744.941853:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320744.941858:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320744.941861:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380091008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320744.941960:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091392
00000100:00100000:2.0:1767320744.941978:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091392
00000100:00100000:2.0:1767320744.942022:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091648
00000100:00100000:2.0:1767320744.942026:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091648
00000100:00100000:2.0:1767320744.942053:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18007
00000100:00100000:2.0:1767320744.942060:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380091392:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320744.942082:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320744.942125:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380091392:12345-0@lo:38:kworker.0 Request processed in 65us (367us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320744.942132:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18007
00000100:00100000:2.0:1767320744.942145:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18008
00000100:00100000:2.0:1767320744.942149:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380091648:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320744.942159:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320744.942180:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380091648:12345-0@lo:38:kworker.0 Request processed in 30us (365us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320744.942185:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18008
00000100:00080000:3.0:1767320744.942403:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320744.942408:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320744.942411:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380091392:0@lo:38:kworker.0
00000100:00080000:3.0:1767320744.942422:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320744.942425:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320744.942428:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380091648:0@lo:38:kworker.0
00010000:00010000:0.0:1767320745.495632:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320745.873665:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320745.873761:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991296
00000100:00100000:3.0:1767320745.873771:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991296
00000100:00100000:3.0:1767320745.873842:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5029
00000100:00100000:3.0:1767320745.873851:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291991296:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320745.873959:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291991296:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (301us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320745.873966:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5029
00000100:00080000:2.0:1767320745.874204:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320745.884975:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320745.885095:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991168
00000100:00100000:0.0:1767320745.885106:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991168
00000100:00100000:0.0:1767320745.885537:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18009
00000100:00100000:0.0:1767320745.885545:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291991168:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320745.885568:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320745.885642:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291991168:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 95us (676us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320745.885649:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18009
00000100:00100000:2.0:1767320746.457750:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380091776:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320746.457824:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320746.457975:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091776
00000100:00100000:0.0:1767320746.457985:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091776
00000100:00100000:0.0:1767320746.458066:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797
00000100:00100000:0.0:1767320746.458077:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380091776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320746.458109:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767320746.459365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320746.464542:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380091776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6458us (6708us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320746.464556:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797
00000100:00100000:2.0:1767320746.465771:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380091776:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320746.521929:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320747.543094:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320748.568035:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320749.591569:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320750.044161:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320750.044171:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320750.044175:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320750.044179:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320750.044183:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320750.044191:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5647
00000100:00080000:2.0:1767320750.044195:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320750.044202:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320750.044243:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23800 x1853164380091904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320750.044278:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320750.044282:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320750.044284:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320750.044288:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5647
00000100:00080000:2.0:1767320750.044290:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320750.044294:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320750.044310:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23480 x1853164380092032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320750.044338:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380091904:0@lo:38:kworker.0
00000100:00080000:2.0:1767320750.044378:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320750.044381:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320750.044383:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320750.044386:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5647
00000100:00080000:2.0:1767320750.044388:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320750.044391:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320750.044401:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22300 x1853164380092544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320750.044414:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320750.044416:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320750.044419:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320750.044421:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320750.044424:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5647
00000100:00080000:2.0:1767320750.044426:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320750.044430:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320750.044440:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22a00 x1853164380092800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320750.044460:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380092288:0@lo:400:kworker.0
00000100:00100000:0.0:1767320750.044472:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380092032:0@lo:38:kworker.0
00000100:00100000:0.0:1767320750.044490:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320750.044491:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320750.044515:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320750.044516:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380092544:0@lo:38:kworker.0
00000100:00100000:2.0:1767320750.044520:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380092416:0@lo:400:kworker.0
00000100:00100000:1.0:1767320750.044581:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380092160:0@lo:400:kworker.0
00000100:00100000:3.0:1767320750.044699:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380092672:0@lo:400:kworker.0
00000100:00100000:2.0:1767320750.050389:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320750.050470:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092288
00000100:00100000:2.0:1767320750.050479:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092288
00000100:00100000:2.0:1767320750.050534:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986
00000100:00100000:2.0:1767320750.050544:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380092288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320750.050602:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380092288:12345-0@lo:400:kworker.0 Request processed in 60us (6110us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320750.050610:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986
00000100:00080000:2.0:1767320750.050630:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320750.050678:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380092288:0@lo:400:kworker.0
00000100:00100000:1.0:1767320750.051166:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320750.053084:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380091904
00000100:00100000:2.0:1767320750.053097:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380091904
00000100:00100000:2.0:1767320750.053139:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092416
00000100:00100000:2.0:1767320750.053143:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092416
00000100:00100000:2.0:1767320750.053179:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5030
00000100:00100000:2.0:1767320750.053190:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380092416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320750.053272:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380092416:12345-0@lo:400:kworker.0 Request processed in 84us (2888us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320750.053279:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5030
00000100:00100000:2.0:1767320750.053297:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18010
00000100:00100000:2.0:1767320750.053301:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380091904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320750.053320:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320750.053350:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380091904:12345-0@lo:38:kworker.0 Request processed in 47us (8946us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320750.053356:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18010
00000100:00080000:2.0:1767320750.053372:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320750.053411:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380092416:0@lo:400:kworker.0
00000100:00100000:2.0:1767320750.053448:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092160
00000100:00100000:2.0:1767320750.053452:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092160
00000100:00100000:2.0:1767320750.053481:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987
00000100:00100000:2.0:1767320750.053487:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380092160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320750.053517:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380092160:12345-0@lo:400:kworker.0 Request processed in 30us (2352us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320750.053523:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987
00000100:00100000:2.0:1767320750.053540:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092032
00000100:00100000:2.0:1767320750.053544:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092032
00000100:00100000:2.0:1767320750.053562:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242
00000100:00100000:2.0:1767320750.053567:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380092032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320750.053577:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320750.053604:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380092032:12345-0@lo:38:kworker.0 Request processed in 36us (9113us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320750.053610:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242
00000100:00080000:2.0:1767320750.053622:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320750.054629:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380092928:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320750.055006:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320750.055125:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380092160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320750.055302:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092928
00000100:00100000:2.0:1767320750.055309:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092928
00000100:00100000:2.0:1767320750.055688:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798
00000100:00100000:2.0:1767320750.055708:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380092928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320750.055754:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320750.055802:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320750.055815:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380092928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (808us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320750.055835:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092544
00000100:00100000:0.0:1767320750.055840:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092544
00000100:00100000:3.0:1767320750.055848:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320750.055996:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798
00000100:00100000:1.0:1767320750.056156:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380092928:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320750.056209:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380092800:0@lo:38:kworker.0
00000100:00100000:1.0:1767320750.056246:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320750.057555:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092672
00000100:00100000:0.0:1767320750.057566:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092672
00000100:00080000:1.0:1767320750.057597:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320750.057604:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320750.057608:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380091904:0@lo:38:kworker.0
00000100:00080000:1.0:1767320750.057620:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320750.057623:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320750.057626:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380092032:0@lo:38:kworker.0
00000100:00100000:0.0:1767320750.057804:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380092800
00000100:00100000:0.0:1767320750.057809:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380092800
00000100:00100000:1.0:1767320750.057813:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5031
00000100:00100000:1.0:1767320750.057832:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380092672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320750.057836:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18011
00000100:00100000:0.0:1767320750.057842:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380092544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320750.057863:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320750.057911:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380092544:12345-0@lo:38:kworker.0 Request processed in 67us (2108us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320750.057911:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380092672:12345-0@lo:400:kworker.0 Request processed in 82us (2063us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320750.057919:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5031
00000100:00100000:0.0:1767320750.057921:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18011
00000100:00100000:1.0:1767320750.057935:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18012
00000100:00100000:1.0:1767320750.057939:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380092800:12345-0@lo:38:kworker.0
00000100:00080000:0.0:1767320750.057948:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:1.0:1767320750.057950:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320750.057974:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380092800:12345-0@lo:38:kworker.0 Request processed in 33us (1726us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320750.057980:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18012
00000100:00080000:1.0:1767320750.058005:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320750.058009:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320750.058012:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380092544:0@lo:38:kworker.0
00000100:00080000:1.0:1767320750.058021:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320750.058024:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320750.058026:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380092800:0@lo:38:kworker.0
00000100:00100000:1.0:1767320750.058062:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380092672:0@lo:400:kworker.0
00010000:00010000:2.0:1767320750.618318:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320750.995706:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320750.995760:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320750.996013:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991552
00000100:00100000:2.0:1767320750.996025:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991552
00000100:00100000:2.0:1767320750.996108:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991424
00000100:00100000:2.0:1767320750.996120:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991424
00000100:00100000:2.0:1767320750.996142:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5032
00000100:00100000:2.0:1767320750.996151:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291991552:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320750.996231:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291991552:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (541us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320750.996238:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5032
00000100:00100000:2.0:1767320750.996257:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18013
00000100:00100000:2.0:1767320750.996261:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291991424:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320750.996292:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320750.996316:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291991424:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 53us (556us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320750.996323:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18013
00000100:00080000:0.0:1767320750.997228:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320751.575463:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320751.575489:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380093056:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320751.575562:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320751.575712:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093056
00000100:00100000:1.0:1767320751.575720:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093056
00000100:00100000:1.0:1767320751.575776:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799
00000100:00100000:1.0:1767320751.575785:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380093056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320751.575822:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320751.575906:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380093056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (343us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320751.575914:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799
00000100:00100000:2.0:1767320751.576024:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380093056:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320751.639640:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320752.663587:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320753.687109:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320754.712305:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320755.159941:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320755.159953:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320755.159956:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320755.159960:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320755.159964:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320755.159972:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5652
00000100:00080000:1.0:1767320755.159977:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320755.159985:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320755.160025:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47480 x1853164380093184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320755.160054:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320755.160058:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320755.160060:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320755.160064:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5652
00000100:00080000:1.0:1767320755.160066:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320755.160070:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320755.160085:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47b80 x1853164380093312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320755.160372:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380093184:0@lo:38:kworker.0
00000100:00100000:2.0:1767320755.160449:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320755.160583:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093184
00000100:00100000:0.0:1767320755.160591:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093184
00000100:00100000:0.0:1767320755.160648:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18014
00000100:00100000:0.0:1767320755.160656:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380093184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320755.160679:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320755.160730:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380093184:12345-0@lo:38:kworker.0 Request processed in 72us (279us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320755.160737:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18014
00000100:00080000:0.0:1767320755.160781:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320755.160786:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320755.160790:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380093184:0@lo:38:kworker.0
00000100:00080000:1.0:1767320755.160926:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320755.160930:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320755.160932:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320755.160936:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5652
00000100:00080000:1.0:1767320755.160939:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320755.160943:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320755.160957:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164380093824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320755.160972:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320755.160975:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320755.160977:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320755.160980:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5652
00000100:00080000:1.0:1767320755.160982:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320755.160986:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320755.160997:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45180 x1853164380094080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320755.161024:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380093568:0@lo:400:kworker.0
00000100:00100000:1.0:1767320755.161057:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320755.161393:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380093312:0@lo:38:kworker.0
00000100:00100000:0.0:1767320755.161427:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320755.161452:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380093824:0@lo:38:kworker.0
00000100:00100000:0.0:1767320755.161473:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320755.161487:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380094080:0@lo:38:kworker.0
00000100:00100000:0.0:1767320755.161507:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320755.161539:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093312
00000100:00100000:0.0:1767320755.161543:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093312
00000100:00100000:0.0:1767320755.161568:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243
00000100:00100000:0.0:1767320755.161572:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380093312:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320755.161585:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320755.161628:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380093312:12345-0@lo:38:kworker.0 Request processed in 53us (199us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320755.161634:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243
00000100:00100000:0.0:1767320755.161649:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093824
00000100:00100000:0.0:1767320755.161652:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093824
00000100:00100000:0.0:1767320755.161665:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094080
00000100:00100000:0.0:1767320755.161667:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094080
00000100:00100000:0.0:1767320755.161681:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18015
00000100:00100000:0.0:1767320755.161685:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380093824:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320755.161694:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320755.161716:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380093824:12345-0@lo:38:kworker.0 Request processed in 30us (241us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320755.161721:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18015
00000100:00100000:0.0:1767320755.161731:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18016
00000100:00100000:0.0:1767320755.161735:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380094080:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320755.161743:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320755.161764:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380094080:12345-0@lo:38:kworker.0 Request processed in 28us (256us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320755.161769:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18016
00000100:00080000:0.0:1767320755.161796:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320755.161800:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320755.161803:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380093312:0@lo:38:kworker.0
00000100:00080000:0.0:1767320755.161811:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320755.161814:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320755.161817:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380093824:0@lo:38:kworker.0
00000100:00080000:0.0:1767320755.161823:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320755.161826:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320755.161828:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380094080:0@lo:38:kworker.0
00000100:00100000:0.0:1767320755.161861:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380093696:0@lo:400:kworker.0
00000100:00100000:0.0:1767320755.161907:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320755.161933:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093696
00000100:00100000:0.0:1767320755.161937:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093696
00000100:00100000:0.0:1767320755.161973:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5033
00000100:00100000:0.0:1767320755.161980:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380093696:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320755.162019:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380093696:12345-0@lo:400:kworker.0 Request processed in 41us (112us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320755.162026:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5033
00000100:00080000:0.0:1767320755.162042:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320755.162062:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380093696:0@lo:400:kworker.0
00000100:00100000:2.0:1767320755.162504:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380093440:0@lo:400:kworker.0
00000100:00100000:2.0:1767320755.162539:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320755.162570:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380094208:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320755.162612:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320755.162641:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320755.162647:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380093952:0@lo:400:kworker.0
00000100:00100000:2.0:1767320755.162668:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320755.162702:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093568
00000100:00100000:2.0:1767320755.162707:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093568
00000100:00100000:2.0:1767320755.162745:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093440
00000100:00100000:2.0:1767320755.162749:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093440
00000100:00100000:2.0:1767320755.162769:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988
00000100:00100000:2.0:1767320755.162776:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380093568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320755.162813:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380093568:12345-0@lo:400:kworker.0 Request processed in 37us (1754us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320755.162819:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988
00000100:00100000:2.0:1767320755.162832:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989
00000100:00100000:2.0:1767320755.162837:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380093440:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320755.162886:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380093440:12345-0@lo:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320755.162893:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989
00000100:00100000:2.0:1767320755.162914:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380093952
00000100:00100000:2.0:1767320755.162917:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380093952
00000100:00100000:2.0:1767320755.162944:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5034
00000100:00100000:2.0:1767320755.162950:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380093952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320755.162979:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380093952:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320755.162984:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5034
00000100:00080000:2.0:1767320755.163010:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320755.163014:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320755.163017:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320755.163036:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380093952:0@lo:400:kworker.0
00000100:00100000:2.0:1767320755.163044:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380093440:0@lo:400:kworker.0
00000100:00100000:1.0:1767320755.163666:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094208
00000100:00100000:1.0:1767320755.163676:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094208
00000100:00100000:1.0:1767320755.163724:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800
00000100:00100000:1.0:1767320755.163731:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380094208:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320755.163754:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320755.163802:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380094208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (1190us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320755.163809:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800
00000100:00100000:1.0:1767320755.163849:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380094208:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320755.163906:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380093568:0@lo:400:kworker.0
00010000:00010000:2.0:1767320755.735350:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320756.113230:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320756.113309:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991808
00000100:00100000:3.0:1767320756.113320:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991808
00000100:00100000:1.0:1767320756.113327:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320756.113422:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991680
00000100:00100000:2.0:1767320756.113427:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991680
00000100:00100000:2.0:1767320756.113478:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18017
00000100:00100000:2.0:1767320756.113487:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291991680:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320756.113510:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320756.113569:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291991680:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 82us (240us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320756.113577:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18017
00000100:00100000:3.0:1767320756.114709:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5035
00000100:00100000:3.0:1767320756.114724:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291991808:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320756.114792:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291991808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 73us (1572us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320756.114801:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5035
00000100:00080000:0.0:1767320756.117271:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320756.696823:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380094336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320756.696918:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320756.697637:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094336
00000100:00100000:1.0:1767320756.697650:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094336
00000100:00100000:1.0:1767320756.697710:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801
00000100:00100000:1.0:1767320756.697720:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380094336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320756.697752:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320756.697816:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380094336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (898us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320756.697824:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801
00000100:00100000:2.0:1767320756.698198:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380094336:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320756.759647:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320757.783128:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320758.807904:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320759.831450:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320760.279465:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320760.279477:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320760.279480:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320760.279484:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320760.279488:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320760.279496:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5657
00000100:00080000:1.0:1767320760.279501:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320760.279507:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320760.279558:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164380094464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320760.279585:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320760.279589:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320760.279591:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320760.279595:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5657
00000100:00080000:1.0:1767320760.279598:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320760.279602:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320760.279616:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44000 x1853164380094592/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320760.279686:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320760.279689:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320760.279691:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320760.279694:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5657
00000100:00080000:1.0:1767320760.279697:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320760.279701:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320760.279713:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c45880 x1853164380095104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320760.279729:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320760.279732:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320760.279734:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320760.279737:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5657
00000100:00080000:1.0:1767320760.279740:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320760.279743:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320760.279753:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2eea00 x1853164380095360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320760.279818:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380095232:0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.279847:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380094848:0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.279912:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320760.279916:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320760.279976:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320760.279983:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380094976:0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.280008:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320760.280060:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094848
00000100:00100000:0.0:1767320760.280068:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094848
00000100:00100000:0.0:1767320760.280191:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990
00000100:00100000:0.0:1767320760.280198:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380094848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320760.280237:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380094848:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320760.280242:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990
00000100:00080000:0.0:1767320760.280259:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320760.280270:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380094720:0@lo:400:kworker.0
00000100:00100000:0.0:1767320760.280286:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320760.280303:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094720
00000100:00100000:0.0:1767320760.280305:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094720
00000100:00100000:0.0:1767320760.280321:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991
00000100:00100000:0.0:1767320760.280325:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380094720:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320760.280345:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380094720:12345-0@lo:400:kworker.0 Request processed in 19us (58us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320760.280348:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991
00000100:00080000:0.0:1767320760.280356:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320760.280376:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380094720:0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.280452:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380094848:0@lo:400:kworker.0
00000100:00100000:3.0:1767320760.280490:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380095232
00000100:00100000:3.0:1767320760.280496:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380095232
00000100:00100000:3.0:1767320760.280536:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094976
00000100:00100000:3.0:1767320760.280539:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094976
00000100:00100000:0.0:1767320760.280992:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380094464:0@lo:38:kworker.0
00000100:00100000:0.0:1767320760.281026:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320760.294837:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094464
00000100:00100000:2.0:1767320760.294854:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094464
00000100:00100000:2.0:1767320760.294900:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5036
00000100:00100000:2.0:1767320760.295023:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380095232:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.295293:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380095232:12345-0@lo:400:kworker.0 Request processed in 384us (15382us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320760.295301:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5036
00000100:00100000:2.0:1767320760.295333:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5037
00000100:00100000:2.0:1767320760.295340:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380094976:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.295389:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380094976:12345-0@lo:400:kworker.0 Request processed in 49us (15380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320760.295395:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5037
00000100:00100000:2.0:1767320760.295441:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380094976:0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.295493:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18018
00000100:00100000:2.0:1767320760.295497:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380094464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320760.295522:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320760.295566:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380094464:12345-0@lo:38:kworker.0 Request processed in 67us (14539us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320760.295572:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18018
00000100:00100000:2.0:1767320760.295910:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380095488:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320760.295951:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320760.296023:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320760.296029:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320760.296032:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380094464:0@lo:38:kworker.0
00000100:00100000:2.0:1767320760.296040:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380094592:0@lo:38:kworker.0
00000100:00100000:2.0:1767320760.296065:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320760.296169:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380094592
00000100:00100000:2.0:1767320760.296174:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380094592
00000100:00100000:2.0:1767320760.296201:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244
00000100:00100000:2.0:1767320760.296206:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380094592:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320760.296218:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320760.296245:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380094592:12345-0@lo:38:kworker.0 Request processed in 38us (179us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320760.296254:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244
00000100:00080000:2.0:1767320760.296283:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320760.296288:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320760.296291:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380094592:0@lo:38:kworker.0
00000100:00100000:2.0:1767320760.296297:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380095104:0@lo:38:kworker.0
00000100:00100000:2.0:1767320760.296320:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320760.296339:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380095104
00000100:00100000:2.0:1767320760.296343:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380095104
00000100:00100000:2.0:1767320760.296362:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18019
00000100:00100000:2.0:1767320760.296366:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380095104:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320760.296376:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320760.296401:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380095104:12345-0@lo:38:kworker.0 Request processed in 33us (80us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320760.296406:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18019
00000100:00080000:2.0:1767320760.296429:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320760.296433:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320760.296435:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380095104:0@lo:38:kworker.0
00000100:00100000:2.0:1767320760.296442:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380095360:0@lo:38:kworker.0
00000100:00100000:2.0:1767320760.296463:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320760.296501:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380095360
00000100:00100000:2.0:1767320760.296505:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380095360
00000100:00100000:2.0:1767320760.296524:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18020
00000100:00100000:2.0:1767320760.296528:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380095360:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320760.296537:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320760.296577:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380095360:12345-0@lo:38:kworker.0 Request processed in 47us (112us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320760.296583:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18020
00000100:00080000:2.0:1767320760.296606:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320760.296610:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320760.296613:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380095360:0@lo:38:kworker.0
00000100:00080000:2.0:1767320760.296641:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320760.308478:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380095488
00000100:00100000:1.0:1767320760.308497:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380095488
00000100:00100000:1.0:1767320760.308569:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802
00000100:00100000:1.0:1767320760.308579:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380095488:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320760.308614:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320760.308708:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380095488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (12756us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320760.308716:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802
00000100:00100000:1.0:1767320760.308777:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380095232:0@lo:400:kworker.0
00000100:00100000:2.0:1767320760.308998:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380095488:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320760.855130:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320761.234203:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320761.234282:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320761.234639:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291991936
00000100:00100000:3.0:1767320761.234650:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291991936
00000100:00100000:3.0:1767320761.234694:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291992064
00000100:00100000:3.0:1767320761.234697:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291992064
00000100:00100000:3.0:1767320761.234749:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5038
00000100:00100000:3.0:1767320761.234759:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291992064:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320761.234839:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291992064:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (554us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320761.234847:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5038
00000100:00100000:3.0:1767320761.234904:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18021
00000100:00100000:3.0:1767320761.234910:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291991936:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320761.234930:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320761.234957:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291991936:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (765us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320761.234963:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18021
00000100:00080000:1.0:1767320761.235346:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320761.815284:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320761.815324:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380095616:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320761.815396:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320761.815726:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380095616
00000100:00100000:1.0:1767320761.815735:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380095616
00000100:00100000:1.0:1767320761.815795:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803
00000100:00100000:1.0:1767320761.815805:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380095616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320761.815836:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320761.815928:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380095616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (530us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320761.815936:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803
00000100:00100000:0.0:1767320761.816123:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380095616:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767320761.879502:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320762.903111:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320763.927101:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320764.953096:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320765.399104:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320765.399127:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380095744:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320765.399202:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320765.399384:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320765.399390:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320765.399393:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320765.399396:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320765.399400:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320765.399415:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320765.399419:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320765.399426:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320765.399448:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6d80 x1853164380095872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320765.399460:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320765.399463:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320765.399464:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320765.399468:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320765.399470:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320765.399473:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320765.399485:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7480 x1853164380096000/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320765.399530:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320765.399533:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320765.399535:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767320765.399540:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380096128:0@lo:400:kworker.0
00000100:00080000:0.0:1767320765.399541:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320765.399547:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320765.399552:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320765.399566:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6a00 x1853164380096384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320765.399585:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320765.399591:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320765.399596:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320765.399598:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320765.399602:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5662
00000100:00080000:0.0:1767320765.399605:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320765.399609:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320765.399618:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320765.399623:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef6680 x1853164380096640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320765.399626:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380096256:0@lo:400:kworker.0
00000100:00100000:3.0:1767320765.399657:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320765.399684:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320765.399693:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380096512:0@lo:400:kworker.0
00000100:00100000:0.0:1767320765.399696:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380096256
00000100:00100000:0.0:1767320765.399705:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380096256
00000100:00100000:3.0:1767320765.399714:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320765.399747:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380096128
00000100:00100000:3.0:1767320765.399751:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380096128
00000100:00100000:0.0:1767320765.399759:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380096512
00000100:00100000:0.0:1767320765.399764:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380096512
00000100:00100000:3.0:1767320765.399789:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992
00000100:00100000:0.0:1767320765.399801:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5039
00000100:00100000:3.0:1767320765.399802:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380096128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320765.399815:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380096256:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320765.399858:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380096128:12345-0@lo:400:kworker.0 Request processed in 59us (273us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320765.399896:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992
00000100:00100000:0.0:1767320765.399902:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380096256:12345-0@lo:400:kworker.0 Request processed in 56us (209us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320765.399912:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5039
00000100:00100000:3.0:1767320765.399929:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5040
00000100:00100000:3.0:1767320765.399938:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380096512:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320765.399981:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380096512:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320765.399989:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380095872:0@lo:38:kworker.0
00000100:00100000:1.0:1767320765.400022:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320765.400040:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380095744
00000100:00100000:1.0:1767320765.400044:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380096000:0@lo:38:kworker.0
00000100:00100000:2.0:1767320765.400045:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380095744
00000100:00100000:1.0:1767320765.400068:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320765.400074:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804
00000100:00100000:2.0:1767320765.400081:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380095744:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320765.400101:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320765.400134:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380095744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (933us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320765.400141:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804
00000100:00100000:2.0:1767320765.400164:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380095872
00000100:00100000:2.0:1767320765.400167:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380095872
00000100:00100000:1.0:1767320765.400220:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380096384:0@lo:38:kworker.0
00000100:00100000:1.0:1767320765.400244:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320765.400260:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380096640:0@lo:38:kworker.0
00000100:00100000:1.0:1767320765.400277:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320765.400296:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320765.400299:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320765.400302:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320765.400310:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380096384
00000100:00100000:1.0:1767320765.400313:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380096384
00000100:00100000:0.0:1767320765.400531:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380096640
00000100:00100000:0.0:1767320765.400536:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380096640
00000100:00100000:0.0:1767320765.400550:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18022
00000100:00100000:0.0:1767320765.400554:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380096640:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320765.400571:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320765.400609:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380096640:12345-0@lo:38:kworker.0 Request processed in 53us (331us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320765.400615:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18022
00000100:00080000:0.0:1767320765.400649:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320765.400653:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320765.400656:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380096640:0@lo:38:kworker.0
00000100:00100000:0.0:1767320765.400706:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380095744:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320765.400733:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380096000
00000100:00100000:0.0:1767320765.400737:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380096000
00000100:00100000:0.0:1767320765.400757:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245
00000100:00100000:0.0:1767320765.400761:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380096000:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320765.400770:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320765.400800:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380096000:12345-0@lo:38:kworker.0 Request processed in 38us (731us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320765.400806:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245
00000100:00080000:0.0:1767320765.400828:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320765.400832:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320765.400835:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380096000:0@lo:38:kworker.0
00000100:00100000:0.0:1767320765.400933:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380096256:0@lo:400:kworker.0
00000100:00100000:0.0:1767320765.400945:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380096128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320765.400978:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380096512:0@lo:400:kworker.0
00000100:00100000:3.0:1767320765.405860:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5040
00000100:00100000:2.0:1767320765.410286:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18023
00000100:00100000:2.0:1767320765.410302:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380095872:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320765.410328:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320765.410413:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380095872:12345-0@lo:38:kworker.0 Request processed in 112us (10389us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320765.410422:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18023
00000100:00080000:0.0:1767320765.410759:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320765.410766:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320765.410770:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380095872:0@lo:38:kworker.0
00000100:00100000:1.0:1767320765.414275:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18024
00000100:00100000:1.0:1767320765.414291:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380096384:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320765.414318:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320765.416817:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380096384:12345-0@lo:38:kworker.0 Request processed in 2518us (16561us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320765.416832:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18024
00000100:00080000:0.0:1767320765.419103:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320765.419116:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320765.419121:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380096384:0@lo:38:kworker.0
00010000:00010000:0.0:1767320765.975094:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320766.354195:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320766.354353:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291992320
00000100:00100000:1.0:1767320766.354362:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291992320
00000100:00100000:1.0:1767320766.354432:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5041
00000100:00100000:1.0:1767320766.354440:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291992320:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320766.354526:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291992320:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (352us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320766.354534:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5041
00000100:00080000:2.0:1767320766.354725:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320766.356574:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320766.356679:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291992192
00000100:00100000:1.0:1767320766.356688:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291992192
00000100:00100000:1.0:1767320766.356735:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18025
00000100:00100000:1.0:1767320766.356743:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291992192:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320766.356769:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320766.356834:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291992192:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 90us (265us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320766.356843:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18025
00000400:00000100:1.0:1767320766.357352:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291992448 offset 0 length 520: 4
00000100:00100000:3.0:1767320766.935393:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380096768:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320766.935466:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320766.935608:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380096768
00000100:00100000:0.0:1767320766.935617:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380096768
00000100:00100000:0.0:1767320766.935675:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805
00000100:00100000:0.0:1767320766.935685:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380096768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320766.935713:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320766.935762:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380096768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320766.935770:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805
00000100:00100000:3.0:1767320766.935857:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380096768:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320766.999226:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320768.029569:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320769.047214:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320769.495031:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320744/real 1767320744]  req@ffff8b0e0dc23100 x1853164380090624/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320769 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320769.495072:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0dc23100 x1853164380090624/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320769 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320769.495092:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320769.495167:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320769.495172:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380090624:0@lo:250:kworker.0
00000100:00080000:2.0:1767320769.496575:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320769.496585:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320769.496588:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320769.496594:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5647
00000100:00080000:2.0:1767320769.496599:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320769.496606:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320769.496641:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628700 x1853164380096896/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320769.496699:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380096896:0@lo:250:kworker.0
00000400:00000100:0.0:1767320769.496748:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380096896 offset 0 length 520: 4
00000100:00080000:2.0:1767320769.496805:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320769.496809:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320769.496811:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320769.496815:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5667
00000100:00080000:2.0:1767320769.496818:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320769.496821:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320769.496839:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628380 x1853164380097024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320769.500671:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380097024:0@lo:38:kworker.0
00000100:00100000:0.0:1767320769.500752:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320769.500946:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097024
00000100:00100000:3.0:1767320769.501049:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097024
00000100:00100000:3.0:1767320769.501098:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18026
00000100:00100000:3.0:1767320769.501107:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380097024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320769.501130:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320769.501188:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380097024:12345-0@lo:38:kworker.0 Request processed in 81us (436us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320769.501196:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18026
00000100:00080000:0.0:1767320769.501595:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320769.501601:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320769.501605:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380097024:0@lo:38:kworker.0
00000100:00080000:2.0:1767320769.502079:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320769.502085:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320769.502088:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320769.502093:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5667
00000100:00080000:2.0:1767320769.502097:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320769.502102:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320769.502138:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629180 x1853164380097152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320769.502231:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320769.502296:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320769.502308:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380097408:0@lo:400:kworker.0
00000100:00100000:3.0:1767320769.502356:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320769.502398:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097408
00000100:00100000:3.0:1767320769.502403:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097408
00000100:00100000:3.0:1767320769.502493:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993
00000100:00100000:3.0:1767320769.502501:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380097408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320769.502545:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380097408:12345-0@lo:400:kworker.0 Request processed in 45us (189us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320769.502552:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993
00000100:00100000:3.0:1767320769.502587:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380097408:0@lo:400:kworker.0
00000100:00080000:3.0:1767320769.502620:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320769.503724:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380097152:0@lo:38:kworker.0
00000100:00100000:0.0:1767320769.503776:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320769.504236:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097152
00000100:00100000:3.0:1767320769.504243:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097152
00000100:00100000:3.0:1767320769.504282:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246
00000100:00100000:3.0:1767320769.504288:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380097152:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320769.504309:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320769.504354:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380097152:12345-0@lo:38:kworker.0 Request processed in 65us (577us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320769.504361:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246
00000100:00080000:0.0:1767320769.504441:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320769.504447:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320769.504450:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380097152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320769.506656:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380097280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320769.506730:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320769.506988:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097280
00000100:00100000:3.0:1767320769.506997:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097280
00000100:00100000:3.0:1767320769.507066:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994
00000100:00100000:3.0:1767320769.507075:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380097280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320769.507132:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380097280:12345-0@lo:400:kworker.0 Request processed in 58us (402us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320769.507140:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994
00000100:00080000:0.0:1767320769.507283:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320769.507358:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380097280:0@lo:400:kworker.0
00000100:00100000:0.0:1767320769.508133:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380097536:0@lo:400:kworker.0
00000100:00100000:0.0:1767320769.508175:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320769.508236:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097536
00000100:00100000:1.0:1767320769.508242:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097536
00000100:00100000:1.0:1767320769.508296:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042
00000100:00100000:1.0:1767320769.508303:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380097536:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767320769.508365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320769.508428:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320769.508433:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320769.508436:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320769.508441:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5667
00000100:00080000:2.0:1767320769.508445:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320769.508450:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320769.508490:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628a80 x1853164380097664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320769.508551:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380097792:0@lo:400:kworker.0
00000100:00100000:3.0:1767320769.508580:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320769.508626:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097792
00000100:00100000:3.0:1767320769.508630:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097792
00000100:00100000:3.0:1767320769.508674:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5043
00000100:00100000:3.0:1767320769.508682:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380097792:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320769.508716:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380097792:12345-0@lo:400:kworker.0 Request processed in 35us (135us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320769.508723:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5043
00000100:00080000:3.0:1767320769.508738:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320769.508760:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380097792:0@lo:400:kworker.0
00000100:00100000:3.0:1767320769.508789:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380097664:0@lo:38:kworker.0
00000100:00100000:3.0:1767320769.508811:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320769.508833:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097664
00000100:00100000:3.0:1767320769.508836:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097664
00000100:00100000:3.0:1767320769.508853:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18027
00000100:00100000:3.0:1767320769.508857:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380097664:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320769.508895:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320769.508922:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380097664:12345-0@lo:38:kworker.0 Request processed in 63us (110us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320769.508928:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18027
00000100:00080000:3.0:1767320769.508948:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320769.508963:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320769.508966:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380097664:0@lo:38:kworker.0
00000100:00100000:1.0:1767320769.509360:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380097536:12345-0@lo:400:kworker.0 Request processed in 1056us (1182us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320769.509368:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042
00000100:00080000:2.0:1767320769.509448:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320769.509667:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320769.509670:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320769.509674:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5667
00000100:00080000:2.0:1767320769.509678:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320769.509683:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320769.509706:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162b100 x1853164380097920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320769.509821:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380097920:0@lo:38:kworker.0
00000100:00100000:3.0:1767320769.509856:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320769.509941:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380097920
00000100:00100000:1.0:1767320769.509947:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380097920
00000100:00100000:1.0:1767320769.511670:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18028
00000100:00100000:1.0:1767320769.511685:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380097920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320769.511710:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320769.511788:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380097920:12345-0@lo:38:kworker.0 Request processed in 104us (1930us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320769.511795:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18028
00000100:00080000:2.0:1767320769.512738:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320769.512746:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320769.512750:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380097920:0@lo:38:kworker.0
00000100:00100000:0.0:1767320769.515790:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380097536:0@lo:400:kworker.0
00010000:00010000:0.0:1767320770.071344:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320770.519650:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380098048:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320770.519829:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320770.520484:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098048
00000100:00100000:2.0:1767320770.520493:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098048
00000100:00100000:2.0:1767320770.520559:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806
00000100:00100000:2.0:1767320770.520570:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380098048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320770.520602:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320770.520657:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380098048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (827us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320770.520665:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806
00000100:00100000:2.0:1767320770.520745:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380098048:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320771.095066:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320771.472842:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320771.472910:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320771.473078:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291992576
00000100:00100000:1.0:1767320771.473087:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291992576
00000100:00100000:1.0:1767320771.473142:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291992704
00000100:00100000:1.0:1767320771.473146:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291992704
00000100:00100000:1.0:1767320771.473192:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5044
00000100:00100000:1.0:1767320771.473198:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291992704:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320771.473254:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291992704:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 57us (344us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320771.473259:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5044
00000100:00100000:1.0:1767320771.473279:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18029
00000100:00100000:1.0:1767320771.473283:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291992576:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320771.473304:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320771.473329:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291992576:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (494us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320771.473378:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18029
00000100:00080000:2.0:1767320771.473746:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320772.059135:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320772.059159:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380098176:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320772.059229:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320772.059400:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098176
00000100:00100000:0.0:1767320772.059408:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098176
00000100:00100000:0.0:1767320772.059498:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807
00000100:00100000:0.0:1767320772.059509:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380098176:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320772.059540:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320772.059590:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380098176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (360us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320772.059597:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807
00000100:00080000:3.0:1767320772.059692:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320772.059727:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380098176:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320772.119754:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320773.143723:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320774.167119:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320774.479307:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320774.479356:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320774.479447:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291992960
00000100:00100000:0.0:1767320774.479457:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291992960
00000100:00100000:0.0:1767320774.479547:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291992832
00000100:00100000:0.0:1767320774.479551:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291992832
00000100:00100000:0.0:1767320774.479571:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5045
00000100:00100000:0.0:1767320774.479582:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291992960:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320774.479655:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291992960:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 75us (359us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320774.479662:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5045
00000100:00100000:0.0:1767320774.479681:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18030
00000100:00100000:0.0:1767320774.479686:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291992832:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320774.479706:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320774.479732:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291992832:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (375us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320774.479738:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18030
00000100:00080000:2.0:1767320774.479808:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320774.615101:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320774.615112:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320774.615115:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320774.615119:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320774.615123:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320774.615131:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5671
00000100:00080000:1.0:1767320774.615136:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320774.615142:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320774.615301:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05880 x1853164380098304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320774.615318:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320774.615321:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320774.615324:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320774.615327:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5671
00000100:00080000:1.0:1767320774.615330:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320774.615334:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320774.615345:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05180 x1853164380098432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320774.615414:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380098560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320774.615488:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320774.615608:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380098304:0@lo:38:kworker.0
00000100:00100000:2.0:1767320774.615639:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320774.615655:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380098432:0@lo:38:kworker.0
00000100:00100000:2.0:1767320774.615677:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320774.615719:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098432
00000100:00100000:2.0:1767320774.615727:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098432
00000100:00100000:2.0:1767320774.615755:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247
00000100:00100000:2.0:1767320774.615762:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380098432:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320774.615781:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320774.615818:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380098432:12345-0@lo:38:kworker.0 Request processed in 55us (140us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320774.615825:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247
00000100:00080000:2.0:1767320774.615860:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320774.615864:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320774.615888:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380098432:0@lo:38:kworker.0
00000100:00100000:3.0:1767320774.615979:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098560
00000100:00100000:3.0:1767320774.615984:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098560
00000100:00100000:3.0:1767320774.616042:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995
00000100:00100000:3.0:1767320774.616050:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380098560:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767320774.618241:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320774.618291:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380098688:0@lo:400:kworker.0
00000100:00100000:2.0:1767320774.618354:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320774.618405:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098688
00000100:00100000:2.0:1767320774.618411:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098688
00000100:00100000:2.0:1767320774.618467:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996
00000100:00100000:2.0:1767320774.618475:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380098688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320774.618521:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380098688:12345-0@lo:400:kworker.0 Request processed in 46us (166us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320774.618527:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996
00000100:00100000:2.0:1767320774.618553:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098304
00000100:00100000:2.0:1767320774.618557:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098304
00000100:00100000:2.0:1767320774.618588:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18031
00000100:00100000:2.0:1767320774.618593:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380098304:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320774.618611:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320774.618647:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380098304:12345-0@lo:38:kworker.0 Request processed in 52us (3007us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320774.618653:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18031
00000100:00080000:2.0:1767320774.618665:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320774.618692:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380098688:0@lo:400:kworker.0
00000100:00080000:2.0:1767320774.618718:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320774.618722:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320774.618725:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380098304:0@lo:38:kworker.0
00000100:00080000:1.0:1767320774.619641:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320774.619646:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320774.619649:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320774.619655:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5671
00000100:00080000:1.0:1767320774.619658:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320774.619663:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320774.619670:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320774.619680:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380098816:0@lo:400:kworker.0
00000100:00100000:1.0:1767320774.619719:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320774.619749:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098816
00000100:00100000:1.0:1767320774.619753:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098816
00000100:00100000:1.0:1767320774.619790:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5046
00000100:00100000:1.0:1767320774.619797:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380098816:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320774.619834:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380098816:12345-0@lo:400:kworker.0 Request processed in 37us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320774.619840:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5046
00000100:00100000:1.0:1767320774.619888:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380098816:0@lo:400:kworker.0
00000100:00080000:1.0:1767320774.619903:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320774.619927:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164380098944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320774.619950:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380098944:0@lo:38:kworker.0
00000100:00100000:1.0:1767320774.619974:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320774.620118:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380098944
00000100:00100000:1.0:1767320774.620122:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380098944
00000100:00100000:1.0:1767320774.620140:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18032
00000100:00100000:1.0:1767320774.620145:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380098944:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320774.620161:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320774.624155:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380098944:12345-0@lo:38:kworker.0 Request processed in 3998us (4169us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320774.624565:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18032
00000100:00080000:1.0:1767320774.624646:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320774.624652:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320774.624657:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380098944:0@lo:38:kworker.0
00000100:00080000:1.0:1767320774.624714:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320774.624719:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320774.624721:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320774.624726:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5671
00000100:00080000:1.0:1767320774.624731:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320774.624737:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320774.624751:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380099072:0@lo:400:kworker.0
00000100:00100000:1.0:1767320774.624794:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320774.624830:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099072
00000100:00100000:1.0:1767320774.624835:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099072
00000100:00100000:1.0:1767320774.624898:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5047
00000100:00100000:1.0:1767320774.624908:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380099072:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320774.624958:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380099072:12345-0@lo:400:kworker.0 Request processed in 52us (163us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320774.624965:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5047
00000100:00100000:1.0:1767320774.625068:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380099072:0@lo:400:kworker.0
00000100:00080000:1.0:1767320774.625087:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320774.625113:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05f80 x1853164380099200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320774.625137:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380099200:0@lo:38:kworker.0
00000100:00100000:1.0:1767320774.625162:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320774.625400:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099200
00000100:00100000:1.0:1767320774.625405:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099200
00000100:00100000:1.0:1767320774.625437:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18033
00000100:00100000:1.0:1767320774.625442:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380099200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320774.625462:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320774.625493:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380099200:12345-0@lo:38:kworker.0 Request processed in 50us (331us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320774.625500:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18033
00000100:00080000:1.0:1767320774.625526:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320774.625530:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320774.625533:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380099200:0@lo:38:kworker.0
00000100:00100000:3.0:1767320774.626132:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380098560:12345-0@lo:400:kworker.0 Request processed in 10080us (10640us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320774.626142:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995
00000100:00100000:0.0:1767320774.627309:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380098560:0@lo:400:kworker.0
00010000:00010000:2.0:1767320775.195587:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320775.642025:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320775.642051:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380099328:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320775.642129:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320775.642279:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099328
00000100:00100000:1.0:1767320775.642288:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099328
00000100:00100000:1.0:1767320775.642341:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808
00000100:00100000:1.0:1767320775.642349:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380099328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320775.642385:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320775.642480:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380099328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (350us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320775.642488:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808
00000100:00100000:3.0:1767320775.642650:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380099328:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320776.215360:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320777.175613:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380099456:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320777.175692:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320777.177178:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099456
00000100:00100000:1.0:1767320777.177189:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099456
00000100:00100000:1.0:1767320777.177259:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809
00000100:00100000:1.0:1767320777.177270:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380099456:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320777.177299:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320777.177378:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380099456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1685us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320777.177386:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809
00000100:00100000:0.0:1767320777.177552:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380099456:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320777.177726:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320777.239115:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320778.264047:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320779.291657:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320779.664707:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320779.664747:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320779.664902:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291993216
00000100:00100000:1.0:1767320779.664912:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291993216
00000100:00100000:1.0:1767320779.664972:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291993088
00000100:00100000:1.0:1767320779.664975:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291993088
00000100:00100000:1.0:1767320779.664990:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5048
00000100:00100000:1.0:1767320779.665000:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291993216:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320779.665090:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291993216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (390us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320779.665098:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5048
00000100:00100000:1.0:1767320779.665118:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18034
00000100:00100000:1.0:1767320779.665122:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291993088:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320779.665142:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320779.665169:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291993088:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (420us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320779.665174:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18034
00000100:00080000:3.0:1767320779.665382:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320779.738442:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320779.738453:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320779.738456:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320779.738460:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320779.738465:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320779.738471:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5677
00000100:00080000:1.0:1767320779.738475:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320779.738482:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320779.738523:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06d80 x1853164380099584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320779.738540:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320779.738543:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320779.738545:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320779.738548:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5677
00000100:00080000:1.0:1767320779.738551:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320779.738554:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320779.738563:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04a80 x1853164380099712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320779.738624:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320779.738627:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320779.738629:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320779.738633:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5677
00000100:00080000:1.0:1767320779.738635:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320779.738638:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320779.738647:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05500 x1853164380100224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320779.738660:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320779.738664:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320779.738665:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320779.738668:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5677
00000100:00080000:1.0:1767320779.738670:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320779.738673:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320779.738681:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04000 x1853164380100480/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320779.738707:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380100096:0@lo:400:kworker.0
00000100:00100000:1.0:1767320779.738765:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320779.738822:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320779.738827:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380100352:0@lo:400:kworker.0
00000100:00100000:1.0:1767320779.738845:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320779.738888:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100096
00000100:00100000:1.0:1767320779.738894:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100096
00000100:00100000:1.0:1767320779.738936:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100352
00000100:00100000:1.0:1767320779.738938:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100352
00000100:00100000:1.0:1767320779.738955:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5049
00000100:00100000:1.0:1767320779.738962:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380100096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320779.739004:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380100096:12345-0@lo:400:kworker.0 Request processed in 42us (239us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320779.739011:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5049
00000100:00100000:1.0:1767320779.739027:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5050
00000100:00100000:1.0:1767320779.739032:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380100352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320779.739051:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380100352:12345-0@lo:400:kworker.0 Request processed in 19us (205us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320779.739056:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5050
00000100:00100000:1.0:1767320779.739085:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380100352:0@lo:400:kworker.0
00000100:00100000:1.0:1767320779.739093:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380100096:0@lo:400:kworker.0
00000100:00100000:0.0:1767320779.739356:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380099968:0@lo:400:kworker.0
00000100:00100000:0.0:1767320779.739398:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320779.739430:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320779.739435:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380099840:0@lo:400:kworker.0
00000100:00100000:0.0:1767320779.739452:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320779.739501:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099968
00000100:00100000:0.0:1767320779.739505:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099968
00000100:00100000:0.0:1767320779.739530:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099840
00000100:00100000:0.0:1767320779.739532:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099840
00000100:00100000:0.0:1767320779.739548:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997
00000100:00100000:0.0:1767320779.739553:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380099968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320779.739582:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380099968:12345-0@lo:400:kworker.0 Request processed in 28us (184us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320779.739587:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997
00000100:00100000:0.0:1767320779.739597:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998
00000100:00100000:0.0:1767320779.739602:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380099840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320779.739622:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380099840:12345-0@lo:400:kworker.0 Request processed in 20us (169us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320779.739627:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998
00000100:00100000:0.0:1767320779.739652:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380099840:0@lo:400:kworker.0
00000100:00100000:0.0:1767320779.739660:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380099968:0@lo:400:kworker.0
00000100:00080000:3.0:1767320779.739910:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320779.739915:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320779.739917:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320779.740072:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380099584:0@lo:38:kworker.0
00000100:00100000:2.0:1767320779.740102:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320779.740154:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380099712:0@lo:38:kworker.0
00000100:00100000:2.0:1767320779.740174:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320779.740201:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380100224:0@lo:38:kworker.0
00000100:00100000:2.0:1767320779.740218:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320779.740250:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099712
00000100:00100000:3.0:1767320779.740254:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099712
00000100:00100000:3.0:1767320779.740281:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248
00000100:00100000:3.0:1767320779.740286:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380099712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320779.740302:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320779.740343:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380099712:12345-0@lo:38:kworker.0 Request processed in 56us (167us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320779.740348:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248
00000100:00100000:2.0:1767320779.740513:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380100480:0@lo:38:kworker.0
00000100:00100000:2.0:1767320779.740535:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320779.740588:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380099584
00000100:00100000:0.0:1767320779.740592:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380099584
00000100:00100000:0.0:1767320779.740616:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100224
00000100:00100000:0.0:1767320779.740618:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100224
00000100:00100000:0.0:1767320779.740631:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18035
00000100:00100000:0.0:1767320779.740635:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380099584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320779.740645:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320779.740668:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380099584:12345-0@lo:38:kworker.0 Request processed in 32us (566us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320779.740676:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18035
00000100:00100000:0.0:1767320779.740686:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18036
00000100:00100000:0.0:1767320779.740690:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380100224:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320779.740697:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320779.740713:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380100224:12345-0@lo:38:kworker.0 Request processed in 23us (495us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320779.740719:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18036
00000100:00080000:2.0:1767320779.740909:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320779.740915:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320779.740918:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380099584:0@lo:38:kworker.0
00000100:00080000:2.0:1767320779.740926:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320779.740929:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320779.740932:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380099712:0@lo:38:kworker.0
00000100:00080000:2.0:1767320779.740938:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767320779.741024:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100480
00000100:00100000:3.0:1767320779.741028:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100480
00000100:00100000:3.0:1767320779.741051:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18037
00000100:00100000:3.0:1767320779.741055:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380100480:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320779.741065:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320779.741089:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380100480:12345-0@lo:38:kworker.0 Request processed in 33us (553us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320779.741094:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18037
00000100:00080000:2.0:1767320779.741154:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320779.741157:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380100224:0@lo:38:kworker.0
00000100:00080000:2.0:1767320779.741168:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320779.741171:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320779.741174:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380100480:0@lo:38:kworker.0
00010000:00010000:2.0:1767320780.311540:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320780.761458:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380100608:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320780.761535:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320780.761671:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100608
00000100:00100000:2.0:1767320780.761680:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100608
00000100:00100000:2.0:1767320780.761738:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810
00000100:00100000:2.0:1767320780.761747:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380100608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320780.761776:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320780.761817:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380100608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (282us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320780.761824:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810
00000100:00100000:3.0:1767320780.761918:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380100608:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320781.335280:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320782.295288:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380100736:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320782.295374:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320782.295581:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100736
00000100:00100000:1.0:1767320782.295589:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100736
00000100:00080000:3.0:1767320782.295660:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320782.299979:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811
00000100:00100000:1.0:1767320782.300017:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380100736:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320782.300054:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320782.300161:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380100736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (4786us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320782.300169:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811
00000100:00100000:0.0:1767320782.300385:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380100736:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767320782.361568:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320783.383371:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320784.407155:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320784.784317:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320784.784508:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291993472
00000100:00100000:1.0:1767320784.784518:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291993472
00000100:00080000:3.0:1767320784.784574:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320784.784592:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5051
00000100:00100000:1.0:1767320784.784605:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291993472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320784.784691:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291993472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (389us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320784.784698:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5051
00000100:00100000:1.0:1767320784.795990:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320784.796072:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291993344
00000100:00100000:0.0:1767320784.796085:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291993344
00000100:00100000:0.0:1767320784.796152:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18038
00000100:00100000:0.0:1767320784.796161:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291993344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320784.796188:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320784.796270:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291993344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 108us (288us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320784.796279:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18038
00000100:00080000:0.0:1767320784.856518:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320784.856529:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320784.856532:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320784.856536:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320784.856541:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320784.856548:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5682
00000100:00080000:0.0:1767320784.856553:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320784.856559:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320784.856605:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4e00 x1853164380100864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320784.856633:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320784.856637:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320784.856639:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320784.856643:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5682
00000100:00080000:0.0:1767320784.856645:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320784.856649:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320784.856661:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4700 x1853164380100992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320784.856719:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320784.856722:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320784.856724:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320784.856738:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5682
00000100:00080000:0.0:1767320784.856741:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320784.856745:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320784.856756:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44a80 x1853164380101504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320784.856771:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320784.856774:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320784.856776:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320784.856779:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5682
00000100:00080000:0.0:1767320784.856781:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320784.856785:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320784.856793:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164380101760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320784.856821:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380101248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320784.856900:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320784.856961:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320784.856967:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380101120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320784.857129:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380101248
00000100:00100000:1.0:1767320784.857137:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380101248
00000100:00100000:1.0:1767320784.857191:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999
00000100:00100000:1.0:1767320784.857200:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380101248:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320784.857298:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380101632:0@lo:400:kworker.0
00000100:00080000:3.0:1767320784.857367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320784.857385:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380101376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320784.858043:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380101248:12345-0@lo:400:kworker.0 Request processed in 843us (1141us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320784.858052:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999
00000100:00100000:1.0:1767320784.858090:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380100864:0@lo:38:kworker.0
00000100:00100000:1.0:1767320784.858119:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320784.858143:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380100992:0@lo:38:kworker.0
00000100:00100000:1.0:1767320784.858166:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320784.858191:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380101504:0@lo:38:kworker.0
00000100:00100000:1.0:1767320784.858213:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320784.858230:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380101760:0@lo:38:kworker.0
00000100:00100000:1.0:1767320784.858248:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320784.858280:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100992
00000100:00100000:1.0:1767320784.858285:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100992
00000100:00100000:1.0:1767320784.858308:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249
00000100:00100000:1.0:1767320784.858313:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380100992:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320784.858346:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320784.858545:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380100992:12345-0@lo:38:kworker.0 Request processed in 69us (216us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320784.858554:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249
00000100:00100000:1.0:1767320784.858576:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380100864
00000100:00100000:1.0:1767320784.858579:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380100864
00000100:00100000:1.0:1767320784.858598:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380101504
00000100:00100000:1.0:1767320784.858600:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380101504
00000100:00100000:1.0:1767320784.858612:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380101760
00000100:00100000:1.0:1767320784.858614:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380101760
00000100:00100000:1.0:1767320784.858627:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18039
00000100:00100000:1.0:1767320784.858632:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380100864:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320784.858642:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320784.858669:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380100864:12345-0@lo:38:kworker.0 Request processed in 36us (549us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320784.858675:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18039
00000100:00100000:1.0:1767320784.858686:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18040
00000100:00100000:1.0:1767320784.858690:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380101504:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320784.858699:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320784.858722:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380101504:12345-0@lo:38:kworker.0 Request processed in 30us (508us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320784.858727:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18040
00000100:00100000:1.0:1767320784.858852:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18041
00000100:00100000:1.0:1767320784.858856:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380101760:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320784.858867:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320784.858912:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380101760:12345-0@lo:38:kworker.0 Request processed in 54us (663us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320784.858917:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18041
00000100:00080000:1.0:1767320784.858957:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320784.858962:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320784.858966:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380100864:0@lo:38:kworker.0
00000100:00080000:1.0:1767320784.858975:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320784.858977:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320784.858980:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380100992:0@lo:38:kworker.0
00000100:00080000:1.0:1767320784.859180:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320784.859185:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320784.859187:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380101504:0@lo:38:kworker.0
00000100:00080000:1.0:1767320784.859195:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320784.859198:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320784.859200:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380101760:0@lo:38:kworker.0
00000100:00100000:2.0:1767320784.864516:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320784.864680:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320784.864800:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380101632
00000100:00100000:2.0:1767320784.864811:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380101632
00000100:00100000:1.0:1767320784.864832:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380101376
00000100:00100000:1.0:1767320784.864837:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380101376
00000100:00080000:3.0:1767320784.864915:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320784.865280:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320784.865343:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380101248:0@lo:400:kworker.0
00000100:00100000:3.0:1767320784.865913:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380101120
00000100:00100000:3.0:1767320784.865919:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380101120
00000100:00100000:3.0:1767320784.865982:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000
00000100:00100000:3.0:1767320784.865992:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380101120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320784.866075:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380101120:12345-0@lo:400:kworker.0 Request processed in 86us (795us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320784.866083:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000
00000100:00100000:3.0:1767320784.866373:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380101120:0@lo:400:kworker.0
00000100:00080000:0.0:1767320784.866864:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320784.870230:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5052
00000100:00100000:1.0:1767320784.870259:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380101632:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320784.871190:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5053
00000100:00100000:0.0:1767320784.871208:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380101376:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320784.884272:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380101376:12345-0@lo:400:kworker.0 Request processed in 13062us (19582us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320784.884289:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5053
00000100:00100000:3.0:1767320784.884500:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380101376:0@lo:400:kworker.0
00000100:00100000:1.0:1767320784.888610:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380101632:12345-0@lo:400:kworker.0 Request processed in 18355us (24095us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320784.888627:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5052
00000100:00100000:2.0:1767320784.888858:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380101632:0@lo:400:kworker.0
00010000:00010000:2.0:1767320785.431217:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320785.880648:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380101888:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320785.880748:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320785.880844:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380101888
00000100:00100000:2.0:1767320785.880853:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380101888
00000100:00100000:2.0:1767320785.880978:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812
00000100:00100000:2.0:1767320785.880988:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380101888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320785.881019:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320785.882098:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380101888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1108us (1345us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320785.882522:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380101888:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320785.884470:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812
00010000:00010000:0.0:1767320786.455180:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320787.415280:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380102016:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320787.415383:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320787.415526:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102016
00000100:00100000:0.0:1767320787.415535:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102016
00000100:00100000:0.0:1767320787.415602:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813
00000100:00100000:0.0:1767320787.415612:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380102016:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320787.415642:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320787.415690:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380102016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (308us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320787.415701:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813
00000100:00100000:0.0:1767320787.415746:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380102016:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320787.415853:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320787.479124:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320788.503939:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320789.527112:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320789.909737:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320789.909852:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320789.914231:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291993728
00000100:00100000:1.0:1767320789.914247:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291993728
00000100:00080000:3.0:1767320789.914317:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320789.914337:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291993600
00000100:00100000:1.0:1767320789.914341:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291993600
00000100:00100000:1.0:1767320789.914368:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5054
00000100:00100000:1.0:1767320789.914382:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291993728:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320789.914382:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18042
00000100:00100000:2.0:1767320789.914396:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291993600:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320789.914418:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320789.914457:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291993728:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (4731us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320789.914464:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5054
00000100:00100000:2.0:1767320789.914751:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291993600:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 356us (4898us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320789.914758:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18042
00000100:00080000:3.0:1767320789.975452:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320789.975463:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320789.975467:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320789.975473:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320789.975478:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320789.975485:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5687
00000100:00080000:3.0:1767320789.975490:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320789.975497:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320789.975536:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680000 x1853164380102144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320789.975595:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380102144:0@lo:38:kworker.0
00000100:00100000:1.0:1767320789.975674:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320789.975828:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102144
00000100:00100000:0.0:1767320789.975837:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102144
00000100:00100000:0.0:1767320789.975896:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18043
00000100:00100000:0.0:1767320789.975909:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380102144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320789.975931:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320789.976044:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320789.976048:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320789.976050:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320789.976055:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5687
00000100:00080000:3.0:1767320789.976057:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320789.976062:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320789.976076:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681f80 x1853164380102272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320789.976488:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380102272:0@lo:38:kworker.0
00000100:00100000:1.0:1767320789.976521:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320789.976597:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102272
00000100:00100000:2.0:1767320789.976602:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102272
00000100:00100000:2.0:1767320789.976629:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250
00000100:00100000:2.0:1767320789.976634:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380102272:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320789.976659:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320789.976693:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380102272:12345-0@lo:38:kworker.0 Request processed in 58us (171us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320789.976700:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250
00000100:00100000:0.0:1767320789.977217:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380102144:12345-0@lo:38:kworker.0 Request processed in 1311us (1541us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320789.977226:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18043
00000100:00080000:2.0:1767320789.977555:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320789.977559:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320789.977561:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320789.977566:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5687
00000100:00080000:2.0:1767320789.977569:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320789.977574:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320789.977591:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21180 x1853164380102784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320789.977609:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320789.977612:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320789.977613:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320789.977617:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5687
00000100:00080000:2.0:1767320789.977619:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320789.977623:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320789.977632:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21500 x1853164380103040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320789.977665:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380102656:0@lo:400:kworker.0
00000100:00100000:2.0:1767320789.977693:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320789.977709:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320789.977712:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380102912:0@lo:400:kworker.0
00000100:00100000:2.0:1767320789.977724:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320789.977741:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102656
00000100:00100000:2.0:1767320789.977745:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102656
00000100:00100000:2.0:1767320789.977790:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102912
00000100:00100000:2.0:1767320789.977794:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102912
00000100:00100000:2.0:1767320789.977813:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5055
00000100:00100000:2.0:1767320789.977819:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380102656:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320789.977862:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380102656:12345-0@lo:400:kworker.0 Request processed in 43us (167us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320789.977884:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5055
00000100:00100000:2.0:1767320789.977899:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5056
00000100:00100000:2.0:1767320789.977905:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380102912:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320789.977931:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380102912:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320789.977937:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5056
00000100:00100000:2.0:1767320789.977973:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380102912:0@lo:400:kworker.0
00000100:00100000:2.0:1767320789.977983:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380102656:0@lo:400:kworker.0
00000100:00100000:3.0:1767320789.978525:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380102528:0@lo:400:kworker.0
00000100:00100000:3.0:1767320789.978564:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320789.978603:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320789.978609:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380102400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320789.978629:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320789.978671:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320789.978688:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102528
00000100:00100000:3.0:1767320789.978692:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102528
00000100:00100000:3.0:1767320789.978725:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102400
00000100:00100000:3.0:1767320789.978727:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102400
00000100:00100000:3.0:1767320789.978745:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001
00000100:00100000:3.0:1767320789.978750:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380102528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320789.978805:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380102528:12345-0@lo:400:kworker.0 Request processed in 54us (240us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320789.978810:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001
00000100:00100000:3.0:1767320789.978822:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002
00000100:00100000:3.0:1767320789.978828:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380102400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320789.978861:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380102400:12345-0@lo:400:kworker.0 Request processed in 34us (231us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320789.978866:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002
00000100:00080000:3.0:1767320789.978900:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320789.978902:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320789.978922:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380102400:0@lo:400:kworker.0
00000100:00100000:3.0:1767320789.978930:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380102528:0@lo:400:kworker.0
00000100:00080000:1.0:1767320789.980589:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320789.980601:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320789.980607:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380102144:0@lo:38:kworker.0
00000100:00100000:1.0:1767320789.980641:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380102784:0@lo:38:kworker.0
00000100:00100000:1.0:1767320789.981141:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320789.981243:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380103040:0@lo:38:kworker.0
00000100:00100000:1.0:1767320789.981268:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320789.981355:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320789.981360:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320789.981363:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380102272:0@lo:38:kworker.0
00000100:00100000:0.0:1767320789.981606:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380102784
00000100:00100000:0.0:1767320789.981614:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380102784
00000100:00100000:2.0:1767320789.981729:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380103040
00000100:00100000:2.0:1767320789.981734:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380103040
00000100:00100000:0.0:1767320789.981748:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18044
00000100:00100000:0.0:1767320789.981775:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380102784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320789.981797:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320789.981813:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18045
00000100:00100000:2.0:1767320789.981819:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380103040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320789.981828:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320789.981855:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380102784:12345-0@lo:38:kworker.0 Request processed in 98us (714us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320789.981855:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380103040:12345-0@lo:38:kworker.0 Request processed in 34us (585us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320789.981862:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18045
00000100:00100000:0.0:1767320789.982328:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18044
00000100:00080000:1.0:1767320789.985431:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320789.985443:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320789.985448:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380102784:0@lo:38:kworker.0
00000100:00080000:1.0:1767320789.985459:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320789.985462:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320789.985465:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380103040:0@lo:38:kworker.0
00010000:00010000:0.0:1767320790.552409:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767320790.939121:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291993856 offset 0 length 520: 4
00000100:00100000:2.0:1767320790.939199:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320790.939818:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291993984
00000100:00100000:0.0:1767320790.939828:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291993984
00000100:00100000:3.0:1767320790.939901:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320790.942456:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291994112
00000100:00100000:0.0:1767320790.942470:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291994112
00000100:00100000:0.0:1767320790.942554:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5057
00000100:00100000:0.0:1767320790.942566:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291994112:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320790.942655:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291994112:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 90us (2755us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320790.942660:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18046
00000100:00100000:0.0:1767320790.942670:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5057
00000100:00100000:3.0:1767320790.942672:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291993984:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320790.942694:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320790.942727:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291993984:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (3530us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320790.942733:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18046
00000100:00100000:0.0:1767320790.999586:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380103168:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320790.999659:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320790.999783:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380103168
00000100:00100000:1.0:1767320790.999792:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380103168
00000100:00100000:1.0:1767320790.999844:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814
00000100:00100000:1.0:1767320790.999854:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380103168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320790.999903:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320790.999958:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380103168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320790.999965:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814
00000100:00100000:2.0:1767320791.000569:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380103168:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320791.576183:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320792.535732:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320792.535767:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380103296:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320792.535841:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320792.536049:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380103296
00000100:00100000:1.0:1767320792.536058:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380103296
00000100:00100000:1.0:1767320792.536129:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815
00000100:00100000:1.0:1767320792.536151:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380103296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320792.536182:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320792.536232:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380103296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (390us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320792.536240:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815
00000100:00080000:0.0:1767320792.536927:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320792.536977:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380103296:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320792.599107:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320793.624235:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320794.071017:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320769/real 1767320769]  req@ffff8b0e01628700 x1853164380096896/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320794 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320794.071053:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e01628700 x1853164380096896/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320794 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320794.071076:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320794.071112:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320794.071117:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380096896:0@lo:250:kworker.0
00000100:00080000:3.0:1767320794.071308:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320794.071313:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767320794.071317:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320794.071322:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5671
00000100:00080000:3.0:1767320794.071326:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320794.071332:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320794.071365:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02681f80 x1853164380103424/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320794.071390:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320794.071393:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320794.071394:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320794.071397:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5692
00000100:00080000:3.0:1767320794.071399:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320794.071401:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320794.071415:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680000 x1853164380103552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320794.071421:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320794.071423:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320794.071424:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320794.071427:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5692
00000100:00080000:3.0:1767320794.071428:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320794.071431:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320794.071438:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9df80 x1853164380103680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320794.071492:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380103808:0@lo:400:kworker.0
00000100:00100000:2.0:1767320794.071546:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320794.071676:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380103808
00000100:00100000:0.0:1767320794.071684:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380103808
00000100:00100000:0.0:1767320794.071731:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003
00000100:00100000:0.0:1767320794.071738:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380103808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.071820:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380103424:0@lo:250:kworker.0
00000400:00000100:1.0:1767320794.071843:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380103424 offset 0 length 520: 4
00000100:00100000:1.0:1767320794.071863:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380103552:0@lo:38:kworker.0
00000100:00100000:1.0:1767320794.071909:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320794.071929:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380103680:0@lo:38:kworker.0
00000100:00100000:1.0:1767320794.071950:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320794.071979:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380103680
00000100:00100000:1.0:1767320794.071982:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380103680
00000100:00100000:1.0:1767320794.072004:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251
00000100:00100000:1.0:1767320794.072009:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380103680:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320794.072028:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320794.072062:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380103680:12345-0@lo:38:kworker.0 Request processed in 50us (109us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320794.072069:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251
00000100:00080000:1.0:1767320794.072121:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320794.072125:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320794.072128:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380103680:0@lo:38:kworker.0
00000100:00080000:1.0:1767320794.072160:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320794.072170:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380103936:0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.072195:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320794.072230:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380103936
00000100:00100000:1.0:1767320794.072234:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380103936
00000100:00100000:1.0:1767320794.072276:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004
00000100:00100000:1.0:1767320794.072283:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380103936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.072317:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380103936:12345-0@lo:400:kworker.0 Request processed in 34us (121us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320794.072324:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004
00000100:00080000:1.0:1767320794.072343:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320794.072361:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380103936:0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.072397:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380103552
00000100:00100000:1.0:1767320794.072400:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380103552
00000100:00100000:1.0:1767320794.072415:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18047
00000100:00100000:1.0:1767320794.072418:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380103552:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320794.072425:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320794.072446:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380103552:12345-0@lo:38:kworker.0 Request processed in 27us (538us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320794.072450:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18047
00000100:00080000:1.0:1767320794.072467:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320794.072469:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320794.072471:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380103552:0@lo:38:kworker.0
00000100:00080000:3.0:1767320794.073862:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320794.073882:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320794.073886:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320794.073894:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5692
00000100:00080000:3.0:1767320794.073898:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320794.073905:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320794.073924:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608700 x1853164380104192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320794.073949:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320794.073952:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320794.073954:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320794.073957:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5692
00000100:00080000:3.0:1767320794.073959:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320794.073962:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320794.073972:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164380104448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320794.074124:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380104320:0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.074179:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320794.074212:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320794.074218:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380104064:0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.074250:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320794.074281:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104320
00000100:00100000:1.0:1767320794.074288:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104320
00000100:00100000:1.0:1767320794.074347:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104064
00000100:00100000:1.0:1767320794.074351:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104064
00000100:00100000:1.0:1767320794.074374:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5058
00000100:00100000:1.0:1767320794.074382:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380104320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.074434:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380104320:12345-0@lo:400:kworker.0 Request processed in 53us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320794.074441:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5058
00000100:00100000:1.0:1767320794.074460:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5059
00000100:00100000:1.0:1767320794.074466:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380104064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.074494:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380104064:12345-0@lo:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320794.074499:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5059
00000100:00080000:1.0:1767320794.074515:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320794.074548:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380104064:0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.074558:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380104320:0@lo:400:kworker.0
00000100:00100000:1.0:1767320794.074611:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380104192:0@lo:38:kworker.0
00000100:00100000:1.0:1767320794.074637:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320794.074761:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380103808:12345-0@lo:400:kworker.0 Request processed in 3021us (3211us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320794.074770:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003
00000100:00100000:1.0:1767320794.075555:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380104448:0@lo:38:kworker.0
00000100:00100000:1.0:1767320794.075589:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320794.076283:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380103808:0@lo:400:kworker.0
00000100:00100000:0.0:1767320794.076653:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104192
00000100:00100000:0.0:1767320794.076661:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104192
00000100:00100000:0.0:1767320794.076705:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104448
00000100:00100000:0.0:1767320794.076708:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104448
00000100:00100000:0.0:1767320794.076728:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18048
00000100:00100000:0.0:1767320794.076734:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380104192:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320794.076755:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320794.076804:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380104192:12345-0@lo:38:kworker.0 Request processed in 69us (2166us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320794.076811:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18048
00000100:00100000:0.0:1767320794.076826:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18049
00000100:00100000:0.0:1767320794.076830:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380104448:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320794.076839:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320794.076862:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380104448:12345-0@lo:38:kworker.0 Request processed in 30us (1273us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320794.076867:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18049
00000100:00080000:1.0:1767320794.077028:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320794.077034:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320794.077038:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380104192:0@lo:38:kworker.0
00000100:00080000:1.0:1767320794.077046:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320794.077049:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320794.077052:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380104448:0@lo:38:kworker.0
00010000:00010000:0.0:1767320794.647036:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320795.671085:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320796.047376:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320796.047479:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291994368
00000100:00100000:1.0:1767320796.047490:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291994368
00000100:00100000:1.0:1767320796.047577:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5060
00000100:00100000:1.0:1767320796.047588:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291994368:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320796.047672:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291994368:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (307us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320796.047680:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5060
00000100:00080000:2.0:1767320796.047923:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320796.049335:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320796.049497:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291994240
00000100:00100000:3.0:1767320796.049507:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291994240
00000100:00100000:3.0:1767320796.049555:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18050
00000100:00100000:3.0:1767320796.049563:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291994240:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320796.049586:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320796.049643:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291994240:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 79us (312us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320796.049650:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18050
00000100:00100000:1.0:1767320796.119229:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320796.119254:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380104576:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320796.119325:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320796.119547:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104576
00000100:00100000:2.0:1767320796.119557:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104576
00000100:00100000:2.0:1767320796.119636:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816
00000100:00100000:2.0:1767320796.119645:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380104576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320796.119673:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767320796.120026:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320796.120151:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380104576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 506us (824us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320796.120159:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816
00000100:00100000:3.0:1767320796.123905:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380104576:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320796.695158:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320797.658830:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320797.658856:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380104704:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320797.658975:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320797.659388:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104704
00000100:00100000:2.0:1767320797.659399:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104704
00000100:00100000:2.0:1767320797.659467:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817
00000100:00080000:1.0:1767320797.659474:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320797.659476:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380104704:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320797.659506:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320797.659567:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380104704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (593us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320797.659574:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817
00000100:00100000:1.0:1767320797.659710:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380104704:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320797.719089:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320798.743136:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320799.191979:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320799.191987:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320799.191990:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320799.191994:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320799.191998:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320799.192006:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5696
00000100:00080000:2.0:1767320799.192010:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320799.192017:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320799.192055:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21180 x1853164380104832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320799.192080:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320799.192083:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320799.192085:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320799.192089:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5696
00000100:00080000:2.0:1767320799.192091:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320799.192095:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320799.192110:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628700 x1853164380104960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320799.192145:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380104832:0@lo:38:kworker.0
00000100:00080000:2.0:1767320799.192171:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320799.192174:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320799.192176:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320799.192181:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5696
00000100:00080000:2.0:1767320799.192183:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320799.192187:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320799.192215:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d180 x1853164380105472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320799.192234:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320799.192234:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320799.192240:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320799.192242:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320799.192246:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5696
00000100:00080000:2.0:1767320799.192249:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320799.192253:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320799.192265:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e680 x1853164380105728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320799.192299:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380104960:0@lo:38:kworker.0
00000100:00100000:2.0:1767320799.192308:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380105344:0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.192333:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320799.192350:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320799.192371:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380105472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320799.192379:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320799.192388:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380105600:0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.192397:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320799.192420:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380105728:0@lo:38:kworker.0
00000100:00100000:2.0:1767320799.192421:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320799.192450:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320799.192456:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380105216:0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.192487:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104832
00000100:00100000:2.0:1767320799.192491:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320799.192497:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104832
00000100:00100000:2.0:1767320799.192512:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320799.192519:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380105088:0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.192531:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105344
00000100:00100000:1.0:1767320799.192535:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105344
00000100:00100000:2.0:1767320799.192546:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320799.192572:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105472
00000100:00100000:1.0:1767320799.192576:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105472
00000100:00100000:1.0:1767320799.192587:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105600
00000100:00100000:1.0:1767320799.192590:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105600
00000100:00100000:2.0:1767320799.192592:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105728
00000100:00100000:2.0:1767320799.192597:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105728
00000100:00100000:1.0:1767320799.192610:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061
00000100:00100000:1.0:1767320799.192692:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380105344:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.192750:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380105344:12345-0@lo:400:kworker.0 Request processed in 132us (401us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320799.192758:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061
00000100:00100000:2.0:1767320799.192767:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5062
00000100:00100000:2.0:1767320799.192779:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380105600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.192785:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18051
00000100:00100000:1.0:1767320799.192791:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380104832:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320799.192810:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320799.192816:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380105600:12345-0@lo:400:kworker.0 Request processed in 40us (396us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320799.192823:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5062
00000100:00100000:2.0:1767320799.192840:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18052
00000100:00100000:2.0:1767320799.192845:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380105472:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767320799.192852:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380104832:12345-0@lo:38:kworker.0 Request processed in 59us (620us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767320799.192857:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320799.192900:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380105472:12345-0@lo:38:kworker.0 Request processed in 54us (502us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320799.192907:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18052
00000100:00100000:2.0:1767320799.192919:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18053
00000100:00100000:2.0:1767320799.192922:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380105728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320799.192932:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320799.192952:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380105728:12345-0@lo:38:kworker.0 Request processed in 28us (502us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320799.192957:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18053
00000100:00100000:2.0:1767320799.192978:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380104960
00000100:00100000:2.0:1767320799.192982:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380104960
00000100:00100000:2.0:1767320799.193002:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252
00000100:00100000:2.0:1767320799.193006:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380104960:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320799.193015:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320799.193039:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380104960:12345-0@lo:38:kworker.0 Request processed in 31us (706us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320799.193044:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252
00000100:00100000:1.0:1767320799.193064:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18051
00000100:00080000:1.0:1767320799.193093:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320799.193108:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105216
00000100:00100000:2.0:1767320799.193113:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105216
00000100:00080000:1.0:1767320799.193137:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320799.193143:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320799.193146:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105088
00000100:00100000:1.0:1767320799.193149:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380105472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320799.193151:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105088
00000100:00080000:1.0:1767320799.193168:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320799.193173:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320799.193177:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380105728:0@lo:38:kworker.0
00000100:00100000:2.0:1767320799.193182:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005
00000100:00080000:1.0:1767320799.193200:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320799.193206:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320799.193206:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380105216:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.193213:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380104832:0@lo:38:kworker.0
00000100:00080000:1.0:1767320799.193226:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320799.193230:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320799.193233:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380104960:0@lo:38:kworker.0
00000100:00100000:2.0:1767320799.193256:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380105216:12345-0@lo:400:kworker.0 Request processed in 63us (763us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320799.193263:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005
00000100:00100000:2.0:1767320799.193279:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006
00000100:00100000:2.0:1767320799.193289:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380105088:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1767320799.193296:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320799.193300:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320799.193322:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380105088:12345-0@lo:400:kworker.0 Request processed in 35us (775us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320799.193329:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006
00000100:00100000:1.0:1767320799.193363:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380105600:0@lo:400:kworker.0
00000100:00100000:2.0:1767320799.193381:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380105088:0@lo:400:kworker.0
00000100:00100000:1.0:1767320799.193382:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380105344:0@lo:400:kworker.0
00000100:00100000:2.0:1767320799.193406:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380105216:0@lo:400:kworker.0
00010000:00010000:2.0:1767320799.767292:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320800.792299:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320801.182388:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320801.182436:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320801.182512:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291994624
00000100:00100000:1.0:1767320801.182523:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291994624
00000100:00100000:1.0:1767320801.182605:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291994496
00000100:00100000:1.0:1767320801.182609:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291994496
00000100:00100000:1.0:1767320801.182631:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5063
00000100:00100000:1.0:1767320801.182642:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291994624:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320801.182743:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291994624:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 103us (366us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320801.182752:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5063
00000100:00100000:1.0:1767320801.182775:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18054
00000100:00100000:1.0:1767320801.182779:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291994496:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320801.182799:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320801.182823:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291994496:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 42us (387us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320801.182830:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18054
00000100:00080000:0.0:1767320801.183063:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320801.240497:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380105856:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320801.240569:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320801.240810:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105856
00000100:00100000:1.0:1767320801.240818:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105856
00000100:00100000:1.0:1767320801.240903:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818
00000100:00100000:1.0:1767320801.240913:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380105856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320801.240943:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320801.240998:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380105856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (429us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320801.241006:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818
00000100:00100000:2.0:1767320801.241061:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380105856:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320801.241068:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320801.815085:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320802.775127:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380105984:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320802.775216:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320802.775247:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380105984
00000100:00100000:0.0:1767320802.775255:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380105984
00000100:00080000:1.0:1767320802.775293:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320802.775307:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819
00000100:00100000:0.0:1767320802.775316:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380105984:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320802.775355:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320802.775408:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380105984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (192us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320802.775415:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819
00000100:00100000:1.0:1767320802.775461:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380105984:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767320802.839027:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320803.863204:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320804.311129:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320804.311142:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320804.311154:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320804.311159:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320804.311164:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320804.311173:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5701
00000100:00080000:3.0:1767320804.311178:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320804.311184:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320804.311229:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164380106112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320804.311259:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320804.311263:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320804.311265:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320804.311269:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5701
00000100:00080000:3.0:1767320804.311272:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320804.311275:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320804.311288:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608700 x1853164380106240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320804.311353:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320804.311356:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320804.311358:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320804.311362:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5701
00000100:00080000:3.0:1767320804.311364:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320804.311368:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320804.311381:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f5180 x1853164380106752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320804.311396:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320804.311400:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320804.311402:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320804.311406:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5701
00000100:00080000:3.0:1767320804.311408:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320804.311412:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320804.311422:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f7b80 x1853164380107008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320804.311505:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380106880:0@lo:400:kworker.0
00000100:00100000:1.0:1767320804.311573:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320804.311642:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320804.311649:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380106624:0@lo:400:kworker.0
00000100:00100000:1.0:1767320804.311671:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320804.311679:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380106368:0@lo:400:kworker.0
00000100:00100000:2.0:1767320804.311711:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320804.311801:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380106880
00000100:00100000:1.0:1767320804.311810:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380106880
00000100:00100000:0.0:1767320804.313360:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380106496:0@lo:400:kworker.0
00000100:00100000:0.0:1767320804.313417:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320804.323076:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380106368
00000100:00100000:2.0:1767320804.323101:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380106368
00000100:00100000:2.0:1767320804.323180:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380106496
00000100:00100000:2.0:1767320804.323184:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380106496
00000100:00100000:2.0:1767320804.323211:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007
00000100:00100000:2.0:1767320804.323221:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380106368:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320804.323316:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380106368:12345-0@lo:400:kworker.0 Request processed in 97us (11603us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320804.323323:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007
00000100:00100000:2.0:1767320804.323340:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008
00000100:00100000:2.0:1767320804.323346:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380106496:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320804.323371:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380106496:12345-0@lo:400:kworker.0 Request processed in 25us (9954us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320804.323377:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008
00000100:00100000:2.0:1767320804.323425:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380106368:0@lo:400:kworker.0
00000100:00080000:2.0:1767320804.323492:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767320804.323496:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320804.323500:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320804.323519:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380106112:0@lo:38:kworker.0
00000100:00100000:2.0:1767320804.325172:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320804.325225:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380106240:0@lo:38:kworker.0
00000100:00100000:2.0:1767320804.325255:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320804.325286:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380106752:0@lo:38:kworker.0
00000100:00100000:2.0:1767320804.325305:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320804.325321:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380107008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320804.325337:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320804.325377:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380106624
00000100:00100000:2.0:1767320804.325383:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380106624
00000100:00100000:1.0:1767320804.325496:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380106112
00000100:00100000:1.0:1767320804.325501:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380106112
00000100:00100000:1.0:1767320804.325516:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380106752
00000100:00100000:1.0:1767320804.325519:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380106752
00000100:00100000:1.0:1767320804.325526:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107008
00000100:00100000:1.0:1767320804.325528:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107008
00000100:00100000:1.0:1767320804.325539:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5064
00000100:00100000:1.0:1767320804.325548:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380106880:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320804.325612:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380106880:12345-0@lo:400:kworker.0 Request processed in 65us (14037us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320804.325619:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5064
00000100:00100000:0.0:1767320804.327335:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380106496:0@lo:400:kworker.0
00000100:00100000:0.0:1767320804.327526:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18055
00000100:00100000:0.0:1767320804.327534:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380106112:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320804.327561:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320804.327642:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380106112:12345-0@lo:38:kworker.0 Request processed in 107us (2475us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320804.327649:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18055
00000100:00100000:0.0:1767320804.327673:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18056
00000100:00100000:0.0:1767320804.327677:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380106752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320804.327686:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320804.327710:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380106752:12345-0@lo:38:kworker.0 Request processed in 31us (2404us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320804.327715:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18056
00000100:00100000:0.0:1767320804.327726:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18057
00000100:00100000:0.0:1767320804.327730:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380107008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320804.327738:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320804.327758:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380107008:12345-0@lo:38:kworker.0 Request processed in 27us (2420us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320804.327763:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18057
00000100:00100000:0.0:1767320804.327811:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380106880:0@lo:400:kworker.0
00000100:00100000:0.0:1767320804.327844:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380106240
00000100:00100000:0.0:1767320804.327850:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380106240
00000100:00100000:0.0:1767320804.327910:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253
00000100:00100000:0.0:1767320804.327915:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380106240:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320804.327924:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320804.327952:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380106240:12345-0@lo:38:kworker.0 Request processed in 35us (2696us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320804.327958:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253
00000100:00080000:0.0:1767320804.327975:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320804.328378:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320804.328385:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320804.328390:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380106112:0@lo:38:kworker.0
00000100:00080000:0.0:1767320804.328403:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320804.328406:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320804.328409:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380106240:0@lo:38:kworker.0
00000100:00080000:0.0:1767320804.328416:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320804.328419:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320804.328421:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380106752:0@lo:38:kworker.0
00000100:00080000:0.0:1767320804.328429:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320804.328432:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320804.328434:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380107008:0@lo:38:kworker.0
00000100:00100000:2.0:1767320804.329308:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5065
00000100:00100000:2.0:1767320804.329326:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380106624:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320804.329400:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380106624:12345-0@lo:400:kworker.0 Request processed in 82us (17726us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320804.329407:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5065
00000100:00100000:2.0:1767320804.329456:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380106624:0@lo:400:kworker.0
00010000:00010000:2.0:1767320804.887104:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320805.911210:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320806.287268:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320806.287372:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291994752
00000100:00100000:1.0:1767320806.287382:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291994752
00000100:00100000:1.0:1767320806.287434:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18058
00000100:00100000:1.0:1767320806.287443:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291994752:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320806.287467:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320806.287537:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291994752:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 94us (278us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320806.287545:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18058
00000100:00100000:1.0:1767320806.287646:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320806.287701:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291994880
00000100:00100000:3.0:1767320806.287706:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291994880
00000100:00080000:1.0:1767320806.287737:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320806.287747:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5066
00000100:00100000:3.0:1767320806.287755:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291994880:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320806.287797:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291994880:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 43us (150us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320806.293332:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5066
00000100:00100000:3.0:1767320806.359603:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380107136:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320806.359674:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320806.359763:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107136
00000100:00100000:3.0:1767320806.359771:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107136
00000100:00100000:3.0:1767320806.359892:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820
00000100:00100000:2.0:1767320806.359916:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380107136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320806.359946:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320806.359999:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380107136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (325us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320806.360006:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820
00000100:00080000:1.0:1767320806.360221:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320806.362743:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380107136:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767320806.935022:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320807.895224:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380107264:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320807.895293:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320807.895640:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107264
00000100:00100000:1.0:1767320807.895651:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107264
00000100:00100000:1.0:1767320807.895724:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821
00000100:00100000:1.0:1767320807.895734:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380107264:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320807.895763:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767320807.895787:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320807.895816:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380107264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (521us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320807.895823:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821
00000100:00100000:0.0:1767320807.896161:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380107264:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320807.960833:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320808.983282:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320809.431545:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320809.431556:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320809.431559:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320809.431563:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320809.431567:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320809.431574:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5706
00000100:00080000:2.0:1767320809.431579:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320809.431594:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320809.431642:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c000 x1853164380107392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320809.431672:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320809.431675:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320809.431677:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320809.431681:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5706
00000100:00100000:1.0:1767320809.431903:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380107392:0@lo:38:kworker.0
00000100:00100000:1.0:1767320809.431979:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320809.432747:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320809.432753:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320809.433754:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107392
00000100:00100000:3.0:1767320809.433764:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107392
00000100:00100000:3.0:1767320809.433819:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18059
00000100:00100000:3.0:1767320809.433829:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380107392:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320809.433851:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320809.433951:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380107392:12345-0@lo:38:kworker.0 Request processed in 122us (1971us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320809.433959:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18059
00000100:00080000:1.0:1767320809.434943:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320809.434951:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320809.434956:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380107392:0@lo:38:kworker.0
00000100:00100000:2.0:1767320809.439172:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9e300 x1853164380107520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320809.439259:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380107520:0@lo:38:kworker.0
00000100:00100000:1.0:1767320809.439325:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320809.439413:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320809.439426:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380107648:0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.439453:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320809.439488:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380107776:0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.439505:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320809.439529:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107648
00000100:00100000:2.0:1767320809.439535:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107648
00000100:00100000:2.0:1767320809.439578:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107776
00000100:00100000:2.0:1767320809.439580:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107776
00000100:00100000:2.0:1767320809.439598:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009
00000100:00100000:2.0:1767320809.439605:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380107648:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.439656:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380107648:12345-0@lo:400:kworker.0 Request processed in 51us (201us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320809.439663:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009
00000100:00100000:2.0:1767320809.439677:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010
00000100:00080000:3.0:1767320809.439816:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320809.439821:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320809.439844:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320809.439848:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320809.439851:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320809.439856:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5706
00000100:00080000:3.0:1767320809.439860:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320809.439864:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320809.439887:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380107904:0@lo:400:kworker.0
00000100:00100000:3.0:1767320809.439917:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320809.439955:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f5180 x1853164380108032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320809.439995:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380107776:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320809.440173:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107520
00000100:00100000:0.0:1767320809.440179:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107520
00000100:00100000:0.0:1767320809.440201:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254
00000100:00100000:0.0:1767320809.440206:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380107520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320809.440226:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320809.440288:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380107776:12345-0@lo:400:kworker.0 Request processed in 605us (781us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320809.440295:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010
00000100:00100000:2.0:1767320809.440330:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380107776:0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.440339:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380107648:0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.440389:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380107904
00000100:00100000:2.0:1767320809.440391:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380107904
00000100:00100000:2.0:1767320809.440419:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5067
00000100:00100000:2.0:1767320809.440424:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380107904:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.440457:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380107904:12345-0@lo:400:kworker.0 Request processed in 32us (539us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320809.440463:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5067
00000100:00080000:2.0:1767320809.440475:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320809.440496:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380107904:0@lo:400:kworker.0
00000100:00100000:1.0:1767320809.443731:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380108032:0@lo:38:kworker.0
00000100:00100000:1.0:1767320809.444296:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320809.444389:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108032
00000100:00100000:2.0:1767320809.444398:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108032
00000100:00100000:2.0:1767320809.444450:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18060
00000100:00100000:2.0:1767320809.444459:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380108032:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320809.444484:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320809.444527:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380108032:12345-0@lo:38:kworker.0 Request processed in 67us (231us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320809.444534:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18060
00000100:00080000:3.0:1767320809.445988:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320809.445995:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320809.445998:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767320809.446136:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380108160:0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.446199:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320809.446251:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108160
00000100:00100000:2.0:1767320809.446258:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108160
00000100:00100000:2.0:1767320809.446311:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5068
00000100:00100000:2.0:1767320809.446319:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380108160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320809.446370:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380108160:12345-0@lo:400:kworker.0 Request processed in 51us (170us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320809.446377:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5068
00000100:00080000:2.0:1767320809.446397:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320809.446427:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380108160:0@lo:400:kworker.0
00000100:00080000:3.0:1767320809.446497:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5706
00000100:00080000:3.0:1767320809.446502:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320809.446507:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320809.446529:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f4000 x1853164380108288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320809.450854:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380107520:12345-0@lo:38:kworker.0 Request processed in 6475us (7357us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320809.450889:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254
00000100:00080000:1.0:1767320809.453563:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320809.453576:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320809.453582:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380107520:0@lo:38:kworker.0
00000100:00100000:1.0:1767320809.453619:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380108288:0@lo:38:kworker.0
00000100:00100000:1.0:1767320809.455275:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320809.455419:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320809.455425:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320809.455429:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380108032:0@lo:38:kworker.0
00000100:00100000:2.0:1767320809.457174:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108288
00000100:00100000:2.0:1767320809.457189:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108288
00000100:00100000:2.0:1767320809.457254:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18061
00000100:00100000:2.0:1767320809.457264:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380108288:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320809.457289:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320809.457383:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380108288:12345-0@lo:38:kworker.0 Request processed in 120us (2114us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320809.457391:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18061
00000100:00080000:1.0:1767320809.457542:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320809.457549:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320809.457553:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380108288:0@lo:38:kworker.0
00010000:00010000:2.0:1767320810.007402:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320811.032514:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320811.409426:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320811.409528:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320811.410406:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291995008
00000100:00100000:0.0:1767320811.410423:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291995008
00000100:00100000:0.0:1767320811.410521:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291995136
00000100:00100000:0.0:1767320811.410526:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291995136
00000100:00080000:1.0:1767320811.410614:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320811.410728:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5069
00000100:00100000:2.0:1767320811.410742:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291995136:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320811.410860:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291995136:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 121us (1331us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320811.410915:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5069
00000100:00100000:2.0:1767320811.410939:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18062
00000100:00100000:2.0:1767320811.410943:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291995008:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320811.410969:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320811.410998:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291995008:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (1588us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320811.411005:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18062
00000100:00100000:0.0:1767320811.480934:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320811.480972:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380108416:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320811.481101:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320811.482727:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108416
00000100:00100000:2.0:1767320811.482749:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108416
00000100:00100000:2.0:1767320811.482905:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822
00000100:00100000:2.0:1767320811.482917:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380108416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320811.482961:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320811.483069:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380108416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (1967us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320811.483078:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822
00000100:00100000:0.0:1767320811.483222:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380108416:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320811.484340:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320812.056823:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320813.015378:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380108544:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320813.015485:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320813.015733:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108544
00000100:00100000:2.0:1767320813.015745:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108544
00000100:00100000:2.0:1767320813.015854:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823
00000100:00100000:2.0:1767320813.015866:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380108544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320813.015929:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767320813.016017:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320813.019915:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380108544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4006us (4385us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320813.019937:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823
00000100:00100000:0.0:1767320813.021547:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380108544:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320813.079091:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320814.103349:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320814.553064:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320814.553080:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320814.553084:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320814.553089:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320814.553095:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320814.553105:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5711
00000100:00080000:1.0:1767320814.553111:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320814.553121:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320814.553177:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21180 x1853164380108672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320814.553227:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320814.553231:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320814.553233:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320814.553237:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5711
00000100:00080000:1.0:1767320814.553240:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320814.553244:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320814.553264:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ea00 x1853164380108800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320814.553349:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320814.553354:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320814.553356:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320814.553360:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5711
00000100:00080000:1.0:1767320814.553372:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320814.553376:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320814.553388:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572300 x1853164380109312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320814.553403:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320814.553407:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320814.553408:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320814.553411:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5711
00000100:00080000:1.0:1767320814.553414:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320814.553417:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320814.553426:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c572680 x1853164380109568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320814.553568:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380109056:0@lo:400:kworker.0
00000100:00100000:3.0:1767320814.553568:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380108928:0@lo:400:kworker.0
00000100:00100000:2.0:1767320814.553749:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380108672:0@lo:38:kworker.0
00000100:00100000:1.0:1767320814.557017:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380109440:0@lo:400:kworker.0
00000100:00100000:3.0:1767320814.565320:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320814.565422:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108928
00000100:00100000:0.0:1767320814.565436:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108928
00000100:00100000:0.0:1767320814.565558:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011
00000100:00100000:0.0:1767320814.565570:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380108928:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320814.565787:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380109184:0@lo:400:kworker.0
00000100:00100000:3.0:1767320814.565837:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320814.565895:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320814.565911:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380109184
00000100:00100000:3.0:1767320814.565916:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380109184
00000100:00100000:0.0:1767320814.565995:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380108928:12345-0@lo:400:kworker.0 Request processed in 428us (686us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320814.566008:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011
00000100:00100000:2.0:1767320814.566009:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320814.566036:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380108800:0@lo:38:kworker.0
00000100:00100000:0.0:1767320814.566039:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108672
00000100:00100000:0.0:1767320814.566042:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108672
00000100:00100000:2.0:1767320814.566077:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320814.566103:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380109312:0@lo:38:kworker.0
00000100:00100000:2.0:1767320814.566127:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320814.566145:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380109568:0@lo:38:kworker.0
00000100:00100000:2.0:1767320814.566167:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320814.566186:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320814.566237:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380108800
00000100:00100000:1.0:1767320814.566241:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380108800
00000100:00100000:1.0:1767320814.566267:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255
00000100:00100000:1.0:1767320814.566272:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380108800:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320814.566294:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320814.566329:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380108800:12345-0@lo:38:kworker.0 Request processed in 56us (251us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320814.566334:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255
00000100:00100000:1.0:1767320814.568012:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380109568
00000100:00100000:2.0:1767320814.568012:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380109312
00000100:00100000:1.0:1767320814.568028:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380109568
00000100:00100000:2.0:1767320814.568028:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380109312
00000100:00100000:2.0:1767320814.568080:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380109440
00000100:00100000:2.0:1767320814.568084:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380109440
00000100:00100000:2.0:1767320814.568122:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5070
00000100:00100000:2.0:1767320814.568132:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380109184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320814.568152:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5071
00000100:00100000:0.0:1767320814.568162:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380109440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320814.568207:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18063
00000100:00100000:1.0:1767320814.568213:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380108672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320814.568238:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320814.568345:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380109440:12345-0@lo:400:kworker.0 Request processed in 184us (2157us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320814.568353:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5071
00000100:00100000:0.0:1767320814.568376:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18064
00000100:00100000:0.0:1767320814.568381:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380109312:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320814.568391:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320814.568421:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380109312:12345-0@lo:38:kworker.0 Request processed in 39us (2293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320814.568427:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18064
00000100:00100000:0.0:1767320814.568439:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18065
00000100:00100000:0.0:1767320814.568442:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380109568:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320814.568452:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320814.568475:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380109568:12345-0@lo:38:kworker.0 Request processed in 31us (2307us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320814.568784:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18065
00000100:00100000:0.0:1767320814.568933:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380109440:0@lo:400:kworker.0
00000100:00100000:0.0:1767320814.569006:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380108928:0@lo:400:kworker.0
00000100:00080000:0.0:1767320814.569027:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320814.569086:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320814.569133:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380109056
00000100:00100000:0.0:1767320814.569139:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380109056
00000100:00100000:0.0:1767320814.569177:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012
00000100:00100000:0.0:1767320814.569184:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380109056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320814.569233:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380109056:12345-0@lo:400:kworker.0 Request processed in 49us (185us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320814.569239:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012
00000100:00100000:0.0:1767320814.569275:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380109056:0@lo:400:kworker.0
00000100:00100000:2.0:1767320814.572718:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380109184:12345-0@lo:400:kworker.0 Request processed in 4572us (6864us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320814.572737:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5070
00000100:00100000:2.0:1767320814.572837:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380109184:0@lo:400:kworker.0
00000100:00080000:3.0:1767320814.573097:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320814.573105:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320814.573109:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380109568:0@lo:38:kworker.0
00000100:00080000:3.0:1767320814.573138:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320814.573142:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320814.573145:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380108800:0@lo:38:kworker.0
00000100:00080000:3.0:1767320814.573160:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320814.573163:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320814.573166:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380109312:0@lo:38:kworker.0
00000100:00100000:1.0:1767320814.575609:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380108672:12345-0@lo:38:kworker.0 Request processed in 7378us (9583us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320814.575630:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18063
00000100:00080000:3.0:1767320814.575842:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320814.575850:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320814.575855:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380108672:0@lo:38:kworker.0
00010000:00010000:0.0:1767320815.127219:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767320815.504067:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291995264 offset 0 length 520: 4
00000100:00100000:1.0:1767320815.504519:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320815.504661:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291995392
00000100:00100000:0.0:1767320815.504676:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291995392
00000100:00100000:0.0:1767320815.504741:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18066
00000100:00100000:0.0:1767320815.504752:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291995392:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320815.504782:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320815.504920:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291995392:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 168us (402us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320815.504929:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18066
00000100:00100000:2.0:1767320815.506163:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320815.507144:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291995520
00000100:00100000:0.0:1767320815.507159:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291995520
00000100:00100000:0.0:1767320815.507304:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5072
00000100:00100000:0.0:1767320815.507315:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291995520:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320815.507429:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291995520:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 115us (1273us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320815.507438:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5072
00000100:00080000:3.0:1767320815.509361:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320816.151270:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320816.600145:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320816.600174:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380109696:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320816.600265:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320816.600478:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380109696
00000100:00100000:2.0:1767320816.600488:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380109696
00000100:00100000:2.0:1767320816.600566:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824
00000100:00100000:2.0:1767320816.600577:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380109696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320816.600621:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320816.600684:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380109696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (419us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320816.600692:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824
00000100:00100000:0.0:1767320816.600786:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380109696:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320816.600965:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320817.175337:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320818.137665:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320818.137708:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380109824:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320818.137810:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320818.137972:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380109824
00000100:00100000:1.0:1767320818.137984:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380109824
00000100:00100000:1.0:1767320818.138084:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825
00000100:00100000:1.0:1767320818.138096:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380109824:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320818.138139:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320818.138208:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380109824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (398us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320818.138217:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825
00000100:00100000:1.0:1767320818.138283:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380109824:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320818.138453:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320818.199945:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320819.227284:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320819.671081:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320794/real 1767320794]  req@ffff8b0e02681f80 x1853164380103424/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320819 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767320819.671122:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e02681f80 x1853164380103424/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320819 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767320819.671144:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320819.671169:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767320819.671174:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380103424:0@lo:250:kworker.0
00000100:00080000:1.0:1767320819.671522:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320819.671533:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320819.671538:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320819.671547:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5696
00000100:00080000:1.0:1767320819.671553:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320819.671563:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320819.671615:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcea00 x1853164380109952/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320819.671645:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320819.671651:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320819.671653:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320819.671656:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5716
00000100:00080000:1.0:1767320819.671659:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320819.671662:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320819.671679:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce300 x1853164380110080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320819.671687:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320819.671690:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320819.671692:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320819.671696:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5716
00000100:00080000:1.0:1767320819.671698:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320819.671702:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320819.671712:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc000 x1853164380110208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320819.671786:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320819.671789:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320819.671791:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320819.671795:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5716
00000100:00080000:1.0:1767320819.671798:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320819.671802:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320819.671815:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ef100 x1853164380110720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320819.671833:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320819.671837:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320819.671839:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320819.671843:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5716
00000100:00080000:1.0:1767320819.671846:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320819.671851:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320819.671862:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efed80 x1853164380110976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320819.671943:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380110592:0@lo:400:kworker.0
00000100:00100000:1.0:1767320819.672042:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320819.672121:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320819.672129:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380110848:0@lo:400:kworker.0
00000100:00100000:2.0:1767320819.672297:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110592
00000100:00100000:2.0:1767320819.672307:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110592
00000100:00100000:2.0:1767320819.672385:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5073
00000100:00100000:2.0:1767320819.672398:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380110592:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320819.672464:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380110592:12345-0@lo:400:kworker.0 Request processed in 69us (421us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320819.672471:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5073
00000100:00080000:2.0:1767320819.672498:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320819.672572:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380110464:0@lo:400:kworker.0
00000100:00100000:0.0:1767320819.672615:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320819.672655:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320819.672661:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380110336:0@lo:400:kworker.0
00000100:00100000:0.0:1767320819.672683:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320819.672722:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110464
00000100:00100000:0.0:1767320819.672727:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110464
00000100:00100000:0.0:1767320819.672755:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110336
00000100:00100000:0.0:1767320819.672758:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110336
00000100:00100000:0.0:1767320819.672782:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013
00000100:00100000:0.0:1767320819.672788:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380110464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320819.672825:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380110464:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320819.672832:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013
00000100:00100000:0.0:1767320819.672846:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014
00000100:00100000:0.0:1767320819.672852:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380110336:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320819.672899:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380110336:12345-0@lo:400:kworker.0 Request processed in 47us (215us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320819.672905:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014
00000100:00100000:0.0:1767320819.672955:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380110336:0@lo:400:kworker.0
00000100:00100000:0.0:1767320819.672966:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380110464:0@lo:400:kworker.0
00000100:00080000:2.0:1767320819.673062:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320819.674312:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320819.674403:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380109952:0@lo:250:kworker.0
00000100:00100000:1.0:1767320819.674425:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380110592:0@lo:400:kworker.0
00000400:00000100:3.0:1767320819.674480:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380109952 offset 0 length 520: 4
00000100:00100000:3.0:1767320819.674549:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380110080:0@lo:38:kworker.0
00000100:00100000:3.0:1767320819.674590:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320819.674622:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380110208:0@lo:38:kworker.0
00000100:00100000:3.0:1767320819.674658:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320819.674685:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380110720:0@lo:38:kworker.0
00000100:00100000:3.0:1767320819.674705:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320819.674726:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380110976:0@lo:38:kworker.0
00000100:00100000:3.0:1767320819.674745:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320819.674785:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110848
00000100:00100000:3.0:1767320819.674793:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110848
00000100:00100000:3.0:1767320819.674851:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110080
00000100:00100000:3.0:1767320819.674854:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110080
00000100:00100000:3.0:1767320819.674914:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110720
00000100:00100000:3.0:1767320819.674918:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110720
00000100:00100000:3.0:1767320819.674927:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110976
00000100:00100000:3.0:1767320819.674929:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110976
00000100:00100000:3.0:1767320819.674940:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5074
00000100:00100000:3.0:1767320819.674948:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380110848:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320819.675002:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380110848:12345-0@lo:400:kworker.0 Request processed in 55us (2847us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320819.675024:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5074
00000100:00100000:3.0:1767320819.675042:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18067
00000100:00100000:3.0:1767320819.675047:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380110080:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320819.675065:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320819.675099:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380110080:12345-0@lo:38:kworker.0 Request processed in 50us (509us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320819.675105:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18067
00000100:00100000:3.0:1767320819.675117:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18068
00000100:00100000:3.0:1767320819.675120:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380110720:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320819.675129:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320819.675152:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380110720:12345-0@lo:38:kworker.0 Request processed in 30us (446us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320819.675157:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18068
00000100:00100000:3.0:1767320819.675168:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18069
00000100:00100000:3.0:1767320819.675171:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380110976:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320819.675179:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320819.675202:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380110976:12345-0@lo:38:kworker.0 Request processed in 29us (457us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320819.675207:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18069
00000100:00080000:3.0:1767320819.675253:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320819.675259:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320819.675263:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380110080:0@lo:38:kworker.0
00000100:00080000:3.0:1767320819.675272:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320819.675275:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320819.675278:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380110720:0@lo:38:kworker.0
00000100:00080000:3.0:1767320819.675285:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320819.675289:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320819.675292:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380110976:0@lo:38:kworker.0
00000100:00100000:1.0:1767320819.675574:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380110208
00000100:00100000:1.0:1767320819.675585:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380110208
00000100:00100000:1.0:1767320819.675633:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256
00000100:00100000:1.0:1767320819.675640:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380110208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320819.675661:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320819.675722:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380110208:12345-0@lo:38:kworker.0 Request processed in 82us (1063us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320819.675728:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256
00000100:00100000:1.0:1767320819.675774:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380110848:0@lo:400:kworker.0
00000100:00080000:2.0:1767320819.676043:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320819.676145:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320819.676154:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320819.676157:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380110208:0@lo:38:kworker.0
00010000:00010000:2.0:1767320820.248103:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320820.623024:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320820.623276:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291995776
00000100:00100000:3.0:1767320820.623286:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291995776
00000100:00100000:2.0:1767320820.623303:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320820.623370:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291995648
00000100:00100000:3.0:1767320820.623382:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291995648
00000100:00100000:3.0:1767320820.623407:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5075
00000100:00100000:3.0:1767320820.623419:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291995776:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:0.0:1767320820.623423:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320820.623507:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291995776:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 91us (492us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320820.623517:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5075
00000100:00100000:3.0:1767320820.623537:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18070
00000100:00100000:3.0:1767320820.623543:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291995648:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320820.623567:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320820.623603:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291995648:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (301us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320820.623610:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18070
00010000:00010000:2.0:1767320821.271230:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320821.719463:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380111104:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320821.719539:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320821.719901:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380111104
00000100:00100000:2.0:1767320821.719910:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380111104
00000100:00100000:2.0:1767320821.719977:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826
00000100:00100000:2.0:1767320821.719999:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380111104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320821.720032:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320821.720084:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380111104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (544us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320821.720091:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826
00000100:00080000:0.0:1767320821.721720:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320821.721814:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380111104:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320822.296183:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320823.255100:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320823.266306:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380111232:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320823.266401:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320823.266564:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380111232
00000100:00100000:3.0:1767320823.266575:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380111232
00000100:00100000:3.0:1767320823.266645:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827
00000100:00100000:3.0:1767320823.266656:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380111232:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320823.266691:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320823.266751:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380111232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (348us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320823.266758:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827
00000100:00080000:0.0:1767320823.266896:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320823.266918:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380111232:0@lo:13:osp-pre-0-1.0
00010000:00010000:0.0:1767320823.319122:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320824.343261:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320824.791753:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320824.791763:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320824.791767:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320824.791772:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320824.791777:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320824.791787:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5722
00000100:00080000:2.0:1767320824.791794:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320824.791803:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320824.791909:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9500 x1853164380111360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320824.791945:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320824.791950:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320824.791953:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320824.791958:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5722
00000100:00080000:2.0:1767320824.791969:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320824.791974:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320824.791988:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063aa300 x1853164380111488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320824.792009:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380111360:0@lo:38:kworker.0
00000100:00100000:1.0:1767320824.792047:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380111616:0@lo:400:kworker.0
00000100:00100000:3.0:1767320824.792079:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320824.792091:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320824.792146:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320824.792150:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320824.792152:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320824.792156:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5722
00000100:00080000:2.0:1767320824.792158:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320824.792163:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320824.792168:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380111744:0@lo:400:kworker.0
00000100:00100000:2.0:1767320824.792177:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fe680 x1853164380112000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320824.792197:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320824.792200:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320824.792202:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320824.792207:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5722
00000100:00080000:2.0:1767320824.792210:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320824.792213:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320824.792228:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fea00 x1853164380112256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320824.792257:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380111872:0@lo:400:kworker.0
00000100:00100000:1.0:1767320824.803465:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380111360
00000100:00100000:1.0:1767320824.803480:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380111360
00000100:00100000:1.0:1767320824.803535:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18071
00000100:00100000:1.0:1767320824.803543:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380111360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320824.803566:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320824.803640:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380111360:12345-0@lo:38:kworker.0 Request processed in 96us (11560us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320824.803648:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18071
00000100:00100000:1.0:1767320824.803693:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380112128:0@lo:400:kworker.0
00000100:00100000:1.0:1767320824.803735:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320824.803783:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112128
00000100:00100000:1.0:1767320824.803788:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112128
00000100:00100000:1.0:1767320824.803895:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5076
00000100:00100000:1.0:1767320824.803907:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380112128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320824.803979:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380112128:12345-0@lo:400:kworker.0 Request processed in 74us (245us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320824.803988:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5076
00000100:00100000:1.0:1767320824.804041:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380112128:0@lo:400:kworker.0
00000100:00080000:1.0:1767320824.804070:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320824.804330:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320824.804348:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320824.804352:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380111360:0@lo:38:kworker.0
00000100:00100000:3.0:1767320824.804359:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380111488:0@lo:38:kworker.0
00000100:00100000:3.0:1767320824.804389:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320824.804427:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380112000:0@lo:38:kworker.0
00000100:00100000:3.0:1767320824.804463:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320824.804482:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380112256:0@lo:38:kworker.0
00000100:00100000:3.0:1767320824.804501:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320824.804917:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380111616
00000100:00100000:3.0:1767320824.804924:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380111616
00000100:00100000:3.0:1767320824.804977:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015
00000100:00100000:3.0:1767320824.804985:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380111616:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320824.805033:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380111616:12345-0@lo:400:kworker.0 Request processed in 49us (12940us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320824.805040:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015
00000100:00100000:3.0:1767320824.805071:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380111488
00000100:00100000:3.0:1767320824.805075:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380111488
00000100:00100000:3.0:1767320824.805096:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257
00000100:00100000:3.0:1767320824.805100:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380111488:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320824.805268:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320824.805306:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380111488:12345-0@lo:38:kworker.0 Request processed in 204us (916us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320824.805314:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257
00000100:00080000:1.0:1767320824.806237:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320824.807035:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320824.810829:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380111616:0@lo:400:kworker.0
00000100:00100000:2.0:1767320824.811244:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320824.811550:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112000
00000100:00100000:1.0:1767320824.811561:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112000
00000100:00100000:1.0:1767320824.811601:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112256
00000100:00100000:1.0:1767320824.811606:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112256
00000100:00100000:1.0:1767320824.811630:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380111872
00000100:00100000:1.0:1767320824.811633:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380111872
00000100:00100000:1.0:1767320824.811671:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5077
00000100:00100000:1.0:1767320824.811680:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380111872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320824.811741:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380111872:12345-0@lo:400:kworker.0 Request processed in 62us (498us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320824.811749:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5077
00000100:00100000:1.0:1767320824.811781:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18072
00000100:00100000:1.0:1767320824.811785:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380112000:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320824.811803:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320824.811832:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380112000:12345-0@lo:38:kworker.0 Request processed in 45us (7369us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320824.811839:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18072
00000100:00100000:1.0:1767320824.811851:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18073
00000100:00100000:2.0:1767320824.814466:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380111744
00000100:00100000:2.0:1767320824.814483:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380111744
00000100:00100000:2.0:1767320824.814559:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016
00000100:00100000:2.0:1767320824.814571:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380111744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320824.814674:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380111744:12345-0@lo:400:kworker.0 Request processed in 107us (7642us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320824.814681:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016
00000100:00100000:1.0:1767320824.815258:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380112256:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320824.815284:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320824.815344:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380112256:12345-0@lo:38:kworker.0 Request processed in 85us (10839us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767320824.817753:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320824.817764:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320824.817770:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380112000:0@lo:38:kworker.0
00000100:00080000:3.0:1767320824.817787:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320824.817790:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320824.817793:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380112256:0@lo:38:kworker.0
00000100:00080000:3.0:1767320824.817804:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320824.817807:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320824.817810:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380111488:0@lo:38:kworker.0
00000100:00100000:3.0:1767320824.817907:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380111872:0@lo:400:kworker.0
00000100:00100000:3.0:1767320824.817949:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380111744:0@lo:400:kworker.0
00000100:00080000:3.0:1767320824.817990:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320824.827329:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18073
00010000:00010000:2.0:1767320825.367120:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320825.747797:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320825.754305:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291995904
00000100:00100000:1.0:1767320825.754321:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291995904
00000100:00100000:0.0:1767320825.754359:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320825.754829:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291996032
00000100:00100000:2.0:1767320825.754835:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291996032
00000100:00100000:1.0:1767320825.755481:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18074
00000100:00100000:1.0:1767320825.755489:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291995904:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320825.755520:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320825.755596:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291995904:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 106us (7969us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320825.755604:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18074
00000100:00100000:2.0:1767320825.755846:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5078
00000100:00100000:2.0:1767320825.755893:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291996032:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320825.755964:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291996032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 110us (1609us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320825.755972:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5078
00000100:00080000:3.0:1767320825.766074:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320826.391604:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320826.839284:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380112384:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320826.839354:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320826.839542:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112384
00000100:00100000:2.0:1767320826.839551:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112384
00000100:00100000:2.0:1767320826.839669:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828
00000100:00100000:2.0:1767320826.839678:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380112384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320826.839706:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320826.839746:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380112384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (391us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320826.839751:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828
00000100:00080000:1.0:1767320826.840015:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320826.840075:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380112384:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767320827.415059:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320828.375596:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320828.375623:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380112512:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320828.375695:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320828.376164:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112512
00000100:00100000:1.0:1767320828.376174:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112512
00000100:00100000:1.0:1767320828.376244:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829
00000100:00100000:1.0:1767320828.376253:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380112512:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320828.376283:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320828.376347:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380112512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (650us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320828.376354:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829
00000100:00080000:2.0:1767320828.376430:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320828.376513:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380112512:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320828.443130:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320829.463503:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320829.911969:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320829.911980:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320829.911983:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320829.911996:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320829.912001:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320829.912009:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5727
00000100:00080000:1.0:1767320829.912013:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320829.912020:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320829.912068:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd500 x1853164380112640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320829.912093:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320829.912098:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320829.912100:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320829.912103:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5727
00000100:00080000:1.0:1767320829.912105:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320829.912109:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320829.912122:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efed80 x1853164380112768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320829.912153:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380112640:0@lo:38:kworker.0
00000100:00080000:1.0:1767320829.912190:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320829.912193:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320829.912195:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320829.912199:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5727
00000100:00080000:1.0:1767320829.912202:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320829.912206:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320829.912220:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063aaa00 x1853164380113280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320829.912226:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380112896:0@lo:400:kworker.0
00000100:00080000:1.0:1767320829.912242:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767320829.912246:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320829.912246:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320829.912248:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320829.912252:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5727
00000100:00080000:1.0:1767320829.912254:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320829.912258:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320829.912269:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab480 x1853164380113536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320829.912278:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320829.912304:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380113408:0@lo:400:kworker.0
00000100:00100000:0.0:1767320829.912316:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380112768:0@lo:38:kworker.0
00000100:00100000:3.0:1767320829.912329:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320829.912338:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380113024:0@lo:400:kworker.0
00000100:00100000:0.0:1767320829.912343:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320829.912343:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320829.912370:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320829.912377:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320829.912378:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380113152:0@lo:400:kworker.0
00000100:00100000:0.0:1767320829.912382:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380113280:0@lo:38:kworker.0
00000100:00100000:1.0:1767320829.912409:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320829.912418:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112896
00000100:00100000:3.0:1767320829.912427:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112896
00000100:00100000:3.0:1767320829.912484:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113024
00000100:00100000:3.0:1767320829.912488:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113024
00000100:00100000:0.0:1767320829.912489:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112768
00000100:00100000:0.0:1767320829.912496:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112768
00000100:00100000:3.0:1767320829.912513:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017
00000100:00100000:3.0:1767320829.912523:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380112896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320829.915986:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258
00000100:00100000:0.0:1767320829.916001:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380112768:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320829.916031:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320829.916100:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018
00000100:00100000:2.0:1767320829.916124:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380113024:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320829.920946:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380112896:12345-0@lo:400:kworker.0 Request processed in 8413us (8660us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320829.920963:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017
00000100:00100000:3.0:1767320829.921045:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380112896:0@lo:400:kworker.0
00000100:00080000:3.0:1767320829.921093:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320829.921108:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380112640
00000100:00100000:3.0:1767320829.921113:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380112640
00000100:00100000:3.0:1767320829.921137:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113408
00000100:00100000:3.0:1767320829.921140:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113408
00000100:00100000:3.0:1767320829.921166:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113152
00000100:00100000:3.0:1767320829.921168:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113152
00000100:00100000:3.0:1767320829.924881:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079
00000100:00100000:3.0:1767320829.924897:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380113408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320829.925011:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380113408:12345-0@lo:400:kworker.0 Request processed in 117us (12671us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320829.925019:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079
00000100:00100000:3.0:1767320829.925038:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5080
00000100:00100000:3.0:1767320829.925045:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380113152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320829.925075:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380113152:12345-0@lo:400:kworker.0 Request processed in 32us (12667us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320829.925081:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5080
00000100:00100000:3.0:1767320829.925093:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18075
00000100:00100000:3.0:1767320829.925099:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380112640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320829.925117:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320829.925147:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380112640:12345-0@lo:38:kworker.0 Request processed in 47us (12902us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320829.925153:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18075
00000100:00080000:3.0:1767320829.925188:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320829.925278:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320829.925310:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380113536:0@lo:38:kworker.0
00000100:00100000:3.0:1767320829.925343:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320829.925380:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320829.925385:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320829.925389:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380112640:0@lo:38:kworker.0
00000100:00100000:3.0:1767320829.925421:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113280
00000100:00100000:3.0:1767320829.925427:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113280
00000100:00100000:3.0:1767320829.925446:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113536
00000100:00100000:3.0:1767320829.925449:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113536
00000100:00100000:3.0:1767320829.925462:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18076
00000100:00100000:3.0:1767320829.925466:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380113280:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320829.925476:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320829.925508:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380113280:12345-0@lo:38:kworker.0 Request processed in 40us (229us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320829.925514:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18076
00000100:00100000:3.0:1767320829.925527:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18077
00000100:00100000:3.0:1767320829.925531:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380113536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320829.925540:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320829.925565:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380113536:12345-0@lo:38:kworker.0 Request processed in 33us (221us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320829.925571:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18077
00000100:00080000:3.0:1767320829.925598:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320829.925603:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320829.925606:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380113280:0@lo:38:kworker.0
00000100:00080000:3.0:1767320829.925617:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320829.925620:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320829.925729:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380113536:0@lo:38:kworker.0
00000100:00100000:0.0:1767320829.930702:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380112768:12345-0@lo:38:kworker.0 Request processed in 14693us (18352us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320829.930717:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258
00000100:00080000:3.0:1767320829.932745:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320829.932758:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320829.932763:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380112768:0@lo:38:kworker.0
00000100:00100000:2.0:1767320829.933692:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380113024:12345-0@lo:400:kworker.0 Request processed in 17572us (21312us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320829.933705:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018
00000100:00100000:3.0:1767320829.933824:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380113024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320829.945327:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380113152:0@lo:400:kworker.0
00000100:00100000:1.0:1767320829.945347:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380113408:0@lo:400:kworker.0
00010000:00010000:2.0:1767320830.487281:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320830.867820:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320830.867862:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320830.867966:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291996288
00000100:00100000:1.0:1767320830.867977:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291996288
00000100:00100000:1.0:1767320830.868063:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291996160
00000100:00100000:1.0:1767320830.868068:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291996160
00000100:00100000:1.0:1767320830.868087:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5081
00000100:00100000:1.0:1767320830.868098:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291996288:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320830.868141:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18078
00000100:00100000:0.0:1767320830.868148:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291996160:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320830.868169:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320830.868190:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291996288:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 94us (382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320830.868195:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164291996160:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (334us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320830.868198:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5081
00000100:00100000:0.0:1767320830.868201:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18078
00000100:00080000:2.0:1767320830.868589:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:0.0:1767320831.511106:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320831.959318:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320831.959338:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380113664:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320831.959409:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320831.959686:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113664
00000100:00100000:2.0:1767320831.959695:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113664
00000100:00100000:2.0:1767320831.959764:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830
00000100:00100000:2.0:1767320831.959775:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380113664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320831.959806:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767320831.959821:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320831.959932:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380113664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (457us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320831.959940:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830
00000100:00100000:1.0:1767320831.960129:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380113664:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320832.540120:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320833.495262:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380113792:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320833.495354:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320833.509136:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113792
00000100:00100000:0.0:1767320833.509151:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113792
00000100:00100000:0.0:1767320833.509244:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831
00000100:00100000:0.0:1767320833.509255:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380113792:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320833.509289:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320833.509378:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380113792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (14023us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320833.509385:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831
00000100:00100000:2.0:1767320833.509454:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380113792:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767320833.510289:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320833.559104:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320834.583219:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320835.032303:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320835.032313:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320835.032316:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320835.032320:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320835.032325:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320835.032334:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5732
00000100:00080000:2.0:1767320835.032339:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320835.032346:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320835.032390:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcf800 x1853164380113920/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320835.032433:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320835.032437:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320835.032440:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320835.032444:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5732
00000100:00080000:2.0:1767320835.032446:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320835.032450:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320835.032464:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcdf80 x1853164380114048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320835.032527:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380113920:0@lo:38:kworker.0
00000100:00080000:2.0:1767320835.032542:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320835.032547:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320835.032549:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320835.032553:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5732
00000100:00080000:2.0:1767320835.032555:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320835.032559:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320835.032571:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f1c00 x1853164380114560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320835.032592:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320835.032595:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320835.032597:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1767320835.032603:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320835.032604:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5732
00000100:00080000:2.0:1767320835.032609:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320835.032614:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320835.032626:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc20e00 x1853164380114816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320835.032669:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380114048:0@lo:38:kworker.0
00000100:00100000:2.0:1767320835.032697:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380114688:0@lo:400:kworker.0
00000100:00100000:3.0:1767320835.032705:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320835.032739:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320835.032744:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380114560:0@lo:38:kworker.0
00000100:00100000:2.0:1767320835.032769:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320835.032776:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320835.032779:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380114432:0@lo:400:kworker.0
00000100:00100000:3.0:1767320835.032815:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380114816:0@lo:38:kworker.0
00000100:00100000:2.0:1767320835.032816:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320835.032848:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320835.032916:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380113920
00000100:00100000:3.0:1767320835.032925:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380113920
00000100:00100000:3.0:1767320835.032955:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114688
00000100:00100000:3.0:1767320835.032958:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114688
00000100:00100000:2.0:1767320835.033012:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114560
00000100:00100000:2.0:1767320835.033017:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114560
00000100:00100000:2.0:1767320835.033031:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114432
00000100:00100000:2.0:1767320835.033033:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114432
00000100:00100000:1.0:1767320835.033357:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114816
00000100:00100000:1.0:1767320835.033362:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114816
00000100:00100000:1.0:1767320835.033383:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18079
00000100:00100000:1.0:1767320835.033390:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380113920:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320835.033418:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320835.033466:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380113920:12345-0@lo:38:kworker.0 Request processed in 75us (865us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320835.033474:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18079
00000100:00100000:1.0:1767320835.033490:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18080
00000100:00100000:1.0:1767320835.033494:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380114560:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320835.033503:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320835.033525:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380114560:12345-0@lo:38:kworker.0 Request processed in 30us (751us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320835.033531:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18080
00000100:00100000:1.0:1767320835.033543:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18081
00000100:00100000:1.0:1767320835.033546:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380114816:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320835.033555:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320835.033576:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380114816:12345-0@lo:38:kworker.0 Request processed in 29us (729us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320835.033582:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18081
00000100:00100000:1.0:1767320835.033607:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380114304:0@lo:400:kworker.0
00000100:00100000:1.0:1767320835.033635:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320835.033656:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320835.033661:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380114176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320835.033680:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320835.033718:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114304
00000100:00100000:1.0:1767320835.033722:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114304
00000100:00100000:1.0:1767320835.033754:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114176
00000100:00100000:1.0:1767320835.033757:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114176
00000100:00100000:1.0:1767320835.033776:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019
00000100:00100000:1.0:1767320835.033783:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380114304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320835.033823:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380114304:12345-0@lo:400:kworker.0 Request processed in 41us (186us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320835.033829:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019
00000100:00100000:1.0:1767320835.033840:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020
00000100:00100000:1.0:1767320835.033846:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380114176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320835.033897:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380114176:12345-0@lo:400:kworker.0 Request processed in 52us (216us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320835.033903:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020
00000100:00100000:1.0:1767320835.033944:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380114176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320835.033956:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380114304:0@lo:400:kworker.0
00000100:00100000:1.0:1767320835.033998:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114048
00000100:00100000:1.0:1767320835.034002:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114048
00000100:00100000:1.0:1767320835.034025:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259
00000100:00100000:1.0:1767320835.034030:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380114048:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320835.034036:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5082
00010000:00020000:1.0:1767320835.034044:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320835.034078:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380114048:12345-0@lo:38:kworker.0 Request processed in 47us (1377us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320835.034085:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259
00000100:00080000:1.0:1767320835.034125:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320835.037562:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5083
00000100:00100000:0.0:1767320835.037579:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380114432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320835.037690:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380114432:12345-0@lo:400:kworker.0 Request processed in 117us (4875us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320835.037698:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5083
00000100:00100000:0.0:1767320835.037776:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380114432:0@lo:400:kworker.0
00000100:00080000:2.0:1767320835.037995:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320835.038002:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320835.038006:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380114560:0@lo:38:kworker.0
00000100:00080000:2.0:1767320835.038018:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320835.038022:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320835.038025:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380114816:0@lo:38:kworker.0
00000100:00080000:2.0:1767320835.038035:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320835.038038:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320835.038042:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380113920:0@lo:38:kworker.0
00000100:00080000:2.0:1767320835.038054:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320835.038057:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320835.038061:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380114048:0@lo:38:kworker.0
00000100:00100000:3.0:1767320835.039325:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380114688:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320835.040143:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380114688:12345-0@lo:400:kworker.0 Request processed in 6095us (7401us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320835.040156:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5082
00000100:00100000:0.0:1767320835.040540:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380114688:0@lo:400:kworker.0
00000100:00080000:1.0:1767320835.041269:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320835.041274:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767320835.607019:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320835.983446:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320835.983504:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320835.983816:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291996544
00000100:00100000:2.0:1767320835.983826:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291996544
00000100:00100000:2.0:1767320835.983958:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291996416
00000100:00100000:2.0:1767320835.984149:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291996416
00000100:00100000:2.0:1767320835.984177:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5084
00000100:00100000:2.0:1767320835.984187:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291996544:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320835.984263:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291996544:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (828us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320835.984271:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5084
00000100:00100000:2.0:1767320835.984290:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18082
00000100:00100000:2.0:1767320835.984295:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291996416:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320835.984316:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320835.984342:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291996416:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (837us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320835.984440:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18082
00000100:00080000:1.0:1767320835.985424:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320836.631359:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320837.079283:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320837.079303:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380114944:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320837.079414:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320837.079693:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380114944
00000100:00100000:3.0:1767320837.079702:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380114944
00000100:00100000:3.0:1767320837.079776:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832
00000100:00100000:3.0:1767320837.079787:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380114944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320837.079815:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320837.079908:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380114944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (493us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320837.079917:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832
00000100:00100000:2.0:1767320837.079949:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380114944:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320837.079977:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320837.659253:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320838.620199:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380115072:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320838.620287:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320838.620419:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115072
00000100:00100000:3.0:1767320838.620427:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115072
00000100:00100000:3.0:1767320838.620491:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833
00000100:00100000:3.0:1767320838.620502:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380115072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320838.620532:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320838.622730:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380115072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2221us (2433us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320838.622743:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833
00000100:00080000:0.0:1767320838.625847:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320838.628304:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380115072:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320838.679344:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320839.703390:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320840.151548:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320840.151561:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320840.151564:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320840.151568:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320840.151572:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320840.151580:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320840.151586:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320840.151594:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320840.151637:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332d80 x1853164380115200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320840.151663:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320840.151667:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320840.151669:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320840.151673:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320840.151675:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320840.151679:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320840.151710:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332300 x1853164380115328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320840.151778:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320840.151782:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320840.151784:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320840.151788:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320840.151790:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320840.151793:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320840.151806:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f109f1c00 x1853164380115840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320840.151831:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320840.151834:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320840.151835:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320840.151838:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5737
00000100:00080000:0.0:1767320840.151840:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320840.151844:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320840.151852:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380115456:0@lo:400:kworker.0
00000100:00100000:0.0:1767320840.151854:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d500 x1853164380116096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320840.151937:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320840.151995:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320840.152001:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380115584:0@lo:400:kworker.0
00000100:00100000:1.0:1767320840.152024:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320840.152058:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115456
00000100:00100000:0.0:1767320840.152060:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380115712:0@lo:400:kworker.0
00000100:00100000:1.0:1767320840.152065:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115456
00000100:00100000:0.0:1767320840.152093:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320840.152111:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320840.152116:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380115968:0@lo:400:kworker.0
00000100:00100000:1.0:1767320840.152132:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115584
00000100:00100000:0.0:1767320840.152135:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320840.152136:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115584
00000100:00100000:1.0:1767320840.152158:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021
00000100:00100000:1.0:1767320840.152166:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380115456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320840.152215:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380115456:12345-0@lo:400:kworker.0 Request processed in 49us (278us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320840.152259:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022
00000100:00100000:0.0:1767320840.152270:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380115584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320840.152294:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380115200:0@lo:38:kworker.0
00000100:00100000:0.0:1767320840.152305:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380115584:12345-0@lo:400:kworker.0 Request processed in 38us (278us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320840.152312:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022
00000100:00100000:3.0:1767320840.152330:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320840.152348:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115712
00000100:00100000:0.0:1767320840.152353:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115712
00000100:00100000:3.0:1767320840.152358:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380115328:0@lo:38:kworker.0
00000100:00100000:3.0:1767320840.152380:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320840.152388:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115968
00000100:00100000:0.0:1767320840.152393:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115968
00000100:00100000:3.0:1767320840.152402:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f109f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380115840:0@lo:38:kworker.0
00000100:00100000:0.0:1767320840.152419:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115200
00000100:00100000:3.0:1767320840.152419:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320840.152424:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115200
00000100:00100000:3.0:1767320840.152434:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380116096:0@lo:38:kworker.0
00000100:00100000:0.0:1767320840.152437:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115840
00000100:00100000:0.0:1767320840.152441:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115840
00000100:00100000:3.0:1767320840.152457:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320840.152461:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5085
00000100:00100000:0.0:1767320840.152472:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380115712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320840.152479:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380116096
00000100:00100000:3.0:1767320840.152482:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380116096
00000100:00100000:3.0:1767320840.152498:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5086
00000100:00100000:3.0:1767320840.152504:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380115968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320840.152514:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380115712:12345-0@lo:400:kworker.0 Request processed in 45us (419us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320840.152520:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5085
00000100:00100000:3.0:1767320840.152534:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380115968:12345-0@lo:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320840.152541:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18083
00000100:00100000:0.0:1767320840.152547:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380115200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320840.152564:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320840.152598:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380115200:12345-0@lo:38:kworker.0 Request processed in 50us (268us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320840.153055:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021
00000100:00100000:3.0:1767320840.153432:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5086
00000100:00100000:3.0:1767320840.153450:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18084
00000100:00100000:3.0:1767320840.153454:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380115840:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320840.153465:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320840.153501:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380115840:12345-0@lo:38:kworker.0 Request processed in 47us (1082us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320840.153505:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18084
00000100:00100000:3.0:1767320840.153512:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18085
00000100:00100000:3.0:1767320840.153515:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380116096:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320840.153535:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320840.153563:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380116096:12345-0@lo:38:kworker.0 Request processed in 47us (1108us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320840.153569:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18085
00000100:00100000:3.0:1767320840.153591:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380115328
00000100:00100000:3.0:1767320840.153599:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380115328
00000100:00100000:3.0:1767320840.153623:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260
00000100:00100000:3.0:1767320840.153627:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380115328:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320840.153636:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320840.153664:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380115328:12345-0@lo:38:kworker.0 Request processed in 35us (1283us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320840.153669:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260
00000100:00080000:3.0:1767320840.153709:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320840.153715:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320840.153718:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380115200:0@lo:38:kworker.0
00000100:00080000:3.0:1767320840.153730:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320840.153734:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320840.153737:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380115328:0@lo:38:kworker.0
00000100:00080000:3.0:1767320840.153744:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320840.153747:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320840.153749:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380115840:0@lo:38:kworker.0
00000100:00080000:3.0:1767320840.153757:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320840.153760:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320840.153763:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380116096:0@lo:38:kworker.0
00000100:00080000:3.0:1767320840.153932:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320840.153938:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320840.153941:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320840.154001:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f109f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380115968:0@lo:400:kworker.0
00000100:00100000:3.0:1767320840.154014:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380115712:0@lo:400:kworker.0
00000100:00100000:3.0:1767320840.154079:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380115584:0@lo:400:kworker.0
00000100:00100000:3.0:1767320840.154090:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380115456:0@lo:400:kworker.0
00000100:00100000:0.0:1767320840.167041:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18083
00010000:00010000:2.0:1767320840.727307:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320841.111393:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767320841.111431:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291996672 offset 0 length 520: 4
00000100:00100000:1.0:1767320841.111455:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320841.111550:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291996928
00000100:00100000:2.0:1767320841.111561:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291996928
00000100:00100000:2.0:1767320841.111655:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291996800
00000100:00100000:2.0:1767320841.111659:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291996800
00000100:00100000:2.0:1767320841.111678:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5087
00000100:00100000:2.0:1767320841.111688:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291996928:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320841.111756:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291996928:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 69us (371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320841.111763:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5087
00000100:00100000:2.0:1767320841.111781:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18086
00000100:00100000:2.0:1767320841.111787:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291996800:12345-192.168.202.33@tcp:38:kworker.0
00000100:00080000:3.0:1767320841.111805:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00020000:2.0:1767320841.111820:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320841.111848:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164291996800:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 60us (392us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320841.111855:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18086
00010000:00010000:2.0:1767320841.751195:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320842.203423:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320842.203441:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380116224:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320842.203531:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320842.203639:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380116224
00000100:00100000:0.0:1767320842.203646:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380116224
00000100:00100000:0.0:1767320842.203701:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834
00000100:00100000:0.0:1767320842.203709:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380116224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320842.203736:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320842.203780:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380116224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (248us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320842.203787:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834
00000100:00100000:0.0:1767320842.203842:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380116224:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320842.203889:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320842.776984:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320843.735207:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380116352:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320843.735284:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320843.735637:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380116352
00000100:00100000:1.0:1767320843.735646:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380116352
00000100:00100000:1.0:1767320843.735715:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835
00000100:00100000:1.0:1767320843.735724:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380116352:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320843.735757:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320843.735849:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380116352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (564us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320843.735858:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835
00000100:00100000:2.0:1767320843.735922:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380116352:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320843.735989:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:0.0:1767320843.799123:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320844.247039:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320819/real 1767320819]  req@ffff8b0e0cfcea00 x1853164380109952/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320844.247091:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0cfcea00 x1853164380109952/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320844 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320844.247117:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320844.247128:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320844.247132:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380109952:0@lo:250:kworker.0
00000100:00080000:1.0:1767320844.247388:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320844.247395:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320844.247398:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320844.247404:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5722
00000100:00080000:1.0:1767320844.247408:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320844.247416:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320844.247452:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04a80 x1853164380116480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320844.247477:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320844.247480:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320844.247482:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320844.247486:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5742
00000100:00080000:1.0:1767320844.247488:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320844.247491:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320844.247505:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44700 x1853164380116608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320844.247515:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320844.247518:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320844.247520:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320844.247524:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5742
00000100:00080000:1.0:1767320844.247527:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320844.247530:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320844.247539:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46680 x1853164380116736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320844.247587:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320844.247591:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320844.247592:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320844.247596:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5742
00000100:00080000:1.0:1767320844.247598:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320844.247601:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320844.247611:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47b80 x1853164380117120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320844.247633:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320844.247636:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320844.247638:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320844.247641:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5742
00000100:00080000:1.0:1767320844.247643:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767320844.247853:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380116864:0@lo:400:kworker.0
00000100:00100000:3.0:1767320844.247950:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320844.247981:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380116864
00000100:00100000:2.0:1767320844.247989:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380116864
00000100:00100000:3.0:1767320844.248012:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320844.248019:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380116992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320844.248047:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320844.248081:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023
00000100:00100000:3.0:1767320844.248091:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380116864:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320844.248132:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380116480:0@lo:250:kworker.0
00000100:00100000:3.0:1767320844.248151:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380116864:12345-0@lo:400:kworker.0 Request processed in 61us (199us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320844.248159:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023
00000400:00000100:2.0:1767320844.248165:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380116480 offset 0 length 520: 4
00000100:00100000:2.0:1767320844.248194:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380116608:0@lo:38:kworker.0
00000100:00100000:3.0:1767320844.248208:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380116864:0@lo:400:kworker.0
00000100:00100000:2.0:1767320844.248219:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320844.248243:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380116736:0@lo:38:kworker.0
00000100:00100000:3.0:1767320844.248258:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380117248:0@lo:400:kworker.0
00000100:00100000:2.0:1767320844.248269:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320844.248294:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380117120:0@lo:38:kworker.0
00000100:00100000:3.0:1767320844.248294:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320844.248327:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380116736
00000100:00100000:2.0:1767320844.248332:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380116736
00000100:00100000:2.0:1767320844.248357:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261
00000100:00100000:2.0:1767320844.248362:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380116736:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320844.248375:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380116992
00000100:00100000:3.0:1767320844.248380:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380116992
00010000:00020000:2.0:1767320844.248382:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320844.248415:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380116608
00000100:00100000:2.0:1767320844.248416:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380116736:12345-0@lo:38:kworker.0 Request processed in 51us (146us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320844.248420:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380116608
00000100:00100000:2.0:1767320844.248427:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261
00000100:00100000:3.0:1767320844.248438:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380117248
00000100:00100000:3.0:1767320844.248442:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380117248
00000100:00100000:3.0:1767320844.248468:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5088
00000100:00100000:3.0:1767320844.248475:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380116992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320844.248509:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380116992:12345-0@lo:400:kworker.0 Request processed in 35us (462us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320844.248518:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5088
00000100:00100000:3.0:1767320844.248529:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5089
00000100:00100000:3.0:1767320844.248535:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380117248:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320844.248561:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380117248:12345-0@lo:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320844.248566:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5089
00000100:00100000:3.0:1767320844.248575:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18087
00000100:00100000:3.0:1767320844.248579:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380116608:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320844.248589:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320844.248611:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380116608:12345-0@lo:38:kworker.0 Request processed in 31us (393us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320844.248617:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18087
00000100:00100000:3.0:1767320844.248659:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380116992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320844.248682:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380117248:0@lo:400:kworker.0
00000100:00100000:3.0:1767320844.248706:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320844.248730:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320844.248735:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320844.248738:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380116608:0@lo:38:kworker.0
00000100:00080000:3.0:1767320844.248746:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320844.248748:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320844.248751:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380116736:0@lo:38:kworker.0
00000100:00100000:3.0:1767320844.248769:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380117120
00000100:00100000:3.0:1767320844.248772:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380117120
00000100:00100000:3.0:1767320844.248801:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18088
00000100:00100000:3.0:1767320844.248805:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380117120:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320844.248815:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320844.248844:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380117120:12345-0@lo:38:kworker.0 Request processed in 38us (138us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320844.248849:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18088
00000100:00080000:3.0:1767320844.248895:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320844.248898:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320844.248901:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380117120:0@lo:38:kworker.0
00000100:00080000:1.0:1767320844.249139:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320844.249167:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164380117376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320844.249264:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320844.249270:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320844.249759:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380117376:0@lo:38:kworker.0
00000100:00100000:3.0:1767320844.249852:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320844.249954:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380117376
00000100:00100000:0.0:1767320844.249960:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380117376
00000100:00100000:0.0:1767320844.249997:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18089
00000100:00100000:0.0:1767320844.250003:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380117376:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320844.250017:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320844.250061:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380117376:12345-0@lo:38:kworker.0 Request processed in 57us (209us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320844.250067:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18089
00000100:00080000:3.0:1767320844.250173:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320844.250178:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320844.250181:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380117376:0@lo:38:kworker.0
00010000:00010000:2.0:1767320844.823464:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320845.847890:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320846.228282:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320846.228413:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320846.229608:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997184
00000100:00100000:0.0:1767320846.229621:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997184
00000100:00100000:0.0:1767320846.229775:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997056
00000100:00100000:0.0:1767320846.229779:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997056
00000100:00100000:0.0:1767320846.229806:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5090
00000100:00100000:0.0:1767320846.229818:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291997184:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320846.229941:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18090
00000100:00100000:3.0:1767320846.229956:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291997056:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:0.0:1767320846.229973:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291997184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 154us (1700us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320846.229983:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5090
00010000:00020000:3.0:1767320846.229989:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320846.230057:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291997056:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 102us (1643us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320846.230066:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18090
00000100:00080000:2.0:1767320846.230993:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320846.872745:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320847.319289:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320847.319309:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380117504:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320847.319407:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320847.319562:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380117504
00000100:00100000:0.0:1767320847.319572:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380117504
00000100:00080000:1.0:1767320847.319925:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320847.320546:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836
00000100:00100000:0.0:1767320847.320564:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380117504:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320847.320635:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320847.320724:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380117504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 167us (1316us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320847.320732:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836
00000100:00100000:3.0:1767320847.320841:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380117504:0@lo:13:osp-pre-1-1.0
00010000:00010000:0.0:1767320847.895118:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320848.856033:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320848.856063:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380117632:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320848.856156:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320848.856909:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380117632
00000100:00100000:0.0:1767320848.856924:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380117632
00000100:00100000:0.0:1767320848.857020:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837
00000100:00100000:0.0:1767320848.857033:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380117632:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320848.857072:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320848.857143:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380117632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (987us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320848.857163:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837
00000100:00100000:0.0:1767320848.857231:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380117632:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320848.857463:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320848.919219:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320849.368006:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320849.368017:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320849.368020:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320849.368025:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320849.368030:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320849.368040:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5746
00000100:00080000:2.0:1767320849.368047:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320849.368057:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320849.368105:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858700 x1853164380117760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320849.368133:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320849.368138:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320849.368140:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320849.368145:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5746
00000100:00080000:2.0:1767320849.368148:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320849.368153:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320849.368167:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c858e00 x1853164380117888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320849.368229:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320849.368233:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320849.368235:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320849.368238:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5746
00000100:00080000:2.0:1767320849.368241:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320849.368245:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320849.368258:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6680 x1853164380118272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320849.368276:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320849.368280:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320849.368283:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320849.368287:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5746
00000100:00080000:2.0:1767320849.368290:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320849.368297:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320849.368313:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed7b80 x1853164380118528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320849.368359:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380118400:0@lo:400:kworker.0
00000100:00100000:1.0:1767320849.368401:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320849.368434:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380118016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320849.368447:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380118144:0@lo:400:kworker.0
00000100:00100000:1.0:1767320849.371210:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320849.371254:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118016
00000100:00100000:3.0:1767320849.371264:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118016
00000100:00100000:1.0:1767320849.371290:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380117760:0@lo:38:kworker.0
00000100:00100000:3.0:1767320849.371321:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024
00000100:00100000:1.0:1767320849.371327:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320849.371332:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380118016:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320849.371354:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380117888:0@lo:38:kworker.0
00000100:00100000:3.0:1767320849.371826:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380118016:12345-0@lo:400:kworker.0 Request processed in 496us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320849.371833:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320849.371838:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024
00000100:00080000:3.0:1767320849.371862:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320849.371896:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380118272:0@lo:38:kworker.0
00000100:00100000:3.0:1767320849.371918:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380118016:0@lo:400:kworker.0
00000100:00100000:1.0:1767320849.371922:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320849.371944:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380118528:0@lo:38:kworker.0
00000100:00100000:3.0:1767320849.371945:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380117760
00000100:00100000:3.0:1767320849.371950:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380117760
00000100:00100000:3.0:1767320849.371967:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118272
00000100:00100000:1.0:1767320849.371968:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320849.371970:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118272
00000100:00100000:3.0:1767320849.371989:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118528
00000100:00100000:3.0:1767320849.371990:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118528
00000100:00100000:3.0:1767320849.372003:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18091
00000100:00100000:3.0:1767320849.372007:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380117760:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320849.372023:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320849.372052:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380117760:12345-0@lo:38:kworker.0 Request processed in 43us (726us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320849.372829:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18092
00000100:00100000:1.0:1767320849.372852:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380118272:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320849.372858:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18091
00010000:00020000:1.0:1767320849.372892:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320849.372933:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380118272:12345-0@lo:38:kworker.0 Request processed in 81us (1012us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320849.372940:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18092
00000100:00100000:3.0:1767320849.372963:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18093
00000100:00100000:3.0:1767320849.372967:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380118528:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320849.372975:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320849.372997:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380118528:12345-0@lo:38:kworker.0 Request processed in 30us (1031us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320849.375123:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380117888
00000100:00100000:2.0:1767320849.375144:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380117888
00000100:00100000:2.0:1767320849.375424:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262
00000100:00100000:2.0:1767320849.375435:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380117888:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320849.375466:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320849.375564:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380117888:12345-0@lo:38:kworker.0 Request processed in 130us (3735us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320849.375573:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262
00000100:00100000:2.0:1767320849.375636:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320849.375715:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118400
00000100:00100000:2.0:1767320849.375720:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118400
00000100:00100000:3.0:1767320849.375957:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18093
00000100:00080000:3.0:1767320849.375997:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320849.376064:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320849.376072:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320849.376076:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380117760:0@lo:38:kworker.0
00000100:00080000:1.0:1767320849.376091:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320849.376094:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320849.376097:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380117888:0@lo:38:kworker.0
00000100:00080000:1.0:1767320849.376109:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320849.376113:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320849.376115:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380118272:0@lo:38:kworker.0
00000100:00080000:1.0:1767320849.376125:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320849.376129:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320849.376132:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380118528:0@lo:38:kworker.0
00000100:00100000:2.0:1767320849.377032:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5091
00000100:00100000:2.0:1767320849.377056:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380118400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320849.377171:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380118400:12345-0@lo:400:kworker.0 Request processed in 126us (1534us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320849.377179:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5091
00000100:00100000:1.0:1767320849.377706:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380118400:0@lo:400:kworker.0
00000100:00100000:0.0:1767320849.378024:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320849.378243:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118144
00000100:00100000:3.0:1767320849.378253:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118144
00000100:00100000:3.0:1767320849.378325:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5092
00000100:00100000:3.0:1767320849.378334:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380118144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320849.378425:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380118144:12345-0@lo:400:kworker.0 Request processed in 92us (402us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320849.378432:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5092
00000100:00100000:3.0:1767320849.378469:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380118144:0@lo:400:kworker.0
00000100:00080000:2.0:1767320849.380048:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320849.943167:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320850.967262:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320851.346492:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320851.346590:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320851.350566:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997440
00000100:00100000:2.0:1767320851.350582:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997440
00000100:00100000:2.0:1767320851.350707:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997312
00000100:00100000:2.0:1767320851.350712:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997312
00000100:00080000:0.0:1767320851.350763:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320851.354341:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5093
00000100:00100000:1.0:1767320851.354367:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291997440:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320851.354476:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291997440:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (7993us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320851.354488:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5093
00000100:00100000:1.0:1767320851.354519:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18094
00000100:00100000:1.0:1767320851.354524:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291997312:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320851.354545:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320851.354570:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291997312:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (7980us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320851.354576:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18094
00010000:00010000:0.0:1767320851.991323:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320852.439385:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380118656:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320852.439474:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320852.439899:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118656
00000100:00100000:2.0:1767320852.439909:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118656
00000100:00100000:2.0:1767320852.439984:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838
00000100:00100000:2.0:1767320852.439994:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380118656:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320852.440024:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320852.440029:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320852.440084:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380118656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (609us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320852.440092:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838
00000100:00100000:0.0:1767320852.440135:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380118656:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320853.015766:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320853.975253:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380118784:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320853.975326:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320853.975574:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118784
00000100:00100000:2.0:1767320853.975583:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118784
00000100:00100000:2.0:1767320853.975649:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839
00000100:00100000:2.0:1767320853.975669:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380118784:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320853.975711:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320853.975777:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320853.976076:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380118784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 409us (749us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320853.976085:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839
00000100:00100000:3.0:1767320853.976179:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380118784:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320854.039307:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320854.487144:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320854.487154:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320854.487158:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320854.487162:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320854.487166:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320854.487174:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5751
00000100:00080000:1.0:1767320854.487179:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320854.487185:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320854.487225:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c46d80 x1853164380118912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320854.487253:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320854.487256:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320854.487258:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320854.487262:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5751
00000100:00080000:1.0:1767320854.487264:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320854.487268:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320854.487281:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c47800 x1853164380119040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320854.487350:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380119168:0@lo:400:kworker.0
00000100:00100000:0.0:1767320854.487424:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320854.487454:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380118912:0@lo:38:kworker.0
00000100:00100000:2.0:1767320854.487489:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320854.487542:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320854.487546:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320854.487548:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320854.487552:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5751
00000100:00080000:1.0:1767320854.487554:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320854.487558:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320854.487570:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6680 x1853164380119424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320854.487596:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320854.487600:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320854.487601:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320854.487604:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5751
00000100:00080000:1.0:1767320854.487607:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320854.487610:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320854.487621:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680700 x1853164380119680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320854.487644:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380119552:0@lo:400:kworker.0
00000100:00100000:1.0:1767320854.487674:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320854.487736:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380118912
00000100:00100000:1.0:1767320854.487743:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380118912
00000100:00100000:1.0:1767320854.487777:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119552
00000100:00100000:1.0:1767320854.487779:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119552
00000100:00100000:2.0:1767320854.488303:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380119040:0@lo:38:kworker.0
00000100:00100000:2.0:1767320854.488347:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320854.488382:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380119424:0@lo:38:kworker.0
00000100:00100000:2.0:1767320854.488412:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320854.488432:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380119680:0@lo:38:kworker.0
00000100:00100000:2.0:1767320854.488454:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320854.488490:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119424
00000100:00100000:2.0:1767320854.488495:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119424
00000100:00100000:2.0:1767320854.488519:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119680
00000100:00100000:2.0:1767320854.488523:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119680
00000100:00100000:2.0:1767320854.488537:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18095
00000100:00100000:2.0:1767320854.488544:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f109f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380118912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320854.488566:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320854.488609:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f109f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380118912:12345-0@lo:38:kworker.0 Request processed in 63us (1117us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320854.488616:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18095
00000100:00100000:2.0:1767320854.488637:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18096
00000100:00100000:2.0:1767320854.488641:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380119424:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320854.488651:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320854.488673:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380119424:12345-0@lo:38:kworker.0 Request processed in 30us (260us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320854.488679:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18096
00000100:00100000:2.0:1767320854.488702:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18097
00000100:00100000:2.0:1767320854.488707:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380119680:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320854.488717:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320854.488737:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380119680:12345-0@lo:38:kworker.0 Request processed in 30us (283us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320854.488742:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18097
00000100:00100000:2.0:1767320854.488759:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119040
00000100:00100000:2.0:1767320854.488762:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119040
00000100:00100000:2.0:1767320854.488778:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263
00000100:00100000:2.0:1767320854.488782:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380119040:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320854.489182:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320854.489218:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380119040:12345-0@lo:38:kworker.0 Request processed in 433us (869us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320854.489226:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263
00000100:00080000:2.0:1767320854.489291:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320854.489297:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320854.489301:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380119424:0@lo:38:kworker.0
00000100:00080000:2.0:1767320854.489310:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320854.489313:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320854.489316:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380119680:0@lo:38:kworker.0
00000100:00080000:2.0:1767320854.489324:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320854.489328:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320854.489584:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380118912:0@lo:38:kworker.0
00000100:00080000:2.0:1767320854.489599:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320854.489602:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320854.489605:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380119040:0@lo:38:kworker.0
00000100:00100000:2.0:1767320854.489659:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380119296:0@lo:400:kworker.0
00000100:00100000:2.0:1767320854.489701:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320854.489732:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119296
00000100:00100000:2.0:1767320854.489737:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119296
00000100:00100000:2.0:1767320854.489784:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5094
00000100:00100000:2.0:1767320854.490059:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380119296:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320854.490108:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380119296:12345-0@lo:400:kworker.0 Request processed in 317us (418us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320854.490114:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5094
00000100:00100000:2.0:1767320854.490145:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380119296:0@lo:400:kworker.0
00000100:00080000:2.0:1767320854.490199:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320854.490311:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5095
00000100:00100000:1.0:1767320854.490320:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380119552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320854.490374:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380119552:12345-0@lo:400:kworker.0 Request processed in 57us (2700us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320854.490380:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5095
00000100:00100000:1.0:1767320854.490413:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380119552:0@lo:400:kworker.0
00000100:00080000:2.0:1767320854.490647:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320854.491091:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119168
00000100:00100000:3.0:1767320854.491098:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119168
00000100:00100000:3.0:1767320854.491158:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025
00000100:00100000:3.0:1767320854.491166:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380119168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320854.491212:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380119168:12345-0@lo:400:kworker.0 Request processed in 48us (3788us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320854.491217:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025
00000100:00080000:2.0:1767320854.491355:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320854.492286:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380119168:0@lo:400:kworker.0
00010000:00010000:2.0:1767320855.066797:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1767320856.087909:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320856.477393:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320856.477444:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320856.477574:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997696
00000100:00100000:1.0:1767320856.477584:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997696
00000100:00100000:1.0:1767320856.477679:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997568
00000100:00100000:1.0:1767320856.477684:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997568
00000100:00100000:1.0:1767320856.477703:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5096
00000100:00100000:1.0:1767320856.477713:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291997696:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320856.477788:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291997696:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 76us (404us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320856.477796:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5096
00000100:00100000:1.0:1767320856.477818:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18098
00000100:00100000:1.0:1767320856.477824:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291997568:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320856.477843:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320856.477893:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291997568:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (424us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320856.477900:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18098
00000100:00080000:2.0:1767320856.478154:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320857.112108:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320857.559279:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380119808:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320857.559356:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320857.559515:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119808
00000100:00100000:2.0:1767320857.559523:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119808
00000100:00080000:0.0:1767320857.559584:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320857.559600:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840
00000100:00100000:2.0:1767320857.559611:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380119808:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320857.559643:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320857.559708:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380119808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (352us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320857.559715:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840
00000100:00100000:0.0:1767320857.560107:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c449500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380119808:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320858.135769:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320859.095823:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380119936:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320859.095911:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320859.096094:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380119936
00000100:00100000:3.0:1767320859.096102:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380119936
00000100:00100000:3.0:1767320859.096179:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841
00000100:00100000:3.0:1767320859.096190:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380119936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320859.096220:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320859.096275:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380119936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (363us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320859.096283:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841
00000100:00100000:3.0:1767320859.096326:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380119936:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320859.096463:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320859.159247:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320859.607074:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320859.607083:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320859.607086:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320859.607090:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320859.607094:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320859.607101:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5756
00000100:00080000:1.0:1767320859.607106:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320859.607113:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320859.607148:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680700 x1853164380120064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320859.607171:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320859.607174:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320859.607176:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320859.607180:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5756
00000100:00080000:1.0:1767320859.607182:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320859.607186:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320859.607197:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f41d9dc00 x1853164380120192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320859.607275:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320859.607278:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320859.607280:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320859.607284:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5756
00000100:00080000:1.0:1767320859.607286:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320859.607289:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320859.607300:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91c00 x1853164380120704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320859.607326:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320859.607329:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320859.607331:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320859.607334:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5756
00000100:00080000:1.0:1767320859.607337:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320859.607340:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320859.607351:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93800 x1853164380120960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320859.607387:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380120448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320859.607447:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320859.607496:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320859.607501:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380120576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320859.607521:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320859.607546:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120448
00000100:00100000:1.0:1767320859.607552:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120448
00000100:00100000:1.0:1767320859.607588:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026
00000100:00100000:1.0:1767320859.607595:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380120448:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320859.607636:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380120448:12345-0@lo:400:kworker.0 Request processed in 41us (189us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320859.607654:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026
00000100:00100000:1.0:1767320859.607693:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380120448:0@lo:400:kworker.0
00000100:00100000:0.0:1767320859.607755:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120576
00000100:00100000:0.0:1767320859.607759:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120576
00000100:00100000:0.0:1767320859.607798:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5097
00000100:00100000:0.0:1767320859.607805:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380120576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320859.607839:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380120576:12345-0@lo:400:kworker.0 Request processed in 35us (316us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320859.607845:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5097
00000100:00100000:0.0:1767320859.607862:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380120064:0@lo:38:kworker.0
00000100:00100000:0.0:1767320859.607907:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320859.607921:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380120192:0@lo:38:kworker.0
00000100:00100000:0.0:1767320859.607940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320859.607957:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380120704:0@lo:38:kworker.0
00000100:00100000:0.0:1767320859.607975:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320859.607987:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380120960:0@lo:38:kworker.0
00000100:00100000:0.0:1767320859.608007:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320859.608031:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120064
00000100:00100000:0.0:1767320859.608034:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120064
00000100:00100000:0.0:1767320859.608047:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120704
00000100:00100000:0.0:1767320859.608049:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120704
00000100:00100000:0.0:1767320859.608057:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120960
00000100:00100000:0.0:1767320859.608059:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120960
00000100:00100000:0.0:1767320859.608067:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18099
00000100:00100000:0.0:1767320859.608071:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380120064:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320859.608088:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320859.608115:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380120064:12345-0@lo:38:kworker.0 Request processed in 43us (208us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320859.608121:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18099
00000100:00100000:0.0:1767320859.608130:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18100
00000100:00100000:0.0:1767320859.608133:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380120704:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320859.608141:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320859.608157:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380120704:12345-0@lo:38:kworker.0 Request processed in 22us (181us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320859.608162:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18100
00000100:00100000:0.0:1767320859.608170:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18101
00000100:00100000:0.0:1767320859.608173:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380120960:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320859.608181:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320859.608194:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380120960:12345-0@lo:38:kworker.0 Request processed in 20us (187us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320859.608199:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18101
00000100:00100000:0.0:1767320859.608221:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380120576:0@lo:400:kworker.0
00000100:00080000:0.0:1767320859.608237:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320859.608241:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320859.608244:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380120064:0@lo:38:kworker.0
00000100:00080000:0.0:1767320859.608252:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320859.608255:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320859.608257:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380120704:0@lo:38:kworker.0
00000100:00080000:0.0:1767320859.608263:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320859.608266:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320859.608268:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380120960:0@lo:38:kworker.0
00000100:00100000:2.0:1767320859.608358:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380120320:0@lo:400:kworker.0
00000100:00100000:2.0:1767320859.608389:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320859.608418:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320859.608424:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380120832:0@lo:400:kworker.0
00000100:00100000:2.0:1767320859.608444:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320859.608470:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120192
00000100:00100000:2.0:1767320859.608474:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120192
00000100:00100000:2.0:1767320859.608494:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264
00000100:00100000:2.0:1767320859.608499:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380120192:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320859.608509:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320859.608536:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380120192:12345-0@lo:38:kworker.0 Request processed in 36us (595us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320859.608542:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264
00000100:00100000:2.0:1767320859.608560:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120832
00000100:00100000:2.0:1767320859.608563:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120832
00000100:00100000:2.0:1767320859.608586:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5098
00000100:00100000:2.0:1767320859.608592:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380120832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320859.608622:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380120832:12345-0@lo:400:kworker.0 Request processed in 31us (177us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320859.608628:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5098
00000100:00100000:2.0:1767320859.608675:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380120832:0@lo:400:kworker.0
00000100:00100000:3.0:1767320859.608919:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380120320
00000100:00100000:3.0:1767320859.608924:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380120320
00000100:00100000:3.0:1767320859.608956:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027
00000100:00100000:3.0:1767320859.608964:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380120320:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320859.609008:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380120320:12345-0@lo:400:kworker.0 Request processed in 46us (618us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320859.609014:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027
00000100:00100000:3.0:1767320859.609042:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380120320:0@lo:400:kworker.0
00000100:00080000:1.0:1767320859.609111:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320859.609115:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767320859.612950:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320859.612963:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320859.612968:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f41d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380120192:0@lo:38:kworker.0
00010000:00010000:0.0:1767320860.183205:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320861.210321:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320861.590465:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320861.590639:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997952
00000100:00100000:0.0:1767320861.590649:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997952
00000100:00100000:0.0:1767320861.590728:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5099
00000100:00100000:0.0:1767320861.590739:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291997952:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767320861.591243:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320861.595329:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291997952:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 4578us (4862us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320861.595346:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5099
00000100:00100000:2.0:1767320861.596123:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320861.596737:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291997824
00000100:00100000:0.0:1767320861.596748:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291997824
00000100:00100000:0.0:1767320861.596965:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18102
00000100:00100000:0.0:1767320861.596974:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291997824:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320861.596998:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320861.597054:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291997824:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 79us (944us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320861.597061:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18102
00010000:00010000:2.0:1767320862.231423:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320862.681792:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320862.686648:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380121088:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320862.686730:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320862.689666:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121088
00000100:00100000:1.0:1767320862.689686:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121088
00000100:00080000:0.0:1767320862.689788:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320862.690140:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842
00000100:00100000:1.0:1767320862.690153:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380121088:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320862.690187:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320862.690357:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380121088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 208us (3626us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320862.690365:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842
00000100:00100000:0.0:1767320862.690443:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380121088:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320863.257332:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320864.216029:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320864.216056:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380121216:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320864.216157:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320864.217926:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121216
00000100:00100000:1.0:1767320864.217942:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121216
00000100:00100000:1.0:1767320864.218099:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843
00000100:00100000:1.0:1767320864.218112:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380121216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320864.218149:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320864.218259:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380121216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (2101us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320864.218268:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843
00000100:00100000:2.0:1767320864.218822:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380121216:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1767320864.222825:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767320864.284558:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320864.727036:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320864.727048:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320864.727051:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320864.727055:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320864.727060:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320864.727068:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5762
00000100:00080000:1.0:1767320864.727073:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320864.727082:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320864.727136:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91f80 x1853164380121344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320864.727204:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380121344:0@lo:38:kworker.0
00000100:00100000:2.0:1767320864.727274:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320864.727351:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320864.727355:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320864.727357:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320864.727361:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5762
00000100:00080000:1.0:1767320864.727364:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320864.727368:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320864.727382:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90000 x1853164380121472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320864.727384:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121344
00000100:00100000:3.0:1767320864.727393:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121344
00000100:00100000:3.0:1767320864.727437:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18103
00000100:00100000:3.0:1767320864.727444:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380121344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320864.727465:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320864.728169:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380121472:0@lo:38:kworker.0
00000100:00100000:2.0:1767320864.728209:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320864.728344:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320864.728347:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320864.728350:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320864.728355:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5762
00000100:00080000:1.0:1767320864.728358:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320864.728362:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320864.728377:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93480 x1853164380121984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320864.728405:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320864.728408:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320864.728410:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320864.728414:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5762
00000100:00080000:1.0:1767320864.728416:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320864.728420:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320864.728430:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92680 x1853164380122240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320864.728459:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380121728:0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.728490:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320864.728541:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320864.728547:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380121856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.728572:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320864.728624:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121728
00000100:00100000:1.0:1767320864.728630:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121728
00000100:00100000:1.0:1767320864.728682:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028
00000100:00100000:1.0:1767320864.728690:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380121728:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.728737:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380121728:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320864.728744:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028
00000100:00100000:1.0:1767320864.728773:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121856
00000100:00100000:1.0:1767320864.728777:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121856
00000100:00100000:1.0:1767320864.728810:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5100
00000100:00100000:1.0:1767320864.728815:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380121856:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.728845:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380121856:12345-0@lo:400:kworker.0 Request processed in 30us (271us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320864.728851:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5100
00000100:00100000:1.0:1767320864.728903:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380121856:0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.728914:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380121728:0@lo:400:kworker.0
00000100:00080000:1.0:1767320864.728964:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320864.729793:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380122112:0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.729835:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320864.729893:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320864.729900:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380121600:0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.729923:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320864.729955:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121600
00000100:00100000:1.0:1767320864.729960:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121600
00000100:00100000:1.0:1767320864.730005:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029
00000100:00100000:1.0:1767320864.730012:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380121600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.730049:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380121600:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320864.730055:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029
00000100:00080000:1.0:1767320864.730072:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320864.730422:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380121600:0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.730448:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380122112
00000100:00100000:1.0:1767320864.730451:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380122112
00000100:00100000:1.0:1767320864.730489:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5101
00000100:00100000:1.0:1767320864.730496:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380122112:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320864.730849:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380122112:12345-0@lo:400:kworker.0 Request processed in 352us (1012us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320864.730856:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5101
00000100:00080000:1.0:1767320864.730898:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320864.730920:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380122112:0@lo:400:kworker.0
00000100:00100000:0.0:1767320864.731376:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121472
00000100:00100000:0.0:1767320864.731383:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121472
00000100:00100000:0.0:1767320864.731489:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265
00000100:00100000:0.0:1767320864.731496:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380121472:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320864.731773:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320864.731826:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380121472:12345-0@lo:38:kworker.0 Request processed in 329us (3616us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320864.731832:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265
00000100:00100000:3.0:1767320864.737424:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380121344:12345-0@lo:38:kworker.0 Request processed in 9967us (10137us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320864.737440:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18103
00000100:00080000:2.0:1767320864.737546:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320864.737553:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320864.737556:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380121344:0@lo:38:kworker.0
00000100:00100000:2.0:1767320864.737588:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380121984:0@lo:38:kworker.0
00000100:00100000:2.0:1767320864.738248:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320864.738293:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380122240:0@lo:38:kworker.0
00000100:00100000:2.0:1767320864.738316:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320864.738424:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320864.738429:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320864.738433:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380121472:0@lo:38:kworker.0
00000100:00100000:1.0:1767320864.738847:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380121984
00000100:00100000:1.0:1767320864.738952:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380121984
00000100:00100000:1.0:1767320864.739229:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380122240
00000100:00100000:1.0:1767320864.739234:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380122240
00000100:00100000:2.0:1767320864.739277:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18104
00000100:00100000:2.0:1767320864.739284:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380121984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320864.739309:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320864.739377:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380121984:12345-0@lo:38:kworker.0 Request processed in 92us (1130us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320864.739384:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18104
00000100:00100000:2.0:1767320864.739416:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18105
00000100:00100000:2.0:1767320864.739421:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380122240:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320864.739431:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320864.739455:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380122240:12345-0@lo:38:kworker.0 Request processed in 32us (1139us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320864.739461:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18105
00000100:00080000:0.0:1767320864.739645:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320864.739651:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320864.739655:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380121984:0@lo:38:kworker.0
00000100:00080000:0.0:1767320864.739677:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320864.739681:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320864.739684:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380122240:0@lo:38:kworker.0
00010000:00010000:2.0:1767320865.303526:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320865.687778:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767320865.687820:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291998080 offset 0 length 520: 4
00000100:00100000:3.0:1767320865.687849:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320865.687929:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291998336
00000100:00100000:2.0:1767320865.687940:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291998336
00000100:00100000:2.0:1767320865.688017:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291998208
00000100:00100000:2.0:1767320865.688020:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291998208
00000100:00100000:2.0:1767320865.688040:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5102
00000100:00100000:2.0:1767320865.688049:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291998336:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320865.688106:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18106
00000100:00100000:1.0:1767320865.688115:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291998208:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:2.0:1767320865.688120:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291998336:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 69us (364us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320865.688128:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5102
00010000:00020000:1.0:1767320865.688148:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320865.688196:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164291998208:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 79us (344us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320865.688203:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18106
00000100:00080000:3.0:1767320865.688489:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320866.327229:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320867.351173:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320867.802439:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380122368:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320867.802521:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320867.802649:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380122368
00000100:00100000:3.0:1767320867.802658:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380122368
00000100:00100000:3.0:1767320867.802729:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844
00000100:00100000:3.0:1767320867.802738:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380122368:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320867.802767:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320867.802841:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320867.810655:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380122368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7906us (8122us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320867.810818:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844
00000100:00100000:1.0:1767320867.811592:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380122368:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320868.375600:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320869.335530:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380122496:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320869.335616:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320869.335733:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380122496
00000100:00100000:3.0:1767320869.335742:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380122496
00000100:00100000:3.0:1767320869.335807:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845
00000100:00100000:3.0:1767320869.335817:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380122496:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320869.335852:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767320869.335965:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320869.348330:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380122496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 12504us (12703us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320869.348360:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845
00000100:00100000:2.0:1767320869.351216:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380122496:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320869.399829:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320869.847000:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320869.847014:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00100000:0.0:1767320869.847015:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320844/real 1767320844]  req@ffff8b0e0be04a80 x1853164380116480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320869 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320869.847017:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320869.847024:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320869.847029:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320869.847036:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5767
00000100:00080000:1.0:1767320869.847041:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320869.847049:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320869.847054:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0be04a80 x1853164380116480/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320869 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320869.847076:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1767320869.847090:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b91180 x1853164380122624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320869.847100:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320869.847106:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380116480:0@lo:250:kworker.0
00000100:00080000:1.0:1767320869.847107:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320869.847115:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320869.847117:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320869.847121:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5767
00000100:00080000:1.0:1767320869.847123:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320869.847127:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320869.847140:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380122624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320869.847142:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92680 x1853164380122752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320869.847211:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320869.847234:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320869.847238:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320869.847240:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320869.847245:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5767
00000100:00080000:1.0:1767320869.847249:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1767320869.847252:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:1.0:1767320869.847254:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320869.847266:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380122880:0@lo:400:kworker.0
00000100:00100000:1.0:1767320869.847288:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b90a80 x1853164380123264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320869.847291:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380122752:0@lo:38:kworker.0
00000100:00100000:3.0:1767320869.847310:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320869.847318:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320869.847322:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320869.847325:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320869.847330:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5767
00000100:00080000:1.0:1767320869.847352:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320869.847357:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320869.847369:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92a00 x1853164380123520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320869.847383:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320869.847386:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320869.847388:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320869.847391:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5746
00000100:00080000:1.0:1767320869.847393:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320869.847396:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320869.847409:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93800 x1853164380123648/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320869.847430:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380123136:0@lo:400:kworker.0
00000100:00100000:2.0:1767320869.847530:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320869.847540:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380123392:0@lo:400:kworker.0
00000100:00100000:0.0:1767320869.849689:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320869.849774:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380123264:0@lo:38:kworker.0
00000100:00100000:0.0:1767320869.849828:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320869.849847:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380123520:0@lo:38:kworker.0
00000100:00100000:0.0:1767320869.849882:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320869.849901:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380123648:0@lo:250:kworker.0
00000400:00000100:0.0:1767320869.850077:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380123648 offset 0 length 520: 4
00000100:00100000:0.0:1767320869.850457:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380123008:0@lo:400:kworker.0
00000100:00100000:0.0:1767320869.850490:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320869.850537:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380122624
00000100:00100000:0.0:1767320869.850544:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380122624
00000100:00100000:0.0:1767320869.850594:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380123264
00000100:00100000:0.0:1767320869.850598:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380123264
00000100:00100000:0.0:1767320869.850615:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380123520
00000100:00100000:0.0:1767320869.850617:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380123520
00000100:00100000:0.0:1767320869.850635:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18107
00000100:00100000:0.0:1767320869.850642:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380122624:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320869.850664:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320869.850710:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380122624:12345-0@lo:38:kworker.0 Request processed in 66us (3499us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320869.850716:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18107
00000100:00100000:0.0:1767320869.850734:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18108
00000100:00100000:0.0:1767320869.850738:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380123264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320869.850746:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320869.850770:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380123264:12345-0@lo:38:kworker.0 Request processed in 30us (941us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320869.850775:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18108
00000100:00100000:0.0:1767320869.850785:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18109
00000100:00100000:0.0:1767320869.850789:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380123520:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320869.850797:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320869.850819:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380123520:12345-0@lo:38:kworker.0 Request processed in 28us (951us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320869.850824:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18109
00000100:00100000:0.0:1767320869.850842:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380122752
00000100:00100000:0.0:1767320869.850847:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380122752
00000100:00100000:0.0:1767320869.850865:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266
00000100:00100000:0.0:1767320869.850898:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380122752:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320869.850909:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320869.851461:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380122752:12345-0@lo:38:kworker.0 Request processed in 560us (1775us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320869.851468:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266
00000100:00080000:0.0:1767320869.851532:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320869.851537:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320869.851542:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380123264:0@lo:38:kworker.0
00000100:00080000:0.0:1767320869.851562:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320869.851566:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320869.851569:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380123520:0@lo:38:kworker.0
00000100:00080000:0.0:1767320869.851579:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320869.851582:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320869.851584:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380122752:0@lo:38:kworker.0
00000100:00080000:0.0:1767320869.851592:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320869.851594:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320869.851597:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380122624:0@lo:38:kworker.0
00000100:00100000:0.0:1767320869.851648:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380122880
00000100:00100000:0.0:1767320869.851654:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380122880
00000100:00100000:0.0:1767320869.851694:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380123008
00000100:00100000:0.0:1767320869.851697:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380123008
00000100:00100000:0.0:1767320869.851715:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030
00000100:00100000:0.0:1767320869.851721:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380122880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320869.851765:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380122880:12345-0@lo:400:kworker.0 Request processed in 43us (4456us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320869.851771:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030
00000100:00100000:0.0:1767320869.851785:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031
00000100:00100000:0.0:1767320869.851792:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380123008:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320869.851822:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380122880:0@lo:400:kworker.0
00000100:00100000:0.0:1767320869.851832:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380123008:12345-0@lo:400:kworker.0 Request processed in 39us (1340us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320869.851840:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031
00000100:00080000:0.0:1767320869.851863:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320869.852065:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380123008:0@lo:400:kworker.0
00000100:00100000:1.0:1767320869.857129:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320869.857218:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380123136
00000100:00100000:3.0:1767320869.857231:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380123136
00000100:00100000:3.0:1767320869.857307:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5103
00000100:00100000:3.0:1767320869.857319:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380123136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320869.857469:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380123136:12345-0@lo:400:kworker.0 Request processed in 153us (346us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320869.857477:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5103
00000100:00080000:0.0:1767320869.860211:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320869.860719:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320869.860816:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380123136:0@lo:400:kworker.0
00000100:00100000:3.0:1767320869.861236:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380123392
00000100:00100000:3.0:1767320869.861246:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380123392
00000100:00100000:3.0:1767320869.861356:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5104
00000100:00100000:3.0:1767320869.861366:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380123392:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320869.861448:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380123392:12345-0@lo:400:kworker.0 Request processed in 80us (742us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320869.861476:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5104
00000100:00100000:2.0:1767320869.861616:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380123392:0@lo:400:kworker.0
00000100:00080000:0.0:1767320869.864278:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320870.423351:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320870.800001:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320870.800100:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320870.805173:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291998592
00000100:00100000:2.0:1767320870.805190:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291998592
00000100:00100000:2.0:1767320870.805277:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291998464
00000100:00100000:2.0:1767320870.805280:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291998464
00000100:00100000:2.0:1767320870.805307:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5105
00000100:00100000:2.0:1767320870.805317:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291998592:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320870.805336:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18110
00000100:00100000:3.0:1767320870.805345:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291998464:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320870.805371:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320870.805752:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164291998592:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 435us (5763us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320870.805759:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5105
00000100:00080000:1.0:1767320870.806401:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320870.814597:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291998464:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 9236us (14480us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320870.814615:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18110
00010000:00010000:2.0:1767320871.447070:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320872.473833:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320872.923147:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320872.933285:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380123776:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320872.933369:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320872.933680:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380123776
00000100:00100000:0.0:1767320872.933690:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380123776
00000100:00100000:0.0:1767320872.933762:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846
00000100:00100000:0.0:1767320872.933771:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380123776:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320872.933804:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320872.933848:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380123776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (479us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320872.933856:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846
00000100:00080000:2.0:1767320872.934011:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320872.934237:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380123776:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320873.498611:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320874.459125:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380123904:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320874.459191:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320874.459318:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380123904
00000100:00100000:3.0:1767320874.459326:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380123904
00000100:00100000:3.0:1767320874.459385:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847
00000100:00100000:3.0:1767320874.459393:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380123904:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320874.459420:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320874.459468:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380123904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (277us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320874.459475:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847
00000100:00100000:3.0:1767320874.459530:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380123904:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767320874.459648:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320874.519375:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320874.968107:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320874.968118:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320874.968121:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320874.968125:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320874.968129:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320874.968138:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5772
00000100:00080000:3.0:1767320874.968143:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320874.968150:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320874.968191:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dc700 x1853164380124032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320874.968222:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320874.968234:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320874.968236:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320874.968240:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5772
00000100:00080000:3.0:1767320874.968242:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320874.968246:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320874.968286:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964e680 x1853164380124160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320874.968356:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320874.968359:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320874.968361:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320874.968365:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5772
00000100:00080000:3.0:1767320874.968368:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320874.968371:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320874.968380:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164380124672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320874.968395:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320874.968398:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320874.968400:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320874.968404:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5772
00000100:00080000:3.0:1767320874.968406:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320874.968410:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320874.968420:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964dc00 x1853164380124928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320874.968628:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380124800:0@lo:400:kworker.0
00000100:00100000:1.0:1767320874.968693:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320874.968757:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320874.968763:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380124288:0@lo:400:kworker.0
00000100:00100000:1.0:1767320874.968788:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320874.968824:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124800
00000100:00100000:1.0:1767320874.968832:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124800
00000100:00100000:1.0:1767320874.968929:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5106
00000100:00100000:1.0:1767320874.968938:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380124800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320874.968990:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380124800:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320874.968997:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5106
00000100:00080000:1.0:1767320874.969022:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320874.969053:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380124800:0@lo:400:kworker.0
00000100:00100000:0.0:1767320874.969281:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380124032:0@lo:38:kworker.0
00000100:00100000:0.0:1767320874.969313:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320874.969339:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380124160:0@lo:38:kworker.0
00000100:00100000:0.0:1767320874.969362:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320874.969392:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380124672:0@lo:38:kworker.0
00000100:00100000:0.0:1767320874.969413:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320874.969431:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380124928:0@lo:38:kworker.0
00000100:00100000:0.0:1767320874.969449:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320874.969489:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380124544:0@lo:400:kworker.0
00000100:00100000:0.0:1767320874.969537:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320874.969571:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124288
00000100:00100000:0.0:1767320874.969576:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124288
00000100:00100000:0.0:1767320874.969616:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032
00000100:00100000:0.0:1767320874.969624:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380124288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320874.969660:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380124288:12345-0@lo:400:kworker.0 Request processed in 38us (871us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320874.969667:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032
00000100:00100000:0.0:1767320874.969685:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124032
00000100:00100000:0.0:1767320874.969688:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124032
00000100:00100000:0.0:1767320874.969706:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124672
00000100:00100000:0.0:1767320874.969709:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124672
00000100:00100000:0.0:1767320874.969716:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124928
00000100:00100000:0.0:1767320874.969719:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124928
00000100:00100000:0.0:1767320874.969725:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124544
00000100:00100000:0.0:1767320874.969727:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124544
00000100:00100000:0.0:1767320874.969745:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5107
00000100:00100000:0.0:1767320874.969750:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380124544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320874.969782:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380124544:12345-0@lo:400:kworker.0 Request processed in 32us (245us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320874.969788:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5107
00000100:00100000:0.0:1767320874.969800:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18111
00000100:00100000:0.0:1767320874.969804:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380124032:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320874.969821:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320874.969853:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380124032:12345-0@lo:38:kworker.0 Request processed in 47us (539us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320874.970099:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124160
00000100:00100000:2.0:1767320874.970104:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124160
00000100:00100000:2.0:1767320874.970131:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267
00000100:00100000:2.0:1767320874.970136:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380124160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320874.970146:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320874.970175:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380124160:12345-0@lo:38:kworker.0 Request processed in 38us (812us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320874.970181:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267
00000100:00100000:0.0:1767320874.970260:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18111
00000100:00100000:0.0:1767320874.970273:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18112
00000100:00100000:0.0:1767320874.970277:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380124672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320874.970287:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320874.970302:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18113
00000100:00100000:2.0:1767320874.970307:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380124928:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767320874.970312:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f41d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380124672:12345-0@lo:38:kworker.0 Request processed in 34us (899us total) trans 0 rc -19/-19
00010000:00020000:2.0:1767320874.970316:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320874.970317:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18112
00000100:00100000:2.0:1767320874.970340:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380124928:12345-0@lo:38:kworker.0 Request processed in 31us (889us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320874.970345:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18113
00000100:00100000:0.0:1767320874.970352:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380124544:0@lo:400:kworker.0
00000100:00080000:2.0:1767320874.970367:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767320874.970372:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320874.970376:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320874.970382:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320874.970385:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380124032:0@lo:38:kworker.0
00000100:00080000:0.0:1767320874.970393:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320874.970397:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320874.970399:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380124160:0@lo:38:kworker.0
00000100:00080000:0.0:1767320874.970407:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320874.970410:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320874.970413:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380124672:0@lo:38:kworker.0
00000100:00080000:0.0:1767320874.970420:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320874.970423:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320874.970426:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380124928:0@lo:38:kworker.0
00000100:00100000:0.0:1767320874.970548:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380124288:0@lo:400:kworker.0
00000100:00100000:3.0:1767320874.970657:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380124416:0@lo:400:kworker.0
00000100:00100000:3.0:1767320874.970694:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320874.970977:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380124416
00000100:00100000:2.0:1767320874.970983:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380124416
00000100:00100000:2.0:1767320874.971026:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033
00000100:00100000:2.0:1767320874.971033:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380124416:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320874.971154:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380124416:12345-0@lo:400:kworker.0 Request processed in 121us (458us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320874.971162:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033
00000100:00100000:3.0:1767320874.974796:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380124416:0@lo:400:kworker.0
00010000:00010000:2.0:1767320875.543202:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320875.919838:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320875.920283:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291998848
00000100:00100000:3.0:1767320875.920302:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291998848
00000100:00100000:3.0:1767320875.920380:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5108
00000100:00100000:3.0:1767320875.920391:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291998848:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320875.920511:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164291998848:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 122us (686us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320875.920519:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5108
00000100:00080000:2.0:1767320875.920791:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320875.920821:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320875.920903:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291998720
00000100:00100000:3.0:1767320875.920918:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291998720
00000100:00100000:3.0:1767320875.920948:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18114
00000100:00100000:3.0:1767320875.920953:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291998720:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320875.920973:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320875.921002:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291998720:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 48us (201us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320875.921009:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18114
00010000:00010000:2.0:1767320876.568347:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320877.591537:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320878.040212:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380125056:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320878.040333:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320878.042444:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125056
00000100:00100000:2.0:1767320878.042464:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125056
00000100:00100000:2.0:1767320878.042553:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848
00000100:00100000:2.0:1767320878.042564:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380125056:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320878.042614:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320878.042713:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380125056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (2380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320878.042721:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848
00000100:00080000:1.0:1767320878.042988:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320878.043043:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380125056:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320878.617629:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320879.575440:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380125184:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320879.575615:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320879.575780:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125184
00000100:00100000:1.0:1767320879.575791:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125184
00000100:00080000:2.0:1767320879.577129:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320879.577342:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849
00000100:00100000:1.0:1767320879.577361:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380125184:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320879.577400:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320879.577509:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380125184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (1892us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320879.577516:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849
00000100:00100000:3.0:1767320879.577616:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380125184:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320879.639452:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320880.087552:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320880.087567:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320880.087571:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320880.087576:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320880.087583:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320880.087593:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5777
00000100:00080000:2.0:1767320880.087599:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320880.087609:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320880.087667:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379b480 x1853164380125312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320880.087713:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320880.087718:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320880.087720:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320880.087725:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5777
00000100:00080000:2.0:1767320880.087727:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320880.087732:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320880.087753:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379bb80 x1853164380125440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320880.087841:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380125568:0@lo:400:kworker.0
00000100:00100000:0.0:1767320880.087964:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320880.088136:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380125312:0@lo:38:kworker.0
00000100:00100000:1.0:1767320880.088173:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320880.088210:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380125440:0@lo:38:kworker.0
00000100:00100000:1.0:1767320880.088236:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320880.088303:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125440
00000100:00100000:1.0:1767320880.088313:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125440
00000100:00100000:1.0:1767320880.088359:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268
00000100:00100000:1.0:1767320880.088368:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380125440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320880.088395:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320880.088448:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380125440:12345-0@lo:38:kworker.0 Request processed in 79us (209us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320880.088466:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268
00000100:00080000:1.0:1767320880.088522:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320880.088528:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320880.088532:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380125440:0@lo:38:kworker.0
00000100:00100000:1.0:1767320880.088572:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125312
00000100:00100000:1.0:1767320880.088576:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125312
00000100:00100000:1.0:1767320880.088601:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18115
00000100:00100000:1.0:1767320880.088606:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380125312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320880.088617:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320880.088647:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380125312:12345-0@lo:38:kworker.0 Request processed in 39us (473us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320880.088653:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18115
00000100:00080000:1.0:1767320880.088678:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320880.088682:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320880.088685:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380125312:0@lo:38:kworker.0
00000100:00080000:2.0:1767320880.088825:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320880.088830:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320880.088832:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320880.088836:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5777
00000100:00080000:2.0:1767320880.088840:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320880.088844:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320880.088861:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33798e00 x1853164380125952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320880.090191:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380125824:0@lo:400:kworker.0
00000100:00100000:1.0:1767320880.090279:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320880.090338:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767320880.090345:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380125696:0@lo:400:kworker.0
00000100:00100000:1.0:1767320880.090377:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320880.090598:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320880.090608:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380126080:0@lo:400:kworker.0
00000100:00100000:0.0:1767320880.090643:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320880.090737:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380125952:0@lo:38:kworker.0
00000100:00100000:0.0:1767320880.090771:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320880.090816:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125824
00000100:00100000:0.0:1767320880.090825:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125824
00000100:00100000:0.0:1767320880.090916:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126080
00000100:00100000:0.0:1767320880.090920:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126080
00000100:00100000:0.0:1767320880.090943:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125952
00000100:00100000:0.0:1767320880.090946:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125952
00000100:00100000:0.0:1767320880.090964:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5109
00000100:00100000:0.0:1767320880.090974:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380125824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320880.091047:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380125824:12345-0@lo:400:kworker.0 Request processed in 73us (768us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320880.091056:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5109
00000100:00100000:0.0:1767320880.091077:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5110
00000100:00100000:0.0:1767320880.091082:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380126080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320880.091114:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380126080:12345-0@lo:400:kworker.0 Request processed in 32us (470us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320880.091120:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5110
00000100:00100000:0.0:1767320880.091132:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18116
00000100:00100000:0.0:1767320880.091136:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380125952:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320880.091159:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320880.091202:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380125952:12345-0@lo:38:kworker.0 Request processed in 64us (429us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320880.091208:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18116
00000100:00080000:0.0:1767320880.091250:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320880.091255:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320880.091258:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380125952:0@lo:38:kworker.0
00000100:00100000:0.0:1767320880.091294:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380126080:0@lo:400:kworker.0
00000100:00080000:0.0:1767320880.091334:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320880.091850:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380125824:0@lo:400:kworker.0
00000100:00100000:3.0:1767320880.092001:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125568
00000100:00100000:3.0:1767320880.092008:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125568
00000100:00100000:3.0:1767320880.092069:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380125696
00000100:00100000:3.0:1767320880.092073:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380125696
00000100:00100000:3.0:1767320880.092095:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034
00000100:00100000:3.0:1767320880.092102:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380125568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320880.092164:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380125568:12345-0@lo:400:kworker.0 Request processed in 63us (4201us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320880.092171:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034
00000100:00080000:1.0:1767320880.092300:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320880.092331:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035
00000100:00100000:1.0:1767320880.092340:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380125696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320880.092379:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380125696:12345-0@lo:400:kworker.0 Request processed in 42us (2001us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320880.092386:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035
00000100:00100000:1.0:1767320880.092418:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380125696:0@lo:400:kworker.0
00000100:00100000:1.0:1767320880.092465:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380125568:0@lo:400:kworker.0
00000100:00080000:2.0:1767320880.092600:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320880.092607:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320880.092612:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320880.092618:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5777
00000100:00080000:2.0:1767320880.092623:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320880.092628:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320880.092669:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799500 x1853164380126208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320880.092849:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380126208:0@lo:38:kworker.0
00000100:00100000:3.0:1767320880.092915:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320880.093012:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126208
00000100:00100000:1.0:1767320880.093018:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126208
00000100:00100000:1.0:1767320880.093055:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18117
00000100:00100000:1.0:1767320880.093061:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380126208:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320880.093082:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320880.093122:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380126208:12345-0@lo:38:kworker.0 Request processed in 59us (207us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320880.093131:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18117
00000100:00080000:3.0:1767320880.093324:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320880.093329:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320880.093333:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380126208:0@lo:38:kworker.0
00010000:00010000:2.0:1767320880.663186:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320881.040424:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320881.040607:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320881.041777:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291999104
00000100:00100000:3.0:1767320881.041795:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291999104
00000100:00100000:3.0:1767320881.041961:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291998976
00000100:00100000:3.0:1767320881.041966:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291998976
00000100:00100000:3.0:1767320881.041995:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5111
00000100:00100000:3.0:1767320881.042017:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291999104:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320881.042128:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164291999104:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 114us (1719us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320881.042137:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5111
00000100:00100000:3.0:1767320881.042158:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18118
00000100:00100000:3.0:1767320881.042163:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291998976:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320881.042188:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320881.042377:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291998976:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 211us (1770us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320881.042386:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18118
00000100:00080000:0.0:1767320881.043464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320881.688132:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320882.712405:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320883.161647:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380126336:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320883.161757:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320883.162059:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126336
00000100:00100000:3.0:1767320883.162070:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126336
00000100:00100000:3.0:1767320883.162161:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850
00000100:00100000:3.0:1767320883.162172:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380126336:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320883.162211:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320883.162277:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380126336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (519us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320883.162285:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850
00000100:00080000:1.0:1767320883.162544:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320883.162590:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380126336:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320883.736029:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320884.695706:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380126464:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320884.695809:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320884.698538:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126464
00000100:00100000:2.0:1767320884.698568:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126464
00000100:00080000:1.0:1767320884.698934:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320884.699864:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851
00000100:00100000:2.0:1767320884.699904:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380126464:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320884.699953:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320884.705362:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380126464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5453us (9535us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320884.705383:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851
00000100:00100000:0.0:1767320884.707662:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380126464:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320884.759274:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320885.208229:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320885.208239:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320885.208242:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320885.208248:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320885.208253:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320885.208271:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5782
00000100:00080000:0.0:1767320885.208277:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320885.208286:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320885.208338:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a4700 x1853164380126592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320885.208374:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320885.208378:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320885.208380:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320885.208385:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5782
00000100:00080000:0.0:1767320885.208387:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320885.208391:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320885.208417:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a5880 x1853164380126720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320885.208483:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320885.208486:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320885.208488:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320885.208492:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5782
00000100:00080000:0.0:1767320885.208494:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320885.208498:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320885.208510:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a5180 x1853164380127104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320885.208526:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320885.208529:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320885.208531:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320885.208535:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5782
00000100:00080000:0.0:1767320885.208537:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320885.208542:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320885.208555:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f092a6300 x1853164380127360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320885.208591:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320885.208613:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380126848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.208701:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320885.208774:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380126976:0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.208802:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320885.208827:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320885.208832:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380127232:0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.208852:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320885.208916:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126848
00000100:00100000:0.0:1767320885.208924:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126848
00000100:00100000:0.0:1767320885.208988:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036
00000100:00100000:0.0:1767320885.208998:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380126848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.209059:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380126848:12345-0@lo:400:kworker.0 Request processed in 62us (356us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320885.209066:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036
00000100:00100000:0.0:1767320885.209116:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380126848:0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.209167:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126976
00000100:00100000:0.0:1767320885.209171:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126976
00000100:00100000:0.0:1767320885.209200:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380127232
00000100:00100000:0.0:1767320885.209203:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380127232
00000100:00100000:0.0:1767320885.209225:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5112
00000100:00100000:0.0:1767320885.209232:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380126976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.209268:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380126976:12345-0@lo:400:kworker.0 Request processed in 37us (465us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320885.209274:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5112
00000100:00100000:0.0:1767320885.209286:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5113
00000100:00100000:0.0:1767320885.209292:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380127232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.209318:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380127232:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320885.209324:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5113
00000100:00100000:0.0:1767320885.209349:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380127232:0@lo:400:kworker.0
00000100:00100000:0.0:1767320885.209359:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380126976:0@lo:400:kworker.0
00000100:00100000:3.0:1767320885.209756:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380126592:0@lo:38:kworker.0
00000100:00100000:3.0:1767320885.209797:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320885.209824:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380126720:0@lo:38:kworker.0
00000100:00100000:3.0:1767320885.209851:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320885.209905:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380127104:0@lo:38:kworker.0
00000100:00100000:3.0:1767320885.209930:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320885.209946:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380127360:0@lo:38:kworker.0
00000100:00100000:3.0:1767320885.209968:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320885.209998:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126592
00000100:00100000:3.0:1767320885.210003:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126592
00000100:00100000:3.0:1767320885.210026:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380127104
00000100:00100000:3.0:1767320885.210029:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380127104
00000100:00100000:3.0:1767320885.210040:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380127360
00000100:00100000:3.0:1767320885.210042:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380127360
00000100:00100000:3.0:1767320885.210053:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18119
00000100:00100000:3.0:1767320885.210059:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380126592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320885.210082:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320885.210124:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380126592:12345-0@lo:38:kworker.0 Request processed in 63us (325us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320885.210130:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18119
00000100:00100000:3.0:1767320885.210144:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18120
00000100:00100000:3.0:1767320885.210147:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380127104:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320885.210157:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320885.210180:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380127104:12345-0@lo:38:kworker.0 Request processed in 31us (250us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320885.210185:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18120
00000100:00100000:3.0:1767320885.210197:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18121
00000100:00100000:3.0:1767320885.210201:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380127360:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320885.210210:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320885.210233:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380127360:12345-0@lo:38:kworker.0 Request processed in 31us (265us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320885.210239:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18121
00000100:00080000:3.0:1767320885.210757:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320885.210764:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320885.210769:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380126592:0@lo:38:kworker.0
00000100:00080000:3.0:1767320885.210780:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320885.210784:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320885.210787:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380127104:0@lo:38:kworker.0
00000100:00080000:3.0:1767320885.210795:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320885.210798:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320885.210801:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380127360:0@lo:38:kworker.0
00000100:00080000:1.0:1767320885.210985:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320885.210993:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320885.211009:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380126720
00000100:00100000:1.0:1767320885.211015:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380126720
00000100:00100000:1.0:1767320885.211049:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269
00000100:00100000:1.0:1767320885.211056:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380126720:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320885.211070:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320885.211127:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380126720:12345-0@lo:38:kworker.0 Request processed in 70us (1274us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320885.211133:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269
00000100:00080000:1.0:1767320885.211168:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320885.211172:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320885.211175:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f092a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380126720:0@lo:38:kworker.0
00010000:00010000:2.0:1767320885.785005:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320886.163294:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320886.169295:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320886.174207:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291999360
00000100:00100000:0.0:1767320886.174229:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291999360
00000100:00100000:0.0:1767320886.174352:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291999232
00000100:00100000:0.0:1767320886.174355:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291999232
00000100:00100000:0.0:1767320886.174384:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5114
00000100:00100000:0.0:1767320886.174394:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291999360:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320886.174691:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18122
00000100:00100000:3.0:1767320886.174699:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291999232:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320886.174728:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767320886.174816:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320886.175816:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291999360:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 1410us (12525us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320886.175830:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5114
00000100:00100000:3.0:1767320886.178666:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164291999232:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 3943us (9364us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320886.178687:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18122
00010000:00010000:2.0:1767320886.807751:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320887.831799:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320888.279624:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380127488:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320888.279729:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320888.280199:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380127488
00000100:00100000:2.0:1767320888.280211:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380127488
00000100:00080000:1.0:1767320888.280389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320888.280510:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852
00000100:00100000:2.0:1767320888.280525:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380127488:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320888.280568:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320888.280705:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380127488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 184us (975us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320888.280714:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852
00000100:00100000:0.0:1767320888.291792:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380127488:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320888.855137:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320889.815393:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320889.815425:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380127616:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320889.815521:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320889.815763:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380127616
00000100:00100000:2.0:1767320889.815774:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380127616
00000100:00100000:2.0:1767320889.815859:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853
00000100:00100000:2.0:1767320889.815898:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380127616:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320889.815937:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320889.815995:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380127616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (472us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320889.816003:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853
00000100:00080000:1.0:1767320889.816124:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320889.816224:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380127616:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320889.879306:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320890.327464:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320890.327479:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320890.327482:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320890.327487:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320890.327492:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320890.327503:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5787
00000100:00080000:2.0:1767320890.327508:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320890.327516:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320890.327581:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799f80 x1853164380127744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320890.327615:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320890.327618:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320890.327621:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320890.327625:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5787
00000100:00080000:2.0:1767320890.327627:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320890.327631:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320890.327647:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f33799880 x1853164380127872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320890.327697:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320890.327700:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320890.327702:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320890.327705:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5787
00000100:00080000:2.0:1767320890.327708:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320890.327711:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320890.327721:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379a680 x1853164380128256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320890.327748:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320890.327752:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320890.327754:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320890.327757:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5787
00000100:00080000:2.0:1767320890.327759:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320890.327763:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320890.327773:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379ad80 x1853164380128512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320890.329632:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380128384:0@lo:400:kworker.0
00000100:00100000:0.0:1767320890.329745:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320890.329913:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380128000:0@lo:400:kworker.0
00000100:00100000:0.0:1767320890.329948:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320890.329979:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320890.329987:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380128128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320890.330011:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320890.330656:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380128384
00000100:00100000:3.0:1767320890.330670:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380128384
00000100:00100000:3.0:1767320890.330758:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380128128
00000100:00100000:3.0:1767320890.330763:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380128128
00000100:00100000:3.0:1767320890.330800:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5115
00000100:00100000:3.0:1767320890.330811:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380128384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320890.330932:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380128384:12345-0@lo:400:kworker.0 Request processed in 121us (1186us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320890.330941:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5115
00000100:00100000:3.0:1767320890.330963:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5116
00000100:00100000:3.0:1767320890.330970:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380128128:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320890.331017:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380128128:12345-0@lo:400:kworker.0 Request processed in 47us (1005us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320890.331024:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5116
00000100:00100000:3.0:1767320890.331047:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380128000
00000100:00100000:3.0:1767320890.331051:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380128000
00000100:00100000:3.0:1767320890.331094:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037
00000100:00100000:3.0:1767320890.331101:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380128000:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320890.331133:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380128000:12345-0@lo:400:kworker.0 Request processed in 32us (1185us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320890.331139:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037
00000100:00100000:3.0:1767320890.331181:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380127744:0@lo:38:kworker.0
00000100:00100000:3.0:1767320890.331219:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320890.331244:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380127872:0@lo:38:kworker.0
00000100:00100000:3.0:1767320890.331275:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320890.331304:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380128256:0@lo:38:kworker.0
00000100:00100000:3.0:1767320890.331328:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320890.331357:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380128512:0@lo:38:kworker.0
00000100:00100000:3.0:1767320890.331392:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320890.331428:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380127872
00000100:00100000:3.0:1767320890.331433:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380127872
00000100:00100000:3.0:1767320890.331457:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270
00000100:00100000:3.0:1767320890.331463:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380127872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320890.331485:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320890.331526:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380127872:12345-0@lo:38:kworker.0 Request processed in 62us (250us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320890.331532:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270
00000100:00100000:3.0:1767320890.331550:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380127744
00000100:00100000:3.0:1767320890.331553:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380127744
00000100:00100000:3.0:1767320890.331573:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380128256
00000100:00100000:3.0:1767320890.331576:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380128256
00000100:00100000:3.0:1767320890.331583:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380128512
00000100:00100000:3.0:1767320890.331585:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380128512
00000100:00100000:3.0:1767320890.331595:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18123
00000100:00100000:3.0:1767320890.331599:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380127744:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320890.331610:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320890.331643:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380127744:12345-0@lo:38:kworker.0 Request processed in 43us (424us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320890.331650:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18123
00000100:00100000:3.0:1767320890.331662:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18124
00000100:00100000:3.0:1767320890.331666:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380128256:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320890.331674:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320890.331695:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380128256:12345-0@lo:38:kworker.0 Request processed in 28us (366us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320890.331700:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18124
00000100:00100000:3.0:1767320890.331711:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18125
00000100:00100000:3.0:1767320890.331715:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380128512:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320890.331724:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320890.331746:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380128512:12345-0@lo:38:kworker.0 Request processed in 29us (353us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320890.331752:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18125
00000100:00080000:3.0:1767320890.331804:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320890.331810:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320890.331814:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380127744:0@lo:38:kworker.0
00000100:00080000:3.0:1767320890.331824:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320890.331828:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320890.331831:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380127872:0@lo:38:kworker.0
00000100:00080000:3.0:1767320890.331839:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320890.331843:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320890.331845:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380128256:0@lo:38:kworker.0
00000100:00080000:3.0:1767320890.331853:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320890.331856:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320890.331858:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380128512:0@lo:38:kworker.0
00000100:00100000:3.0:1767320890.331946:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380128384:0@lo:400:kworker.0
00000100:00080000:2.0:1767320890.333106:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767320890.333119:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320890.333331:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380128128:0@lo:400:kworker.0
00000100:00100000:0.0:1767320890.333369:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380128000:0@lo:400:kworker.0
00010000:00010000:2.0:1767320890.905460:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320891.279215:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767320891.279260:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164291999488 offset 0 length 520: 4
00000100:00100000:1.0:1767320891.279290:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320891.279375:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291999744
00000100:00100000:0.0:1767320891.279396:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291999744
00000100:00100000:0.0:1767320891.279517:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291999616
00000100:00100000:0.0:1767320891.279521:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291999616
00000100:00080000:1.0:1767320891.279570:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320891.284832:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5117
00000100:00100000:2.0:1767320891.284915:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291999744:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320891.285055:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164291999744:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 195us (5855us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320891.285065:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5117
00000100:00100000:2.0:1767320891.285106:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18126
00000100:00100000:2.0:1767320891.285113:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291999616:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320891.285143:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320891.285172:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164291999616:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 58us (5880us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320891.285179:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18126
00010000:00010000:2.0:1767320891.928013:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320892.951927:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320893.399563:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320893.399589:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380128640:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320893.399713:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320893.400185:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380128640
00000100:00100000:2.0:1767320893.400198:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380128640
00000100:00100000:2.0:1767320893.400291:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854
00000100:00100000:2.0:1767320893.400301:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380128640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320893.400379:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320893.400445:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380128640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 145us (732us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320893.400454:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854
00000100:00080000:2.0:1767320893.400506:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320893.400660:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380128640:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320893.982075:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320894.423108:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320869/real 1767320869]  req@ffff8b0f10b93800 x1853164380123648/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320894 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767320894.423156:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f10b93800 x1853164380123648/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320894 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767320894.423182:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320894.423489:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767320894.423495:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380123648:0@lo:250:kworker.0
00000100:00080000:1.0:1767320894.425217:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320894.425229:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320894.425235:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320894.425245:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5772
00000100:00080000:1.0:1767320894.425251:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320894.425261:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320894.425754:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907480 x1853164380128768/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320894.425898:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380128768:0@lo:250:kworker.0
00000400:00000100:0.0:1767320894.425972:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380128768 offset 0 length 520: 4
00000100:00080000:1.0:1767320894.426620:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320894.426626:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320894.426630:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320894.426635:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5792
00000100:00080000:1.0:1767320894.426639:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320894.426645:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320894.426688:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10907b80 x1853164380128896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320894.433932:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380128896:0@lo:38:kworker.0
00000100:00100000:0.0:1767320894.434122:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320894.434286:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320894.434293:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1767320894.434320:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380128896
00000100:00100000:3.0:1767320894.434349:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380128896
00000100:00100000:3.0:1767320894.434406:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18127
00000100:00100000:3.0:1767320894.434417:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380128896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320894.434469:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320894.434547:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380128896:12345-0@lo:38:kworker.0 Request processed in 130us (425us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320894.434556:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18127
00000100:00080000:1.0:1767320894.434614:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320894.434623:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5792
00000100:00080000:1.0:1767320894.434628:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320894.434637:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320894.434770:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10906680 x1853164380129024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320894.434855:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380129152:0@lo:400:kworker.0
00000100:00100000:2.0:1767320894.434921:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320894.435013:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129152
00000100:00100000:3.0:1767320894.435020:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129152
00000100:00100000:3.0:1767320894.435066:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038
00000100:00100000:0.0:1767320894.435073:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380129024:0@lo:38:kworker.0
00000100:00100000:3.0:1767320894.435075:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380129152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320894.439542:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320894.439626:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320894.439630:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320894.439634:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380128896:0@lo:38:kworker.0
00000100:00100000:0.0:1767320894.439703:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380129280:0@lo:400:kworker.0
00000100:00100000:0.0:1767320894.439733:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320894.439765:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129024
00000100:00100000:0.0:1767320894.439771:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129024
00000100:00100000:0.0:1767320894.439800:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271
00000100:00100000:0.0:1767320894.439805:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380129024:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320894.439833:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320894.439959:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380129024:12345-0@lo:38:kworker.0 Request processed in 57us (333us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320894.439968:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271
00000100:00080000:0.0:1767320894.440083:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320894.440087:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320894.440089:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380129024:0@lo:38:kworker.0
00000100:00100000:0.0:1767320894.440115:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129280
00000100:00100000:0.0:1767320894.440117:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129280
00000100:00100000:0.0:1767320894.440154:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039
00000100:00100000:0.0:1767320894.440159:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380129280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320894.440193:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380129280:12345-0@lo:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0
00000100:00080000:2.0:1767320894.440969:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320894.442618:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320894.442627:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320894.442633:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320894.442645:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5792
00000100:00080000:1.0:1767320894.442651:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320894.442661:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320894.442739:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039
00000100:00100000:0.0:1767320894.442847:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380129280:0@lo:400:kworker.0
00000100:00100000:0.0:1767320894.443141:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380129408:0@lo:400:kworker.0
00000100:00100000:0.0:1767320894.443195:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320894.443504:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129408
00000100:00100000:0.0:1767320894.443512:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129408
00000100:00100000:0.0:1767320894.443569:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5118
00000100:00100000:0.0:1767320894.443578:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380129408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320894.443620:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380129408:12345-0@lo:400:kworker.0 Request processed in 44us (424us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320894.443625:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5118
00000100:00100000:0.0:1767320894.443645:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380129408:0@lo:400:kworker.0
00000100:00100000:1.0:1767320894.443886:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10904a80 x1853164380129536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320894.443936:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320894.443941:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320894.443944:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320894.443949:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5792
00000100:00080000:1.0:1767320894.443952:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320894.443959:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320894.443975:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380129664:0@lo:400:kworker.0
00000100:00100000:1.0:1767320894.444054:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320894.444111:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129664
00000100:00100000:1.0:1767320894.444118:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129664
00000100:00100000:1.0:1767320894.444170:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5119
00000100:00100000:1.0:1767320894.444180:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380129664:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320894.444234:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380129664:12345-0@lo:400:kworker.0 Request processed in 55us (179us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320894.444245:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5119
00000100:00100000:0.0:1767320894.444296:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380129536:0@lo:38:kworker.0
00000100:00100000:1.0:1767320894.444302:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380129664:0@lo:400:kworker.0
00000100:00100000:0.0:1767320894.444427:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320894.444520:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b93800 x1853164380129792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320894.444548:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380129792:0@lo:38:kworker.0
00000100:00100000:0.0:1767320894.444572:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320894.444602:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129536
00000100:00100000:0.0:1767320894.444608:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129536
00000100:00100000:0.0:1767320894.444633:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129792
00000100:00100000:0.0:1767320894.444637:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129792
00000100:00100000:0.0:1767320894.444653:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18128
00000100:00100000:0.0:1767320894.444659:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380129536:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320894.444680:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320894.444718:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380129536:12345-0@lo:38:kworker.0 Request processed in 58us (293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320894.444724:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18128
00000100:00100000:0.0:1767320894.444737:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18129
00000100:00100000:0.0:1767320894.444740:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380129792:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320894.444748:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320894.444768:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380129792:12345-0@lo:38:kworker.0 Request processed in 27us (196us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320894.444773:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18129
00000100:00080000:0.0:1767320894.444802:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320894.444807:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320894.444811:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380129792:0@lo:38:kworker.0
00000100:00080000:0.0:1767320894.444821:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767320894.444824:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767320894.444826:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380129536:0@lo:38:kworker.0
00000100:00100000:3.0:1767320894.445402:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380129152:12345-0@lo:400:kworker.0 Request processed in 10322us (10474us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320894.445416:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038
00000100:00100000:2.0:1767320894.449949:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380129152:0@lo:400:kworker.0
00000100:00080000:2.0:1767320894.449983:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320894.935174:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380129920:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320894.935278:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320894.935431:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380129920
00000100:00100000:2.0:1767320894.935445:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380129920
00000100:00100000:2.0:1767320894.935525:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855
00000100:00100000:2.0:1767320894.935538:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380129920:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320894.935585:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320894.935830:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380129920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 293us (550us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320894.935839:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855
00000100:00100000:0.0:1767320894.935957:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380129920:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320895.007488:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320896.023910:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320896.400188:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320896.402188:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292000000
00000100:00100000:3.0:1767320896.402211:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292000000
00000100:00100000:3.0:1767320896.402353:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5120
00000100:00100000:3.0:1767320896.402368:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292000000:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320896.402496:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292000000:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 132us (2325us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320896.402504:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5120
00000100:00080000:2.0:1767320896.405460:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320896.439205:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320896.439589:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164291999872
00000100:00100000:3.0:1767320896.439603:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164291999872
00000100:00100000:3.0:1767320896.439679:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18130
00000100:00100000:3.0:1767320896.439689:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291999872:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320896.439722:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320896.439811:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164291999872:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 122us (620us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320896.439820:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18130
00010000:00010000:2.0:1767320897.047341:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320898.071146:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320898.528480:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320898.528515:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380130048:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320898.528659:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320898.528968:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130048
00000100:00100000:2.0:1767320898.528978:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130048
00000100:00100000:2.0:1767320898.529064:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856
00000100:00100000:2.0:1767320898.529075:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380130048:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320898.529112:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320898.529161:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380130048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (502us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320898.529169:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856
00000100:00080000:0.0:1767320898.529267:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320898.529325:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380130048:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320899.095450:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320899.543588:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320899.543602:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320899.543605:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320899.543609:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320899.543614:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320899.543623:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5796
00000100:00080000:3.0:1767320899.543627:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320899.543634:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320899.543671:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964fb80 x1853164380130176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320899.543738:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380130176:0@lo:38:kworker.0
00000100:00100000:1.0:1767320899.543817:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320899.543959:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130176
00000100:00100000:2.0:1767320899.543967:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130176
00000100:00100000:2.0:1767320899.544006:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18131
00000100:00100000:2.0:1767320899.544013:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380130176:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320899.544045:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320899.544483:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320899.544488:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320899.544490:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320899.544495:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5796
00000100:00080000:3.0:1767320899.544498:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320899.544503:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320899.544521:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964c380 x1853164380130304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320899.544561:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380130304:0@lo:38:kworker.0
00000100:00100000:1.0:1767320899.544590:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320899.544678:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130304
00000100:00100000:0.0:1767320899.544684:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130304
00000100:00100000:0.0:1767320899.544708:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272
00000100:00100000:0.0:1767320899.544714:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380130304:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320899.544728:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320899.544774:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380130304:12345-0@lo:38:kworker.0 Request processed in 58us (182us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320899.544780:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272
00000100:00100000:2.0:1767320899.545913:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380130176:12345-0@lo:38:kworker.0 Request processed in 1895us (2092us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320899.545923:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18131
00000100:00080000:3.0:1767320899.546563:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320899.546567:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320899.546570:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320899.546575:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5796
00000100:00080000:3.0:1767320899.546579:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320899.546584:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320899.546601:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ce00 x1853164380130816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320899.546619:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320899.546622:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320899.546624:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320899.546627:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5796
00000100:00080000:3.0:1767320899.546629:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320899.546633:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320899.546664:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623bb80 x1853164380131072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320899.547468:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380130560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.547538:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320899.547580:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320899.547586:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380130432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.547606:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320899.547637:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130560
00000100:00100000:0.0:1767320899.547644:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130560
00000100:00100000:0.0:1767320899.547689:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130432
00000100:00100000:0.0:1767320899.547692:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130432
00000100:00100000:0.0:1767320899.547715:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040
00000100:00100000:0.0:1767320899.547722:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380130560:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.548379:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380130560:12345-0@lo:400:kworker.0 Request processed in 656us (839us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320899.548388:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040
00000100:00100000:0.0:1767320899.548407:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041
00000100:00100000:0.0:1767320899.548414:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380130432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.548442:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380130432:12345-0@lo:400:kworker.0 Request processed in 30us (835us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320899.548448:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041
00000100:00080000:0.0:1767320899.548466:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320899.548505:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380130432:0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.548515:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380130560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.548565:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380130688:0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.548594:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320899.548617:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320899.548623:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380130944:0@lo:400:kworker.0
00000100:00100000:0.0:1767320899.548643:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320899.548666:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130688
00000100:00100000:0.0:1767320899.548671:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130688
00000100:00100000:0.0:1767320899.548704:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130944
00000100:00100000:0.0:1767320899.548707:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130944
00000100:00100000:0.0:1767320899.548726:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5121
00000100:00100000:0.0:1767320899.548732:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380130688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320899.549313:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5122
00000100:00100000:2.0:1767320899.549329:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380130944:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320899.549381:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380130944:12345-0@lo:400:kworker.0 Request processed in 57us (737us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320899.549388:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5122
00000100:00100000:2.0:1767320899.549423:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380130944:0@lo:400:kworker.0
00000100:00080000:2.0:1767320899.549468:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320899.550630:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380130688:12345-0@lo:400:kworker.0 Request processed in 1893us (2030us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320899.550642:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5121
00000100:00080000:1.0:1767320899.550738:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320899.550744:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320899.550759:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380130176:0@lo:38:kworker.0
00000100:00100000:1.0:1767320899.550796:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380130816:0@lo:38:kworker.0
00000100:00100000:1.0:1767320899.550832:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320899.550861:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380131072:0@lo:38:kworker.0
00000100:00100000:1.0:1767320899.550904:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320899.550935:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320899.550939:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320899.550942:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380130304:0@lo:38:kworker.0
00000100:00100000:0.0:1767320899.551037:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380130816
00000100:00100000:0.0:1767320899.551044:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380130816
00000100:00100000:0.0:1767320899.551067:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131072
00000100:00100000:0.0:1767320899.551079:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131072
00000100:00100000:0.0:1767320899.551102:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18132
00000100:00100000:0.0:1767320899.551107:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380130816:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320899.551127:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320899.551174:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380130816:12345-0@lo:38:kworker.0 Request processed in 66us (341us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320899.551181:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18132
00000100:00100000:0.0:1767320899.551194:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18133
00000100:00100000:0.0:1767320899.551198:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380131072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320899.551207:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320899.551228:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380131072:12345-0@lo:38:kworker.0 Request processed in 29us (324us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320899.551234:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18133
00000100:00080000:1.0:1767320899.551547:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320899.551552:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320899.551555:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380130816:0@lo:38:kworker.0
00000100:00080000:1.0:1767320899.551563:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320899.551566:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320899.551569:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380131072:0@lo:38:kworker.0
00000100:00100000:2.0:1767320899.552497:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380130688:0@lo:400:kworker.0
00000100:00100000:0.0:1767320900.055448:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380131200:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320900.055535:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320900.055859:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131200
00000100:00100000:1.0:1767320900.055904:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131200
00000100:00100000:1.0:1767320900.055970:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857
00000100:00100000:1.0:1767320900.055980:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380131200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320900.056012:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320900.056073:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380131200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (537us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320900.056081:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857
00000100:00100000:0.0:1767320900.056260:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380131200:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320900.119836:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320901.143197:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320901.519339:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320901.519483:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292000256
00000100:00100000:3.0:1767320901.519492:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292000256
00000100:00100000:3.0:1767320901.519588:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5123
00000100:00100000:3.0:1767320901.519595:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292000256:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320901.519671:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292000256:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 76us (342us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320901.519679:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5123
00000100:00080000:2.0:1767320901.519992:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320901.524010:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320901.524095:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292000128
00000100:00100000:2.0:1767320901.524103:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292000128
00000100:00100000:2.0:1767320901.524304:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18134
00000100:00100000:2.0:1767320901.524313:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292000128:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320901.524337:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320901.524416:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292000128:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 102us (414us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320901.524424:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18134
00010000:00010000:2.0:1767320902.167073:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320903.191559:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320903.639128:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320903.639146:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380131328:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320903.639213:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320903.639281:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131328
00000100:00100000:0.0:1767320903.639290:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131328
00000100:00100000:0.0:1767320903.639365:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858
00000100:00100000:0.0:1767320903.639375:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380131328:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320903.639500:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320903.639561:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380131328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 187us (347us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320903.639570:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858
00000100:00100000:1.0:1767320903.639652:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380131328:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320903.641131:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320904.215377:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320904.663152:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320904.663164:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320904.663168:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320904.663172:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320904.663176:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320904.663183:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5801
00000100:00080000:3.0:1767320904.663188:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320904.663194:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320904.663277:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623a680 x1853164380131456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320904.663301:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320904.663303:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320904.663304:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320904.663580:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5801
00000100:00080000:3.0:1767320904.663584:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320904.663588:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320904.663601:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06238380 x1853164380131584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320904.663652:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380131712:0@lo:400:kworker.0
00000100:00100000:0.0:1767320904.663717:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320904.663798:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131712
00000100:00100000:2.0:1767320904.663807:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131712
00000100:00100000:2.0:1767320904.663857:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042
00000100:00100000:2.0:1767320904.663882:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380131712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320904.664038:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380131456:0@lo:38:kworker.0
00000100:00100000:1.0:1767320904.664073:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320904.664102:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131456
00000100:00100000:1.0:1767320904.664107:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131456
00000100:00100000:1.0:1767320904.664135:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18135
00000100:00100000:2.0:1767320904.664135:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380131712:12345-0@lo:400:kworker.0 Request processed in 262us (408us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320904.664145:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380131456:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767320904.664146:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042
00010000:00020000:1.0:1767320904.664169:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320904.664191:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380131840:0@lo:400:kworker.0
00000100:00100000:1.0:1767320904.664201:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380131456:12345-0@lo:38:kworker.0 Request processed in 55us (126us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320904.664209:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18135
00000100:00100000:2.0:1767320904.664241:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320904.664259:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320904.664266:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320904.664270:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380131456:0@lo:38:kworker.0
00000100:00100000:1.0:1767320904.664278:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380131584:0@lo:38:kworker.0
00000100:00100000:2.0:1767320904.664281:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131840
00000100:00100000:2.0:1767320904.664286:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131840
00000100:00100000:1.0:1767320904.664313:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320904.664319:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043
00000100:00100000:2.0:1767320904.664325:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380131840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320904.664360:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380131840:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320904.664365:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043
00000100:00100000:1.0:1767320904.664378:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131584
00000100:00080000:2.0:1767320904.664380:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320904.664385:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131584
00000100:00100000:2.0:1767320904.664398:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380131840:0@lo:400:kworker.0
00000100:00100000:1.0:1767320904.664415:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273
00000100:00100000:1.0:1767320904.664423:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380131584:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320904.664436:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320904.664477:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767320904.664478:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380131584:12345-0@lo:38:kworker.0 Request processed in 55us (167us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767320904.664481:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320904.664484:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320904.664490:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5801
00000100:00100000:1.0:1767320904.664494:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273
00000100:00080000:3.0:1767320904.664495:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320904.664501:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320904.664511:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239500 x1853164380132096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320904.664523:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320904.664526:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320904.664527:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320904.664531:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5801
00000100:00100000:1.0:1767320904.664532:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380131968:0@lo:400:kworker.0
00000100:00080000:3.0:1767320904.664532:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320904.664537:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320904.664547:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623aa00 x1853164380132352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320904.664566:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380132224:0@lo:400:kworker.0
00000100:00100000:1.0:1767320904.664567:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320904.664596:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320904.664638:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380132096:0@lo:38:kworker.0
00000100:00100000:2.0:1767320904.664917:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320904.665303:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380131712:0@lo:400:kworker.0
00000100:00100000:2.0:1767320904.673988:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380132352:0@lo:38:kworker.0
00000100:00100000:2.0:1767320904.674064:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320904.679388:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380131968
00000100:00100000:1.0:1767320904.679404:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380131968
00000100:00100000:1.0:1767320904.679486:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132224
00000100:00100000:1.0:1767320904.679490:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132224
00000100:00100000:1.0:1767320904.679517:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132096
00000100:00100000:1.0:1767320904.679521:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132096
00000100:00100000:1.0:1767320904.679548:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5124
00000100:00100000:1.0:1767320904.679556:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380131968:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320904.679657:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380131968:12345-0@lo:400:kworker.0 Request processed in 101us (15091us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320904.679664:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5124
00000100:00100000:1.0:1767320904.679684:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5125
00000100:00100000:1.0:1767320904.679691:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380132224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320904.679727:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380132224:12345-0@lo:400:kworker.0 Request processed in 37us (15130us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320904.679733:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5125
00000100:00100000:1.0:1767320904.679747:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18136
00000100:00100000:1.0:1767320904.679751:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380132096:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320904.679770:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320904.679798:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380132096:12345-0@lo:38:kworker.0 Request processed in 45us (14886us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320904.679803:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18136
00000100:00080000:1.0:1767320904.679826:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320904.679888:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380132224:0@lo:400:kworker.0
00000100:00100000:1.0:1767320904.679924:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380131968:0@lo:400:kworker.0
00000100:00080000:2.0:1767320904.680524:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320904.680532:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320904.680537:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380131584:0@lo:38:kworker.0
00000100:00080000:2.0:1767320904.680561:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320904.680565:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320904.680646:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380132096:0@lo:38:kworker.0
00000100:00100000:0.0:1767320904.680695:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132352
00000100:00100000:0.0:1767320904.689283:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132352
00000100:00100000:0.0:1767320904.689430:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18137
00000100:00100000:0.0:1767320904.689440:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380132352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320904.689462:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320904.689553:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380132352:12345-0@lo:38:kworker.0 Request processed in 113us (15487us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320904.689560:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18137
00000100:00080000:2.0:1767320904.689655:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320904.689662:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320904.689666:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380132352:0@lo:38:kworker.0
00000100:00100000:0.0:1767320905.175769:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380132480:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320905.175845:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320905.178337:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132480
00000100:00100000:3.0:1767320905.178362:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132480
00000100:00100000:3.0:1767320905.178434:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859
00000100:00100000:3.0:1767320905.178445:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380132480:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320905.178481:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320905.178584:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380132480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (2739us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320905.178592:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859
00000100:00100000:2.0:1767320905.179250:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380132480:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320905.239279:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320906.264843:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320906.639257:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320906.639308:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320906.639426:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292000512
00000100:00100000:1.0:1767320906.639436:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292000512
00000100:00080000:1.0:1767320906.639470:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320906.639511:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292000384
00000100:00100000:1.0:1767320906.639514:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292000384
00000100:00100000:1.0:1767320906.639533:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5126
00000100:00100000:1.0:1767320906.639542:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292000512:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320906.639620:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292000512:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (374us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320906.639629:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5126
00000100:00100000:1.0:1767320906.639652:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18138
00000100:00100000:1.0:1767320906.639657:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292000384:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320906.639684:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320906.639723:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292000384:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 63us (413us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320906.639729:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18138
00010000:00010000:2.0:1767320907.289256:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320908.311525:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320908.759402:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380132608:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320908.759480:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320908.759909:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132608
00000100:00100000:1.0:1767320908.759919:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132608
00000100:00100000:1.0:1767320908.759998:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860
00000100:00100000:1.0:1767320908.760009:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380132608:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320908.760049:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320908.760101:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380132608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (621us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320908.760108:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860
00000100:00100000:2.0:1767320908.760122:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380132608:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767320908.760175:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320909.335398:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320909.783027:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320909.783037:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320909.783041:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320909.783046:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320909.783050:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320909.783058:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5807
00000100:00080000:0.0:1767320909.783063:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320909.783069:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320909.783110:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199880 x1853164380132736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320909.783127:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320909.783130:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320909.783132:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320909.783146:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5807
00000100:00080000:0.0:1767320909.783149:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320909.783153:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320909.783165:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199f80 x1853164380132864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320909.783258:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380132992:0@lo:400:kworker.0
00000100:00100000:1.0:1767320909.783327:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320909.783463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380132736:0@lo:38:kworker.0
00000100:00100000:2.0:1767320909.783495:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320909.783517:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380132864:0@lo:38:kworker.0
00000100:00100000:2.0:1767320909.783553:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320909.783600:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380133120:0@lo:400:kworker.0
00000100:00100000:2.0:1767320909.783622:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320909.783652:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132992
00000100:00100000:2.0:1767320909.783659:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132992
00000100:00100000:2.0:1767320909.783701:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380133120
00000100:00100000:2.0:1767320909.783704:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380133120
00000100:00100000:2.0:1767320909.783745:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044
00000100:00100000:2.0:1767320909.783753:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380132992:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320909.783836:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045
00000100:00100000:3.0:1767320909.783847:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380133120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320909.783910:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380133120:12345-0@lo:400:kworker.0 Request processed in 65us (285us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320909.783917:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045
00000100:00080000:3.0:1767320909.783949:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320909.783965:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132736
00000100:00100000:3.0:1767320909.783969:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132736
00000100:00100000:3.0:1767320909.783990:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18139
00000100:00100000:3.0:1767320909.783995:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380132736:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320909.784012:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320909.784044:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380132736:12345-0@lo:38:kworker.0 Request processed in 48us (548us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320909.784050:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18139
00000100:00100000:3.0:1767320909.784091:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380133120:0@lo:400:kworker.0
00000100:00080000:3.0:1767320909.784132:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320909.784137:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320909.784141:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380132736:0@lo:38:kworker.0
00000100:00100000:3.0:1767320909.784165:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380132864
00000100:00100000:3.0:1767320909.784168:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380132864
00000100:00100000:3.0:1767320909.784198:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274
00000100:00100000:3.0:1767320909.784203:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380132864:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320909.784213:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320909.784243:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380132864:12345-0@lo:38:kworker.0 Request processed in 38us (689us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320909.784249:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274
00000100:00080000:3.0:1767320909.784270:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320909.784274:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320909.784277:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380132864:0@lo:38:kworker.0
00000100:00080000:0.0:1767320909.784865:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320909.784883:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320909.784886:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320909.784890:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5807
00000100:00080000:0.0:1767320909.784894:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320909.784898:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320909.784917:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819a300 x1853164380133376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320909.784944:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320909.784947:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320909.784949:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320909.784952:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5807
00000100:00080000:0.0:1767320909.784954:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320909.784958:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320909.784980:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819bb80 x1853164380133632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320909.785011:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380133504:0@lo:400:kworker.0
00000100:00100000:0.0:1767320909.785051:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320909.785077:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320909.785082:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380133248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320909.785103:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320909.785128:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380133504
00000100:00100000:0.0:1767320909.785132:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380133504
00000100:00100000:3.0:1767320909.785360:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380133376:0@lo:38:kworker.0
00000100:00100000:3.0:1767320909.785389:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320909.785410:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380133632:0@lo:38:kworker.0
00000100:00100000:3.0:1767320909.785431:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320909.785460:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380133248
00000100:00100000:3.0:1767320909.785464:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380133248
00000100:00100000:3.0:1767320909.785505:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380133376
00000100:00100000:3.0:1767320909.785508:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380133376
00000100:00100000:3.0:1767320909.785536:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380133632
00000100:00100000:3.0:1767320909.785539:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380133632
00000100:00100000:3.0:1767320909.785552:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5127
00000100:00100000:3.0:1767320909.785560:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380133248:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320909.785608:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380133248:12345-0@lo:400:kworker.0 Request processed in 49us (503us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320909.785615:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5127
00000100:00100000:3.0:1767320909.785630:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18140
00000100:00100000:3.0:1767320909.785634:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380133376:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320909.785647:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320909.785678:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380133376:12345-0@lo:38:kworker.0 Request processed in 43us (289us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320909.785685:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18140
00000100:00100000:3.0:1767320909.785697:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18141
00000100:00100000:3.0:1767320909.785701:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380133632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320909.785711:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320909.785748:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380133632:12345-0@lo:38:kworker.0 Request processed in 45us (317us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320909.785754:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18141
00000100:00080000:3.0:1767320909.785771:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320909.785793:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320909.785798:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320909.785801:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380133376:0@lo:38:kworker.0
00000100:00080000:3.0:1767320909.785811:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320909.785814:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320909.785816:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380133632:0@lo:38:kworker.0
00000100:00100000:3.0:1767320909.785891:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380133248:0@lo:400:kworker.0
00000100:00100000:0.0:1767320909.786348:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5128
00000100:00100000:0.0:1767320909.786356:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380133504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320909.786401:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380133504:12345-0@lo:400:kworker.0 Request processed in 46us (1349us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320909.786408:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5128
00000100:00100000:0.0:1767320909.786438:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380133504:0@lo:400:kworker.0
00000100:00100000:2.0:1767320909.786538:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380132992:12345-0@lo:400:kworker.0 Request processed in 2784us (3209us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320909.786547:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044
00000100:00080000:3.0:1767320909.786668:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320909.786811:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380132992:0@lo:400:kworker.0
00000100:00100000:3.0:1767320910.295166:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320910.296504:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380133760:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320910.296595:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320910.296856:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380133760
00000100:00100000:1.0:1767320910.296901:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380133760
00000100:00100000:1.0:1767320910.296965:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861
00000100:00100000:1.0:1767320910.296975:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380133760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320910.297006:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320910.297062:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380133760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (465us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320910.297071:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861
00000100:00100000:3.0:1767320910.298754:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380133760:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320910.359170:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320911.383381:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320911.760003:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320911.760047:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320911.760151:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292000640
00000100:00100000:2.0:1767320911.760161:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292000640
00000100:00100000:2.0:1767320911.760216:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292000768
00000100:00100000:2.0:1767320911.760220:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292000768
00000100:00100000:2.0:1767320911.760273:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5129
00000100:00100000:2.0:1767320911.760284:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292000768:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320911.760352:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292000768:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 70us (303us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320911.760359:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5129
00000100:00100000:2.0:1767320911.760375:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18142
00000100:00100000:2.0:1767320911.760380:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292000640:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320911.760399:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320911.760420:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292000640:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 38us (426us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320911.760426:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18142
00000100:00080000:3.0:1767320911.760837:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320912.407373:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320913.431287:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320913.879222:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320913.879247:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380133888:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320913.879318:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320913.880222:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380133888
00000100:00100000:2.0:1767320913.880233:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380133888
00000100:00100000:2.0:1767320913.880298:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862
00000100:00100000:2.0:1767320913.880307:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380133888:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320913.880337:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320913.880573:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380133888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (1253us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320913.880580:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862
00000100:00080000:0.0:1767320913.882214:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767320913.883258:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f33798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380133888:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320914.455429:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320914.908346:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320914.908357:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320914.908360:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320914.908364:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320914.908369:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320914.908377:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5812
00000100:00080000:3.0:1767320914.908382:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320914.908389:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320914.908429:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623b480 x1853164380134016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320914.908469:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320914.908473:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320914.908475:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320914.908479:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5812
00000100:00080000:3.0:1767320914.908481:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320914.908485:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320914.908500:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623aa00 x1853164380134144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320914.908557:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320914.908560:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320914.908562:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320914.908565:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5812
00000100:00080000:3.0:1767320914.908567:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320914.908571:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320914.908582:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06239c00 x1853164380134656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320914.908596:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320914.908599:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320914.908600:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320914.908603:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5812
00000100:00080000:3.0:1767320914.908605:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320914.908608:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320914.908616:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06238e00 x1853164380134912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320914.908646:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380134400:0@lo:400:kworker.0
00000100:00100000:1.0:1767320914.908774:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380134016:0@lo:38:kworker.0
00000100:00100000:1.0:1767320914.908850:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320914.908929:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380134144:0@lo:38:kworker.0
00000100:00100000:1.0:1767320914.908956:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320914.908977:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380134656:0@lo:38:kworker.0
00000100:00100000:1.0:1767320914.908995:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320914.909008:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380134912:0@lo:38:kworker.0
00000100:00100000:1.0:1767320914.909024:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320914.909057:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134016
00000100:00100000:1.0:1767320914.909064:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134016
00000100:00100000:1.0:1767320914.909092:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134656
00000100:00100000:1.0:1767320914.909094:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134656
00000100:00100000:1.0:1767320914.909105:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134912
00000100:00100000:1.0:1767320914.909107:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134912
00000100:00100000:1.0:1767320914.909122:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18143
00000100:00100000:1.0:1767320914.909129:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380134016:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320914.909162:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320914.909201:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380134016:12345-0@lo:38:kworker.0 Request processed in 71us (350us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320914.909207:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18143
00000100:00100000:1.0:1767320914.909227:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18144
00000100:00100000:1.0:1767320914.909231:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380134656:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320914.909239:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320914.909267:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380134656:12345-0@lo:38:kworker.0 Request processed in 35us (271us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320914.909273:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18144
00000100:00100000:1.0:1767320914.909284:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18145
00000100:00100000:1.0:1767320914.909288:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380134912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320914.909298:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320914.909317:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380134912:12345-0@lo:38:kworker.0 Request processed in 28us (292us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320914.909323:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18145
00000100:00080000:1.0:1767320914.909358:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320914.909363:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320914.909366:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380134016:0@lo:38:kworker.0
00000100:00080000:1.0:1767320914.909374:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320914.909377:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320914.909379:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380134656:0@lo:38:kworker.0
00000100:00080000:1.0:1767320914.909385:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320914.909388:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320914.909390:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380134912:0@lo:38:kworker.0
00000100:00100000:1.0:1767320914.909417:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380134528:0@lo:400:kworker.0
00000100:00100000:1.0:1767320914.909439:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320914.909457:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134528
00000100:00100000:1.0:1767320914.909460:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134528
00000100:00100000:1.0:1767320914.909499:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5130
00000100:00100000:1.0:1767320914.909505:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380134528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320914.909538:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380134528:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320914.909544:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5130
00000100:00080000:1.0:1767320914.909558:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320914.909578:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380134528:0@lo:400:kworker.0
00000100:00100000:1.0:1767320914.909590:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320914.909595:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380134784:0@lo:400:kworker.0
00000100:00100000:1.0:1767320914.909616:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320914.909632:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134784
00000100:00100000:1.0:1767320914.909635:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134784
00000100:00100000:1.0:1767320914.909659:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5131
00000100:00100000:1.0:1767320914.909664:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380134784:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320914.909707:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380134784:12345-0@lo:400:kworker.0 Request processed in 42us (89us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320914.909712:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5131
00000100:00080000:1.0:1767320914.909726:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320914.909743:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380134784:0@lo:400:kworker.0
00000100:00100000:1.0:1767320914.909783:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134144
00000100:00100000:1.0:1767320914.909787:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134144
00000100:00100000:1.0:1767320914.909806:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275
00000100:00100000:1.0:1767320914.909811:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3919e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380134144:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320914.909821:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320914.909850:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3919e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380134144:12345-0@lo:38:kworker.0 Request processed in 38us (892us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320914.909856:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275
00000100:00080000:1.0:1767320914.910056:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320914.910061:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320914.910064:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380134144:0@lo:38:kworker.0
00000100:00100000:3.0:1767320914.910294:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320914.910321:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320914.910327:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380134272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320914.910348:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320914.910378:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134400
00000100:00100000:3.0:1767320914.910382:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134400
00000100:00100000:3.0:1767320914.910412:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380134272
00000100:00100000:3.0:1767320914.910415:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380134272
00000100:00100000:3.0:1767320914.910433:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046
00000100:00100000:3.0:1767320914.910439:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380134400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320914.910474:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380134400:12345-0@lo:400:kworker.0 Request processed in 35us (180us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320914.910481:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046
00000100:00100000:3.0:1767320914.910493:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047
00000100:00100000:3.0:1767320914.910499:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380134272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320914.910525:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380134272:12345-0@lo:400:kworker.0 Request processed in 27us (176us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320914.910531:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047
00000100:00100000:3.0:1767320914.910560:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380134272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320914.910570:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380134400:0@lo:400:kworker.0
00000100:00080000:3.0:1767320914.910584:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320915.415711:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380135040:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320915.415791:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320915.415894:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135040
00000100:00100000:0.0:1767320915.415903:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135040
00000100:00100000:0.0:1767320915.415957:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863
00000100:00100000:0.0:1767320915.415966:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380135040:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320915.415995:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320915.420979:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380135040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4999us (5174us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320915.420996:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863
00000100:00100000:2.0:1767320915.421167:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380135040:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320915.480192:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320915.855927:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:3.0:1767320915.855969:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292000896 offset 0 length 520: 4
00000100:00100000:3.0:1767320915.855993:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320915.856205:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001152
00000100:00100000:1.0:1767320915.856216:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001152
00000100:00100000:1.0:1767320915.856298:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001024
00000100:00100000:1.0:1767320915.856302:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001024
00000100:00100000:1.0:1767320915.856324:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5132
00000100:00100000:1.0:1767320915.856334:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292001152:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320915.856391:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18146
00000100:00100000:2.0:1767320915.856399:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292001024:12345-192.168.202.33@tcp:38:kworker.0
00000100:00100000:1.0:1767320915.856413:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292001152:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (494us total) trans 0 rc 0/0
00010000:00020000:2.0:1767320915.856422:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320915.856423:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5132
00000100:00100000:2.0:1767320915.856458:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292001024:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 57us (463us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320915.856465:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18146
00000100:00080000:3.0:1767320915.856792:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320916.503382:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320917.529848:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320918.551135:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320919.000716:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380135168:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320919.000804:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320919.000897:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135168
00000100:00100000:1.0:1767320919.000908:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135168
00000100:00100000:1.0:1767320919.000973:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864
00000100:00100000:1.0:1767320919.000984:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380135168:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320919.001012:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320919.001055:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380135168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (252us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320919.001064:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864
00000100:00080000:2.0:1767320919.001124:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320919.001203:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380135168:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320919.577080:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320920.023131:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320920.023141:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320920.023146:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320920.023150:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320920.023154:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320920.023163:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5817
00000100:00080000:3.0:1767320920.023168:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320920.023175:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320920.023217:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623ad80 x1853164380135296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320920.023233:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320920.023236:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320920.023239:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320920.023242:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5817
00000100:00080000:3.0:1767320920.023245:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320920.023249:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320920.023261:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06238a80 x1853164380135424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320920.023347:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380135552:0@lo:400:kworker.0
00000100:00100000:2.0:1767320920.023420:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320920.028252:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320920.028318:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320894/real 1767320894]  req@ffff8b0f10907480 x1853164380128768/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320920.028351:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f10907480 x1853164380128768/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320920.028373:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380135296:0@lo:38:kworker.0
00000100:00100000:1.0:1767320920.028440:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320920.028479:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380135424:0@lo:38:kworker.0
00000100:00100000:1.0:1767320920.028529:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320920.028591:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320920.028597:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320920.028600:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320920.028606:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5817
00000100:00080000:3.0:1767320920.028611:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320920.028618:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320920.028640:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609c00 x1853164380135936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320920.028664:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320920.028668:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320920.028670:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320920.028673:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5817
00000100:00080000:3.0:1767320920.028676:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320920.028680:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320920.028693:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfce300 x1853164380136192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320920.028726:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135424
00000100:00100000:3.0:1767320920.028733:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135424
00000100:00100000:3.0:1767320920.028782:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276
00000100:00100000:3.0:1767320920.028789:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380135424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320920.028809:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320920.028859:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380135424:12345-0@lo:38:kworker.0 Request processed in 69us (329us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320920.028866:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276
00000100:00100000:2.0:1767320920.028946:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380135680:0@lo:400:kworker.0
00000100:00100000:2.0:1767320920.028979:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320920.030349:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135552
00000100:00100000:0.0:1767320920.030360:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135552
00000100:00100000:0.0:1767320920.030422:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048
00000100:00100000:0.0:1767320920.030430:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380135552:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320920.030493:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380135552:12345-0@lo:400:kworker.0 Request processed in 64us (7073us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320920.030499:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048
00000100:00100000:0.0:1767320920.030525:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135296
00000100:00100000:0.0:1767320920.030529:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135296
00000100:00100000:0.0:1767320920.030555:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18147
00000100:00100000:0.0:1767320920.030560:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380135296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320920.030576:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320920.030601:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380135296:12345-0@lo:38:kworker.0 Request processed in 40us (2161us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320920.030607:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18147
00000100:00100000:0.0:1767320920.030656:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380136064:0@lo:400:kworker.0
00000100:00100000:0.0:1767320920.030682:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320920.030786:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380136064
00000100:00100000:2.0:1767320920.030791:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380136064
00000100:00100000:2.0:1767320920.030828:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5133
00000100:00100000:2.0:1767320920.030835:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380136064:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320920.030866:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380136064:12345-0@lo:400:kworker.0 Request processed in 33us (183us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320920.030885:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5133
00000100:00080000:2.0:1767320920.030903:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320920.030915:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135680
00000100:00100000:2.0:1767320920.030918:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135680
00000100:00100000:2.0:1767320920.030944:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049
00000100:00100000:2.0:1767320920.030949:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380135680:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320920.030977:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380135680:12345-0@lo:400:kworker.0 Request processed in 28us (1997us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320920.030990:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049
00000100:00080000:2.0:1767320920.031003:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320920.031159:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320920.031165:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320920.031169:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380135424:0@lo:38:kworker.0
00000100:00080000:1.0:1767320920.031176:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320920.031191:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320920.031194:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380128768:0@lo:250:kworker.0
00000100:00100000:1.0:1767320920.031220:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380135936:0@lo:38:kworker.0
00000100:00100000:1.0:1767320920.031248:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320920.031266:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380136192:0@lo:38:kworker.0
00000100:00100000:1.0:1767320920.031286:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320920.031306:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320920.031310:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320920.031313:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380135296:0@lo:38:kworker.0
00000100:00100000:1.0:1767320920.031340:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135936
00000100:00100000:1.0:1767320920.031343:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135936
00000100:00100000:1.0:1767320920.031362:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380136192
00000100:00100000:1.0:1767320920.031365:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380136192
00000100:00100000:1.0:1767320920.031381:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18148
00000100:00100000:1.0:1767320920.031386:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380135936:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320920.031397:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320920.031425:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380135936:12345-0@lo:38:kworker.0 Request processed in 38us (176us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320920.031431:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18148
00000100:00100000:1.0:1767320920.031446:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18149
00000100:00100000:1.0:1767320920.031449:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380136192:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320920.031457:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320920.031477:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380136192:12345-0@lo:38:kworker.0 Request processed in 27us (190us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320920.031483:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18149
00000100:00080000:1.0:1767320920.031513:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320920.031517:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320920.031519:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380135936:0@lo:38:kworker.0
00000100:00080000:1.0:1767320920.031526:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320920.031529:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320920.031531:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380136192:0@lo:38:kworker.0
00000100:00080000:1.0:1767320920.031584:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320920.031588:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1767320920.031591:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320920.031595:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5796
00000100:00080000:1.0:1767320920.031599:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320920.031603:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320920.031625:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fe680 x1853164380136320/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320920.031671:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380136320:0@lo:250:kworker.0
00000400:00000100:1.0:1767320920.031692:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380136320 offset 0 length 520: 4
00000100:00100000:0.0:1767320920.032034:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380136064:0@lo:400:kworker.0
00000100:00100000:0.0:1767320920.032050:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320920.032057:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380135808:0@lo:400:kworker.0
00000100:00100000:0.0:1767320920.032083:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320920.036470:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380135808
00000100:00100000:1.0:1767320920.036487:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380135808
00000100:00100000:1.0:1767320920.036579:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5134
00000100:00100000:1.0:1767320920.036595:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380135808:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320920.036694:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380135808:12345-0@lo:400:kworker.0 Request processed in 107us (4609us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320920.036702:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5134
00000100:00100000:0.0:1767320920.037520:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380135808:0@lo:400:kworker.0
00000100:00080000:3.0:1767320920.037952:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320920.040984:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380135680:0@lo:400:kworker.0
00000100:00100000:2.0:1767320920.041003:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380135552:0@lo:400:kworker.0
00000100:00100000:0.0:1767320920.535799:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320920.535827:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380136448:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320920.535958:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320920.536354:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380136448
00000100:00100000:3.0:1767320920.536363:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380136448
00000100:00100000:3.0:1767320920.536414:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865
00000100:00100000:3.0:1767320920.536423:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380136448:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320920.536463:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320920.536525:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380136448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (566us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320920.536532:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865
00000100:00100000:0.0:1767320920.536820:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380136448:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320920.599376:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320920.977341:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320920.977440:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320920.978811:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001280
00000100:00100000:0.0:1767320920.978826:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001280
00000100:00100000:0.0:1767320920.978903:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001408
00000100:00100000:0.0:1767320920.978908:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001408
00000100:00100000:0.0:1767320920.978957:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5135
00000100:00100000:0.0:1767320920.978967:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292001408:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320920.979055:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292001408:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (1614us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320920.979064:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5135
00000100:00100000:0.0:1767320920.979102:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18150
00000100:00100000:0.0:1767320920.979108:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292001280:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320920.979130:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320920.979158:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292001280:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 49us (1831us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320920.979165:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18150
00000100:00080000:3.0:1767320920.979326:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320921.630844:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320922.647287:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320923.671528:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320924.120318:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320924.120343:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380136576:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320924.120426:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320924.120624:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380136576
00000100:00100000:2.0:1767320924.120634:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380136576
00000100:00080000:3.0:1767320924.120668:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320924.120752:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866
00000100:00100000:2.0:1767320924.120763:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380136576:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320924.120806:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320924.120933:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380136576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (445us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320924.120940:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866
00000100:00100000:3.0:1767320924.121045:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380136576:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320924.695102:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320925.145502:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320925.145512:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320925.145515:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320925.145519:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320925.145523:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320925.145530:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5822
00000100:00080000:3.0:1767320925.145534:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320925.145541:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320925.145587:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063ab480 x1853164380136704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320925.145679:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380136704:0@lo:38:kworker.0
00000100:00100000:1.0:1767320925.145748:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320925.145927:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380136704
00000100:00100000:2.0:1767320925.145942:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380136704
00000100:00100000:2.0:1767320925.145981:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18151
00000100:00100000:2.0:1767320925.145990:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380136704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320925.146010:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320925.148243:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320925.148254:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320925.148258:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320925.148265:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5822
00000100:00080000:3.0:1767320925.148270:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320925.148276:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320925.148327:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd500 x1853164380136832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320925.148910:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380136832:0@lo:38:kworker.0
00000100:00100000:1.0:1767320925.148990:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320925.149090:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380136832
00000100:00100000:0.0:1767320925.149098:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380136832
00000100:00100000:0.0:1767320925.149137:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277
00000100:00100000:0.0:1767320925.149144:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380136832:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320925.149165:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320925.149207:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380136832:12345-0@lo:38:kworker.0 Request processed in 62us (216us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320925.149213:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277
00000100:00100000:2.0:1767320925.150672:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380136704:12345-0@lo:38:kworker.0 Request processed in 4674us (4915us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320925.150687:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18151
00000100:00080000:1.0:1767320925.151298:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320925.151305:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320925.151310:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380136704:0@lo:38:kworker.0
00000100:00080000:1.0:1767320925.151344:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320925.151347:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320925.151350:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380136832:0@lo:38:kworker.0
00000100:00100000:0.0:1767320925.151789:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380136960:0@lo:400:kworker.0
00000100:00100000:0.0:1767320925.151854:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320925.151933:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380136960
00000100:00100000:1.0:1767320925.151940:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380136960
00000100:00100000:1.0:1767320925.151993:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050
00000100:00100000:1.0:1767320925.152002:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380136960:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1767320925.152754:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320925.152761:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320925.152764:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320925.152769:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5822
00000100:00080000:3.0:1767320925.152773:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320925.152777:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320925.152799:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03c44700 x1853164380137344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320925.152822:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320925.152825:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320925.152826:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320925.152829:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5822
00000100:00080000:3.0:1767320925.152831:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320925.152835:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320925.152859:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04ed6a00 x1853164380137600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320925.152909:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380137216:0@lo:400:kworker.0
00000100:00100000:3.0:1767320925.152946:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320925.152974:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320925.152980:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380137472:0@lo:400:kworker.0
00000100:00100000:3.0:1767320925.153001:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320925.153058:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137216
00000100:00100000:3.0:1767320925.153063:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137216
00000100:00100000:3.0:1767320925.153103:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137472
00000100:00100000:3.0:1767320925.153106:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137472
00000100:00100000:3.0:1767320925.153644:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5136
00000100:00100000:3.0:1767320925.153657:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380137216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320925.153720:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380137216:12345-0@lo:400:kworker.0 Request processed in 67us (772us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320925.153726:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5136
00000100:00100000:3.0:1767320925.153741:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5137
00000100:00100000:3.0:1767320925.153747:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380137472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320925.153775:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380137472:12345-0@lo:400:kworker.0 Request processed in 28us (773us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320925.153780:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5137
00000100:00080000:3.0:1767320925.153803:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320925.153956:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380137472:0@lo:400:kworker.0
00000100:00100000:3.0:1767320925.153971:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380137216:0@lo:400:kworker.0
00000100:00100000:3.0:1767320925.154025:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380137344:0@lo:38:kworker.0
00000100:00100000:3.0:1767320925.154065:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320925.154085:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380137600:0@lo:38:kworker.0
00000100:00100000:3.0:1767320925.154107:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320925.154277:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137344
00000100:00100000:3.0:1767320925.154284:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137344
00000100:00100000:3.0:1767320925.154306:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137600
00000100:00100000:3.0:1767320925.154309:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137600
00000100:00100000:3.0:1767320925.154327:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18152
00000100:00100000:3.0:1767320925.154332:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380137344:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320925.154352:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320925.154389:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380137344:12345-0@lo:38:kworker.0 Request processed in 55us (322us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320925.154395:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18152
00000100:00100000:3.0:1767320925.154408:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18153
00000100:00100000:3.0:1767320925.154411:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380137600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320925.154600:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320925.154628:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380137600:12345-0@lo:38:kworker.0 Request processed in 215us (520us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320925.154634:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18153
00000100:00080000:3.0:1767320925.154665:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320925.154669:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320925.154672:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380137344:0@lo:38:kworker.0
00000100:00080000:3.0:1767320925.154680:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320925.154683:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320925.154685:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380137600:0@lo:38:kworker.0
00000100:00100000:2.0:1767320925.154791:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380137088:0@lo:400:kworker.0
00000100:00100000:2.0:1767320925.154825:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320925.155054:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380136960:12345-0@lo:400:kworker.0 Request processed in 3042us (3188us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320925.155065:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050
00000100:00100000:1.0:1767320925.155084:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137088
00000100:00100000:1.0:1767320925.155087:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137088
00000100:00100000:1.0:1767320925.155146:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051
00000100:00100000:1.0:1767320925.155153:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380137088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320925.155190:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380137088:12345-0@lo:400:kworker.0 Request processed in 38us (365us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320925.155197:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051
00000100:00080000:2.0:1767320925.155739:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320925.155768:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380137088:0@lo:400:kworker.0
00000100:00100000:0.0:1767320925.155982:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380136960:0@lo:400:kworker.0
00000100:00100000:2.0:1767320925.655385:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320925.655408:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380137728:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320925.655479:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320925.655639:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137728
00000100:00100000:1.0:1767320925.655648:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137728
00000100:00100000:1.0:1767320925.655694:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867
00000100:00100000:1.0:1767320925.655703:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380137728:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320925.655730:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320925.655777:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f33798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380137728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320925.655783:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867
00000100:00100000:2.0:1767320925.655910:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380137728:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320925.719220:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320926.098773:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320926.098897:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001536
00000100:00100000:2.0:1767320926.098908:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001536
00000100:00100000:2.0:1767320926.098968:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18154
00000100:00100000:2.0:1767320926.098977:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292001536:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320926.099001:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320926.099085:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292001536:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 107us (322us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320926.099093:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18154
00000100:00100000:3.0:1767320926.104307:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320926.110368:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001664
00000100:00100000:1.0:1767320926.110387:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001664
00000100:00100000:0.0:1767320926.112426:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5138
00000100:00100000:0.0:1767320926.112445:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292001664:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320926.112544:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292001664:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 106us (8247us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320926.112552:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5138
00000100:00080000:2.0:1767320926.113994:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320926.743168:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320927.767183:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320928.791048:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320929.239336:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320929.239353:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380137856:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320929.239433:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320929.239570:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137856
00000100:00100000:1.0:1767320929.239578:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137856
00000100:00100000:1.0:1767320929.239650:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868
00000100:00100000:1.0:1767320929.239659:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380137856:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320929.239687:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320929.239732:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380137856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320929.239739:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868
00000100:00100000:3.0:1767320929.240248:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380137856:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320929.240321:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320929.815403:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320930.263084:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320930.263095:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320930.263099:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320930.263103:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320930.263107:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320930.263117:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5827
00000100:00080000:2.0:1767320930.263129:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320930.263138:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320930.263184:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3379a680 x1853164380137984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320930.263214:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320930.263217:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320930.263219:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320930.263223:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5827
00000100:00080000:2.0:1767320930.263225:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320930.263229:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320930.263244:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333480 x1853164380138112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320930.263298:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320930.263301:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320930.263303:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320930.263306:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5827
00000100:00080000:2.0:1767320930.263308:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320930.263312:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320930.263321:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f10b92680 x1853164380138624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320930.263336:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320930.263339:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320930.263341:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320930.263344:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5827
00000100:00080000:2.0:1767320930.263347:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320930.263350:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320930.263370:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07100 x1853164380138880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320930.263423:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380138368:0@lo:400:kworker.0
00000100:00100000:0.0:1767320930.263424:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380138752:0@lo:400:kworker.0
00000100:00100000:1.0:1767320930.263899:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380137984:0@lo:38:kworker.0
00000100:00100000:2.0:1767320930.263972:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380138240:0@lo:400:kworker.0
00000100:00100000:0.0:1767320930.266300:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320930.266300:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320930.266346:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320930.266403:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380138368
00000100:00100000:3.0:1767320930.266412:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380138368
00000100:00100000:1.0:1767320930.266460:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380138112:0@lo:38:kworker.0
00000100:00100000:3.0:1767320930.266474:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052
00000100:00100000:1.0:1767320930.266498:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320930.266524:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380138624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320930.266545:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320930.266564:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380138880:0@lo:38:kworker.0
00000100:00100000:1.0:1767320930.266582:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320930.266612:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380138752
00000100:00100000:1.0:1767320930.266615:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380138752
00000100:00100000:1.0:1767320930.266645:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380137984
00000100:00100000:1.0:1767320930.266648:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380137984
00000100:00100000:1.0:1767320930.266660:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380138624
00000100:00100000:1.0:1767320930.266662:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380138624
00000100:00100000:1.0:1767320930.266671:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380138880
00000100:00100000:1.0:1767320930.266673:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380138880
00000100:00100000:1.0:1767320930.266681:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5139
00000100:00100000:1.0:1767320930.266688:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380138752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320930.266737:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380138752:12345-0@lo:400:kworker.0 Request processed in 50us (444us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320930.266744:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5139
00000100:00100000:1.0:1767320930.266765:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18155
00000100:00100000:1.0:1767320930.266769:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380137984:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320930.266785:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320930.266815:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380137984:12345-0@lo:38:kworker.0 Request processed in 45us (469us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320930.266821:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18155
00000100:00100000:1.0:1767320930.266831:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18156
00000100:00100000:1.0:1767320930.266834:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380138624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320930.266842:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320930.266860:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380138624:12345-0@lo:38:kworker.0 Request processed in 24us (314us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320930.266865:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18156
00000100:00100000:1.0:1767320930.266896:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18157
00000100:00100000:1.0:1767320930.266900:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380138880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320930.266908:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320930.266927:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380138880:12345-0@lo:38:kworker.0 Request processed in 25us (344us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320930.266932:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18157
00000100:00100000:1.0:1767320930.266947:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380138112
00000100:00100000:1.0:1767320930.266950:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380138112
00000100:00100000:1.0:1767320930.266968:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278
00000100:00100000:1.0:1767320930.266972:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380138112:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320930.266980:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320930.267142:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380138368:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320930.267229:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380138112:12345-0@lo:38:kworker.0 Request processed in 256us (730us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320930.267235:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278
00000100:00100000:3.0:1767320930.267267:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380138368:12345-0@lo:400:kworker.0 Request processed in 786us (975us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320930.267275:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052
00000100:00080000:1.0:1767320930.267290:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320930.267295:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320930.267299:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380137984:0@lo:38:kworker.0
00000100:00100000:3.0:1767320930.267301:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380138496:0@lo:400:kworker.0
00000100:00080000:1.0:1767320930.267309:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320930.267312:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320930.267315:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380138112:0@lo:38:kworker.0
00000100:00080000:1.0:1767320930.267322:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1767320930.267324:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320930.267325:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320930.267328:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380138624:0@lo:38:kworker.0
00000100:00080000:1.0:1767320930.267335:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320930.267337:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320930.267340:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380138880:0@lo:38:kworker.0
00000100:00100000:3.0:1767320930.267351:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380138496
00000100:00100000:3.0:1767320930.267355:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380138496
00000100:00100000:3.0:1767320930.267379:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5140
00000100:00100000:3.0:1767320930.267385:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380138496:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320930.267417:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380138496:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320930.267423:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5140
00000100:00100000:3.0:1767320930.267450:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380138496:0@lo:400:kworker.0
00000100:00100000:3.0:1767320930.267470:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380138368:0@lo:400:kworker.0
00000100:00100000:0.0:1767320930.267608:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380138752:0@lo:400:kworker.0
00000100:00080000:3.0:1767320930.268381:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320930.268389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320930.268496:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320930.268618:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380138240
00000100:00100000:3.0:1767320930.268623:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380138240
00000100:00100000:3.0:1767320930.268655:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053
00000100:00100000:3.0:1767320930.268663:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380138240:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320930.268723:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380138240:12345-0@lo:400:kworker.0 Request processed in 61us (228us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320930.268731:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053
00000100:00100000:2.0:1767320930.268751:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380138240:0@lo:400:kworker.0
00000100:00100000:2.0:1767320930.775527:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380139008:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320930.775607:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320930.775739:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139008
00000100:00100000:1.0:1767320930.775746:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139008
00000100:00100000:1.0:1767320930.775798:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869
00000100:00100000:1.0:1767320930.775808:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380139008:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320930.775837:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320930.775906:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380139008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320930.775913:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869
00000100:00100000:0.0:1767320930.776050:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380139008:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320930.841676:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320931.220402:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320931.220496:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320931.220760:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001920
00000100:00100000:3.0:1767320931.220771:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001920
00000100:00100000:3.0:1767320931.220838:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292001792
00000100:00100000:3.0:1767320931.220841:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292001792
00000100:00100000:3.0:1767320931.220859:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5141
00000100:00100000:3.0:1767320931.220915:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292001920:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320931.221017:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292001920:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 77us (595us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320931.221025:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5141
00000100:00100000:3.0:1767320931.221044:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18158
00000100:00100000:3.0:1767320931.221049:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292001792:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320931.221069:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320931.221097:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292001792:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (601us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320931.221103:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18158
00000100:00080000:0.0:1767320931.222222:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767320931.864491:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320932.892758:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320933.912105:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320934.365981:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320934.366005:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380139136:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320934.366086:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320934.366163:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139136
00000100:00100000:2.0:1767320934.366171:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139136
00000100:00100000:2.0:1767320934.366227:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870
00000100:00080000:0.0:1767320934.366236:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320934.366238:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380139136:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320934.366270:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320934.366317:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f092a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380139136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (229us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320934.366325:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870
00000100:00100000:2.0:1767320934.366373:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380139136:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320934.938073:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767320935.383546:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320935.383563:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320935.383566:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320935.383570:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320935.383575:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320935.383583:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5832
00000100:00080000:3.0:1767320935.383588:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320935.383595:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320935.383634:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c570e00 x1853164380139264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320935.383660:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320935.383664:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320935.383666:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320935.383672:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5832
00000100:00100000:2.0:1767320935.383674:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380139264:0@lo:38:kworker.0
00000100:00080000:3.0:1767320935.383676:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320935.383683:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320935.383699:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c571c00 x1853164380139392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320935.383754:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320935.383759:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320935.383764:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320935.383767:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320935.383771:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5832
00000100:00080000:3.0:1767320935.383774:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320935.383779:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320935.383794:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06238e00 x1853164380139904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320935.383813:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320935.383817:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320935.383819:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767320935.383834:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380139392:0@lo:38:kworker.0
00000100:00080000:3.0:1767320935.383836:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5832
00000100:00080000:3.0:1767320935.383843:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320935.383848:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320935.383863:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f0623b480 x1853164380140160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320935.383897:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320935.383927:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380139904:0@lo:38:kworker.0
00000100:00100000:2.0:1767320935.383962:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320935.383986:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f0623b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380140160:0@lo:38:kworker.0
00000100:00100000:2.0:1767320935.384010:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320935.384046:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139264
00000100:00100000:2.0:1767320935.384054:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139264
00000100:00100000:3.0:1767320935.384060:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380140032:0@lo:400:kworker.0
00000100:00100000:2.0:1767320935.384085:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139904
00000100:00100000:2.0:1767320935.384089:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139904
00000100:00100000:3.0:1767320935.384095:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320935.384401:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380139648:0@lo:400:kworker.0
00000100:00100000:3.0:1767320935.384648:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320935.384657:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380139776:0@lo:400:kworker.0
00000100:00100000:3.0:1767320935.384687:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320935.384736:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320935.384763:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320935.384771:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380139520:0@lo:400:kworker.0
00000100:00100000:0.0:1767320935.384794:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320935.385484:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139648
00000100:00100000:0.0:1767320935.385493:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139648
00000100:00100000:0.0:1767320935.385545:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139520
00000100:00100000:0.0:1767320935.385549:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139520
00000100:00100000:0.0:1767320935.385589:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054
00000100:00100000:0.0:1767320935.385597:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380139648:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320935.385655:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380139648:12345-0@lo:400:kworker.0 Request processed in 58us (919us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320935.385663:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054
00000100:00100000:0.0:1767320935.385679:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055
00000100:00100000:0.0:1767320935.385686:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380139520:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320935.385714:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380139520:12345-0@lo:400:kworker.0 Request processed in 28us (918us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320935.385720:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055
00000100:00080000:0.0:1767320935.385766:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320935.385802:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380139520:0@lo:400:kworker.0
00000100:00100000:0.0:1767320935.385814:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380139648:0@lo:400:kworker.0
00000100:00100000:0.0:1767320935.385884:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139392
00000100:00100000:0.0:1767320935.385888:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139392
00000100:00100000:0.0:1767320935.385909:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279
00000100:00100000:0.0:1767320935.385914:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380139392:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320935.385931:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320935.386202:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380139392:12345-0@lo:38:kworker.0 Request processed in 286us (2305us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320935.386212:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279
00000100:00100000:2.0:1767320935.387814:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140160
00000100:00100000:2.0:1767320935.388453:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140160
00000100:00100000:2.0:1767320935.388643:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140032
00000100:00100000:2.0:1767320935.388648:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140032
00000100:00100000:2.0:1767320935.388695:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5142
00000100:00100000:2.0:1767320935.388706:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380140032:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320935.388795:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380140032:12345-0@lo:400:kworker.0 Request processed in 92us (4700us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320935.388802:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5142
00000100:00100000:2.0:1767320935.388820:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18159
00000100:00100000:2.0:1767320935.388942:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380139264:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320935.389447:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380140032:0@lo:400:kworker.0
00000100:00100000:3.0:1767320935.389488:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380139776
00000100:00100000:3.0:1767320935.389493:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380139776
00000100:00100000:3.0:1767320935.389523:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5143
00000100:00100000:3.0:1767320935.389529:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380139776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320935.389655:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380139776:12345-0@lo:400:kworker.0 Request processed in 125us (4968us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320935.389663:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5143
00000100:00100000:3.0:1767320935.389677:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18160
00000100:00100000:3.0:1767320935.389681:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380139904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320935.389694:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320935.390064:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380139904:12345-0@lo:38:kworker.0 Request processed in 380us (6100us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320935.390071:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18160
00000100:00100000:3.0:1767320935.390087:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18161
00000100:00100000:3.0:1767320935.390091:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380140160:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320935.390101:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320935.390127:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380140160:12345-0@lo:38:kworker.0 Request processed in 34us (6116us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320935.390132:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18161
00000100:00100000:3.0:1767320935.393165:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380139776:0@lo:400:kworker.0
00000100:00080000:3.0:1767320935.393247:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320935.393253:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320935.393257:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f0623b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380140160:0@lo:38:kworker.0
00000100:00080000:3.0:1767320935.393268:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320935.393271:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320935.393274:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380139392:0@lo:38:kworker.0
00000100:00080000:3.0:1767320935.393283:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320935.393286:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320935.393289:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380139904:0@lo:38:kworker.0
00010000:00020000:2.0:1767320935.394139:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:3.0:1767320935.394165:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320935.394237:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380139264:12345-0@lo:38:kworker.0 Request processed in 5290us (10479us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767320935.394247:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767320935.394251:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18159
00000100:00080000:3.0:1767320935.394256:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320935.394260:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380139264:0@lo:38:kworker.0
00000100:00100000:0.0:1767320935.895474:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320935.895514:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380140288:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320935.895591:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320935.896154:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140288
00000100:00100000:1.0:1767320935.896164:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140288
00000100:00100000:1.0:1767320935.896264:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871
00000100:00100000:1.0:1767320935.896275:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380140288:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320935.896305:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320935.896366:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380140288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (774us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320935.896374:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871
00000100:00100000:0.0:1767320935.896459:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10b92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380140288:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320935.959655:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320936.336846:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320936.337077:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292002176
00000100:00100000:0.0:1767320936.337087:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292002176
00000100:00100000:0.0:1767320936.337186:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5144
00000100:00100000:0.0:1767320936.337197:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292002176:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320936.337273:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292002176:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (439us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320936.337282:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5144
00000100:00080000:1.0:1767320936.337552:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320936.338011:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320936.338239:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292002048
00000100:00100000:0.0:1767320936.338246:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292002048
00000100:00100000:0.0:1767320936.338287:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18162
00000100:00100000:0.0:1767320936.338293:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292002048:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320936.338417:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320936.338483:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f0623b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292002048:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 188us (1550us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320936.338491:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18162
00010000:00010000:2.0:1767320936.983326:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320938.008152:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320939.033788:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320939.479387:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380140416:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320939.479465:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320939.479610:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140416
00000100:00100000:1.0:1767320939.479619:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140416
00000100:00100000:1.0:1767320939.479686:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872
00000100:00100000:1.0:1767320939.479697:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380140416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320939.479728:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320939.479783:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380140416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (317us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320939.479790:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872
00000100:00100000:2.0:1767320939.479828:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f10907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380140416:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320939.479951:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320940.055660:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320940.432163:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000400:00000100:1.0:1767320940.432205:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292002304 offset 0 length 520: 4
00000100:00100000:1.0:1767320940.432274:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320940.432649:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292002560
00000100:00100000:2.0:1767320940.432661:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292002560
00000100:00100000:2.0:1767320940.432782:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292002432
00000100:00100000:2.0:1767320940.432793:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292002432
00000100:00100000:2.0:1767320940.432815:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5145
00000100:00100000:2.0:1767320940.432824:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292002560:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767320940.432945:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292002560:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 121us (791us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320940.432953:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5145
00000100:00100000:2.0:1767320940.432971:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18163
00000100:00100000:2.0:1767320940.432976:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292002432:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320940.432996:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320940.433022:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292002432:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (747us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320940.433028:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18163
00000100:00080000:1.0:1767320940.435426:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320940.505307:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320940.505322:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320940.505326:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320940.505332:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320940.505338:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320940.505349:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5837
00000100:00080000:3.0:1767320940.505355:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320940.505365:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320940.505441:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f129500 x1853164380140544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320940.505481:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320940.505486:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320940.505488:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320940.505493:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5837
00000100:00080000:3.0:1767320940.505495:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320940.505499:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320940.505514:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef4000 x1853164380140672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320940.505578:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320940.505582:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320940.505584:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320940.505587:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5837
00000100:00080000:3.0:1767320940.505590:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320940.505594:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320940.505604:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162a680 x1853164380141184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320940.505620:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320940.505623:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320940.505625:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320940.505629:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5837
00000100:00080000:3.0:1767320940.505631:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320940.505635:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320940.505647:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ce00 x1853164380141440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767320940.505685:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380141312:0@lo:400:kworker.0
00000100:00100000:3.0:1767320940.505780:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320940.505835:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380140800:0@lo:400:kworker.0
00000100:00100000:3.0:1767320940.505894:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320940.505922:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380141056:0@lo:400:kworker.0
00000100:00100000:2.0:1767320940.505973:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320940.505982:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320940.506066:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320940.506067:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140800
00000100:00100000:3.0:1767320940.506078:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140800
00000100:00100000:2.0:1767320940.506082:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380140928:0@lo:400:kworker.0
00000100:00100000:2.0:1767320940.506119:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320940.506222:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380141312
00000100:00100000:0.0:1767320940.506228:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380141312
00000100:00100000:0.0:1767320940.506270:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380141056
00000100:00100000:0.0:1767320940.506273:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380141056
00000100:00100000:0.0:1767320940.506297:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5146
00000100:00100000:0.0:1767320940.506305:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380141312:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320940.506373:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380141312:12345-0@lo:400:kworker.0 Request processed in 68us (592us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320940.506381:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5146
00000100:00100000:0.0:1767320940.506398:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5147
00000100:00100000:0.0:1767320940.506404:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380141056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320940.506429:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380141056:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320940.506434:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5147
00000100:00100000:0.0:1767320940.506498:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380141056:0@lo:400:kworker.0
00000100:00100000:0.0:1767320940.506509:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380141312:0@lo:400:kworker.0
00000100:00080000:1.0:1767320940.506728:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320940.506749:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380140544:0@lo:38:kworker.0
00000100:00100000:1.0:1767320940.506785:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320940.506812:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380140672:0@lo:38:kworker.0
00000100:00100000:1.0:1767320940.506836:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320940.506861:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380141184:0@lo:38:kworker.0
00000100:00100000:1.0:1767320940.506899:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320940.506927:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380141440:0@lo:38:kworker.0
00000100:00100000:1.0:1767320940.506951:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320940.506998:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140544
00000100:00100000:1.0:1767320940.507004:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140544
00000100:00100000:1.0:1767320940.507032:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380141184
00000100:00100000:1.0:1767320940.507034:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380141184
00000100:00100000:1.0:1767320940.507048:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380141440
00000100:00100000:1.0:1767320940.507051:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380141440
00000100:00100000:1.0:1767320940.507066:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18164
00000100:00100000:1.0:1767320940.507071:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380140544:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320940.507103:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320940.507152:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380140544:12345-0@lo:38:kworker.0 Request processed in 78us (365us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320940.507164:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18164
00000100:00100000:1.0:1767320940.507182:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18165
00000100:00100000:1.0:1767320940.507186:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380141184:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320940.507195:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320940.507231:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380141184:12345-0@lo:38:kworker.0 Request processed in 43us (331us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320940.507240:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18165
00000100:00100000:1.0:1767320940.507252:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18166
00000100:00100000:1.0:1767320940.507256:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380141440:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320940.507264:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320940.507286:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380141440:12345-0@lo:38:kworker.0 Request processed in 28us (334us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320940.507292:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18166
00000100:00080000:1.0:1767320940.507348:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320940.507354:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320940.507358:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380140544:0@lo:38:kworker.0
00000100:00080000:1.0:1767320940.507366:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320940.507370:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320940.507372:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380141184:0@lo:38:kworker.0
00000100:00080000:1.0:1767320940.507381:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320940.507384:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320940.507387:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380141440:0@lo:38:kworker.0
00000100:00100000:1.0:1767320940.507460:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140672
00000100:00100000:1.0:1767320940.507464:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140672
00000100:00100000:1.0:1767320940.507483:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280
00000100:00100000:1.0:1767320940.507488:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380140672:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320940.507497:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320940.507530:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380140672:12345-0@lo:38:kworker.0 Request processed in 39us (692us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320940.507536:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280
00000100:00080000:1.0:1767320940.507557:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320940.507561:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320940.507564:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380140672:0@lo:38:kworker.0
00000100:00100000:2.0:1767320940.509600:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380140928
00000100:00100000:2.0:1767320940.509621:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380140928
00000100:00100000:2.0:1767320940.509706:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056
00000100:00100000:2.0:1767320940.509719:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380140800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320940.509844:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380140800:12345-0@lo:400:kworker.0 Request processed in 129us (3872us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320940.509851:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056
00000100:00100000:2.0:1767320940.509887:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057
00000100:00100000:2.0:1767320940.509894:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380140928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320940.509938:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380140928:12345-0@lo:400:kworker.0 Request processed in 44us (3817us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320940.509944:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057
00000100:00100000:2.0:1767320940.511323:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380140928:0@lo:400:kworker.0
00000100:00100000:2.0:1767320940.511344:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380140800:0@lo:400:kworker.0
00000100:00080000:1.0:1767320940.511443:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320941.015385:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380141568:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320941.015494:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320941.016267:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380141568
00000100:00100000:1.0:1767320941.016284:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380141568
00000100:00100000:1.0:1767320941.016361:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873
00000100:00100000:1.0:1767320941.016376:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380141568:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320941.016429:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320941.016523:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f10907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380141568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (1028us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320941.016533:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873
00000100:00100000:3.0:1767320941.016702:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380141568:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320941.082995:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320942.103905:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320943.127694:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320944.151145:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320944.599259:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380141696:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320944.599376:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320944.599628:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380141696
00000100:00100000:2.0:1767320944.599640:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380141696
00000100:00100000:2.0:1767320944.599729:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874
00000100:00100000:2.0:1767320944.599740:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380141696:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320944.599778:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320944.599838:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380141696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (461us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320944.599846:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874
00000100:00080000:0.0:1767320944.600079:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320944.600128:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380141696:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320945.175760:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320945.552616:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320945.553404:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292002816
00000100:00100000:0.0:1767320945.553420:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292002816
00000100:00100000:0.0:1767320945.553764:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5148
00000100:00100000:0.0:1767320945.553780:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292002816:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767320945.553929:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292002816:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 154us (1329us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320945.553938:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5148
00000100:00080000:1.0:1767320945.554260:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320945.555079:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320945.555165:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292002688
00000100:00100000:2.0:1767320945.555175:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292002688
00000100:00100000:2.0:1767320945.555223:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18167
00000100:00100000:2.0:1767320945.555231:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292002688:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320945.555259:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320945.555321:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292002688:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 89us (246us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320945.555328:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18167
00000100:00100000:1.0:1767320945.623127:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320920/real 1767320920]  req@ffff8b0f2f3fe680 x1853164380136320/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320945.623176:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f3fe680 x1853164380136320/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1767320945.623203:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320945.623234:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320945.623239:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380136320:0@lo:250:kworker.0
00000100:00080000:0.0:1767320945.623448:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320945.623456:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320945.623461:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320945.623468:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5822
00000100:00080000:0.0:1767320945.623472:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320945.623481:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320945.623528:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964c380 x1853164380141824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320945.623560:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320945.623564:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320945.623566:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320945.623570:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5842
00000100:00080000:0.0:1767320945.623573:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320945.623577:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320945.623599:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964fb80 x1853164380141952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320945.623609:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320945.623613:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320945.623615:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320945.623619:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5842
00000100:00080000:0.0:1767320945.623622:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320945.623626:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320945.623638:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964d500 x1853164380142080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320945.623725:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320945.623850:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380141824:0@lo:250:kworker.0
00000400:00000100:1.0:1767320945.624989:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380141824 offset 0 length 520: 4
00000100:00100000:1.0:1767320945.625077:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380141952:0@lo:38:kworker.0
00000100:00100000:1.0:1767320945.625129:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320945.625158:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380142080:0@lo:38:kworker.0
00000100:00100000:1.0:1767320945.625191:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320945.625279:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142080
00000100:00100000:1.0:1767320945.625289:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142080
00000100:00100000:1.0:1767320945.625335:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281
00000100:00100000:1.0:1767320945.625344:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380142080:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320945.625371:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320945.625427:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380142080:12345-0@lo:38:kworker.0 Request processed in 82us (233us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320945.625434:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281
00000100:00080000:1.0:1767320945.625494:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320945.625500:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320945.625504:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380142080:0@lo:38:kworker.0
00000100:00100000:3.0:1767320945.625753:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380141952
00000100:00100000:3.0:1767320945.625758:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380141952
00000100:00100000:3.0:1767320945.625798:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18168
00000100:00100000:3.0:1767320945.625804:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380141952:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320945.625817:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320945.625896:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380141952:12345-0@lo:38:kworker.0 Request processed in 90us (766us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320945.625903:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18168
00000100:00080000:1.0:1767320945.629520:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320945.629539:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320945.629546:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380141952:0@lo:38:kworker.0
00000100:00100000:2.0:1767320945.630316:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380142336:0@lo:400:kworker.0
00000100:00100000:2.0:1767320945.630418:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320945.630569:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380142208:0@lo:400:kworker.0
00000100:00100000:2.0:1767320945.630595:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320945.631678:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320945.631685:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320945.631690:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320945.631699:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5842
00000100:00080000:0.0:1767320945.631705:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320945.631714:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320945.631739:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964d500 x1853164380142592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320945.631766:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320945.631770:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320945.631772:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320945.631776:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5842
00000100:00080000:0.0:1767320945.631779:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320945.631783:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320945.631794:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162a300 x1853164380142848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320945.631837:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380142720:0@lo:400:kworker.0
00000100:00100000:0.0:1767320945.631925:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320945.631965:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320945.631972:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380142464:0@lo:400:kworker.0
00000100:00100000:0.0:1767320945.631997:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320945.632064:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142720
00000100:00100000:0.0:1767320945.632073:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142720
00000100:00100000:0.0:1767320945.632133:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142464
00000100:00100000:0.0:1767320945.632137:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142464
00000100:00100000:0.0:1767320945.632161:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5149
00000100:00100000:0.0:1767320945.632171:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380142720:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320945.632229:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380142720:12345-0@lo:400:kworker.0 Request processed in 58us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320945.632240:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5149
00000100:00100000:0.0:1767320945.632259:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5150
00000100:00100000:0.0:1767320945.632266:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380142464:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320945.632293:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380142464:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320945.632299:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5150
00000100:00100000:0.0:1767320945.632341:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380142464:0@lo:400:kworker.0
00000100:00100000:0.0:1767320945.632352:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380142720:0@lo:400:kworker.0
00000100:00080000:1.0:1767320945.632485:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320945.632505:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380142592:0@lo:38:kworker.0
00000100:00100000:1.0:1767320945.632540:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320945.632571:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380142848:0@lo:38:kworker.0
00000100:00100000:1.0:1767320945.632593:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320945.632619:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142592
00000100:00100000:1.0:1767320945.632622:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142592
00000100:00100000:1.0:1767320945.632643:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142848
00000100:00100000:1.0:1767320945.632646:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142848
00000100:00100000:1.0:1767320945.632660:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18169
00000100:00100000:1.0:1767320945.632665:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380142592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320945.632690:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320945.632727:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380142592:12345-0@lo:38:kworker.0 Request processed in 61us (186us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320945.632734:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18169
00000100:00100000:1.0:1767320945.632752:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18170
00000100:00100000:1.0:1767320945.632757:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380142848:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320945.632767:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320945.632790:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380142848:12345-0@lo:38:kworker.0 Request processed in 32us (196us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320945.632796:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18170
00000100:00080000:1.0:1767320945.632827:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320945.632833:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320945.632836:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380142592:0@lo:38:kworker.0
00000100:00080000:1.0:1767320945.632845:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320945.632848:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320945.632851:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380142848:0@lo:38:kworker.0
00000100:00100000:3.0:1767320945.645455:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142336
00000100:00100000:3.0:1767320945.645481:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142336
00000100:00100000:3.0:1767320945.645619:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142208
00000100:00100000:3.0:1767320945.645624:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142208
00000100:00100000:3.0:1767320945.645657:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058
00000100:00100000:3.0:1767320945.645669:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380142336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320945.645809:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380142336:12345-0@lo:400:kworker.0 Request processed in 143us (15391us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320945.645817:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058
00000100:00100000:3.0:1767320945.645836:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059
00000100:00100000:3.0:1767320945.645842:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380142208:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320945.645905:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380142208:12345-0@lo:400:kworker.0 Request processed in 63us (15308us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320945.645911:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059
00000100:00100000:2.0:1767320945.646172:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380142336:0@lo:400:kworker.0
00000100:00100000:2.0:1767320945.646194:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380142208:0@lo:400:kworker.0
00000100:00080000:1.0:1767320945.647660:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320946.135354:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380142976:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320946.135461:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320946.135636:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380142976
00000100:00100000:1.0:1767320946.135646:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380142976
00000100:00100000:1.0:1767320946.135722:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875
00000100:00100000:1.0:1767320946.135733:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380142976:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320946.135770:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320946.135835:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380142976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (375us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320946.135844:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875
00000100:00100000:3.0:1767320946.136257:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380142976:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320946.199442:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320947.223604:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320948.247576:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320949.271401:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320949.720351:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767320949.720380:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380143104:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320949.720477:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320949.720567:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380143104
00000100:00100000:2.0:1767320949.720578:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380143104
00000100:00100000:2.0:1767320949.720652:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876
00000100:00100000:2.0:1767320949.720664:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380143104:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320949.720705:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320949.720757:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380143104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320949.720765:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876
00000100:00080000:2.0:1767320949.720788:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767320949.720844:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380143104:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320950.295975:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320950.673727:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320950.673783:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320950.674743:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292002944
00000100:00100000:1.0:1767320950.674827:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292002944
00000100:00100000:1.0:1767320950.674955:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292003072
00000100:00100000:1.0:1767320950.674959:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292003072
00000100:00100000:1.0:1767320950.675011:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5151
00000100:00100000:1.0:1767320950.675022:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292003072:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320950.675105:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292003072:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (1320us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320950.675112:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5151
00000100:00100000:1.0:1767320950.675134:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18171
00000100:00100000:1.0:1767320950.675138:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f04fd3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292002944:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320950.675160:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320950.675184:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f04fd3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292002944:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (1467us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320950.675190:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18171
00000100:00080000:3.0:1767320950.676909:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320950.743062:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320950.743076:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767320950.743080:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320950.743085:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320950.743091:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320950.743102:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5848
00000100:00080000:3.0:1767320950.743108:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320950.743117:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320950.743171:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06004000 x1853164380143232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320950.743290:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320950.743297:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1767320950.743326:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380143232:0@lo:38:kworker.0
00000100:00080000:3.0:1767320950.743395:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1767320950.743404:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320950.743416:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5848
00000100:00080000:3.0:1767320950.743419:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320950.743424:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320950.743447:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06005180 x1853164380143360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320950.743536:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380143360:0@lo:38:kworker.0
00000100:00080000:3.0:1767320950.743545:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320950.743550:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320950.743553:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320950.743559:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5848
00000100:00080000:3.0:1767320950.743561:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320950.743566:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320950.743580:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06007b80 x1853164380143872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767320950.743599:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767320950.743603:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767320950.743605:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767320950.743608:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5848
00000100:00080000:3.0:1767320950.743611:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767320950.743615:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767320950.743628:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06004380 x1853164380144128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767320950.743702:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320950.746670:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380143488:0@lo:400:kworker.0
00000100:00100000:0.0:1767320950.746743:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320950.747157:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380143872:0@lo:38:kworker.0
00000100:00100000:3.0:1767320950.747171:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380143616:0@lo:400:kworker.0
00000100:00100000:1.0:1767320950.747196:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320950.747222:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380144128:0@lo:38:kworker.0
00000100:00100000:1.0:1767320950.747246:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320950.747286:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380143360
00000100:00100000:1.0:1767320950.747627:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380143360
00000100:00100000:1.0:1767320950.747674:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282
00000100:00100000:1.0:1767320950.747682:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380143360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320950.747703:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320950.747761:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380143488
00000100:00100000:0.0:1767320950.747766:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380143488
00000100:00100000:0.0:1767320950.747820:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060
00000100:00100000:0.0:1767320950.747827:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380143488:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320950.748001:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380143360:12345-0@lo:38:kworker.0 Request processed in 318us (4299us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320950.748009:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282
00000100:00100000:1.0:1767320950.748039:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380143232
00000100:00100000:1.0:1767320950.748043:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380143232
00000100:00100000:1.0:1767320950.748062:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18172
00000100:00100000:1.0:1767320950.748067:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380143232:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320950.748078:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320950.748110:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380143232:12345-0@lo:38:kworker.0 Request processed in 42us (4707us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320950.748116:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18172
00000100:00100000:1.0:1767320950.748139:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380143872
00000100:00100000:1.0:1767320950.748142:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380143872
00000100:00100000:1.0:1767320950.748156:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144128
00000100:00100000:1.0:1767320950.748159:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144128
00000100:00100000:1.0:1767320950.748174:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18173
00000100:00100000:1.0:1767320950.748178:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380143872:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320950.748186:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320950.748209:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380143872:12345-0@lo:38:kworker.0 Request processed in 31us (1015us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320950.748214:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18173
00000100:00100000:1.0:1767320950.748225:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18174
00000100:00100000:1.0:1767320950.748228:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380144128:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320950.748236:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320950.748256:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380144128:12345-0@lo:38:kworker.0 Request processed in 27us (1010us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320950.748261:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18174
00000100:00080000:1.0:1767320950.748848:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320950.748855:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320950.748859:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380143872:0@lo:38:kworker.0
00000100:00080000:1.0:1767320950.748980:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320950.748984:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320950.748988:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06004380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380144128:0@lo:38:kworker.0
00000100:00080000:1.0:1767320950.748998:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320950.749002:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320950.749005:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380143360:0@lo:38:kworker.0
00000100:00080000:1.0:1767320950.749014:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320950.749017:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320950.749020:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380143232:0@lo:38:kworker.0
00000100:00100000:1.0:1767320950.749100:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380144000:0@lo:400:kworker.0
00000100:00100000:1.0:1767320950.749139:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320950.749165:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320950.749171:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380143744:0@lo:400:kworker.0
00000100:00100000:1.0:1767320950.749191:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320950.749215:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144000
00000100:00100000:1.0:1767320950.749219:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144000
00000100:00100000:1.0:1767320950.749258:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380143744
00000100:00100000:1.0:1767320950.749261:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380143744
00000100:00100000:1.0:1767320950.749278:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5152
00000100:00100000:1.0:1767320950.749283:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380144000:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320950.749442:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5153
00000100:00100000:2.0:1767320950.749462:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380143744:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320950.749513:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380143744:12345-0@lo:400:kworker.0 Request processed in 64us (320us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320950.749520:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5153
00000100:00080000:2.0:1767320950.749552:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320950.749711:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380144000:12345-0@lo:400:kworker.0 Request processed in 426us (570us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320950.749718:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5152
00000100:00100000:1.0:1767320950.749749:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06007480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380143744:0@lo:400:kworker.0
00000100:00100000:1.0:1767320950.749758:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380144000:0@lo:400:kworker.0
00000100:00100000:0.0:1767320950.754828:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380143488:12345-0@lo:400:kworker.0 Request processed in 6978us (8061us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320950.754842:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320950.754855:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060
00000100:00100000:0.0:1767320950.754924:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380143616
00000100:00100000:0.0:1767320950.754934:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380143616
00000100:00080000:3.0:1767320950.754999:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320950.755014:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061
00000100:00100000:0.0:1767320950.755030:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380143616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320950.755097:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380143616:12345-0@lo:400:kworker.0 Request processed in 75us (267us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320950.755103:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061
00000100:00100000:3.0:1767320950.756292:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06006300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380143616:0@lo:400:kworker.0
00000100:00100000:1.0:1767320950.758104:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380143488:0@lo:400:kworker.0
00000100:00100000:3.0:1767320951.259621:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320951.259655:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380144256:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320951.259769:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320951.268161:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144256
00000100:00100000:2.0:1767320951.268762:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144256
00000100:00100000:2.0:1767320951.268945:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877
00000100:00100000:2.0:1767320951.268959:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380144256:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320951.269016:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320951.269139:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380144256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 183us (9371us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320951.269148:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877
00000100:00100000:3.0:1767320951.269417:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380144256:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320951.321389:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320952.343354:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320953.369110:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320954.393320:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320954.839290:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380144384:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320954.839391:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320954.839555:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144384
00000100:00100000:2.0:1767320954.839566:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144384
00000100:00100000:2.0:1767320954.839655:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878
00000100:00100000:2.0:1767320954.839667:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380144384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320954.839705:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320954.839806:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380144384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (383us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320954.839816:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878
00000100:00100000:1.0:1767320954.839851:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380144384:0@lo:13:osp-pre-1-1.0
00000100:00080000:3.0:1767320954.840068:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767320955.420815:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320955.796048:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320955.796163:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292003328
00000100:00100000:1.0:1767320955.796173:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292003328
00000100:00100000:1.0:1767320955.796252:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5154
00000100:00100000:1.0:1767320955.796270:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292003328:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320955.796356:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292003328:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (317us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320955.796364:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5154
00000100:00080000:3.0:1767320955.797613:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320955.798510:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320955.800027:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292003200
00000100:00100000:1.0:1767320955.800041:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292003200
00000100:00100000:1.0:1767320955.800172:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18175
00000100:00100000:1.0:1767320955.800182:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292003200:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320955.800208:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320955.800285:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292003200:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 103us (1782us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320955.800293:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18175
00000100:00080000:0.0:1767320955.866005:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320955.866020:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320955.866024:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320955.866029:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320955.866035:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320955.866046:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5853
00000100:00080000:0.0:1767320955.866053:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320955.866062:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320955.866137:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609500 x1853164380144512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320955.866181:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320955.866185:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320955.866187:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320955.866192:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5853
00000100:00080000:0.0:1767320955.866195:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320955.866200:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320955.866215:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608380 x1853164380144640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320955.866307:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320955.866311:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320955.866313:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320955.866316:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5853
00000100:00080000:0.0:1767320955.866319:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320955.866323:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320955.866336:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360ad80 x1853164380145152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320955.866354:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320955.866357:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320955.866359:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320955.866364:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5853
00000100:00080000:0.0:1767320955.866366:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320955.866370:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320955.866382:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164380145408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320955.866426:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380145024:0@lo:400:kworker.0
00000100:00100000:1.0:1767320955.866526:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380144512:0@lo:38:kworker.0
00000100:00100000:1.0:1767320955.866604:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320955.866686:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380144640:0@lo:38:kworker.0
00000100:00100000:1.0:1767320955.866726:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320955.866762:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380145152:0@lo:38:kworker.0
00000100:00100000:1.0:1767320955.866798:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320955.866816:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380145408:0@lo:38:kworker.0
00000100:00100000:1.0:1767320955.866837:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320955.866914:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144640
00000100:00100000:1.0:1767320955.866927:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144640
00000100:00100000:1.0:1767320955.866975:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283
00000100:00100000:1.0:1767320955.866988:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380144640:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320955.867015:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320955.867063:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380144640:12345-0@lo:38:kworker.0 Request processed in 79us (335us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320955.867071:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283
00000100:00080000:1.0:1767320955.867149:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320955.867155:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320955.867158:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380144640:0@lo:38:kworker.0
00000100:00100000:1.0:1767320955.867187:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144512
00000100:00100000:1.0:1767320955.867191:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144512
00000100:00100000:1.0:1767320955.867217:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145152
00000100:00100000:1.0:1767320955.867220:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145152
00000100:00100000:1.0:1767320955.867231:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145408
00000100:00100000:1.0:1767320955.867234:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145408
00000100:00100000:1.0:1767320955.867251:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18176
00000100:00100000:1.0:1767320955.867255:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380144512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320955.867266:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320955.867313:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380144512:12345-0@lo:38:kworker.0 Request processed in 56us (709us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320955.867320:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18176
00000100:00100000:1.0:1767320955.867338:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18177
00000100:00100000:1.0:1767320955.867342:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380145152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320955.867350:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320955.867372:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380145152:12345-0@lo:38:kworker.0 Request processed in 28us (574us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320955.867378:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18177
00000100:00100000:1.0:1767320955.867388:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18178
00000100:00100000:1.0:1767320955.867392:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380145408:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320955.867400:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320955.867420:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380145408:12345-0@lo:38:kworker.0 Request processed in 27us (583us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320955.867434:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18178
00000100:00080000:1.0:1767320955.867469:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320955.867473:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320955.867476:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380144512:0@lo:38:kworker.0
00000100:00080000:1.0:1767320955.867489:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320955.867492:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320955.867496:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380145152:0@lo:38:kworker.0
00000100:00080000:1.0:1767320955.867503:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320955.867505:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320955.867508:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380145408:0@lo:38:kworker.0
00000100:00100000:1.0:1767320955.867579:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380145280:0@lo:400:kworker.0
00000100:00100000:1.0:1767320955.867609:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320955.867638:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145280
00000100:00100000:1.0:1767320955.867642:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145280
00000100:00100000:1.0:1767320955.867690:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5155
00000100:00100000:1.0:1767320955.867696:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380145280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320955.867743:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380145280:12345-0@lo:400:kworker.0 Request processed in 47us (133us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320955.867750:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5155
00000100:00100000:1.0:1767320955.867797:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380145280:0@lo:400:kworker.0
00000100:00100000:3.0:1767320955.868010:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380144896:0@lo:400:kworker.0
00000100:00100000:3.0:1767320955.868057:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320955.868096:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767320955.868105:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380144768:0@lo:400:kworker.0
00000100:00100000:3.0:1767320955.868134:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767320955.868170:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320955.868203:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144896
00000100:00100000:3.0:1767320955.868207:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144896
00000100:00100000:3.0:1767320955.868246:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380144768
00000100:00100000:3.0:1767320955.868250:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380144768
00000100:00100000:3.0:1767320955.868275:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062
00000100:00100000:3.0:1767320955.868289:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380144896:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320955.868342:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380144896:12345-0@lo:400:kworker.0 Request processed in 56us (279us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320955.868350:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062
00000100:00100000:3.0:1767320955.868363:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063
00000100:00100000:3.0:1767320955.868369:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380144768:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320955.868398:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380144768:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320955.868404:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063
00000100:00100000:3.0:1767320955.868441:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380144768:0@lo:400:kworker.0
00000100:00100000:3.0:1767320955.868462:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380144896:0@lo:400:kworker.0
00000100:00080000:3.0:1767320955.868487:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320955.868642:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320955.868805:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145024
00000100:00100000:2.0:1767320955.868810:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145024
00000100:00100000:2.0:1767320955.868859:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5156
00000100:00100000:2.0:1767320955.868866:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380145024:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320955.868931:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380145024:12345-0@lo:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320955.868937:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5156
00000100:00080000:3.0:1767320955.869050:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320955.869108:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380145024:0@lo:400:kworker.0
00000100:00100000:2.0:1767320956.375458:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380145536:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320956.375574:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320956.376013:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145536
00000100:00100000:0.0:1767320956.376024:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145536
00000100:00100000:0.0:1767320956.376103:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879
00000100:00100000:0.0:1767320956.376116:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380145536:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320956.376156:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320956.376221:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380145536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (646us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320956.376230:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879
00000100:00100000:2.0:1767320956.376509:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380145536:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320956.439626:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320957.467806:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320958.487986:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320959.511409:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320959.964428:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380145664:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320959.964531:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320959.964705:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145664
00000100:00100000:1.0:1767320959.964716:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145664
00000100:00100000:1.0:1767320959.964821:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880
00000100:00100000:1.0:1767320959.964831:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380145664:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320959.964897:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320959.964960:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380145664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (428us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320959.964967:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880
00000100:00080000:3.0:1767320959.965364:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320959.965428:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380145664:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320960.535371:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320960.913682:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320960.913789:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292003584
00000100:00100000:1.0:1767320960.913798:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292003584
00000100:00100000:1.0:1767320960.913896:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5157
00000100:00100000:1.0:1767320960.913908:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292003584:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320960.913998:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292003584:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (325us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320960.914006:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5157
00000100:00080000:3.0:1767320960.914121:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320960.921796:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320960.921931:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292003456
00000100:00100000:2.0:1767320960.921941:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292003456
00000100:00100000:2.0:1767320960.922000:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18179
00000100:00100000:2.0:1767320960.922008:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292003456:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320960.922032:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320960.922094:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292003456:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 86us (308us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320960.922102:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18179
00000100:00080000:0.0:1767320960.983324:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320960.983338:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320960.983342:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320960.983348:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320960.983353:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320960.983363:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5858
00000100:00080000:0.0:1767320960.983369:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320960.983378:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320960.983433:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164380145792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320960.983531:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380145792:0@lo:38:kworker.0
00000100:00100000:2.0:1767320960.983638:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320960.983846:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145792
00000100:00100000:1.0:1767320960.983857:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145792
00000100:00100000:1.0:1767320960.983950:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18180
00000100:00100000:1.0:1767320960.983960:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380145792:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320960.983985:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:0.0:1767320960.984320:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320960.984325:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320960.984328:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320960.984334:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5858
00000100:00080000:0.0:1767320960.984338:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320960.984343:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320960.984366:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164380145920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320960.984808:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380145920:0@lo:38:kworker.0
00000100:00100000:2.0:1767320960.984865:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320960.985044:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380145792:12345-0@lo:38:kworker.0 Request processed in 1074us (1396us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320960.985055:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18180
00000100:00080000:0.0:1767320960.985829:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320960.985834:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320960.985838:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320960.985845:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5858
00000100:00080000:0.0:1767320960.985849:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320960.985856:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320960.985901:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b800 x1853164380146432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320960.985922:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320960.985927:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320960.985929:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320960.985933:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5858
00000100:00080000:0.0:1767320960.985936:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320960.985940:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320960.985952:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360bb80 x1853164380146688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320960.985992:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380146304:0@lo:400:kworker.0
00000100:00100000:0.0:1767320960.988515:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320960.988599:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320960.988615:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380146560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320960.988674:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320960.988745:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146304
00000100:00100000:0.0:1767320960.988755:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146304
00000100:00100000:0.0:1767320960.988833:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146560
00000100:00100000:0.0:1767320960.988837:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146560
00000100:00100000:0.0:1767320960.988962:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5158
00000100:00100000:0.0:1767320960.988975:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380146304:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320960.990024:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380146304:12345-0@lo:400:kworker.0 Request processed in 1043us (1511us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320960.990175:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380145920
00000100:00100000:3.0:1767320960.990185:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380145920
00000100:00100000:3.0:1767320960.990234:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284
00000100:00100000:3.0:1767320960.990242:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380145920:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320960.990270:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320960.990336:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06001500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380145920:12345-0@lo:38:kworker.0 Request processed in 94us (5470us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320960.990343:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284
00000100:00100000:3.0:1767320960.990415:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5159
00000100:00100000:3.0:1767320960.990429:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380146560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320960.990472:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380146560:12345-0@lo:400:kworker.0 Request processed in 49us (1797us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320960.990479:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5159
00000100:00080000:3.0:1767320960.990514:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320960.990577:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5158
00000100:00100000:0.0:1767320960.990636:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380146560:0@lo:400:kworker.0
00000100:00100000:0.0:1767320960.990650:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380146304:0@lo:400:kworker.0
00000100:00100000:1.0:1767320960.990913:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146048:0@lo:400:kworker.0
00000100:00100000:1.0:1767320960.990963:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320960.991275:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320960.991284:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320960.991309:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320960.991356:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146048
00000100:00100000:1.0:1767320960.991363:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146048
00000100:00100000:1.0:1767320960.991406:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146176
00000100:00100000:1.0:1767320960.991409:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146176
00000100:00100000:1.0:1767320960.991441:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064
00000100:00100000:1.0:1767320960.991448:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320960.991490:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146048:12345-0@lo:400:kworker.0 Request processed in 41us (527us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320960.991500:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064
00000100:00100000:1.0:1767320960.991518:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065
00000100:00100000:1.0:1767320960.991523:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320960.991548:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146176:12345-0@lo:400:kworker.0 Request processed in 25us (238us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320960.991554:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065
00000100:00080000:1.0:1767320960.991568:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320960.991597:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146176:0@lo:400:kworker.0
00000100:00100000:1.0:1767320960.991606:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146048:0@lo:400:kworker.0
00000100:00080000:2.0:1767320960.992600:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320960.992611:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320960.992616:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380145792:0@lo:38:kworker.0
00000100:00100000:2.0:1767320960.992648:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380146432:0@lo:38:kworker.0
00000100:00100000:2.0:1767320960.992698:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320960.992748:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380146688:0@lo:38:kworker.0
00000100:00100000:2.0:1767320960.992771:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767320960.992802:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320960.992806:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320960.992810:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380145920:0@lo:38:kworker.0
00000100:00100000:0.0:1767320960.993025:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146432
00000100:00100000:0.0:1767320960.993032:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146432
00000100:00100000:0.0:1767320960.993322:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146688
00000100:00100000:0.0:1767320960.993326:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146688
00000100:00100000:3.0:1767320960.995908:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18181
00000100:00100000:3.0:1767320960.995925:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380146432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320960.995957:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320960.996107:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380146432:12345-0@lo:38:kworker.0 Request processed in 181us (3406us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320960.996116:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18181
00000100:00100000:3.0:1767320960.996148:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18182
00000100:00100000:3.0:1767320960.996154:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380146688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320960.996164:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320960.996191:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380146688:12345-0@lo:38:kworker.0 Request processed in 35us (3418us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320960.996197:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18182
00000100:00080000:2.0:1767320960.996452:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320960.996459:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320960.996463:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380146432:0@lo:38:kworker.0
00000100:00080000:2.0:1767320960.996474:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320960.996478:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320960.996482:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380146688:0@lo:38:kworker.0
00000100:00100000:3.0:1767320961.504830:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146816:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320961.504973:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320961.505146:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146816
00000100:00100000:1.0:1767320961.505157:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146816
00000100:00100000:1.0:1767320961.505230:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881
00000100:00100000:1.0:1767320961.505241:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146816:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320961.505281:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320961.505343:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (369us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320961.505351:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881
00000100:00100000:3.0:1767320961.505947:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146816:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320961.559519:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320962.583472:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320963.607599:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320964.643178:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320965.079341:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320965.079366:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146944:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320965.079446:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320965.079601:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380146944
00000100:00100000:1.0:1767320965.079616:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380146944
00000100:00100000:1.0:1767320965.079726:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882
00000100:00100000:1.0:1767320965.079741:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146944:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320965.079783:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320965.079894:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380146944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (424us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320965.079903:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882
00000100:00080000:3.0:1767320965.081433:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767320965.081537:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380146944:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767320965.659790:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320966.031807:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320966.031920:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320966.032047:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292003840
00000100:00100000:3.0:1767320966.032060:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292003840
00000100:00100000:1.0:1767320966.032075:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292003712
00000100:00100000:1.0:1767320966.032092:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292003712
00000100:00100000:3.0:1767320966.032767:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5160
00000100:00100000:3.0:1767320966.032781:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292003840:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320966.032862:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292003840:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 84us (1065us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320966.032891:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5160
00000100:00080000:0.0:1767320966.033138:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320966.034955:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18183
00000100:00100000:1.0:1767320966.034969:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292003712:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767320966.035003:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320966.035962:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292003712:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 152us (3200us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320966.035978:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18183
00000400:00000100:0.0:1767320966.040034:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292003968 offset 0 length 520: 4
00000100:00080000:2.0:1767320966.103068:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320966.103092:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320966.103095:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320966.103100:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320966.103105:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320966.103116:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5863
00000100:00080000:2.0:1767320966.103122:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320966.103134:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320966.103193:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06000700 x1853164380147072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320966.103228:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320966.103232:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320966.103233:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320966.103238:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5863
00000100:00080000:2.0:1767320966.103240:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320966.103245:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320966.103261:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06001880 x1853164380147200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320966.103348:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1767320966.103351:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380147072:0@lo:38:kworker.0
00000100:00080000:2.0:1767320966.103351:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320966.103354:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320966.103358:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5863
00000100:00080000:2.0:1767320966.103360:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320966.103364:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320966.103376:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06003800 x1853164380147712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320966.103390:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320966.103394:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320966.103396:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320966.103400:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5863
00000100:00080000:2.0:1767320966.103402:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320966.103406:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320966.103419:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06003b80 x1853164380147968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320966.103447:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380147840:0@lo:400:kworker.0
00000100:00100000:1.0:1767320966.103452:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320966.103550:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147072
00000100:00100000:3.0:1767320966.103566:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147072
00000100:00100000:0.0:1767320966.103567:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380147328:0@lo:400:kworker.0
00000100:00100000:3.0:1767320966.103614:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18184
00000100:00100000:3.0:1767320966.103622:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380147072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320966.103642:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320966.108228:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320966.108522:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320966.108540:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380147584:0@lo:400:kworker.0
00000100:00100000:2.0:1767320966.108595:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320966.108653:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147840
00000100:00100000:2.0:1767320966.108663:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147840
00000100:00100000:2.0:1767320966.108746:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147584
00000100:00100000:2.0:1767320966.108750:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147584
00000100:00100000:2.0:1767320966.108778:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5161
00000100:00100000:2.0:1767320966.108788:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380147840:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320966.108856:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380147840:12345-0@lo:400:kworker.0 Request processed in 69us (638us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320966.108865:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5161
00000100:00100000:2.0:1767320966.108913:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5162
00000100:00100000:1.0:1767320966.109354:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380147200:0@lo:38:kworker.0
00000100:00100000:1.0:1767320966.109396:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320966.109436:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380147712:0@lo:38:kworker.0
00000100:00100000:1.0:1767320966.109463:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320966.109489:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380147968:0@lo:38:kworker.0
00000100:00100000:1.0:1767320966.109515:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320966.109547:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147200
00000100:00100000:1.0:1767320966.109552:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147200
00000100:00100000:1.0:1767320966.109582:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285
00000100:00100000:1.0:1767320966.109588:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380147200:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320966.109611:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320966.109618:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380147584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320966.114540:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380147072:12345-0@lo:38:kworker.0 Request processed in 10907us (11077us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320966.114556:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18184
00000100:00100000:3.0:1767320966.114621:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380147456:0@lo:400:kworker.0
00000100:00100000:3.0:1767320966.114700:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147712
00000100:00100000:3.0:1767320966.114708:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147712
00000100:00100000:3.0:1767320966.114731:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147968
00000100:00100000:3.0:1767320966.114734:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147968
00000100:00100000:3.0:1767320966.114748:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18185
00000100:00100000:3.0:1767320966.114755:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380147712:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320966.114780:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320966.114826:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380147712:12345-0@lo:38:kworker.0 Request processed in 71us (5363us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320966.114835:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18185
00000100:00100000:3.0:1767320966.114849:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18186
00000100:00100000:3.0:1767320966.114853:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380147968:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320966.114862:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320966.115028:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380147968:12345-0@lo:38:kworker.0 Request processed in 172us (5511us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320966.115035:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18186
00000100:00100000:3.0:1767320966.115128:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380147840:0@lo:400:kworker.0
00000100:00080000:3.0:1767320966.115564:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767320966.115602:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320966.115609:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320966.115613:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06003800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380147712:0@lo:38:kworker.0
00000100:00080000:3.0:1767320966.115625:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320966.115629:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320966.115632:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380147968:0@lo:38:kworker.0
00000100:00080000:3.0:1767320966.115641:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320966.115644:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320966.115647:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380147072:0@lo:38:kworker.0
00000100:00100000:0.0:1767320966.120128:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320966.120229:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147328
00000100:00100000:3.0:1767320966.120247:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147328
00000100:00100000:0.0:1767320966.120293:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320966.120355:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380147456
00000100:00100000:3.0:1767320966.120362:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380147456
00000100:00100000:0.0:1767320966.120399:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066
00000100:00100000:0.0:1767320966.120421:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380147328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320966.120433:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067
00000100:00100000:3.0:1767320966.120449:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380147456:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320966.120568:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380147456:12345-0@lo:400:kworker.0 Request processed in 125us (277us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320966.120576:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067
00000100:00080000:3.0:1767320966.120602:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767320966.123919:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380147200:12345-0@lo:38:kworker.0 Request processed in 14314us (14507us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320966.123938:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285
00000100:00100000:1.0:1767320966.124087:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380147456:0@lo:400:kworker.0
00000100:00080000:3.0:1767320966.124338:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320966.124346:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320966.124350:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380147200:0@lo:38:kworker.0
00000100:00100000:2.0:1767320966.131992:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380147584:12345-0@lo:400:kworker.0 Request processed in 22361us (23380us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320966.132013:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5162
00000100:00100000:0.0:1767320966.132933:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380147328:12345-0@lo:400:kworker.0 Request processed in 12517us (18847us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320966.132948:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066
00000100:00100000:1.0:1767320966.133364:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380147328:0@lo:400:kworker.0
00000100:00100000:3.0:1767320966.133552:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06001180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380147584:0@lo:400:kworker.0
00000100:00100000:0.0:1767320966.615231:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380148096:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320966.615342:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320966.615512:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380148096
00000100:00100000:1.0:1767320966.615524:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380148096
00000100:00100000:1.0:1767320966.615599:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883
00000100:00100000:1.0:1767320966.615611:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380148096:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320966.615659:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320966.615735:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380148096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (392us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320966.615744:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883
00000100:00100000:0.0:1767320966.616123:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380148096:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320966.679272:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320967.703135:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320968.727137:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320969.751280:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320970.199889:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320970.199918:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380148224:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320970.200027:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320970.200204:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320945/real 1767320945]  req@ffff8b0f3964c380 x1853164380141824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320970 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767320970.200233:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f3964c380 x1853164380141824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320970 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767320970.200248:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320970.200258:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767320970.200262:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380141824:0@lo:250:kworker.0
00000100:00080000:0.0:1767320970.200477:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320970.200484:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767320970.200488:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320970.200493:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5848
00000100:00080000:0.0:1767320970.200498:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320970.200505:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320970.200530:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03609f80 x1853164380148352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320970.200546:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320970.200550:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320970.200552:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320970.200555:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5868
00000100:00080000:0.0:1767320970.200558:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320970.200561:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320970.200576:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164380148480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320970.200584:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320970.200587:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320970.200589:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320970.200593:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5868
00000100:00080000:0.0:1767320970.200595:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320970.200598:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320970.200608:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360b100 x1853164380148608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320970.200653:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320970.200656:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320970.200658:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320970.200661:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5868
00000100:00080000:0.0:1767320970.200664:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320970.200668:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320970.200677:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162aa00 x1853164380148992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320970.200697:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320970.200701:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320970.200703:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320970.200706:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5868
00000100:00080000:0.0:1767320970.200709:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320970.200712:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320970.200724:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0162b100 x1853164380149248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320970.200894:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380149120:0@lo:400:kworker.0
00000100:00100000:0.0:1767320970.200941:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320970.201267:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380148352:0@lo:250:kworker.0
00000400:00000100:2.0:1767320970.201297:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380148352 offset 0 length 520: 4
00000100:00100000:2.0:1767320970.201324:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380148480:0@lo:38:kworker.0
00000100:00100000:2.0:1767320970.201345:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320970.201375:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380148608:0@lo:38:kworker.0
00000100:00100000:2.0:1767320970.201402:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320970.201420:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380148992:0@lo:38:kworker.0
00000100:00100000:2.0:1767320970.201456:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320970.201472:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380149248:0@lo:38:kworker.0
00000100:00100000:2.0:1767320970.201492:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320970.201527:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380149120
00000100:00100000:2.0:1767320970.201537:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380149120
00000100:00100000:2.0:1767320970.201598:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380148480
00000100:00100000:2.0:1767320970.201601:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380148480
00000100:00100000:2.0:1767320970.201615:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380148992
00000100:00100000:2.0:1767320970.201617:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380148992
00000100:00100000:2.0:1767320970.201625:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380149248
00000100:00100000:2.0:1767320970.201628:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380149248
00000100:00100000:2.0:1767320970.201653:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5163
00000100:00100000:2.0:1767320970.201665:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380149120:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320970.201726:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380149120:12345-0@lo:400:kworker.0 Request processed in 64us (783us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320970.201734:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5163
00000100:00100000:2.0:1767320970.201755:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18187
00000100:00100000:2.0:1767320970.201760:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380148480:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320970.201783:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320970.201818:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380148480:12345-0@lo:38:kworker.0 Request processed in 56us (472us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320970.201825:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18187
00000100:00100000:2.0:1767320970.201835:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18188
00000100:00100000:2.0:1767320970.201839:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380148992:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320970.201848:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320970.201941:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380148992:12345-0@lo:38:kworker.0 Request processed in 29us (413us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320970.201948:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18188
00000100:00100000:2.0:1767320970.201959:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18189
00000100:00100000:2.0:1767320970.201963:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380149248:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320970.202141:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320970.202171:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380149248:12345-0@lo:38:kworker.0 Request processed in 207us (678us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320970.202177:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18189
00000100:00080000:2.0:1767320970.202233:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320970.202238:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320970.202242:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380148480:0@lo:38:kworker.0
00000100:00080000:2.0:1767320970.202252:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320970.202255:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320970.202258:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380148992:0@lo:38:kworker.0
00000100:00080000:2.0:1767320970.202265:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320970.202268:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320970.202270:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380149248:0@lo:38:kworker.0
00000100:00100000:2.0:1767320970.202323:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380148608
00000100:00100000:2.0:1767320970.202327:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380148608
00000100:00100000:2.0:1767320970.202350:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286
00000100:00100000:2.0:1767320970.202355:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380148608:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320970.202364:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320970.202397:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380148608:12345-0@lo:38:kworker.0 Request processed in 40us (994us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320970.202403:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286
00000100:00080000:2.0:1767320970.202436:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320970.202440:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320970.202444:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380148608:0@lo:38:kworker.0
00000100:00100000:0.0:1767320970.202925:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380149120:0@lo:400:kworker.0
00000100:00100000:1.0:1767320970.203237:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380148224
00000100:00100000:1.0:1767320970.203246:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380148224
00000100:00100000:1.0:1767320970.203303:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884
00000100:00100000:1.0:1767320970.203312:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380148224:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767320970.203346:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320970.203408:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380148224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (3382us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320970.203416:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884
00000100:00100000:0.0:1767320970.204393:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380148224:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320970.205389:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380148736:0@lo:400:kworker.0
00000100:00100000:3.0:1767320970.205490:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320970.205567:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767320970.205576:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380148864:0@lo:400:kworker.0
00000100:00100000:3.0:1767320970.205605:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320970.205661:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380148864
00000100:00100000:3.0:1767320970.205669:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380148864
00000100:00100000:3.0:1767320970.205719:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5164
00000100:00100000:3.0:1767320970.205728:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380148864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320970.205804:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380148864:12345-0@lo:400:kworker.0 Request processed in 75us (197us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320970.205812:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5164
00000100:00080000:3.0:1767320970.205842:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767320970.205848:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320970.206692:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380148864:0@lo:400:kworker.0
00000100:00100000:1.0:1767320970.207372:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380148736
00000100:00100000:1.0:1767320970.207384:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380148736
00000100:00100000:1.0:1767320970.207485:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068
00000100:00100000:1.0:1767320970.207497:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380148736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320970.207597:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380148736:12345-0@lo:400:kworker.0 Request processed in 103us (2107us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320970.207604:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068
00000100:00080000:3.0:1767320970.207758:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767320970.207841:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380148736:0@lo:400:kworker.0
00010000:00010000:2.0:1767320970.775362:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320971.154864:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320971.155143:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320971.155213:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004096
00000100:00100000:3.0:1767320971.155224:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004096
00000100:00100000:3.0:1767320971.155273:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004224
00000100:00100000:3.0:1767320971.155277:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004224
00000100:00100000:3.0:1767320971.155347:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5165
00000100:00100000:3.0:1767320971.155357:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292004224:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320971.155446:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292004224:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (302us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320971.155456:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5165
00000100:00100000:0.0:1767320971.155469:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18190
00000100:00100000:0.0:1767320971.155477:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292004096:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767320971.155511:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767320971.155541:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292004096:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 64us (687us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320971.155548:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18190
00000100:00080000:1.0:1767320971.155660:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320971.735833:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380149376:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320971.735930:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320971.736056:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380149376
00000100:00100000:1.0:1767320971.736065:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380149376
00000100:00100000:1.0:1767320971.736125:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885
00000100:00100000:1.0:1767320971.736134:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380149376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320971.736162:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320971.736216:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380149376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (285us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320971.736223:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885
00000100:00100000:0.0:1767320971.736893:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380149376:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320971.799470:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320972.823076:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320973.847897:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320974.871119:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767320975.321845:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320975.321856:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320975.321859:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320975.321863:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320975.321867:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320975.321891:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5872
00000100:00080000:0.0:1767320975.321896:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320975.321904:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320975.321948:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628000 x1853164380149504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320975.321986:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320975.321990:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320975.321992:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320975.322002:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5872
00000100:00080000:0.0:1767320975.322005:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320975.322008:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320975.322021:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629180 x1853164380149632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320975.322073:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320975.322076:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320975.322078:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320975.322082:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5872
00000100:00080000:0.0:1767320975.322085:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320975.322088:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320975.322100:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01628e00 x1853164380150144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320975.322115:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320975.322119:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320975.322120:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320975.322124:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5872
00000100:00080000:0.0:1767320975.322126:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320975.322130:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320975.322140:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e01629c00 x1853164380150400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320975.322173:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380149760:0@lo:400:kworker.0
00000100:00100000:0.0:1767320975.322254:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320975.322328:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320975.322334:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380149888:0@lo:400:kworker.0
00000100:00100000:0.0:1767320975.322359:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320975.322386:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380150272:0@lo:400:kworker.0
00000100:00100000:0.0:1767320975.322412:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320975.322431:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767320975.322435:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380150016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320975.322456:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320975.322489:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150272
00000100:00100000:0.0:1767320975.322497:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150272
00000100:00100000:0.0:1767320975.322544:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150016
00000100:00100000:0.0:1767320975.322546:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150016
00000100:00100000:0.0:1767320975.322566:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5166
00000100:00100000:0.0:1767320975.322574:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380150272:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320975.322649:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380150272:12345-0@lo:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320975.322658:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5166
00000100:00100000:0.0:1767320975.322680:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5167
00000100:00100000:0.0:1767320975.322687:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380150016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320975.322715:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380150016:12345-0@lo:400:kworker.0 Request processed in 28us (258us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320975.322720:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5167
00000100:00100000:0.0:1767320975.322758:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380150016:0@lo:400:kworker.0
00000100:00100000:0.0:1767320975.322769:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380150272:0@lo:400:kworker.0
00000100:00100000:3.0:1767320975.323498:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380149504:0@lo:38:kworker.0
00000100:00100000:3.0:1767320975.323540:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320975.323578:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380149632:0@lo:38:kworker.0
00000100:00100000:3.0:1767320975.323616:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320975.323657:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380150144:0@lo:38:kworker.0
00000100:00100000:3.0:1767320975.323678:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320975.323693:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380150400:0@lo:38:kworker.0
00000100:00100000:3.0:1767320975.323712:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320975.323746:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380149632
00000100:00100000:3.0:1767320975.323751:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380149632
00000100:00100000:3.0:1767320975.323787:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287
00000100:00100000:3.0:1767320975.323794:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380149632:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320975.323812:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320975.323851:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380149632:12345-0@lo:38:kworker.0 Request processed in 57us (234us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320975.323857:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287
00000100:00100000:3.0:1767320975.323913:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380149504
00000100:00100000:3.0:1767320975.323918:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380149504
00000100:00100000:3.0:1767320975.323936:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150144
00000100:00100000:3.0:1767320975.323938:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150144
00000100:00100000:3.0:1767320975.323948:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150400
00000100:00100000:3.0:1767320975.323950:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150400
00000100:00100000:3.0:1767320975.323959:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18191
00000100:00100000:3.0:1767320975.323963:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380149504:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320975.323986:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320975.324021:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380149504:12345-0@lo:38:kworker.0 Request processed in 56us (481us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320975.324026:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18191
00000100:00100000:3.0:1767320975.324036:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18192
00000100:00100000:3.0:1767320975.324040:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380150144:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320975.324048:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320975.324069:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380150144:12345-0@lo:38:kworker.0 Request processed in 28us (391us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320975.324074:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18192
00000100:00100000:3.0:1767320975.324083:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18193
00000100:00100000:3.0:1767320975.324087:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380150400:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320975.324095:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320975.324117:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380150400:12345-0@lo:38:kworker.0 Request processed in 29us (404us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320975.324121:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18193
00000100:00080000:3.0:1767320975.324157:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320975.324162:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320975.324165:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380149504:0@lo:38:kworker.0
00000100:00080000:3.0:1767320975.324176:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320975.324179:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320975.324181:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380149632:0@lo:38:kworker.0
00000100:00080000:3.0:1767320975.324187:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320975.324191:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320975.324194:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380150144:0@lo:38:kworker.0
00000100:00080000:3.0:1767320975.324200:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320975.324202:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320975.324205:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380150400:0@lo:38:kworker.0
00000100:00100000:2.0:1767320975.324656:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380149760
00000100:00100000:2.0:1767320975.324660:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380149760
00000100:00100000:2.0:1767320975.324697:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380149888
00000100:00100000:2.0:1767320975.324700:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380149888
00000100:00100000:2.0:1767320975.324721:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069
00000100:00100000:2.0:1767320975.324728:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f31e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380149760:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320975.324769:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f31e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380149760:12345-0@lo:400:kworker.0 Request processed in 42us (2514us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320975.324775:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069
00000100:00100000:2.0:1767320975.325043:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070
00000100:00100000:2.0:1767320975.325050:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380149888:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320975.325079:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380149888:12345-0@lo:400:kworker.0 Request processed in 29us (2719us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320975.325084:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070
00000100:00100000:2.0:1767320975.325114:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767320975.325125:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380150528:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767320975.325152:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320975.325654:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320975.325659:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320975.325662:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320975.326393:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150528
00000100:00100000:3.0:1767320975.326402:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150528
00000100:00100000:3.0:1767320975.326455:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886
00000100:00100000:3.0:1767320975.326464:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380150528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320975.326492:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320975.326559:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380150528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (1405us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320975.326566:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886
00000100:00100000:3.0:1767320975.326625:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0162b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380149888:0@lo:400:kworker.0
00000100:00100000:3.0:1767320975.326850:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380149760:0@lo:400:kworker.0
00000100:00100000:2.0:1767320975.327432:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380150528:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320975.896705:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320976.283525:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320976.283610:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320976.283715:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004352
00000100:00100000:3.0:1767320976.283728:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004352
00000100:00100000:3.0:1767320976.283786:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004480
00000100:00100000:3.0:1767320976.283790:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004480
00000100:00100000:3.0:1767320976.283848:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5168
00000100:00100000:3.0:1767320976.283859:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292004480:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320976.283975:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292004480:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 118us (395us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320976.283984:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5168
00000100:00100000:3.0:1767320976.284002:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18194
00000100:00100000:3.0:1767320976.284007:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292004352:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320976.284027:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320976.284053:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292004352:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 45us (539us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320976.284059:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18194
00000100:00080000:1.0:1767320976.284383:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320976.855429:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767320976.855451:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380150656:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767320976.855523:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320976.855671:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150656
00000100:00100000:1.0:1767320976.855679:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150656
00000100:00100000:1.0:1767320976.855737:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887
00000100:00100000:1.0:1767320976.855746:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380150656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320976.855775:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320976.855823:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380150656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (300us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320976.855831:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887
00000100:00100000:0.0:1767320976.855927:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380150656:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320976.919849:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320977.943199:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320978.967421:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320979.991117:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767320980.439017:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320980.439036:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767320980.439040:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320980.439044:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320980.439050:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320980.439058:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5877
00000100:00080000:1.0:1767320980.439062:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320980.439070:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320980.439110:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafce00 x1853164380150784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320980.439141:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320980.439145:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320980.439147:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320980.439152:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5877
00000100:00080000:1.0:1767320980.439154:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320980.439158:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320980.439186:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafc380 x1853164380150912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320980.439234:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320980.439237:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320980.439239:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320980.439242:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5877
00000100:00080000:1.0:1767320980.439245:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320980.439248:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320980.439270:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bafdc00 x1853164380151552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767320980.439289:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767320980.439292:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767320980.439294:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767320980.439297:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5877
00000100:00080000:1.0:1767320980.439299:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767320980.439302:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767320980.439311:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0baff100 x1853164380151808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320980.439380:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380151168:0@lo:400:kworker.0
00000100:00100000:0.0:1767320980.439453:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320980.439527:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3]
00000100:00100000:0.0:1767320980.439533:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380151040:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767320980.439793:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320980.439813:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380151680:0@lo:400:kworker.0
00000100:00100000:0.0:1767320980.439833:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320980.439863:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151680
00000100:00100000:0.0:1767320980.439889:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151680
00000100:00100000:0.0:1767320980.439952:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5169
00000100:00100000:3.0:1767320980.439962:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380151424:0@lo:400:kworker.0
00000100:00100000:0.0:1767320980.439964:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380151680:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320980.440000:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320980.440031:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767320980.440040:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380151296:0@lo:400:kworker.0
00000100:00100000:0.0:1767320980.440045:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380151680:12345-0@lo:400:kworker.0 Request processed in 83us (208us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320980.440054:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5169
00000100:00100000:3.0:1767320980.440073:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320980.440074:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151424
00000100:00100000:0.0:1767320980.440079:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151424
00000100:00100000:0.0:1767320980.440111:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5170
00000100:00100000:0.0:1767320980.440118:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380151424:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320980.440144:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380150784:0@lo:38:kworker.0
00000100:00100000:0.0:1767320980.440155:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380151424:12345-0@lo:400:kworker.0 Request processed in 37us (153us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320980.440162:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5170
00000100:00100000:3.0:1767320980.440175:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320980.440229:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151168
00000100:00100000:2.0:1767320980.440233:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151168
00000100:00100000:2.0:1767320980.440263:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151296
00000100:00100000:2.0:1767320980.440266:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151296
00000100:00100000:2.0:1767320980.440288:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071
00000100:00100000:2.0:1767320980.440295:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380151168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320980.440349:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380150912:0@lo:38:kworker.0
00000100:00080000:1.0:1767320980.440372:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767320980.440378:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767320980.440380:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320980.440394:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072
00000100:00100000:1.0:1767320980.440403:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380151296:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320980.440438:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150784
00000100:00100000:0.0:1767320980.440443:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150784
00000100:00100000:0.0:1767320980.440465:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18195
00000100:00100000:0.0:1767320980.440481:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380150784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767320980.440499:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320980.443163:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380151168:12345-0@lo:400:kworker.0 Request processed in 2857us (3698us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320980.443179:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071
00000100:00100000:2.0:1767320980.443297:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380151424:0@lo:400:kworker.0
00000100:00100000:2.0:1767320980.443357:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380151680:0@lo:400:kworker.0
00000100:00100000:2.0:1767320980.443369:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380151168:0@lo:400:kworker.0
00000100:00100000:2.0:1767320980.443403:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151040
00000100:00100000:2.0:1767320980.443410:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151040
00000100:00100000:2.0:1767320980.445971:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888
00000100:00100000:2.0:1767320980.445998:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380151040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320980.446124:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320980.446222:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380151040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 234us (6423us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320980.446231:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888
00000100:00100000:2.0:1767320980.446303:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380151040:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320980.449066:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320980.449138:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380151552:0@lo:38:kworker.0
00000100:00100000:2.0:1767320980.449153:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380150912
00000100:00100000:2.0:1767320980.449163:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380150912
00000100:00100000:3.0:1767320980.449176:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320980.449200:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380151808:0@lo:38:kworker.0
00000100:00100000:2.0:1767320980.449209:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288
00000100:00100000:2.0:1767320980.449220:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380150912:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767320980.449226:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00010000:00020000:2.0:1767320980.449249:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320980.449297:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151552
00000100:00100000:2.0:1767320980.449319:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380150912:12345-0@lo:38:kworker.0 Request processed in 99us (259us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320980.449327:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288
00000100:00100000:2.0:1767320980.449349:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151808
00000100:00100000:2.0:1767320980.449353:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151808
00000100:00100000:2.0:1767320980.449374:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18196
00000100:00100000:2.0:1767320980.449379:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380151808:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767320980.449388:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320980.449416:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380151808:12345-0@lo:38:kworker.0 Request processed in 35us (193us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320980.449421:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18196
00000100:00080000:2.0:1767320980.449494:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320980.449500:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320980.449503:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380150912:0@lo:38:kworker.0
00000100:00080000:2.0:1767320980.449515:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767320980.449518:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767320980.449521:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0baff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380151808:0@lo:38:kworker.0
00000100:00100000:1.0:1767320980.449816:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380151296:12345-0@lo:400:kworker.0 Request processed in 9414us (9744us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320980.449825:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072
00000100:00100000:2.0:1767320980.449925:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380151296:0@lo:400:kworker.0
00000100:00100000:3.0:1767320980.450071:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151552
00000100:00100000:3.0:1767320980.450106:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18197
00000100:00100000:3.0:1767320980.450112:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380151552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320980.450124:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320980.450168:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380151552:12345-0@lo:38:kworker.0 Request processed in 55us (992us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320980.450175:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18197
00000100:00080000:1.0:1767320980.450415:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320980.450428:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320980.450431:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380151552:0@lo:38:kworker.0
00000100:00100000:0.0:1767320980.450803:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380150784:12345-0@lo:38:kworker.0 Request processed in 10329us (10627us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767320980.450811:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18195
00000100:00080000:1.0:1767320980.450932:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320980.450937:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320980.450941:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380150784:0@lo:38:kworker.0
00010000:00010000:2.0:1767320981.020836:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320981.396324:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320981.396430:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004736
00000100:00100000:2.0:1767320981.396440:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004736
00000100:00100000:2.0:1767320981.396521:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5171
00000100:00100000:2.0:1767320981.396543:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292004736:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767320981.396597:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320981.396629:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292004736:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 99us (314us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320981.396637:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5171
00000100:00100000:3.0:1767320981.398353:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320981.398444:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004608
00000100:00100000:2.0:1767320981.398452:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004608
00000100:00100000:2.0:1767320981.398490:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18198
00000100:00100000:2.0:1767320981.398497:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292004608:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320981.398517:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320981.398570:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292004608:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 73us (223us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320981.398577:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18198
00000100:00100000:3.0:1767320981.975227:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767320981.975248:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380151936:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1767320981.975323:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320981.975606:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380151936
00000100:00100000:1.0:1767320981.975616:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380151936
00000100:00100000:1.0:1767320981.975672:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889
00000100:00100000:1.0:1767320981.975682:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380151936:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767320981.975713:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767320981.975770:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06003480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380151936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (446us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320981.975778:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889
00000100:00100000:3.0:1767320981.975959:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380151936:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767320982.039372:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320983.065938:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320984.091363:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320985.112924:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767320985.559472:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320985.559481:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320985.559484:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320985.559488:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320985.559501:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320985.559509:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5882
00000100:00080000:2.0:1767320985.559514:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320985.559521:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320985.559547:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f38199180 x1853164380152192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320985.559554:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380152064:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767320985.559587:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320985.559592:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320985.559593:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320985.559597:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5882
00000100:00080000:2.0:1767320985.559600:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320985.559604:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320985.559617:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819ad80 x1853164380152320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320985.559625:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320985.559694:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:2.0:1767320985.559698:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320985.559702:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1767320985.559704:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380152448:0@lo:400:kworker.0
00000100:00080000:2.0:1767320985.559705:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320985.559712:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5882
00000100:00080000:2.0:1767320985.559715:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320985.559719:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320985.559731:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3819a300 x1853164380152832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320985.559740:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320985.559775:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152064
00000100:00100000:0.0:1767320985.559782:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152064
00000100:00080000:2.0:1767320985.559788:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320985.559792:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320985.559794:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320985.559798:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5882
00000100:00080000:2.0:1767320985.559800:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320985.559804:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320985.559818:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0bef7480 x1853164380153088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320985.559840:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890
00000100:00100000:0.0:1767320985.559852:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380152064:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767320985.559914:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320985.559954:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380152064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (334us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320985.559961:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890
00000100:00100000:2.0:1767320985.560002:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320985.560004:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152448
00000100:00100000:0.0:1767320985.560009:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152448
00000100:00100000:2.0:1767320985.560015:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380152960:0@lo:400:kworker.0
00000100:00100000:0.0:1767320985.560038:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073
00000100:00100000:0.0:1767320985.560046:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380152448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320985.560053:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320985.560092:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380152448:12345-0@lo:400:kworker.0 Request processed in 46us (353us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320985.560099:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073
00000100:00100000:2.0:1767320985.560107:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152960
00000100:00100000:2.0:1767320985.560112:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152960
00000100:00080000:0.0:1767320985.560119:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320985.560125:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767320985.560145:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5172
00000100:00100000:2.0:1767320985.560153:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380152960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320985.560155:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380152704:0@lo:400:kworker.0
00000100:00100000:0.0:1767320985.560193:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320985.560200:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380152960:12345-0@lo:400:kworker.0 Request processed in 47us (149us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320985.560207:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5172
00000100:00100000:0.0:1767320985.560217:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767320985.560220:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152704
00000100:00100000:2.0:1767320985.560224:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152704
00000100:00100000:0.0:1767320985.560226:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380152576:0@lo:400:kworker.0
00000100:00100000:2.0:1767320985.560253:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5173
00000100:00100000:0.0:1767320985.560259:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320985.560264:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380152704:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320985.560298:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152576
00000100:00100000:2.0:1767320985.560300:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380152704:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320985.560304:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152576
00000100:00100000:2.0:1767320985.560308:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5173
00000100:00100000:0.0:1767320985.560340:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074
00000100:00100000:0.0:1767320985.560448:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380152576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320985.560484:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380152576:12345-0@lo:400:kworker.0 Request processed in 136us (227us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320985.560668:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380152192:0@lo:38:kworker.0
00000100:00100000:1.0:1767320985.560708:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320985.560713:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380152448:0@lo:400:kworker.0
00000100:00100000:1.0:1767320985.560735:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380152320:0@lo:38:kworker.0
00000100:00100000:3.0:1767320985.560737:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380152064:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320985.560763:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320985.560787:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380152832:0@lo:38:kworker.0
00000100:00100000:1.0:1767320985.560809:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320985.560823:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152192
00000100:00100000:1.0:1767320985.560827:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380153088:0@lo:38:kworker.0
00000100:00100000:3.0:1767320985.560829:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152192
00000100:00100000:1.0:1767320985.560851:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320985.560975:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380152576:0@lo:400:kworker.0
00000100:00100000:1.0:1767320985.560999:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380152704:0@lo:400:kworker.0
00000100:00100000:1.0:1767320985.561032:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152320
00000100:00100000:1.0:1767320985.561035:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152320
00000100:00100000:1.0:1767320985.561058:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289
00000100:00100000:1.0:1767320985.561062:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380152320:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320985.561079:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320985.561113:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380152320:12345-0@lo:38:kworker.0 Request processed in 49us (350us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320985.561119:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289
00000100:00100000:3.0:1767320985.562692:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380152832
00000100:00100000:3.0:1767320985.562708:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380152832
00000100:00100000:3.0:1767320985.562749:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153088
00000100:00100000:3.0:1767320985.562753:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153088
00000100:00100000:3.0:1767320985.562766:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18199
00000100:00100000:3.0:1767320985.562774:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380152192:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320985.562794:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320985.562863:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380152192:12345-0@lo:38:kworker.0 Request processed in 88us (2154us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320985.562884:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18199
00000100:00100000:3.0:1767320985.562902:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18200
00000100:00100000:3.0:1767320985.562906:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380152832:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320985.562915:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320985.562940:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380152832:12345-0@lo:38:kworker.0 Request processed in 32us (2130us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320985.562945:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18200
00000100:00100000:3.0:1767320985.562956:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18201
00000100:00100000:3.0:1767320985.562959:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380153088:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320985.562968:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320985.562990:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380153088:12345-0@lo:38:kworker.0 Request processed in 29us (2140us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320985.562996:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18201
00000100:00080000:3.0:1767320985.563061:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767320985.563067:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767320985.563106:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380152960:0@lo:400:kworker.0
00000100:00080000:3.0:1767320985.563150:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320985.563155:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320985.563158:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380152192:0@lo:38:kworker.0
00000100:00080000:3.0:1767320985.563167:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320985.563170:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320985.563186:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380152320:0@lo:38:kworker.0
00000100:00080000:3.0:1767320985.563196:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320985.563199:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320985.563202:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380152832:0@lo:38:kworker.0
00000100:00080000:3.0:1767320985.563213:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767320985.563216:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767320985.563219:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380153088:0@lo:38:kworker.0
00000100:00100000:0.0:1767320985.569301:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074
00010000:00010000:1.0:1767320986.135418:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767320986.512718:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320986.512764:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320986.520715:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004992
00000100:00100000:1.0:1767320986.520731:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004992
00000100:00080000:3.0:1767320986.520884:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320986.520953:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292004864
00000100:00100000:1.0:1767320986.520957:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292004864
00000100:00100000:1.0:1767320986.520981:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5174
00000100:00100000:1.0:1767320986.520991:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292004992:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320986.521197:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18202
00000100:00100000:3.0:1767320986.521204:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292004864:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320986.521224:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320986.521255:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292004864:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 50us (8490us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320986.521262:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18202
00000100:00100000:1.0:1767320986.521553:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292004992:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (8368us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320986.521561:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5174
00000100:00100000:1.0:1767320987.095203:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767320987.095226:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380153216:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320987.095290:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320987.095341:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153216
00000100:00100000:3.0:1767320987.095360:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153216
00000100:00100000:3.0:1767320987.095430:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891
00000100:00100000:3.0:1767320987.095439:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380153216:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767320987.095463:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767320987.095526:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320987.095582:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380153216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (290us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320987.095592:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891
00000100:00100000:0.0:1767320987.096326:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380153216:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320987.159193:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320988.183127:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320989.207378:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320990.231514:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:0.0:1767320990.615107:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292005120 offset 0 length 520: 4
00000100:00100000:0.0:1767320990.615307:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767320990.615342:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767320990.618113:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292005248
00000100:00100000:3.0:1767320990.618113:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292005376
00000100:00100000:2.0:1767320990.618128:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292005248
00000100:00100000:3.0:1767320990.618128:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292005376
00000100:00100000:2.0:1767320990.618180:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18203
00000100:00100000:2.0:1767320990.618189:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292005248:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767320990.618211:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767320990.618287:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292005248:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 97us (2978us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767320990.618295:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18203
00000100:00100000:3.0:1767320990.618478:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5175
00000100:00100000:3.0:1767320990.618488:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292005376:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767320990.618531:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292005376:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 45us (3187us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320990.618538:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5175
00000100:00080000:1.0:1767320990.622750:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767320990.680741:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767320990.680767:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380153344:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767320990.680842:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320990.681045:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153344
00000100:00100000:3.0:1767320990.681054:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153344
00000100:00100000:3.0:1767320990.681126:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892
00000100:00100000:3.0:1767320990.681136:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380153344:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767320990.681165:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767320990.681217:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380153344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (374us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320990.681224:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892
00000100:00100000:3.0:1767320990.681270:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380153344:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767320990.681364:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767320990.681488:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320990.681493:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767320990.681495:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320990.681499:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320990.681502:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320990.681507:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5887
00000100:00080000:0.0:1767320990.681511:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320990.681515:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320990.681538:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964c700 x1853164380153472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320990.681560:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320990.681562:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320990.681564:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320990.681568:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5887
00000100:00080000:0.0:1767320990.681570:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320990.681573:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320990.681584:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964df80 x1853164380153600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320990.681639:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767320990.681707:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380153472:0@lo:38:kworker.0
00000100:00100000:1.0:1767320990.681739:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320990.681768:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380153600:0@lo:38:kworker.0
00000100:00100000:1.0:1767320990.681789:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320990.681901:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320990.681905:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320990.681906:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320990.681910:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5887
00000100:00080000:0.0:1767320990.681912:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320990.681915:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320990.681927:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964e300 x1853164380153984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767320990.681945:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767320990.681948:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767320990.681949:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767320990.681952:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5887
00000100:00080000:0.0:1767320990.681955:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767320990.681959:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767320990.681971:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f3964ca80 x1853164380154240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767320990.681991:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380154112:0@lo:400:kworker.0
00000100:00100000:0.0:1767320990.682018:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320990.682034:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767320990.682039:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380153856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320990.682055:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320990.682123:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380153984:0@lo:38:kworker.0
00000100:00100000:1.0:1767320990.682146:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320990.682170:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380154240:0@lo:38:kworker.0
00000100:00100000:1.0:1767320990.682189:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767320990.682359:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153600
00000100:00100000:3.0:1767320990.682364:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153600
00000100:00100000:3.0:1767320990.682396:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290
00000100:00100000:3.0:1767320990.682402:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380153600:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320990.682420:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320990.682466:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380153600:12345-0@lo:38:kworker.0 Request processed in 63us (676us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320990.682473:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290
00000100:00100000:3.0:1767320990.682494:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153472
00000100:00100000:3.0:1767320990.682498:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153472
00000100:00100000:3.0:1767320990.682514:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380154112
00000100:00100000:3.0:1767320990.682516:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380154112
00000100:00100000:3.0:1767320990.682537:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153856
00000100:00100000:3.0:1767320990.682539:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153856
00000100:00100000:3.0:1767320990.682549:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153984
00000100:00100000:3.0:1767320990.682551:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153984
00000100:00100000:3.0:1767320990.682557:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380154240
00000100:00100000:3.0:1767320990.682559:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380154240
00000100:00100000:3.0:1767320990.682569:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5176
00000100:00100000:3.0:1767320990.682575:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380154112:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320990.682613:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380154112:12345-0@lo:400:kworker.0 Request processed in 39us (595us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320990.682620:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5176
00000100:00100000:3.0:1767320990.682631:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5177
00000100:00100000:3.0:1767320990.682636:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380153856:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767320990.682661:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380153856:12345-0@lo:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0
00000100:00100000:3.0:1767320990.682667:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5177
00000100:00100000:3.0:1767320990.682678:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18204
00000100:00100000:3.0:1767320990.682682:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380153472:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320990.682690:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320990.682712:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380153472:12345-0@lo:38:kworker.0 Request processed in 29us (973us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320990.682718:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18204
00000100:00100000:3.0:1767320990.682728:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18205
00000100:00100000:3.0:1767320990.682732:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380153984:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320990.682740:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320990.682760:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380153984:12345-0@lo:38:kworker.0 Request processed in 27us (614us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320990.682765:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18205
00000100:00100000:3.0:1767320990.682774:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18206
00000100:00100000:3.0:1767320990.682778:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380154240:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767320990.682787:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320990.682810:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380154240:12345-0@lo:38:kworker.0 Request processed in 30us (620us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320990.682816:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18206
00000100:00080000:1.0:1767320990.682895:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320990.682919:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320990.682924:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320990.682927:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380153984:0@lo:38:kworker.0
00000100:00080000:1.0:1767320990.682935:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320990.682938:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320990.682941:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380154240:0@lo:38:kworker.0
00000100:00080000:1.0:1767320990.682948:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320990.682951:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320990.682953:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380153472:0@lo:38:kworker.0
00000100:00080000:1.0:1767320990.682960:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320990.682963:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320990.682966:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380153600:0@lo:38:kworker.0
00000100:00100000:0.0:1767320990.684356:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380153856:0@lo:400:kworker.0
00000100:00100000:0.0:1767320990.684371:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380154112:0@lo:400:kworker.0
00000100:00100000:2.0:1767320990.684508:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380153728:0@lo:400:kworker.0
00000100:00100000:2.0:1767320990.684560:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320990.684649:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380153728
00000100:00100000:0.0:1767320990.684655:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380153728
00000100:00100000:0.0:1767320990.684716:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075
00000100:00100000:0.0:1767320990.684725:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380153728:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320990.684781:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380153728:12345-0@lo:400:kworker.0 Request processed in 57us (220us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320990.684787:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075
00000100:00080000:1.0:1767320990.684849:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767320990.684945:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3964c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380153728:0@lo:400:kworker.0
00010000:00010000:2.0:1767320991.262680:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767320992.219842:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380154368:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767320992.219966:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320992.237429:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380154368
00000100:00100000:0.0:1767320992.237454:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380154368
00000100:00100000:0.0:1767320992.237632:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893
00000100:00100000:0.0:1767320992.237643:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380154368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767320992.237677:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767320992.237771:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380154368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (17804us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320992.237778:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893
00000100:00100000:0.0:1767320992.237846:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380154368:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767320992.243121:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:2.0:1767320992.279277:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320993.303672:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320994.332032:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320995.355305:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767320995.726711:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767320995.727043:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292005632
00000100:00100000:1.0:1767320995.727053:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292005632
00000100:00100000:1.0:1767320995.727134:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5178
00000100:00100000:1.0:1767320995.727146:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292005632:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767320995.727232:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01629180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292005632:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (530us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320995.727243:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5178
00000100:00080000:2.0:1767320995.727930:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320995.728083:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767320995.728154:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292005504
00000100:00100000:3.0:1767320995.728161:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292005504
00000100:00100000:3.0:1767320995.728207:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18207
00000100:00100000:3.0:1767320995.728214:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292005504:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767320995.728235:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767320995.728295:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292005504:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 71us (205us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767320995.728303:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18207
00000100:00080000:2.0:1767320995.799191:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320995.799201:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767320995.799204:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320995.799208:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320995.799212:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320995.799220:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5893
00000100:00080000:2.0:1767320995.799225:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320995.799232:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320995.799271:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06006d80 x1853164380154496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320995.799304:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320995.799308:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320995.799310:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320995.799313:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5893
00000100:00080000:2.0:1767320995.799316:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320995.799320:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320995.799333:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06005c00 x1853164380154624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320995.799389:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320995.799392:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320995.799394:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320995.799397:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5893
00000100:00080000:2.0:1767320995.799408:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320995.799411:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320995.799424:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360aa00 x1853164380155136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767320995.799438:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320995.799441:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767320995.799443:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320995.799446:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5893
00000100:00080000:2.0:1767320995.799448:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320995.799452:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320995.799459:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608380 x1853164380155392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320995.799489:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380154880:0@lo:400:kworker.0
00000100:00100000:2.0:1767320995.799559:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320995.799620:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767320995.799626:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380155008:0@lo:400:kworker.0
00000100:00100000:2.0:1767320995.799647:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320995.799676:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380154880
00000100:00100000:2.0:1767320995.799682:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380154880
00000100:00100000:2.0:1767320995.799732:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076
00000100:00100000:2.0:1767320995.799741:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380154880:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320995.799786:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380154880:12345-0@lo:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320995.799792:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076
00000100:00080000:2.0:1767320995.799809:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320995.799835:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380154880:0@lo:400:kworker.0
00000100:00100000:1.0:1767320995.800152:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320970/real 1767320970]  req@ffff8b0e03609f80 x1853164380148352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320995 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320995.800170:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e03609f80 x1853164380148352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767320995 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1767320995.800183:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380154496:0@lo:38:kworker.0
00000100:00100000:1.0:1767320995.800210:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320995.800228:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380154624:0@lo:38:kworker.0
00000100:00100000:1.0:1767320995.800245:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320995.800265:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380155136:0@lo:38:kworker.0
00000100:00100000:1.0:1767320995.800279:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767320995.800302:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380155392:0@lo:38:kworker.0
00000100:00100000:1.0:1767320995.800319:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767320995.800330:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320995.800339:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:1.0:1767320995.800342:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380148352:0@lo:250:kworker.0
00000100:00100000:1.0:1767320995.800365:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380154624
00000100:00100000:1.0:1767320995.800369:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380154624
00000100:00100000:1.0:1767320995.800386:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291
00000100:00100000:1.0:1767320995.800390:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380154624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320995.800418:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320995.800452:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380154624:12345-0@lo:38:kworker.0 Request processed in 59us (205us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320995.800461:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291
00000100:00100000:1.0:1767320995.800482:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380155008
00000100:00100000:1.0:1767320995.800486:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380155008
00000100:00100000:1.0:1767320995.800516:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380154496
00000100:00100000:1.0:1767320995.800518:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380154496
00000100:00100000:1.0:1767320995.800530:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380155136
00000100:00100000:1.0:1767320995.800532:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380155136
00000100:00100000:1.0:1767320995.800538:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380155392
00000100:00100000:1.0:1767320995.800541:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380155392
00000100:00100000:1.0:1767320995.800547:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5179
00000100:00100000:1.0:1767320995.800553:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380155008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767320995.800589:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380155008:12345-0@lo:400:kworker.0 Request processed in 35us (940us total) trans 0 rc 0/0
00000100:00100000:1.0:1767320995.800594:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5179
00000100:00100000:1.0:1767320995.800607:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18208
00000100:00100000:1.0:1767320995.800611:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380154496:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320995.800621:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320995.800642:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0baff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380154496:12345-0@lo:38:kworker.0 Request processed in 29us (430us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320995.800647:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18208
00000100:00100000:1.0:1767320995.800659:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18209
00000100:00100000:1.0:1767320995.800662:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380155136:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320995.800670:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320995.800689:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380155136:12345-0@lo:38:kworker.0 Request processed in 26us (409us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320995.800694:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18209
00000100:00100000:1.0:1767320995.800705:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18210
00000100:00100000:1.0:1767320995.800708:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380155392:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767320995.800717:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767320995.800736:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380155392:12345-0@lo:38:kworker.0 Request processed in 26us (416us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767320995.800742:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18210
00000100:00080000:1.0:1767320995.800756:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767320995.800774:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320995.800778:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320995.800781:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380154496:0@lo:38:kworker.0
00000100:00080000:1.0:1767320995.800789:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320995.800792:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320995.800794:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380154624:0@lo:38:kworker.0
00000100:00080000:1.0:1767320995.800800:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320995.800803:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320995.800805:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380155136:0@lo:38:kworker.0
00000100:00080000:1.0:1767320995.800811:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767320995.800813:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767320995.800815:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380155392:0@lo:38:kworker.0
00000100:00100000:1.0:1767320995.800846:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380155008:0@lo:400:kworker.0
00000100:00100000:0.0:1767320995.801165:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380155264:0@lo:400:kworker.0
00000100:00100000:0.0:1767320995.801203:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320995.801235:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767320995.801241:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380154752:0@lo:400:kworker.0
00000100:00100000:0.0:1767320995.801261:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767320995.801296:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380154752
00000100:00100000:0.0:1767320995.801301:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380154752
00000100:00100000:0.0:1767320995.801334:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077
00000100:00100000:0.0:1767320995.801340:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380154752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767320995.801373:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380154752:12345-0@lo:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1767320995.801378:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077
00000100:00080000:0.0:1767320995.801392:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767320995.801420:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380154752:0@lo:400:kworker.0
00000100:00080000:2.0:1767320995.801546:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767320995.801552:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767320995.801555:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767320995.801559:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5872
00000100:00080000:2.0:1767320995.801562:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767320995.801567:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767320995.801586:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608e00 x1853164380155520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767320995.801624:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380155264
00000100:00100000:2.0:1767320995.801628:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380155264
00000100:00100000:2.0:1767320995.801653:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5180
00000100:00100000:2.0:1767320995.801659:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380155264:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767320995.801693:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380155264:12345-0@lo:400:kworker.0 Request processed in 34us (488us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320995.801699:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5180
00000100:00100000:3.0:1767320995.802156:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380155648:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767320995.802193:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767320995.802445:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767320995.802457:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380155520:0@lo:250:kworker.0
00000400:00000100:0.0:1767320995.802481:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380155520 offset 0 length 520: 4
00000100:00100000:0.0:1767320995.802527:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380155264:0@lo:400:kworker.0
00000100:00100000:2.0:1767320995.802672:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380155648
00000100:00100000:2.0:1767320995.802677:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380155648
00000100:00100000:2.0:1767320995.802719:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894
00000100:00100000:2.0:1767320995.802728:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380155648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767320995.802756:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320995.802846:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380155648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (652us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320995.802853:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894
00000100:00100000:3.0:1767320995.808145:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380155648:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767320996.379221:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767320997.337539:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380155776:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767320997.337622:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767320997.337655:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380155776
00000100:00100000:2.0:1767320997.337663:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380155776
00000100:00080000:3.0:1767320997.337722:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767320997.337725:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895
00000100:00100000:2.0:1767320997.337734:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380155776:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767320997.337773:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767320997.337837:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380155776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (214us total) trans 0 rc 0/0
00000100:00100000:2.0:1767320997.337844:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895
00000100:00100000:1.0:1767320997.338657:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380155776:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767320997.399219:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767320998.423155:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767320999.447519:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321000.472958:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321000.848710:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321000.848799:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321000.848905:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292005888
00000100:00100000:3.0:1767321000.848916:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292005888
00000100:00100000:3.0:1767321000.849009:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292005760
00000100:00100000:3.0:1767321000.849013:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292005760
00000100:00100000:3.0:1767321000.849059:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5181
00000100:00100000:3.0:1767321000.849071:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292005888:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767321000.849146:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292005888:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (445us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321000.849154:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5181
00000100:00100000:3.0:1767321000.849171:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18211
00000100:00100000:3.0:1767321000.849177:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292005760:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321000.849211:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321000.849238:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292005760:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (438us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321000.849245:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18211
00000100:00080000:0.0:1767321000.849422:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767321000.919242:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321000.919268:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321000.919271:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321000.919276:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321000.919280:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321000.919287:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5898
00000100:00080000:2.0:1767321000.919292:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321000.919298:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321000.919335:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e03608380 x1853164380155904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321000.919372:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321000.919375:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321000.919378:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321000.919381:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5898
00000100:00080000:2.0:1767321000.919384:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321000.919388:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321000.919401:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0360aa00 x1853164380156032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321000.919473:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321000.919476:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321000.919478:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321000.919481:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5898
00000100:00080000:2.0:1767321000.919484:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321000.919487:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321000.919497:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06006a00 x1853164380156544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321000.919512:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321000.919515:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321000.919516:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321000.919519:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5898
00000100:00080000:2.0:1767321000.919521:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321000.919525:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321000.919536:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f06006d80 x1853164380156800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321000.919630:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380156288:0@lo:400:kworker.0
00000100:00100000:2.0:1767321000.919751:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321000.919810:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767321000.919817:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380156416:0@lo:400:kworker.0
00000100:00100000:2.0:1767321000.919842:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321000.919913:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156288
00000100:00100000:2.0:1767321000.919921:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156288
00000100:00100000:2.0:1767321000.919968:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078
00000100:00100000:0.0:1767321000.920289:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380155904:0@lo:38:kworker.0
00000100:00100000:0.0:1767321000.920320:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321000.920342:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380156032:0@lo:38:kworker.0
00000100:00100000:0.0:1767321000.920376:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321000.920400:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380156544:0@lo:38:kworker.0
00000100:00100000:0.0:1767321000.920422:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321000.920439:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380156800:0@lo:38:kworker.0
00000100:00100000:0.0:1767321000.920459:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321000.920494:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380156672:0@lo:400:kworker.0
00000100:00100000:0.0:1767321000.920518:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156032
00000100:00100000:0.0:1767321000.920523:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156032
00000100:00100000:1.0:1767321000.920530:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321000.920555:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292
00000100:00100000:1.0:1767321000.920559:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767321000.920562:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380156032:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767321000.920569:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380156160:0@lo:400:kworker.0
00010000:00020000:0.0:1767321000.920586:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321000.920595:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321000.920636:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380156032:12345-0@lo:38:kworker.0 Request processed in 73us (258us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321000.920643:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292
00000100:00100000:0.0:1767321000.920665:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380155904
00000100:00100000:0.0:1767321000.920668:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380155904
00000100:00100000:1.0:1767321000.920678:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156416
00000100:00100000:1.0:1767321000.920684:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156416
00000100:00100000:0.0:1767321000.920688:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156544
00000100:00100000:0.0:1767321000.920693:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156544
00000100:00100000:0.0:1767321000.920705:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156800
00000100:00100000:0.0:1767321000.920707:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156800
00000100:00100000:1.0:1767321000.920719:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156672
00000100:00100000:0.0:1767321000.920725:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5182
00000100:00100000:1.0:1767321000.920725:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156672
00000100:00100000:0.0:1767321000.920736:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380156416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321000.920749:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5183
00000100:00100000:1.0:1767321000.920758:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380156672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321000.920789:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380156416:12345-0@lo:400:kworker.0 Request processed in 53us (944us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321000.920795:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5182
00000100:00100000:1.0:1767321000.920809:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380156672:12345-0@lo:400:kworker.0 Request processed in 52us (278us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321000.920817:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18212
00000100:00100000:0.0:1767321000.920984:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380155904:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321000.920995:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321000.921022:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380155904:12345-0@lo:38:kworker.0 Request processed in 198us (700us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321000.921181:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380156288:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321000.921217:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380156288:12345-0@lo:400:kworker.0 Request processed in 1242us (1467us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321000.921224:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078
00000100:00100000:2.0:1767321000.921237:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156160
00000100:00100000:2.0:1767321000.921241:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156160
00000100:00100000:2.0:1767321000.921269:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079
00000100:00100000:2.0:1767321000.921275:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380156160:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321000.921303:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380156160:12345-0@lo:400:kworker.0 Request processed in 29us (708us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321000.921308:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079
00000100:00100000:1.0:1767321000.928884:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5183
00000100:00100000:1.0:1767321000.928941:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18213
00000100:00100000:1.0:1767321000.928949:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380156544:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767321000.928966:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18214
00010000:00020000:1.0:1767321000.928975:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321000.928978:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380156800:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321000.929003:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321000.929065:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380156544:12345-0@lo:38:kworker.0 Request processed in 115us (8641us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321000.929071:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380156800:12345-0@lo:38:kworker.0 Request processed in 93us (8608us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321000.929077:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18213
00000100:00100000:3.0:1767321000.929085:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18214
00000100:00100000:1.0:1767321000.929151:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380156160:0@lo:400:kworker.0
00000100:00100000:1.0:1767321000.929166:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380156672:0@lo:400:kworker.0
00000100:00100000:3.0:1767321000.929169:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380156928:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321000.929208:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767321000.929318:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321000.929325:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321000.929330:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380155904:0@lo:38:kworker.0
00000100:00080000:1.0:1767321000.929340:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321000.929343:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321000.929346:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380156032:0@lo:38:kworker.0
00000100:00080000:1.0:1767321000.929367:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321000.929371:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321000.929374:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380156544:0@lo:38:kworker.0
00000100:00080000:1.0:1767321000.929383:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321000.929387:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321000.929391:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380156800:0@lo:38:kworker.0
00000100:00080000:1.0:1767321000.929420:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767321000.929426:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767321000.929429:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767321000.929471:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380156928
00000100:00100000:3.0:1767321000.929478:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380156928
00000100:00100000:1.0:1767321000.929486:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380156416:0@lo:400:kworker.0
00000100:00100000:1.0:1767321000.929502:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03609180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380156288:0@lo:400:kworker.0
00000100:00100000:3.0:1767321000.929524:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896
00000100:00100000:3.0:1767321000.929534:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380156928:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321000.929562:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321000.929612:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380156928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (403us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321000.929618:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896
00000100:00100000:0.0:1767321000.931229:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18212
00000100:00100000:1.0:1767321000.936493:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380156928:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767321001.496689:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321002.455174:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767321002.455193:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380157056:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321002.455254:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321002.455494:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157056
00000100:00100000:3.0:1767321002.455501:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157056
00000100:00080000:1.0:1767321002.455582:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767321002.455608:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897
00000100:00100000:3.0:1767321002.455615:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f301ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380157056:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321002.455642:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321002.455716:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f301ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380157056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (461us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321002.455721:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897
00000100:00100000:2.0:1767321002.456009:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380157056:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321002.519258:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321003.543208:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321004.567180:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321005.591113:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321005.967673:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321005.967787:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292006144
00000100:00100000:2.0:1767321005.967808:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292006144
00000100:00080000:1.0:1767321005.967902:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321005.967918:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5184
00000100:00100000:2.0:1767321005.967930:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292006144:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321005.968006:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292006144:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 79us (342us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321005.968013:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5184
00000100:00100000:3.0:1767321005.972240:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321005.972352:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292006016
00000100:00100000:0.0:1767321005.972363:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292006016
00000100:00100000:0.0:1767321005.972414:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18215
00000100:00100000:0.0:1767321005.972423:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292006016:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767321005.972450:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321005.972524:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292006016:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 101us (293us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321005.972532:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18215
00000100:00080000:2.0:1767321006.039019:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321006.039032:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321006.039036:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321006.039040:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321006.039045:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321006.039055:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5903
00000100:00080000:2.0:1767321006.039060:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321006.039068:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321006.039117:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08eff800 x1853164380157184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321006.039143:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321006.039147:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321006.039149:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321006.039153:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5903
00000100:00080000:2.0:1767321006.039155:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321006.039159:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321006.039172:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efdf80 x1853164380157312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321006.039244:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321006.039247:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321006.039249:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321006.039253:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5903
00000100:00080000:2.0:1767321006.039255:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321006.039268:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321006.039279:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08effb80 x1853164380157824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321006.039294:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321006.039297:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321006.039299:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321006.039303:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5903
00000100:00080000:2.0:1767321006.039315:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321006.039320:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321006.039333:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164380158080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321006.039367:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380157568:0@lo:400:kworker.0
00000100:00100000:2.0:1767321006.039448:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321006.039479:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380157184:0@lo:38:kworker.0
00000100:00100000:2.0:1767321006.039516:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767321006.039523:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321006.039528:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380157696:0@lo:400:kworker.0
00000100:00100000:1.0:1767321006.039552:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380157312:0@lo:38:kworker.0
00000100:00100000:2.0:1767321006.039560:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321006.039585:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321006.039606:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157184
00000100:00100000:2.0:1767321006.039615:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157184
00000100:00100000:1.0:1767321006.039617:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380157824:0@lo:38:kworker.0
00000100:00100000:1.0:1767321006.039641:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321006.039653:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157696
00000100:00100000:2.0:1767321006.039658:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157696
00000100:00100000:1.0:1767321006.039661:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380158080:0@lo:38:kworker.0
00000100:00100000:1.0:1767321006.039683:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321006.039705:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157824
00000100:00100000:2.0:1767321006.039709:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157824
00000100:00100000:1.0:1767321006.039719:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157312
00000100:00100000:2.0:1767321006.039721:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158080
00000100:00100000:1.0:1767321006.039725:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157312
00000100:00100000:2.0:1767321006.039726:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158080
00000100:00100000:2.0:1767321006.039745:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5185
00000100:00100000:2.0:1767321006.039756:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380157696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321006.039760:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293
00000100:00100000:1.0:1767321006.039769:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380157312:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321006.039789:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321006.039826:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380157696:12345-0@lo:400:kworker.0 Request processed in 72us (265us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321006.039833:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380157312:12345-0@lo:38:kworker.0 Request processed in 61us (246us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321006.039838:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5185
00000100:00100000:1.0:1767321006.039845:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293
00000100:00100000:2.0:1767321006.039864:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18216
00000100:00100000:2.0:1767321006.039895:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380157184:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767321006.039898:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18217
00000100:00100000:1.0:1767321006.039906:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380157824:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321006.039911:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767321006.039918:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321006.039946:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380157184:12345-0@lo:38:kworker.0 Request processed in 50us (424us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321006.039956:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18216
00000100:00100000:1.0:1767321006.039957:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380157824:12345-0@lo:38:kworker.0 Request processed in 47us (313us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321006.039965:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18217
00000100:00100000:2.0:1767321006.039973:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18218
00000100:00100000:2.0:1767321006.039980:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380158080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321006.039990:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767321006.040003:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321006.040010:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321006.040014:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380157184:0@lo:38:kworker.0
00000100:00100000:2.0:1767321006.040021:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380158080:12345-0@lo:38:kworker.0 Request processed in 39us (336us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767321006.040027:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767321006.040028:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18218
00000100:00080000:1.0:1767321006.040035:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321006.040038:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380157312:0@lo:38:kworker.0
00000100:00080000:1.0:1767321006.040048:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321006.040053:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00080000:2.0:1767321006.040054:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321006.040056:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380157824:0@lo:38:kworker.0
00000100:00080000:1.0:1767321006.040067:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321006.040070:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321006.040074:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380158080:0@lo:38:kworker.0
00000100:00100000:2.0:1767321006.040088:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380157696:0@lo:400:kworker.0
00000100:00100000:0.0:1767321006.040180:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380157952:0@lo:400:kworker.0
00000100:00100000:0.0:1767321006.040209:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321006.040237:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767321006.040242:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380157440:0@lo:400:kworker.0
00000100:00100000:0.0:1767321006.040264:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321006.040298:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157952
00000100:00100000:0.0:1767321006.040302:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157952
00000100:00100000:0.0:1767321006.040349:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5186
00000100:00100000:0.0:1767321006.040355:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380157952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321006.040388:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380157952:12345-0@lo:400:kworker.0 Request processed in 33us (178us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321006.040393:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5186
00000100:00080000:0.0:1767321006.040409:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321006.040425:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380157952:0@lo:400:kworker.0
00000100:00100000:3.0:1767321006.040755:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157568
00000100:00100000:3.0:1767321006.040760:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157568
00000100:00100000:3.0:1767321006.040794:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380157440
00000100:00100000:3.0:1767321006.040797:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380157440
00000100:00100000:3.0:1767321006.040818:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080
00000100:00100000:3.0:1767321006.040825:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380157568:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321006.040889:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380157568:12345-0@lo:400:kworker.0 Request processed in 46us (1422us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321006.040895:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080
00000100:00100000:3.0:1767321006.040907:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081
00000100:00100000:3.0:1767321006.040914:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380157440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321006.040941:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380157440:12345-0@lo:400:kworker.0 Request processed in 28us (676us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321006.040947:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081
00000100:00080000:3.0:1767321006.041001:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767321006.041004:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767321006.041023:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380157440:0@lo:400:kworker.0
00000100:00100000:3.0:1767321006.041031:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767321006.041039:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380158208:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321006.041064:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321006.041093:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158208
00000100:00100000:3.0:1767321006.041097:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158208
00000100:00100000:3.0:1767321006.041124:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898
00000100:00100000:3.0:1767321006.041130:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380158208:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321006.041149:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321006.041184:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380158208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (118us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321006.041190:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898
00000100:00100000:3.0:1767321006.041223:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380158208:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321006.041247:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380157568:0@lo:400:kworker.0
00010000:00010000:1.0:1767321006.618524:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321007.575206:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767321007.575232:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380158336:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321007.575320:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321007.575456:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158336
00000100:00100000:3.0:1767321007.575464:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158336
00000100:00100000:3.0:1767321007.575561:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899
00000100:00100000:3.0:1767321007.575572:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380158336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321007.575614:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321007.575683:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380158336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (362us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321007.575691:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899
00000100:00100000:1.0:1767321007.575778:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38199500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380158336:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321007.639174:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321008.663117:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321009.687157:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321010.712517:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321011.087539:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321011.087595:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321011.087633:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292006272
00000100:00100000:2.0:1767321011.087645:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292006272
00000100:00100000:2.0:1767321011.087767:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292006400
00000100:00100000:2.0:1767321011.087772:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292006400
00000100:00080000:0.0:1767321011.087853:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321011.088099:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5187
00000100:00100000:3.0:1767321011.088113:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292006400:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767321011.088246:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292006400:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 137us (650us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321011.088255:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5187
00000100:00100000:3.0:1767321011.088287:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18219
00000100:00100000:3.0:1767321011.088292:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292006272:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321011.088328:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321011.088354:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292006272:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 60us (825us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321011.088361:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18219
00000100:00100000:2.0:1767321011.159614:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380158464:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321011.160223:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767321011.160384:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321011.160391:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767321011.160393:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321011.160397:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321011.160401:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321011.160422:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5908
00000100:00080000:1.0:1767321011.160426:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321011.160431:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321011.160487:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fc380 x1853164380158592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321011.160510:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321011.160513:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321011.160515:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321011.160520:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5908
00000100:00080000:1.0:1767321011.160522:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321011.160526:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321011.160537:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fc000 x1853164380158720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321011.160583:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321011.160586:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321011.160587:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321011.160590:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5908
00000100:00080000:1.0:1767321011.160593:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321011.160597:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321011.160606:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fce00 x1853164380159104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321011.160653:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1767321011.161317:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380159232:0@lo:400:kworker.0
00000100:00100000:0.0:1767321011.161364:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321011.162027:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380158848:0@lo:400:kworker.0
00000100:00100000:0.0:1767321011.162066:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321011.162101:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767321011.162107:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380158976:0@lo:400:kworker.0
00000100:00100000:0.0:1767321011.162130:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321011.162160:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158848
00000100:00100000:0.0:1767321011.162168:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158848
00000100:00100000:0.0:1767321011.162226:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082
00000100:00100000:0.0:1767321011.162236:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380158848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321011.162303:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380158848:12345-0@lo:400:kworker.0 Request processed in 67us (235us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321011.162311:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082
00000100:00080000:0.0:1767321011.162338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321011.162366:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380158848:0@lo:400:kworker.0
00000100:00100000:2.0:1767321011.162501:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380158592:0@lo:38:kworker.0
00000100:00100000:2.0:1767321011.162534:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321011.162554:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380158720:0@lo:38:kworker.0
00000100:00100000:2.0:1767321011.162575:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321011.162598:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380159104:0@lo:38:kworker.0
00000100:00100000:2.0:1767321011.162617:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767321011.162985:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321011.162989:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321011.162993:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5908
00000100:00080000:1.0:1767321011.162997:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321011.163002:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321011.163032:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f083fea00 x1853164380159360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321011.163075:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380159360:0@lo:38:kworker.0
00000100:00100000:1.0:1767321011.163151:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321011.163191:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380159232
00000100:00100000:1.0:1767321011.163197:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380159232
00000100:00100000:1.0:1767321011.163236:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158976
00000100:00100000:1.0:1767321011.163239:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158976
00000100:00100000:1.0:1767321011.163253:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158592
00000100:00100000:1.0:1767321011.163255:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158592
00000100:00100000:1.0:1767321011.163276:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380159104
00000100:00100000:1.0:1767321011.163279:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380159104
00000100:00100000:1.0:1767321011.163286:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380159360
00000100:00100000:1.0:1767321011.163288:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380159360
00000100:00100000:1.0:1767321011.163299:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5188
00000100:00100000:1.0:1767321011.163307:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380159232:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321011.163354:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380159232:12345-0@lo:400:kworker.0 Request processed in 47us (1988us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321011.163361:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5188
00000100:00100000:1.0:1767321011.163390:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5189
00000100:00100000:1.0:1767321011.163397:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380158976:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321011.163425:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380158976:12345-0@lo:400:kworker.0 Request processed in 29us (1294us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321011.163430:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5189
00000100:00100000:1.0:1767321011.163442:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18220
00000100:00100000:1.0:1767321011.163458:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380158592:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321011.163477:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321011.163512:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380158592:12345-0@lo:38:kworker.0 Request processed in 64us (977us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321011.163519:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18220
00000100:00100000:1.0:1767321011.163532:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18221
00000100:00100000:1.0:1767321011.163536:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380159104:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321011.163546:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321011.163571:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380159104:12345-0@lo:38:kworker.0 Request processed in 33us (953us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321011.163577:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18221
00000100:00100000:1.0:1767321011.163588:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18222
00000100:00100000:1.0:1767321011.163592:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380159360:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321011.163601:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321011.163623:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380159360:12345-0@lo:38:kworker.0 Request processed in 30us (472us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321011.163629:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18222
00000100:00080000:1.0:1767321011.163649:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321011.164377:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158464
00000100:00100000:3.0:1767321011.164385:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158464
00000100:00100000:3.0:1767321011.164434:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900
00000100:00100000:3.0:1767321011.164442:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380158464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321011.164465:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321011.164515:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380158464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (4294us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321011.164522:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900
00000100:00080000:3.0:1767321011.164540:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767321011.164571:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380158464:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321011.164617:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380158720
00000100:00100000:3.0:1767321011.164620:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380158720
00000100:00100000:3.0:1767321011.164648:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294
00000100:00100000:3.0:1767321011.164652:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380158720:12345-0@lo:38:kworker.0
00000100:00080000:2.0:1767321011.164935:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321011.164941:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321011.164945:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380159360:0@lo:38:kworker.0
00000100:00080000:2.0:1767321011.164955:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321011.164958:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321011.164961:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380158592:0@lo:38:kworker.0
00000100:00080000:2.0:1767321011.164968:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321011.164972:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321011.164974:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380159104:0@lo:38:kworker.0
00010000:00020000:3.0:1767321011.165057:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321011.165100:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380158720:12345-0@lo:38:kworker.0 Request processed in 445us (2523us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321011.165106:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294
00000100:00080000:2.0:1767321011.166924:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321011.166935:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321011.166939:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380158720:0@lo:38:kworker.0
00000100:00100000:0.0:1767321011.167129:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380158976:0@lo:400:kworker.0
00000100:00100000:1.0:1767321011.167546:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f083ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380159232:0@lo:400:kworker.0
00010000:00010000:1.0:1767321011.735030:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321012.696289:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767321012.696366:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380159488:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321012.696502:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321012.697059:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380159488
00000100:00100000:3.0:1767321012.697078:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380159488
00000100:00100000:3.0:1767321012.697174:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901
00000100:00100000:3.0:1767321012.697535:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380159488:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321012.697593:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321012.698016:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380159488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 814us (1499us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321012.698031:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901
00000100:00100000:1.0:1767321012.701401:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f38198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380159488:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767321012.761302:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321013.783714:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321014.807056:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321015.831319:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321016.211681:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321016.212415:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292006784
00000100:00100000:2.0:1767321016.212426:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292006784
00000100:00100000:2.0:1767321016.212557:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5190
00000100:00100000:2.0:1767321016.212568:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292006784:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321016.212673:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292006784:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 105us (1003us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321016.212681:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5190
00000100:00080000:3.0:1767321016.213313:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:0.0:1767321016.227197:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292006528 offset 0 length 520: 4
00000100:00100000:3.0:1767321016.228090:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321016.229514:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292006656
00000100:00100000:0.0:1767321016.229528:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292006656
00000100:00100000:0.0:1767321016.229583:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18223
00000100:00100000:0.0:1767321016.229592:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292006656:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767321016.229656:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321016.229726:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292006656:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 134us (1639us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321016.229734:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18223
00000100:00100000:0.0:1767321016.279994:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380159616:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767321016.280062:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321016.280273:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380159616
00000100:00100000:3.0:1767321016.280282:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380159616
00000100:00100000:3.0:1767321016.280342:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902
00000100:00100000:3.0:1767321016.280352:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380159616:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321016.280378:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321016.280423:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380159616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (361us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321016.280430:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902
00000100:00100000:3.0:1767321016.280468:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380159616:0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767321016.280564:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321016.281785:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321016.281793:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321016.281796:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321016.281800:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321016.281804:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321016.281811:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5913
00000100:00080000:2.0:1767321016.281816:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321016.281821:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321016.281855:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd500 x1853164380159744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321016.281927:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321016.281932:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321016.281933:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321016.281938:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5913
00000100:00080000:2.0:1767321016.281940:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321016.281944:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321016.281951:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380159744:0@lo:38:kworker.0
00000100:00100000:2.0:1767321016.281958:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efea00 x1853164380159872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321016.282011:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321016.282014:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321016.282016:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321016.282019:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5913
00000100:00080000:2.0:1767321016.282021:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321016.282024:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321016.282034:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164380160256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321016.282043:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321016.282047:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321016.282050:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321016.282051:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321016.282054:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5913
00000100:00080000:2.0:1767321016.282056:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321016.282076:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321016.282087:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380159872:0@lo:38:kworker.0
00000100:00100000:2.0:1767321016.282088:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efdf80 x1853164380160512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321016.282123:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321016.282134:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380159744
00000100:00100000:2.0:1767321016.282141:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380159744
00000100:00100000:3.0:1767321016.282149:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380160256:0@lo:38:kworker.0
00000100:00100000:3.0:1767321016.282168:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321016.282171:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18224
00000100:00100000:2.0:1767321016.282177:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380159744:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767321016.282186:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380160512:0@lo:38:kworker.0
00010000:00020000:2.0:1767321016.282196:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321016.282203:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321016.282241:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380159872
00000100:00100000:3.0:1767321016.282244:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380159872
00000100:00100000:2.0:1767321016.282248:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380159744:12345-0@lo:38:kworker.0 Request processed in 70us (204us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321016.282255:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18224
00000100:00100000:2.0:1767321016.282269:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380160256
00000100:00100000:2.0:1767321016.282272:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380160256
00000100:00100000:3.0:1767321016.282277:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295
00000100:00100000:3.0:1767321016.282282:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380159872:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321016.282292:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321016.282298:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380160512
00000100:00100000:2.0:1767321016.282300:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380160512
00000100:00100000:2.0:1767321016.282315:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18225
00000100:00100000:3.0:1767321016.282317:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380159872:12345-0@lo:38:kworker.0 Request processed in 34us (194us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321016.282319:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380160256:12345-0@lo:38:kworker.0
00000100:00100000:3.0:1767321016.282323:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295
00010000:00020000:2.0:1767321016.282328:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321016.282341:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18226
00000100:00100000:3.0:1767321016.282346:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380160512:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767321016.282349:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380160256:12345-0@lo:38:kworker.0 Request processed in 29us (180us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321016.282354:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18225
00010000:00020000:3.0:1767321016.282355:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321016.282378:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380160512:12345-0@lo:38:kworker.0 Request processed in 31us (173us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321016.282383:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18226
00000100:00080000:2.0:1767321016.282399:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321016.282403:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321016.282407:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380160512:0@lo:38:kworker.0
00000100:00080000:2.0:1767321016.282416:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321016.282419:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321016.282422:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380159872:0@lo:38:kworker.0
00000100:00080000:2.0:1767321016.282428:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321016.282431:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321016.282433:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380160256:0@lo:38:kworker.0
00000100:00080000:2.0:1767321016.282439:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321016.282442:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321016.282444:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380159744:0@lo:38:kworker.0
00000100:00100000:0.0:1767321016.282543:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767321016.282554:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380160000:0@lo:400:kworker.0
00000100:00100000:0.0:1767321016.282584:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321016.282800:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380160128:0@lo:400:kworker.0
00000100:00100000:1.0:1767321016.282830:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321016.282862:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767321016.282888:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380160128
00000100:00100000:1.0:1767321016.282890:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380160384:0@lo:400:kworker.0
00000100:00100000:0.0:1767321016.282892:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380160128
00000100:00100000:1.0:1767321016.282911:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321016.282929:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380160384
00000100:00100000:0.0:1767321016.282932:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380160384
00000100:00100000:0.0:1767321016.282951:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5191
00000100:00100000:0.0:1767321016.282957:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380160128:12345-0@lo:400:kworker.0
00000100:00080000:2.0:1767321016.282987:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321016.282997:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380160128:12345-0@lo:400:kworker.0 Request processed in 40us (166us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321016.283045:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380160000
00000100:00100000:3.0:1767321016.283049:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380160000
00000100:00100000:3.0:1767321016.283115:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083
00000100:00100000:3.0:1767321016.283122:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380160000:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321016.283157:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380160000:12345-0@lo:400:kworker.0 Request processed in 36us (571us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321016.283163:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083
00000100:00100000:1.0:1767321016.287622:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5192
00000100:00100000:1.0:1767321016.287652:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380160384:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321016.287755:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380160384:12345-0@lo:400:kworker.0 Request processed in 119us (4842us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321016.287763:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5192
00000100:00100000:1.0:1767321016.287913:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380160000:0@lo:400:kworker.0
00000100:00100000:1.0:1767321016.287967:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380160384:0@lo:400:kworker.0
00000100:00100000:1.0:1767321016.287979:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380160128:0@lo:400:kworker.0
00000100:00080000:1.0:1767321016.288012:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321016.288891:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5191
00010000:00010000:1.0:1767321016.855126:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321017.815738:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767321017.818523:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380160640:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321017.818603:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321017.820478:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380160640
00000100:00100000:2.0:1767321017.820495:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380160640
00000100:00100000:2.0:1767321017.820575:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903
00000100:00100000:2.0:1767321017.820587:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380160640:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767321017.820624:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321017.820707:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380160640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2103us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321017.820715:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903
00000100:00100000:0.0:1767321017.820856:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f3819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380160640:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767321017.879652:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321018.903187:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321019.929060:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321020.374999:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767320995/real 1767320995]  req@ffff8b0e03608e00 x1853164380155520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321020 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1767321020.375172:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e03608e00 x1853164380155520/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321020 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1767321020.375199:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321020.375264:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:3.0:1767321020.375268:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e03608e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380155520:0@lo:250:kworker.0
00000100:00080000:2.0:1767321020.375346:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321020.375352:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767321020.375354:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321020.375359:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5898
00000100:00080000:2.0:1767321020.375363:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321020.375369:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321020.375406:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd500 x1853164380160768/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321020.375432:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321020.375436:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321020.375437:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321020.375440:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5918
00000100:00080000:2.0:1767321020.375443:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321020.375446:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321020.375461:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164380160896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321020.375469:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321020.375472:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321020.375474:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321020.375478:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5918
00000100:00080000:2.0:1767321020.375481:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321020.375485:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321020.375496:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efea00 x1853164380161024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767321020.375564:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380161152:0@lo:400:kworker.0
00000100:00100000:0.0:1767321020.375626:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321020.375716:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321020.375719:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321020.375720:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321020.375723:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5918
00000100:00080000:2.0:1767321020.375725:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321020.375727:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321020.375734:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08effb80 x1853164380161536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321020.375771:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380160768:0@lo:250:kworker.0
00000400:00000100:3.0:1767321020.375788:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380160768 offset 0 length 520: 4
00000100:00100000:3.0:1767321020.375806:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380160896:0@lo:38:kworker.0
00000100:00100000:3.0:1767321020.375821:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321020.375832:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380161024:0@lo:38:kworker.0
00000100:00100000:3.0:1767321020.375845:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321020.375854:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380161536:0@lo:38:kworker.0
00000100:00100000:3.0:1767321020.375864:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321020.375904:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161024
00000100:00100000:3.0:1767321020.375911:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161024
00000100:00100000:3.0:1767321020.375945:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296
00000100:00100000:3.0:1767321020.375952:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380161024:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321020.375972:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321020.376005:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380161024:12345-0@lo:38:kworker.0 Request processed in 53us (158us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321020.376010:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296
00000100:00100000:3.0:1767321020.376030:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380160896
00000100:00100000:3.0:1767321020.376043:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380160896
00000100:00100000:3.0:1767321020.376063:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161536
00000100:00100000:3.0:1767321020.376066:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161536
00000100:00100000:3.0:1767321020.376079:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18227
00000100:00100000:3.0:1767321020.376083:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380160896:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321020.376093:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321020.376112:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f38199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380160896:12345-0@lo:38:kworker.0 Request processed in 28us (290us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321020.376115:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18227
00000100:00100000:3.0:1767321020.376123:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18228
00000100:00100000:3.0:1767321020.376125:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380161536:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321020.376130:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321020.376141:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380161536:12345-0@lo:38:kworker.0 Request processed in 15us (276us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321020.376144:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18228
00000100:00080000:3.0:1767321020.376165:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321020.376167:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321020.376169:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380160896:0@lo:38:kworker.0
00000100:00080000:3.0:1767321020.376185:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321020.376187:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321020.376190:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380161024:0@lo:38:kworker.0
00000100:00080000:3.0:1767321020.376196:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321020.376198:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321020.376200:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380161536:0@lo:38:kworker.0
00000100:00100000:3.0:1767321020.376228:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380161664:0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376255:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321020.376279:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161664
00000100:00100000:3.0:1767321020.376283:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161664
00000100:00100000:3.0:1767321020.376315:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5193
00000100:00100000:3.0:1767321020.376322:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380161664:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376358:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380161664:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321020.376364:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5193
00000100:00100000:3.0:1767321020.376390:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380161664:0@lo:400:kworker.0
00000100:00100000:1.0:1767321020.376498:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161152
00000100:00100000:1.0:1767321020.376501:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161152
00000100:00100000:1.0:1767321020.376538:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084
00000100:00100000:1.0:1767321020.376545:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380161152:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376627:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380161408:0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376652:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321020.376670:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767321020.376676:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380161280:0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376695:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321020.376715:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161408
00000100:00100000:3.0:1767321020.376718:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161408
00000100:00100000:3.0:1767321020.376734:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5194
00000100:00100000:3.0:1767321020.376737:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380161408:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376758:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380161408:12345-0@lo:400:kworker.0 Request processed in 20us (107us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321020.376762:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5194
00000100:00100000:3.0:1767321020.376778:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380161408:0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376788:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161280
00000100:00100000:3.0:1767321020.376790:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161280
00000100:00100000:3.0:1767321020.376805:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085
00000100:00100000:3.0:1767321020.376808:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380161280:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321020.376827:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f3964ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380161280:12345-0@lo:400:kworker.0 Request processed in 18us (132us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321020.376830:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085
00000100:00100000:3.0:1767321020.376845:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380161280:0@lo:400:kworker.0
00000100:00080000:3.0:1767321020.376863:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:3.0:1767321020.376866:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767321020.376885:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1767321020.378688:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321020.378699:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321020.378703:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321020.378709:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5918
00000100:00080000:2.0:1767321020.378713:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321020.378718:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321020.378752:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08eff800 x1853164380161792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321020.380349:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380161152:12345-0@lo:400:kworker.0 Request processed in 3798us (4716us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321020.380363:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084
00000100:00100000:3.0:1767321020.382308:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380161792:0@lo:38:kworker.0
00000100:00100000:3.0:1767321020.382385:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321020.382837:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380161152:0@lo:400:kworker.0
00000100:00100000:2.0:1767321020.385310:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161792
00000100:00100000:2.0:1767321020.385325:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161792
00000100:00100000:2.0:1767321020.385387:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18229
00000100:00100000:2.0:1767321020.385395:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380161792:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321020.385418:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321020.385509:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380161792:12345-0@lo:38:kworker.0 Request processed in 113us (3122us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321020.385516:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18229
00000100:00080000:0.0:1767321020.385789:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321020.385796:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321020.385800:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380161792:0@lo:38:kworker.0
00010000:00010000:1.0:1767321020.951541:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321021.333824:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321021.333908:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321021.338537:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292007040
00000100:00100000:2.0:1767321021.338554:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292007040
00000100:00100000:2.0:1767321021.338667:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292006912
00000100:00100000:2.0:1767321021.338670:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292006912
00000100:00100000:2.0:1767321021.338699:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5195
00000100:00100000:2.0:1767321021.338709:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292007040:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321021.338785:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292007040:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (5128us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321021.338792:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5195
00000100:00100000:2.0:1767321021.338810:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18230
00000100:00100000:2.0:1767321021.338814:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292006912:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767321021.338833:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321021.338856:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292006912:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 40us (4947us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321021.338862:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18230
00000100:00080000:0.0:1767321021.339582:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321021.399341:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767321021.399358:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380161920:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767321021.399426:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321021.400921:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380161920
00000100:00100000:3.0:1767321021.400932:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380161920
00000100:00100000:3.0:1767321021.400990:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904
00000100:00100000:3.0:1767321021.401600:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380161920:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321021.401731:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321021.401908:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380161920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 908us (2480us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321021.401916:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904
00000100:00100000:1.0:1767321021.403469:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380161920:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767321021.975174:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321022.935434:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767321022.935460:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f06003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380162048:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321022.935533:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321022.935605:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162048
00000100:00100000:2.0:1767321022.935614:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162048
00000100:00100000:2.0:1767321022.935685:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905
00000100:00100000:2.0:1767321022.935694:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380162048:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767321022.935725:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321022.935780:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380162048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (246us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321022.935789:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905
00000100:00080000:0.0:1767321022.935847:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767321022.935856:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f06003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380162048:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321023.000599:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321024.023890:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321025.047287:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767321025.495070:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321025.495080:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767321025.495083:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321025.495087:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321025.495092:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321025.495100:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5922
00000100:00080000:0.0:1767321025.495104:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321025.495111:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321025.495162:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332d80 x1853164380162176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767321025.495179:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321025.495182:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321025.495184:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321025.495188:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5922
00000100:00080000:0.0:1767321025.495190:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321025.495194:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321025.495209:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333b80 x1853164380162304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767321025.495266:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321025.495270:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321025.495271:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321025.495275:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5922
00000100:00080000:0.0:1767321025.495277:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321025.495281:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321025.495291:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07332a00 x1853164380162816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767321025.495305:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321025.495308:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321025.495310:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321025.495313:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5922
00000100:00080000:0.0:1767321025.495316:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321025.495320:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321025.495328:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e07333800 x1853164380163072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321025.495399:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380162944:0@lo:400:kworker.0
00000100:00100000:2.0:1767321025.495477:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321025.495547:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767321025.495554:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380162432:0@lo:400:kworker.0
00000100:00100000:2.0:1767321025.495579:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321025.495767:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380162688:0@lo:400:kworker.0
00000100:00100000:1.0:1767321025.495797:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321025.495817:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321025.495822:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380162560:0@lo:400:kworker.0
00000100:00100000:1.0:1767321025.495841:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321025.495890:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162432
00000100:00100000:1.0:1767321025.495897:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162432
00000100:00100000:1.0:1767321025.495945:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162560
00000100:00100000:1.0:1767321025.495948:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162560
00000100:00100000:1.0:1767321025.495973:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086
00000100:00100000:1.0:1767321025.495981:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380162432:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321025.496031:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380162432:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321025.496038:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086
00000100:00100000:1.0:1767321025.496055:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087
00000100:00100000:1.0:1767321025.496062:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380162560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321025.496091:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380162560:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321025.496096:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087
00000100:00100000:1.0:1767321025.496152:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380162560:0@lo:400:kworker.0
00000100:00100000:1.0:1767321025.496180:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380162432:0@lo:400:kworker.0
00000100:00100000:2.0:1767321025.496343:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162944
00000100:00100000:2.0:1767321025.496348:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162944
00000100:00100000:2.0:1767321025.496384:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162688
00000100:00100000:2.0:1767321025.496388:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162688
00000100:00100000:2.0:1767321025.496412:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5196
00000100:00100000:2.0:1767321025.496418:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380162944:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321025.496468:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380162944:12345-0@lo:400:kworker.0 Request processed in 50us (990us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321025.496474:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5196
00000100:00100000:2.0:1767321025.496488:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5197
00000100:00100000:2.0:1767321025.496493:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380162688:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321025.496523:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380162688:12345-0@lo:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321025.496529:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5197
00000100:00100000:2.0:1767321025.496560:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380162688:0@lo:400:kworker.0
00000100:00100000:2.0:1767321025.496580:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380162944:0@lo:400:kworker.0
00000100:00080000:0.0:1767321025.496761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767321025.496767:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767321025.496770:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767321025.496955:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380162176:0@lo:38:kworker.0
00000100:00100000:3.0:1767321025.496992:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321025.497024:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380162304:0@lo:38:kworker.0
00000100:00100000:3.0:1767321025.497048:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321025.497083:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380162816:0@lo:38:kworker.0
00000100:00100000:3.0:1767321025.497105:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321025.497137:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380163072:0@lo:38:kworker.0
00000100:00100000:3.0:1767321025.497159:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321025.497189:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162176
00000100:00100000:3.0:1767321025.497194:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162176
00000100:00100000:3.0:1767321025.497217:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162816
00000100:00100000:3.0:1767321025.497220:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162816
00000100:00100000:3.0:1767321025.497231:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163072
00000100:00100000:3.0:1767321025.497234:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163072
00000100:00100000:3.0:1767321025.497250:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18231
00000100:00100000:3.0:1767321025.497254:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380162176:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321025.497273:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321025.497307:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380162176:12345-0@lo:38:kworker.0 Request processed in 51us (313us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321025.497312:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18231
00000100:00100000:3.0:1767321025.497326:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18232
00000100:00100000:3.0:1767321025.497330:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380162816:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321025.497339:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321025.497362:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380162816:12345-0@lo:38:kworker.0 Request processed in 30us (256us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321025.497367:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18232
00000100:00100000:3.0:1767321025.497377:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18233
00000100:00100000:3.0:1767321025.497380:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380163072:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321025.497389:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321025.497409:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0162b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380163072:12345-0@lo:38:kworker.0 Request processed in 27us (249us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321025.497415:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18233
00000100:00080000:3.0:1767321025.497465:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321025.497471:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321025.497475:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380162176:0@lo:38:kworker.0
00000100:00080000:3.0:1767321025.497482:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321025.497485:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321025.497487:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380162816:0@lo:38:kworker.0
00000100:00080000:3.0:1767321025.497493:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321025.497495:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321025.497497:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380163072:0@lo:38:kworker.0
00000100:00100000:1.0:1767321025.497726:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380162304
00000100:00100000:1.0:1767321025.497731:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380162304
00000100:00100000:1.0:1767321025.497855:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297
00000100:00100000:1.0:1767321025.497860:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380162304:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321025.497893:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321025.497940:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380162304:12345-0@lo:38:kworker.0 Request processed in 78us (890us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321025.497946:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297
00000100:00080000:0.0:1767321025.498014:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321025.498018:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321025.498022:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e07333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380162304:0@lo:38:kworker.0
00010000:00010000:3.0:1767321026.071463:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321026.449388:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321026.449542:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292007296
00000100:00100000:2.0:1767321026.449555:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292007296
00000100:00100000:2.0:1767321026.449666:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5198
00000100:00100000:2.0:1767321026.449677:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292007296:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321026.449768:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292007296:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 92us (391us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321026.449784:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5198
00000100:00080000:0.0:1767321026.450445:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321026.450476:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321026.450553:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292007168
00000100:00100000:1.0:1767321026.450559:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292007168
00000100:00100000:1.0:1767321026.450621:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18234
00000100:00100000:1.0:1767321026.450626:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292007168:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767321026.450644:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321026.450679:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292007168:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (205us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321026.450684:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18234
00000100:00100000:2.0:1767321026.519505:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767321026.521096:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380163200:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321026.521181:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321026.523650:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163200
00000100:00100000:0.0:1767321026.523665:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163200
00000100:00100000:0.0:1767321026.523738:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906
00000100:00100000:0.0:1767321026.523747:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380163200:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321026.523781:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321026.524011:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380163200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 265us (2829us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321026.524019:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906
00000100:00100000:2.0:1767321026.524233:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380163200:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321027.095068:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321028.055333:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380163328:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321028.055408:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321028.055457:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163328
00000100:00100000:0.0:1767321028.055466:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163328
00000100:00100000:0.0:1767321028.055527:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907
00000100:00100000:0.0:1767321028.055537:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380163328:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767321028.055565:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321028.055616:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380163328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (208us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321028.055624:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907
00000100:00100000:1.0:1767321028.055673:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e01628000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380163328:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767321028.055889:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767321028.119172:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321029.143549:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321030.168862:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767321030.615158:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321030.615168:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321030.615172:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321030.615176:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321030.615180:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321030.615188:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5927
00000100:00080000:2.0:1767321030.615193:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321030.615200:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321030.615238:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08efd880 x1853164380163456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321030.615260:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321030.615263:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321030.615264:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321030.615267:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5927
00000100:00080000:2.0:1767321030.615269:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321030.615278:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321030.615289:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08eff800 x1853164380163584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321030.615353:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321030.615357:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321030.615359:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321030.615363:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5927
00000100:00080000:2.0:1767321030.615365:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321030.615368:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321030.615380:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be05c00 x1853164380164096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321030.615396:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321030.615398:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321030.615400:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321030.615402:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5927
00000100:00080000:2.0:1767321030.615404:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321030.615406:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321030.615413:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164380164352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321030.615434:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380163840:0@lo:400:kworker.0
00000100:00100000:2.0:1767321030.615498:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321030.615543:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767321030.615547:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380163968:0@lo:400:kworker.0
00000100:00100000:2.0:1767321030.615563:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321030.615618:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380163456:0@lo:38:kworker.0
00000100:00100000:0.0:1767321030.615646:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321030.615669:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380163584:0@lo:38:kworker.0
00000100:00100000:0.0:1767321030.615691:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321030.615715:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380164096:0@lo:38:kworker.0
00000100:00100000:0.0:1767321030.615734:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321030.615749:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380164352:0@lo:38:kworker.0
00000100:00100000:0.0:1767321030.615766:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321030.615793:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163584
00000100:00100000:0.0:1767321030.615800:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163584
00000100:00100000:0.0:1767321030.615831:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298
00000100:00100000:0.0:1767321030.615838:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380163584:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321030.615854:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321030.615913:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380163584:12345-0@lo:38:kworker.0 Request processed in 74us (220us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321030.615917:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298
00000100:00100000:0.0:1767321030.615935:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163968
00000100:00100000:0.0:1767321030.615937:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163968
00000100:00100000:0.0:1767321030.615961:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163456
00000100:00100000:0.0:1767321030.615962:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163456
00000100:00100000:0.0:1767321030.615969:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164096
00000100:00100000:0.0:1767321030.615970:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164096
00000100:00100000:0.0:1767321030.615974:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164352
00000100:00100000:0.0:1767321030.615976:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164352
00000100:00100000:0.0:1767321030.615983:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5199
00000100:00100000:0.0:1767321030.615989:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380163968:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321030.616026:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380163968:12345-0@lo:400:kworker.0 Request processed in 38us (461us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321030.616033:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5199
00000100:00100000:0.0:1767321030.616045:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18235
00000100:00100000:0.0:1767321030.616049:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380163456:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321030.616056:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321030.616072:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380163456:12345-0@lo:38:kworker.0 Request processed in 23us (427us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321030.616076:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18235
00000100:00100000:0.0:1767321030.616095:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18236
00000100:00100000:0.0:1767321030.616097:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380164096:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321030.616103:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321030.616118:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380164096:12345-0@lo:38:kworker.0 Request processed in 20us (385us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321030.616124:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18236
00000100:00100000:0.0:1767321030.616130:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18237
00000100:00100000:0.0:1767321030.616132:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380164352:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321030.616137:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321030.616147:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380164352:12345-0@lo:38:kworker.0 Request processed in 14us (381us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321030.616151:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18237
00000100:00080000:0.0:1767321030.616175:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321030.616179:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321030.616181:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380163456:0@lo:38:kworker.0
00000100:00080000:0.0:1767321030.616187:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321030.616189:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321030.616191:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380163584:0@lo:38:kworker.0
00000100:00080000:0.0:1767321030.616195:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321030.616196:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321030.616198:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380164096:0@lo:38:kworker.0
00000100:00080000:0.0:1767321030.616201:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321030.616202:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321030.616204:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380164352:0@lo:38:kworker.0
00000100:00100000:1.0:1767321030.616411:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380163712:0@lo:400:kworker.0
00000100:00100000:1.0:1767321030.616434:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321030.616456:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321030.616460:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380164224:0@lo:400:kworker.0
00000100:00100000:1.0:1767321030.616483:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321030.616504:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163840
00000100:00100000:1.0:1767321030.616507:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163840
00000100:00100000:1.0:1767321030.616526:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380163712
00000100:00100000:1.0:1767321030.616527:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380163712
00000100:00100000:1.0:1767321030.616538:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088
00000100:00100000:1.0:1767321030.616541:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380163840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321030.616561:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380163840:12345-0@lo:400:kworker.0 Request processed in 20us (1063us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321030.616567:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088
00000100:00100000:1.0:1767321030.616578:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089
00000100:00100000:1.0:1767321030.616581:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380163712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321030.616597:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380163712:12345-0@lo:400:kworker.0 Request processed in 16us (162us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321030.616600:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089
00000100:00100000:1.0:1767321030.616610:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164224
00000100:00100000:1.0:1767321030.616612:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164224
00000100:00100000:1.0:1767321030.616627:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5200
00000100:00100000:1.0:1767321030.616633:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380164224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321030.616658:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380164224:12345-0@lo:400:kworker.0 Request processed in 25us (173us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321030.616663:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5200
00000100:00100000:1.0:1767321030.616703:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380164224:0@lo:400:kworker.0
00000100:00100000:1.0:1767321030.616712:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380163712:0@lo:400:kworker.0
00000100:00080000:2.0:1767321030.617735:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321030.617743:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1767321030.617746:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321030.617788:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380163968:0@lo:400:kworker.0
00000100:00100000:2.0:1767321030.617803:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380163840:0@lo:400:kworker.0
00010000:00010000:1.0:1767321031.192920:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321031.567767:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321031.567848:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321031.568039:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292007424
00000100:00100000:0.0:1767321031.568052:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292007424
00000100:00100000:0.0:1767321031.568110:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292007552
00000100:00100000:0.0:1767321031.568114:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292007552
00000100:00100000:0.0:1767321031.568163:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5201
00000100:00100000:0.0:1767321031.568197:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292007552:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767321031.568277:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292007552:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (428us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321031.568285:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5201
00000100:00100000:0.0:1767321031.568303:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18238
00000100:00100000:0.0:1767321031.568308:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292007424:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767321031.568328:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321031.568355:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e01628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292007424:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 44us (599us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321031.568361:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18238
00000100:00080000:3.0:1767321031.568925:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321031.639122:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380164480:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321031.639201:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321031.639334:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164480
00000100:00100000:0.0:1767321031.639342:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164480
00000100:00100000:0.0:1767321031.639386:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908
00000100:00100000:0.0:1767321031.639394:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380164480:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321031.639422:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321031.640050:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f083fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380164480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 654us (848us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321031.640059:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908
00000100:00100000:1.0:1767321031.640164:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380164480:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321032.215272:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321033.175402:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767321033.175431:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380164608:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321033.175511:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321033.175635:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164608
00000100:00100000:3.0:1767321033.175644:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164608
00000100:00100000:3.0:1767321033.175703:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909
00000100:00100000:3.0:1767321033.175712:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380164608:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321033.175741:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321033.175786:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380164608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (274us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321033.175793:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909
00000100:00080000:1.0:1767321033.175943:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767321033.175983:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0bafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380164608:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321033.243553:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321034.263526:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321035.287209:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767321035.735062:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321035.735075:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321035.735078:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321035.735083:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321035.735087:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321035.735095:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5933
00000100:00080000:2.0:1767321035.735101:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321035.735109:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321035.735153:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04380 x1853164380164736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321035.735171:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321035.735174:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321035.735176:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321035.735180:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5933
00000100:00080000:2.0:1767321035.735182:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321035.735186:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321035.735197:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04a80 x1853164380164864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321035.735266:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321035.735269:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321035.735271:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321035.735275:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5933
00000100:00080000:2.0:1767321035.735277:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321035.735281:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321035.735290:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04000 x1853164380165376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321035.735304:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321035.735307:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321035.735309:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321035.735312:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5933
00000100:00080000:2.0:1767321035.735314:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321035.735330:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321035.735341:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04700 x1853164380165632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321035.735382:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380165120:0@lo:400:kworker.0
00000100:00100000:2.0:1767321035.735455:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321035.735538:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767321035.735544:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380165248:0@lo:400:kworker.0
00000100:00100000:2.0:1767321035.735570:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321035.735645:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380164992:0@lo:400:kworker.0
00000100:00100000:0.0:1767321035.735730:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380164736:0@lo:38:kworker.0
00000100:00100000:3.0:1767321035.737145:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380165504:0@lo:400:kworker.0
00000100:00100000:1.0:1767321035.742103:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321035.742197:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380165120
00000100:00100000:1.0:1767321035.742209:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380165120
00000100:00100000:1.0:1767321035.742262:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164992
00000100:00100000:1.0:1767321035.742265:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164992
00000100:00100000:1.0:1767321035.742285:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090
00000100:00100000:1.0:1767321035.742294:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380165120:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321035.742347:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380165120:12345-0@lo:400:kworker.0 Request processed in 54us (6892us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321035.742355:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090
00000100:00100000:1.0:1767321035.742374:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091
00000100:00100000:1.0:1767321035.742380:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380164992:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321035.742411:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380164992:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321035.742416:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091
00000100:00080000:1.0:1767321035.742431:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767321035.742435:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767321035.742470:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380164992:0@lo:400:kworker.0
00000100:00100000:0.0:1767321035.750003:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321035.750080:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380164864:0@lo:38:kworker.0
00000100:00100000:0.0:1767321035.750116:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321035.750149:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380165376:0@lo:38:kworker.0
00000100:00100000:0.0:1767321035.750173:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321035.750195:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380165632:0@lo:38:kworker.0
00000100:00100000:0.0:1767321035.750216:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321035.750326:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380165248
00000100:00100000:0.0:1767321035.750335:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380165248
00000100:00100000:0.0:1767321035.750393:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164736
00000100:00100000:0.0:1767321035.750396:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164736
00000100:00100000:0.0:1767321035.750408:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380165376
00000100:00100000:0.0:1767321035.750410:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380165376
00000100:00100000:0.0:1767321035.750420:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5202
00000100:00100000:0.0:1767321035.750430:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380165248:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321035.750488:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380165248:12345-0@lo:400:kworker.0 Request processed in 60us (14916us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321035.750495:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5202
00000100:00100000:0.0:1767321035.750513:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380165632
00000100:00100000:0.0:1767321035.750515:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380165632
00000100:00100000:0.0:1767321035.750526:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18239
00000100:00100000:0.0:1767321035.750531:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380164736:12345-0@lo:38:kworker.0
00000100:00100000:1.0:1767321035.750545:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18240
00000100:00100000:1.0:1767321035.750551:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380165376:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321035.750552:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00010000:00020000:1.0:1767321035.750559:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321035.750583:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380164736:12345-0@lo:38:kworker.0 Request processed in 50us (589us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321035.750583:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380165376:12345-0@lo:38:kworker.0 Request processed in 32us (410us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321035.750589:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18240
00000100:00100000:0.0:1767321035.751073:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18239
00000100:00100000:0.0:1767321035.751092:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18241
00000100:00100000:0.0:1767321035.751097:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380165632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321035.751109:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321035.751141:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380165632:12345-0@lo:38:kworker.0 Request processed in 42us (924us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321035.751148:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18241
00000100:00080000:0.0:1767321035.751194:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321035.751200:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321035.751204:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380164736:0@lo:38:kworker.0
00000100:00080000:0.0:1767321035.751215:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321035.751218:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321035.751221:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380165376:0@lo:38:kworker.0
00000100:00080000:0.0:1767321035.751230:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321035.751233:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321035.751235:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380165632:0@lo:38:kworker.0
00000100:00080000:0.0:1767321035.751289:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321035.751302:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380164864
00000100:00100000:0.0:1767321035.751305:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380164864
00000100:00100000:0.0:1767321035.751328:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299
00000100:00100000:0.0:1767321035.751332:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380164864:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321035.751343:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321035.751374:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380164864:12345-0@lo:38:kworker.0 Request processed in 40us (1257us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321035.751380:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299
00000100:00080000:0.0:1767321035.751405:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321035.751410:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321035.751414:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380164864:0@lo:38:kworker.0
00000100:00100000:3.0:1767321035.758744:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321035.759774:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380165504
00000100:00100000:0.0:1767321035.759787:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380165504
00000100:00100000:0.0:1767321035.759884:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5203
00000100:00100000:0.0:1767321035.759895:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380165504:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321035.760257:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380165504:12345-0@lo:400:kworker.0 Request processed in 363us (1518us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321035.760267:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5203
00000100:00080000:3.0:1767321035.760761:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321035.760805:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380165504:0@lo:400:kworker.0
00000100:00100000:2.0:1767321035.762328:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380165248:0@lo:400:kworker.0
00000100:00100000:2.0:1767321035.762349:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380165120:0@lo:400:kworker.0
00010000:00010000:1.0:1767321036.311084:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321036.693413:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321036.693506:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321036.693614:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292007808
00000100:00100000:0.0:1767321036.693625:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292007808
00000100:00100000:0.0:1767321036.693702:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292007680
00000100:00100000:0.0:1767321036.693706:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292007680
00000100:00080000:3.0:1767321036.693727:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321036.693731:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5204
00000100:00100000:0.0:1767321036.693741:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292007808:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767321036.693760:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18242
00000100:00100000:3.0:1767321036.693766:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292007680:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321036.693785:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321036.693817:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292007808:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 78us (415us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321036.693824:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5204
00000100:00100000:3.0:1767321036.694063:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0bef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292007680:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 295us (555us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321036.694070:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18242
00000100:00100000:1.0:1767321036.760518:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380165760:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321036.760591:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321036.760724:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380165760
00000100:00100000:2.0:1767321036.760733:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380165760
00000100:00100000:2.0:1767321036.760782:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910
00000100:00100000:2.0:1767321036.760792:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380165760:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767321036.760824:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321036.760918:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380165760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (325us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321036.760925:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910
00000100:00100000:1.0:1767321036.761249:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380165760:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321037.335138:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321038.296120:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321038.296142:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380165888:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321038.296210:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321038.296333:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380165888
00000100:00100000:3.0:1767321038.296342:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380165888
00000100:00080000:0.0:1767321038.296401:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767321038.296412:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911
00000100:00100000:3.0:1767321038.296422:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380165888:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321038.296453:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321038.296520:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380165888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (309us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321038.296528:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911
00000100:00100000:1.0:1767321038.296693:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380165888:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767321038.360057:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321039.383095:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321040.407212:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321040.783727:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321040.783901:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008192
00000100:00100000:1.0:1767321040.783912:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008192
00000100:00080000:0.0:1767321040.783999:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321040.784016:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5205
00000100:00100000:1.0:1767321040.784029:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292008192:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767321040.784122:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292008192:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 95us (406us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321040.784132:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5205
00000400:00000100:0.0:1767321040.784853:0:7012:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292007936 offset 0 length 520: 4
00000100:00100000:0.0:1767321040.784922:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321040.784987:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008064
00000100:00100000:3.0:1767321040.785003:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008064
00000100:00100000:3.0:1767321040.785054:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18243
00000100:00100000:3.0:1767321040.785065:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292008064:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321040.785094:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321040.785168:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292008064:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 102us (245us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321040.785180:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18243
00000100:00080000:3.0:1767321040.856148:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321040.856159:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767321040.856162:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321040.856166:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321040.856171:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321040.856179:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5938
00000100:00080000:3.0:1767321040.856184:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321040.856191:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321040.856231:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebca80 x1853164380166016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321040.856258:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321040.856262:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321040.856264:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321040.856267:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5938
00000100:00080000:3.0:1767321040.856269:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321040.856272:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321040.856283:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164380166144/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321040.856346:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321040.856349:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321040.856351:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321040.856354:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5938
00000100:00080000:3.0:1767321040.856356:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321040.856359:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321040.856367:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebce00 x1853164380166656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321040.856381:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321040.856383:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321040.856385:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321040.856387:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5938
00000100:00080000:3.0:1767321040.856389:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321040.856392:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321040.856400:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebfb80 x1853164380166912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321040.856428:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380166400:0@lo:400:kworker.0
00000100:00100000:3.0:1767321040.856512:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321040.856672:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380166016:0@lo:38:kworker.0
00000100:00100000:0.0:1767321040.856706:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321040.856754:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166400
00000100:00100000:0.0:1767321040.856762:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166400
00000100:00100000:2.0:1767321040.856767:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380166784:0@lo:400:kworker.0
00000100:00100000:2.0:1767321040.856806:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321040.856822:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092
00000100:00100000:0.0:1767321040.856831:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380166400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321040.856843:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166016
00000100:00100000:2.0:1767321040.856849:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166016
00000100:00100000:2.0:1767321040.856900:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166784
00000100:00100000:0.0:1767321040.856902:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380166400:12345-0@lo:400:kworker.0 Request processed in 72us (389us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321040.856905:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166784
00000100:00100000:0.0:1767321040.856915:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092
00000100:00100000:2.0:1767321040.856942:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5206
00000100:00080000:0.0:1767321040.856947:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321040.856952:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380166784:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767321040.856954:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321040.856980:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18244
00000100:00100000:0.0:1767321040.856986:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380166016:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767321040.857010:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380166784:12345-0@lo:400:kworker.0 Request processed in 58us (203us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321040.857018:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5206
00010000:00020000:0.0:1767321040.857025:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321040.857067:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380166016:12345-0@lo:38:kworker.0 Request processed in 80us (360us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321040.857074:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18244
00000100:00100000:3.0:1767321040.857698:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380166400:0@lo:400:kworker.0
00000100:00100000:3.0:1767321040.857721:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767321040.857729:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380166528:0@lo:400:kworker.0
00000100:00100000:3.0:1767321040.857757:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321040.857850:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380166272:0@lo:400:kworker.0
00000100:00100000:1.0:1767321040.857916:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321040.857948:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166528
00000100:00100000:1.0:1767321040.857952:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166528
00000100:00100000:1.0:1767321040.858024:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5207
00000100:00100000:1.0:1767321040.858031:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380166528:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321040.858072:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380166528:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321040.858078:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5207
00000100:00080000:1.0:1767321040.858099:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321040.858301:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166272
00000100:00100000:3.0:1767321040.858306:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166272
00000100:00100000:3.0:1767321040.858354:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093
00000100:00100000:3.0:1767321040.858362:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380166272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321040.858398:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380166272:12345-0@lo:400:kworker.0 Request processed in 38us (482us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321040.858405:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093
00000100:00080000:2.0:1767321040.858655:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321040.858661:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321040.858665:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380166016:0@lo:38:kworker.0
00000100:00100000:2.0:1767321040.858674:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380166144:0@lo:38:kworker.0
00000100:00100000:2.0:1767321040.858705:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321040.858740:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380166656:0@lo:38:kworker.0
00000100:00100000:3.0:1767321040.858750:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380166784:0@lo:400:kworker.0
00000100:00100000:2.0:1767321040.858769:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321040.858794:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380166912:0@lo:38:kworker.0
00000100:00100000:3.0:1767321040.858797:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380166528:0@lo:400:kworker.0
00000100:00100000:2.0:1767321040.858820:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321040.858845:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166656
00000100:00100000:3.0:1767321040.858851:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166656
00000100:00100000:2.0:1767321040.858893:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166912
00000100:00100000:3.0:1767321040.858897:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18245
00000100:00100000:2.0:1767321040.858900:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166912
00000100:00100000:3.0:1767321040.858905:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380166656:12345-0@lo:38:kworker.0
00000100:00100000:2.0:1767321040.858926:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18246
00010000:00020000:3.0:1767321040.858933:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321040.858935:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380166912:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321040.858949:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321040.858976:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380166656:12345-0@lo:38:kworker.0 Request processed in 71us (208us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321040.858986:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18245
00000100:00100000:2.0:1767321040.859003:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380166912:12345-0@lo:38:kworker.0 Request processed in 54us (167us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321040.859012:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18246
00000100:00080000:2.0:1767321040.859038:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321040.859043:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321040.859046:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380166656:0@lo:38:kworker.0
00000100:00080000:2.0:1767321040.859054:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321040.859058:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321040.859074:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380166912:0@lo:38:kworker.0
00000100:00100000:0.0:1767321040.859140:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380166144
00000100:00100000:0.0:1767321040.859144:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380166144
00000100:00100000:0.0:1767321040.859175:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300
00000100:00100000:0.0:1767321040.859180:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380166144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321040.859191:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321040.859222:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380166144:12345-0@lo:38:kworker.0 Request processed in 40us (516us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321040.859227:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300
00000100:00100000:1.0:1767321040.860246:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380166272:0@lo:400:kworker.0
00000100:00080000:1.0:1767321040.860273:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321040.860484:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321040.860490:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321040.860493:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380166144:0@lo:38:kworker.0
00010000:00010000:1.0:1767321041.431122:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321041.879297:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767321041.879314:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380167040:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321041.879990:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321041.880250:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380167040
00000100:00100000:3.0:1767321041.880258:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380167040
00000100:00100000:3.0:1767321041.880310:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912
00000100:00100000:3.0:1767321041.880320:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380167040:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321041.880362:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321041.880421:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380167040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (442us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321041.880428:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912
00000100:00100000:0.0:1767321041.882514:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380167040:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767321042.455814:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321043.415599:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380167168:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321043.415682:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321043.415909:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380167168
00000100:00100000:2.0:1767321043.415919:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380167168
00000100:00100000:2.0:1767321043.416010:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913
00000100:00100000:2.0:1767321043.416020:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380167168:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767321043.416047:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767321043.416115:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767321043.417233:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380167168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1211us (1547us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321043.417242:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913
00000100:00100000:0.0:1767321043.421914:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380167168:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321043.480779:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321044.503680:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321045.529430:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321045.903720:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321045.903766:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321045.905846:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008448
00000100:00100000:2.0:1767321045.905862:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008448
00000100:00100000:2.0:1767321045.905993:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008320
00000100:00100000:2.0:1767321045.905997:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008320
00000100:00100000:2.0:1767321045.906021:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5208
00000100:00100000:2.0:1767321045.906034:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292008448:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321045.906117:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292008448:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 87us (2407us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321045.906125:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5208
00000100:00100000:2.0:1767321045.906145:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18247
00000100:00100000:2.0:1767321045.906150:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292008320:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767321045.906171:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321045.906198:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292008320:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (2431us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321045.906205:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18247
00000100:00080000:3.0:1767321045.912594:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321045.975259:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321020/real 1767321020]  req@ffff8b0e08efd500 x1853164380160768/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321045 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767321045.975314:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e08efd500 x1853164380160768/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321045 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767321045.975334:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321045.975343:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767321045.975347:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380160768:0@lo:250:kworker.0
00000100:00080000:2.0:1767321045.975833:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321045.975839:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1767321045.975842:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321045.975847:0:62609:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5922
00000100:00080000:2.0:1767321045.975851:0:62609:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321045.975857:0:62609:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321045.975930:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04000 x1853164380167296/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321045.975967:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321045.975971:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321045.975973:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321045.975976:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5943
00000100:00080000:2.0:1767321045.975978:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321045.975982:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321045.975997:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04380 x1853164380167424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321045.976006:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321045.976009:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321045.976010:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321045.976013:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5943
00000100:00080000:2.0:1767321045.976016:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321045.976019:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321045.976031:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be07800 x1853164380167552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321045.976107:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380167680:0@lo:400:kworker.0
00000100:00100000:1.0:1767321045.976187:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321045.976284:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321045.976288:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321045.976290:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321045.976293:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5943
00000100:00080000:2.0:1767321045.976296:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321045.976311:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321045.976327:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c44aa00 x1853164380168064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321045.976384:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380167296:0@lo:250:kworker.0
00000400:00000100:3.0:1767321045.976419:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380167296 offset 0 length 520: 4
00000100:00100000:3.0:1767321045.976443:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380167424:0@lo:38:kworker.0
00000100:00100000:3.0:1767321045.976468:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321045.976487:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380167552:0@lo:38:kworker.0
00000100:00100000:3.0:1767321045.976508:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321045.976525:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380168064:0@lo:38:kworker.0
00000100:00100000:3.0:1767321045.976557:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321045.976598:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380167424
00000100:00100000:3.0:1767321045.976606:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380167424
00000100:00100000:3.0:1767321045.976640:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168064
00000100:00100000:3.0:1767321045.976643:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168064
00000100:00100000:3.0:1767321045.976662:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18248
00000100:00100000:3.0:1767321045.976670:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380167424:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321045.976691:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321045.976731:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380167424:12345-0@lo:38:kworker.0 Request processed in 59us (261us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321045.976738:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18248
00000100:00100000:3.0:1767321045.976755:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18249
00000100:00100000:3.0:1767321045.976759:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380168064:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321045.976769:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321045.976792:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380168064:12345-0@lo:38:kworker.0 Request processed in 32us (246us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321045.976798:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18249
00000100:00080000:3.0:1767321045.976834:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321045.976838:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321045.976842:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380167424:0@lo:38:kworker.0
00000100:00080000:3.0:1767321045.976851:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321045.976855:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321045.976857:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380168064:0@lo:38:kworker.0
00000100:00100000:3.0:1767321045.976920:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380167552
00000100:00100000:3.0:1767321045.976924:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380167552
00000100:00100000:3.0:1767321045.976958:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301
00000100:00100000:3.0:1767321045.976963:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380167552:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321045.976974:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321045.977004:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380167552:12345-0@lo:38:kworker.0 Request processed in 40us (495us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321045.977011:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301
00000100:00080000:3.0:1767321045.977034:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321045.977037:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321045.977041:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380167552:0@lo:38:kworker.0
00000100:00100000:3.0:1767321045.977079:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380167680
00000100:00100000:3.0:1767321045.977083:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380167680
00000100:00100000:3.0:1767321045.977125:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094
00000100:00100000:3.0:1767321045.977131:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380167680:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.977319:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380167808:0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.977352:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321045.977377:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767321045.977383:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380167936:0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.977818:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321045.977855:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380167808
00000100:00100000:0.0:1767321045.977859:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380167808
00000100:00100000:0.0:1767321045.977925:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095
00000100:00100000:0.0:1767321045.977933:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380167808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.977983:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380167808:12345-0@lo:400:kworker.0 Request processed in 51us (629us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321045.977990:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095
00000100:00100000:0.0:1767321045.978027:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380167808:0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.978047:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380167936
00000100:00100000:0.0:1767321045.978051:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380167936
00000100:00100000:0.0:1767321045.978078:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5209
00000100:00100000:0.0:1767321045.978084:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380167936:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.978117:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380167936:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321045.978123:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5209
00000100:00100000:0.0:1767321045.978150:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380167936:0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.978183:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380168192:0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.978210:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321045.978232:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168192
00000100:00100000:0.0:1767321045.978236:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168192
00000100:00100000:0.0:1767321045.978260:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5210
00000100:00100000:0.0:1767321045.978267:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380168192:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321045.978295:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380168192:12345-0@lo:400:kworker.0 Request processed in 29us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321045.978302:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5210
00000100:00100000:0.0:1767321045.978328:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c44b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380168192:0@lo:400:kworker.0
00000100:00080000:0.0:1767321045.978659:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767321045.978664:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767321045.978666:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321045.983731:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321045.983746:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321045.983751:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321045.983759:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5943
00000100:00080000:2.0:1767321045.983765:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321045.983773:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321045.983820:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c448700 x1853164380168320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321045.985656:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380168320:0@lo:38:kworker.0
00000100:00100000:1.0:1767321045.985730:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321045.986103:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168320
00000100:00100000:2.0:1767321045.986111:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168320
00000100:00100000:2.0:1767321045.986161:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18250
00000100:00100000:2.0:1767321045.986168:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380168320:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321045.986202:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321045.986252:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380168320:12345-0@lo:38:kworker.0 Request processed in 82us (521us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321045.986259:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18250
00000100:00080000:2.0:1767321045.986316:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321045.986321:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321045.986324:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c448700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380168320:0@lo:38:kworker.0
00000100:00100000:3.0:1767321045.987093:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380167680:12345-0@lo:400:kworker.0 Request processed in 9957us (10902us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321045.987104:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094
00000100:00100000:0.0:1767321045.988162:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380167680:0@lo:400:kworker.0
00010000:00010000:3.0:1767321046.552166:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321046.999310:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767321046.999331:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380168448:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321046.999421:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321046.999635:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168448
00000100:00100000:2.0:1767321046.999643:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168448
00000100:00100000:2.0:1767321046.999700:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914
00000100:00100000:2.0:1767321046.999710:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380168448:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767321046.999740:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321046.999849:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380168448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (428us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321046.999857:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914
00000100:00100000:1.0:1767321047.000307:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380168448:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321047.575140:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321048.535332:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380168576:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321048.535405:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321048.535617:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168576
00000100:00100000:3.0:1767321048.535625:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168576
00000100:00100000:3.0:1767321048.535689:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915
00000100:00100000:3.0:1767321048.535699:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380168576:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321048.535729:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321048.535779:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e07330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380168576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (374us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321048.535787:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915
00000100:00080000:0.0:1767321048.536029:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321048.536067:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380168576:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767321048.599782:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321049.623574:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321050.649733:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321051.024104:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321051.024148:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321051.024238:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008704
00000100:00100000:2.0:1767321051.024249:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008704
00000100:00100000:2.0:1767321051.024326:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008576
00000100:00100000:2.0:1767321051.024330:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008576
00000100:00100000:2.0:1767321051.024348:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5211
00000100:00100000:2.0:1767321051.024360:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292008704:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321051.024439:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292008704:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (346us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321051.024447:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5211
00000100:00100000:2.0:1767321051.024465:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18251
00000100:00100000:2.0:1767321051.024481:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292008576:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767321051.024499:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321051.024522:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292008576:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 41us (374us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321051.024528:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18251
00000100:00080000:0.0:1767321051.024961:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767321051.098867:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321051.098888:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767321051.098891:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321051.098903:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321051.098908:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321051.098916:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5948
00000100:00080000:3.0:1767321051.098921:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321051.098929:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321051.098969:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d500 x1853164380168704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321051.099000:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321051.099004:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321051.099005:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321051.099009:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5948
00000100:00080000:3.0:1767321051.099012:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321051.099016:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321051.099028:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c380 x1853164380168832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321051.099123:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380168960:0@lo:400:kworker.0
00000100:00100000:1.0:1767321051.099194:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321051.099320:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168960
00000100:00100000:0.0:1767321051.099329:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168960
00000100:00100000:0.0:1767321051.099401:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096
00000100:00100000:0.0:1767321051.099412:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380168960:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.099509:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380168704:0@lo:38:kworker.0
00000100:00100000:2.0:1767321051.099541:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321051.099560:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380168832:0@lo:38:kworker.0
00000100:00100000:2.0:1767321051.099580:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321051.099630:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168832
00000100:00100000:2.0:1767321051.099634:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168832
00000100:00100000:2.0:1767321051.099655:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302
00000100:00100000:2.0:1767321051.099660:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380168832:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321051.099679:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321051.099713:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380168832:12345-0@lo:38:kworker.0 Request processed in 51us (131us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321051.099720:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302
00000100:00080000:2.0:1767321051.099742:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321051.099766:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321051.099771:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321051.099774:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380168832:0@lo:38:kworker.0
00000100:00100000:2.0:1767321051.099813:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380168704
00000100:00100000:2.0:1767321051.099817:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380168704
00000100:00100000:2.0:1767321051.099837:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18252
00000100:00100000:2.0:1767321051.099842:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380168704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321051.099852:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321051.100265:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380168704:12345-0@lo:38:kworker.0 Request processed in 419us (720us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321051.100272:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18252
00000100:00080000:2.0:1767321051.100300:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321051.100304:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321051.100306:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380168704:0@lo:38:kworker.0
00000100:00080000:3.0:1767321051.100506:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321051.100510:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321051.100513:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321051.100518:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5948
00000100:00080000:3.0:1767321051.100522:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321051.100527:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321051.100542:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729ce00 x1853164380169344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321051.100650:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380169344:0@lo:38:kworker.0
00000100:00100000:2.0:1767321051.100683:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321051.100711:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169344
00000100:00100000:2.0:1767321051.100716:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169344
00000100:00100000:2.0:1767321051.100735:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18253
00000100:00100000:2.0:1767321051.100740:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380169344:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321051.100752:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321051.100786:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380169344:12345-0@lo:38:kworker.0 Request processed in 44us (102us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321051.100791:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18253
00000100:00080000:2.0:1767321051.100828:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321051.100832:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321051.100835:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380169344:0@lo:38:kworker.0
00000100:00100000:2.0:1767321051.100854:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380169472:0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.100906:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321051.100934:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169472
00000100:00100000:2.0:1767321051.100938:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169472
00000100:00100000:2.0:1767321051.100968:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5212
00000100:00100000:2.0:1767321051.100973:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380169472:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.101008:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380169472:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321051.101014:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5212
00000100:00080000:2.0:1767321051.101028:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321051.101047:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380169472:0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.101084:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380169216:0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.101108:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321051.101125:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767321051.101131:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380169088:0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.101152:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321051.101173:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169088
00000100:00100000:2.0:1767321051.101176:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169088
00000100:00100000:2.0:1767321051.101202:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097
00000100:00100000:2.0:1767321051.101208:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380169088:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.101238:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380169088:12345-0@lo:400:kworker.0 Request processed in 29us (84us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321051.101244:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097
00000100:00080000:2.0:1767321051.101257:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767321051.101263:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169216
00000100:00100000:2.0:1767321051.101266:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169216
00000100:00100000:2.0:1767321051.101288:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5213
00000100:00100000:2.0:1767321051.101293:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380169216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.101319:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380169216:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321051.101325:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5213
00000100:00080000:2.0:1767321051.101605:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321051.101628:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380169088:0@lo:400:kworker.0
00000100:00100000:2.0:1767321051.101638:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380169216:0@lo:400:kworker.0
00000100:00100000:0.0:1767321051.106692:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380168960:12345-0@lo:400:kworker.0 Request processed in 7270us (7486us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321051.106708:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096
00000100:00100000:1.0:1767321051.107961:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380168960:0@lo:400:kworker.0
00000100:00080000:3.0:1767321051.109011:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321051.109018:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321051.109022:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321051.109028:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5948
00000100:00080000:3.0:1767321051.109033:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321051.109039:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321051.109425:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729f100 x1853164380169600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321051.109508:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380169600:0@lo:38:kworker.0
00000100:00100000:2.0:1767321051.109577:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321051.109665:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169600
00000100:00100000:0.0:1767321051.109673:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169600
00000100:00100000:0.0:1767321051.109720:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18254
00000100:00100000:0.0:1767321051.109728:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380169600:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321051.109751:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321051.112890:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380169600:12345-0@lo:38:kworker.0 Request processed in 3140us (3291us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321051.112914:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18254
00000100:00080000:2.0:1767321051.117530:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321051.117544:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321051.117550:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380169600:0@lo:38:kworker.0
00010000:00010000:1.0:1767321051.676680:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321052.119966:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380169728:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321052.120056:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321052.120195:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169728
00000100:00100000:2.0:1767321052.120204:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169728
00000100:00100000:2.0:1767321052.120264:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916
00000100:00100000:2.0:1767321052.120274:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f06005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380169728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767321052.120306:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321052.120367:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f06005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380169728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (310us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321052.120376:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916
00000100:00100000:1.0:1767321052.120505:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380169728:0@lo:13:osp-pre-1-1.0
00010000:00010000:2.0:1767321052.697370:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321053.655289:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767321053.655316:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380169856:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321053.655393:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321053.655793:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169856
00000100:00100000:3.0:1767321053.655802:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169856
00000100:00100000:3.0:1767321053.655900:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917
00000100:00100000:3.0:1767321053.655910:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380169856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321053.655941:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:2.0:1767321053.656066:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767321053.656165:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380169856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 256us (771us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321053.656173:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917
00000100:00100000:1.0:1767321053.659397:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380169856:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321053.719143:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321054.747923:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321055.767314:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321056.148463:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321056.148545:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321056.148706:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008960
00000100:00100000:0.0:1767321056.148716:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008960
00000100:00100000:0.0:1767321056.148784:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292008832
00000100:00100000:0.0:1767321056.148788:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292008832
00000100:00100000:0.0:1767321056.148810:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5214
00000100:00100000:0.0:1767321056.148822:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292008960:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767321056.148935:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292008960:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 115us (481us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321056.148943:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5214
00000100:00100000:0.0:1767321056.148960:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18255
00000100:00100000:0.0:1767321056.148964:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292008832:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767321056.148985:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321056.149010:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292008832:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 43us (465us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321056.149016:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18255
00000100:00080000:2.0:1767321056.150545:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1767321056.215090:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321056.215107:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767321056.215114:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321056.215120:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321056.215127:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321056.215139:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5953
00000100:00080000:3.0:1767321056.215145:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321056.215159:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321056.215226:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729c380 x1853164380169984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321056.215272:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321056.215277:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321056.215279:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321056.215284:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5953
00000100:00080000:3.0:1767321056.215287:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321056.215291:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321056.215313:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0729d500 x1853164380170112/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321056.215377:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380169984:0@lo:38:kworker.0
00000100:00100000:2.0:1767321056.215479:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321056.215557:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380170112:0@lo:38:kworker.0
00000100:00100000:2.0:1767321056.215595:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321056.215653:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00080000:3.0:1767321056.215659:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321056.215665:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1767321056.215669:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380170240:0@lo:400:kworker.0
00000100:00080000:3.0:1767321056.215671:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321056.215683:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5953
00000100:00080000:3.0:1767321056.215688:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321056.215694:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321056.215716:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be04e00 x1853164380170624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321056.215717:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321056.215769:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380170112
00000100:00080000:3.0:1767321056.215772:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321056.215778:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321056.215780:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1767321056.215784:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380170112
00000100:00080000:3.0:1767321056.215786:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5953
00000100:00100000:2.0:1767321056.215828:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303
00000100:00100000:2.0:1767321056.215836:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380170112:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321056.215891:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321056.215928:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767321056.215934:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380170112:12345-0@lo:38:kworker.0 Request processed in 97us (339us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321056.215939:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380170752:0@lo:400:kworker.0
00000100:00100000:2.0:1767321056.215941:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303
00000100:00100000:1.0:1767321056.215969:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321056.215974:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380170624:0@lo:38:kworker.0
00000100:00100000:2.0:1767321056.215997:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321056.215998:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380170496:0@lo:400:kworker.0
00000100:00100000:1.0:1767321056.216018:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321056.216029:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321056.216033:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321056.216035:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767321056.216037:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380170112:0@lo:38:kworker.0
00000100:00100000:1.0:1767321056.216040:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380170368:0@lo:400:kworker.0
00000100:00100000:1.0:1767321056.216059:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321056.216064:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380169984
00000100:00100000:2.0:1767321056.216068:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380169984
00000100:00100000:2.0:1767321056.216090:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380170752
00000100:00080000:3.0:1767321056.216092:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1767321056.216098:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380170752
00000100:00080000:3.0:1767321056.216103:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321056.216104:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380170624
00000100:00100000:1.0:1767321056.216113:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380170624
00000100:00100000:3.0:1767321056.216134:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0be06300 x1853164380170880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767321056.216186:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380170240
00000100:00100000:2.0:1767321056.216205:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380170496
00000100:00100000:2.0:1767321056.216210:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380170496
00000100:00100000:0.0:1767321056.216241:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380170240
00000100:00100000:0.0:1767321056.216272:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380170368
00000100:00100000:0.0:1767321056.216275:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380170368
00000100:00100000:0.0:1767321056.216297:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098
00000100:00100000:0.0:1767321056.216304:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380170240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321056.216348:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380170240:12345-0@lo:400:kworker.0 Request processed in 44us (635us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321056.216354:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098
00000100:00100000:0.0:1767321056.216367:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099
00000100:00100000:0.0:1767321056.216373:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380170368:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321056.216402:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380170368:12345-0@lo:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321056.216407:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099
00000100:00100000:1.0:1767321056.221296:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215
00000100:00100000:1.0:1767321056.221322:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380170752:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321056.221814:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5216
00000100:00100000:3.0:1767321056.221841:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380170496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321056.222359:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380170752:12345-0@lo:400:kworker.0 Request processed in 1046us (6384us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321056.222389:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215
00000100:00100000:1.0:1767321056.222432:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18256
00000100:00100000:1.0:1767321056.222438:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380169984:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321056.222460:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321056.222494:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380169984:12345-0@lo:38:kworker.0 Request processed in 56us (7017us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321056.222504:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18256
00000100:00100000:1.0:1767321056.222516:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18257
00000100:00100000:1.0:1767321056.222520:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380170624:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321056.222529:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321056.222550:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380170624:12345-0@lo:38:kworker.0 Request processed in 29us (6552us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321056.222555:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18257
00000100:00100000:1.0:1767321056.222627:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380170752:0@lo:400:kworker.0
00000100:00100000:1.0:1767321056.222670:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380170368:0@lo:400:kworker.0
00000100:00100000:1.0:1767321056.222683:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380170496:0@lo:400:kworker.0
00000100:00100000:1.0:1767321056.222731:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380170240:0@lo:400:kworker.0
00000100:00100000:2.0:1767321056.222770:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380170880:0@lo:38:kworker.0
00000100:00080000:1.0:1767321056.222775:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1767321056.222780:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1767321056.222783:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321056.222813:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321056.222857:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321056.222863:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321056.222879:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380170624:0@lo:38:kworker.0
00000100:00100000:1.0:1767321056.222881:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380170880
00000100:00100000:1.0:1767321056.222886:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380170880
00000100:00080000:2.0:1767321056.222889:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321056.222892:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321056.222895:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0729c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380169984:0@lo:38:kworker.0
00000100:00100000:1.0:1767321056.222911:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18258
00000100:00100000:1.0:1767321056.222915:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380170880:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321056.222925:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321056.222961:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380170880:12345-0@lo:38:kworker.0 Request processed in 44us (147us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321056.222967:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18258
00000100:00080000:2.0:1767321056.223032:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321056.223037:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321056.223040:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380170880:0@lo:38:kworker.0
00000100:00100000:3.0:1767321056.226904:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380170496:12345-0@lo:400:kworker.0 Request processed in 5042us (10850us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321056.226925:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5216
00010000:00010000:2.0:1767321056.791133:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321057.241468:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767321057.241487:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380171008:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767321057.241562:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321057.241646:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171008
00000100:00100000:0.0:1767321057.241653:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171008
00000100:00100000:0.0:1767321057.241718:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918
00000100:00100000:0.0:1767321057.241727:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380171008:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321057.241755:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321057.241806:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380171008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (243us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321057.241814:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918
00000100:00100000:1.0:1767321057.241856:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380171008:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321057.815204:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321058.775671:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1767321058.778639:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380171136:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321058.778717:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321058.780916:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171136
00000100:00100000:0.0:1767321058.780933:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171136
00000100:00100000:0.0:1767321058.781085:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919
00000100:00100000:0.0:1767321058.781106:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380171136:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767321058.781142:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321058.781232:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c449500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380171136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (2515us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321058.781240:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919
00000100:00100000:3.0:1767321058.781481:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380171136:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767321058.783320:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1767321058.839268:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321059.863725:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321060.887316:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321061.263042:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321061.263095:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321061.263159:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292009216
00000100:00100000:0.0:1767321061.263169:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292009216
00000100:00100000:3.0:1767321061.263235:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292009088
00000100:00100000:3.0:1767321061.263240:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292009088
00000100:00100000:3.0:1767321061.263306:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5217
00000100:00100000:3.0:1767321061.263319:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292009216:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767321061.263395:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292009216:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 81us (362us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321061.263403:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5217
00000100:00100000:3.0:1767321061.263420:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18259
00000100:00100000:3.0:1767321061.263425:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292009088:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321061.263445:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321061.263472:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2516:x1853164292009088:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (377us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321061.263479:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18259
00000100:00080000:1.0:1767321061.266826:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1767321061.335140:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321061.335153:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767321061.335156:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321061.335160:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321061.335164:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321061.335173:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5958
00000100:00080000:0.0:1767321061.335178:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321061.335184:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321061.335227:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fce00 x1853164380171264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767321061.335244:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321061.335247:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321061.335249:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321061.335252:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5958
00000100:00080000:0.0:1767321061.335254:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321061.335257:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321061.335268:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd500 x1853164380171392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321061.335337:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:0.0:1767321061.335392:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321061.335397:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321061.335399:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321061.335403:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5958
00000100:00080000:0.0:1767321061.335406:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321061.335412:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321061.335413:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380171776:0@lo:400:kworker.0
00000100:00100000:0.0:1767321061.335425:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd180 x1853164380171904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321061.335495:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380171264:0@lo:38:kworker.0
00000100:00100000:2.0:1767321061.335546:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321061.335594:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380171392:0@lo:38:kworker.0
00000100:00100000:3.0:1767321061.337078:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321061.337132:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1767321061.337143:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380171648:0@lo:400:kworker.0
00000100:00100000:3.0:1767321061.337172:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321061.337216:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171264
00000100:00100000:3.0:1767321061.337223:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171264
00000100:00100000:3.0:1767321061.337256:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171776
00000100:00100000:3.0:1767321061.337258:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171776
00000100:00100000:3.0:1767321061.337296:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5218
00000100:00100000:3.0:1767321061.337304:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380171776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321061.337347:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380171776:12345-0@lo:400:kworker.0 Request processed in 44us (275us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321061.337352:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5218
00000100:00100000:3.0:1767321061.337364:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18260
00000100:00100000:3.0:1767321061.337367:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380171264:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321061.337382:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321061.337402:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380171264:12345-0@lo:38:kworker.0 Request processed in 34us (1857us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321061.337406:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18260
00000100:00080000:3.0:1767321061.337416:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321061.337438:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380171776:0@lo:400:kworker.0
00000100:00100000:2.0:1767321061.337736:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321061.337770:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380171904:0@lo:38:kworker.0
00000100:00100000:2.0:1767321061.337791:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321061.337830:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321061.337836:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321061.337839:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380171264:0@lo:38:kworker.0
00000100:00100000:2.0:1767321061.338147:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171904
00000100:00100000:2.0:1767321061.338152:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171904
00000100:00100000:2.0:1767321061.338173:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18261
00000100:00100000:2.0:1767321061.338177:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380171904:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321061.338186:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321061.338212:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380171904:12345-0@lo:38:kworker.0 Request processed in 35us (421us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321061.338216:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18261
00000100:00080000:2.0:1767321061.338235:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321061.338238:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321061.338240:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380171904:0@lo:38:kworker.0
00000100:00100000:3.0:1767321061.339018:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171392
00000100:00100000:3.0:1767321061.339027:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171392
00000100:00100000:3.0:1767321061.339063:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304
00000100:00100000:3.0:1767321061.339070:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380171392:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321061.339085:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321061.339132:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c44b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380171392:12345-0@lo:38:kworker.0 Request processed in 62us (1395us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321061.339139:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304
00000100:00080000:3.0:1767321061.339188:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321061.339194:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321061.339197:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380171392:0@lo:38:kworker.0
00000100:00100000:1.0:1767321061.343464:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380172032:0@lo:400:kworker.0
00000100:00100000:1.0:1767321061.343689:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321061.343747:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380171520:0@lo:400:kworker.0
00000100:00100000:1.0:1767321061.343774:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321061.343839:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171648
00000100:00100000:1.0:1767321061.343848:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171648
00000100:00100000:1.0:1767321061.343931:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380171520
00000100:00100000:1.0:1767321061.343935:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380171520
00000100:00100000:1.0:1767321061.343960:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100
00000100:00100000:1.0:1767321061.343968:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380171648:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321061.344453:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101
00000100:00100000:2.0:1767321061.344466:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380171520:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321061.345671:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380171520:12345-0@lo:400:kworker.0 Request processed in 1200us (1888us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321061.345683:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101
00000100:00080000:2.0:1767321061.345727:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321061.345732:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767321061.345851:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172032
00000100:00100000:3.0:1767321061.345861:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172032
00000100:00100000:3.0:1767321061.345934:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5219
00000100:00100000:3.0:1767321061.345942:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380172032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321061.346211:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380172032:12345-0@lo:400:kworker.0 Request processed in 52us (2304us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321061.346218:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5219
00000100:00080000:0.0:1767321061.346316:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321061.346321:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321061.346326:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321061.346332:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5958
00000100:00080000:0.0:1767321061.346336:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321061.346341:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321061.346888:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fdf80 x1853164380172160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767321061.346977:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380172032:0@lo:400:kworker.0
00000100:00080000:2.0:1767321061.347245:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321061.347324:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380172160:0@lo:38:kworker.0
00000100:00100000:0.0:1767321061.347372:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380171520:0@lo:400:kworker.0
00000100:00100000:2.0:1767321061.347914:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380171648:0@lo:400:kworker.0
00000100:00100000:3.0:1767321061.352583:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321061.354289:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172160
00000100:00100000:2.0:1767321061.354317:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172160
00000100:00100000:2.0:1767321061.354373:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18262
00000100:00100000:2.0:1767321061.354382:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380172160:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321061.354408:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321061.354499:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380172160:12345-0@lo:38:kworker.0 Request processed in 116us (1922us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321061.354505:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18262
00000100:00080000:0.0:1767321061.354826:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321061.354833:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321061.354838:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380172160:0@lo:38:kworker.0
00000100:00100000:1.0:1767321061.357903:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380171648:12345-0@lo:400:kworker.0 Request processed in 13923us (20717us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321061.357920:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100
00010000:00010000:1.0:1767321061.911688:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321062.359338:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380172288:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321062.359427:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321062.359896:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172288
00000100:00100000:2.0:1767321062.359907:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172288
00000100:00100000:2.0:1767321062.359968:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920
00000100:00100000:2.0:1767321062.359977:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380172288:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1767321062.360007:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321062.360070:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380172288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (642us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321062.360078:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920
00000100:00100000:3.0:1767321062.360341:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380172288:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767321062.938564:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321063.895082:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767321063.898070:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380172416:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321063.898161:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321063.898476:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172416
00000100:00100000:0.0:1767321063.898486:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172416
00000100:00100000:0.0:1767321063.898565:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921
00000100:00100000:0.0:1767321063.898576:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380172416:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767321063.898610:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321063.898681:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380172416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (518us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321063.898689:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921
00000100:00100000:1.0:1767321063.898733:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380172416:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767321063.898938:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767321063.960559:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1767321064.985818:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321066.009435:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321066.383377:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321066.383492:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292009344
00000100:00100000:1.0:1767321066.383509:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292009344
00000100:00100000:1.0:1767321066.383570:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18263
00000100:00100000:1.0:1767321066.383580:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292009344:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767321066.383604:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321066.383691:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292009344:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 111us (329us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321066.383699:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18263
00000100:00100000:1.0:1767321066.390801:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321066.393472:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292009472
00000100:00100000:3.0:1767321066.393487:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292009472
00000100:00100000:3.0:1767321066.393577:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5220
00000100:00100000:3.0:1767321066.393590:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292009472:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767321066.393669:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292009472:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 83us (2877us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321066.393677:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5220
00000100:00080000:2.0:1767321066.393934:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000400:00000100:2.0:1767321066.393972:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292009600 offset 0 length 520: 4
00000100:00080000:3.0:1767321066.456640:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321066.456654:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767321066.456658:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321066.456662:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321066.456668:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321066.456679:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5963
00000100:00080000:3.0:1767321066.456685:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321066.456696:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321066.456770:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebd500 x1853164380172544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321066.456808:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321066.456811:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321066.456813:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321066.456817:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5963
00000100:00080000:3.0:1767321066.456819:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321066.456823:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321066.456838:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebf800 x1853164380172672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321066.456954:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321066.456958:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321066.456960:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321066.456964:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5963
00000100:00080000:3.0:1767321066.456966:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321066.456970:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321066.456981:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164380173184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321066.457008:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321066.457011:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321066.457013:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321066.457017:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5963
00000100:00080000:3.0:1767321066.457019:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321066.457023:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321066.457035:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebed80 x1853164380173440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321066.457071:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380173056:0@lo:400:kworker.0
00000100:00100000:3.0:1767321066.457163:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321066.457247:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767321066.457253:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380172928:0@lo:400:kworker.0
00000100:00100000:3.0:1767321066.457284:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321066.457646:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380173312:0@lo:400:kworker.0
00000100:00100000:0.0:1767321066.457684:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321066.457717:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767321066.457722:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380172800:0@lo:400:kworker.0
00000100:00100000:0.0:1767321066.457744:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321066.457922:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172928
00000100:00100000:2.0:1767321066.457943:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172928
00000100:00080000:0.0:1767321066.458117:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321066.458158:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380172544:0@lo:38:kworker.0
00000100:00100000:0.0:1767321066.458192:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321066.458212:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380172672:0@lo:38:kworker.0
00000100:00100000:0.0:1767321066.458237:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321066.458263:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380173184:0@lo:38:kworker.0
00000100:00100000:0.0:1767321066.458285:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321066.458303:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380173440:0@lo:38:kworker.0
00000100:00100000:0.0:1767321066.458325:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321066.458355:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380173056
00000100:00100000:0.0:1767321066.458359:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380173056
00000100:00100000:0.0:1767321066.458406:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380173312
00000100:00100000:0.0:1767321066.458410:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380173312
00000100:00100000:0.0:1767321066.458437:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172544
00000100:00100000:0.0:1767321066.458440:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172544
00000100:00100000:0.0:1767321066.458448:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380173184
00000100:00100000:0.0:1767321066.458450:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380173184
00000100:00100000:0.0:1767321066.458459:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380173440
00000100:00100000:0.0:1767321066.458462:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380173440
00000100:00100000:0.0:1767321066.458475:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5221
00000100:00100000:0.0:1767321066.458484:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380173056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321066.458545:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380173056:12345-0@lo:400:kworker.0 Request processed in 62us (1382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321066.458554:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5221
00000100:00100000:0.0:1767321066.458574:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5222
00000100:00100000:0.0:1767321066.458581:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380173312:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321066.458626:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380173312:12345-0@lo:400:kworker.0 Request processed in 46us (942us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321066.458632:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5222
00000100:00100000:0.0:1767321066.458644:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18264
00000100:00100000:0.0:1767321066.458648:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380172544:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321066.458669:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321066.458702:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380172544:12345-0@lo:38:kworker.0 Request processed in 52us (509us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321066.458708:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18264
00000100:00100000:0.0:1767321066.458720:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18265
00000100:00100000:0.0:1767321066.458724:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380173184:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321066.458733:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321066.458766:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380173184:12345-0@lo:38:kworker.0 Request processed in 30us (470us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321066.458772:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18265
00000100:00100000:0.0:1767321066.458783:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18266
00000100:00100000:0.0:1767321066.458788:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380173440:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321066.458798:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321066.458820:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380173440:12345-0@lo:38:kworker.0 Request processed in 31us (494us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321066.458825:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18266
00000100:00080000:0.0:1767321066.458842:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321066.458917:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380173312:0@lo:400:kworker.0
00000100:00100000:0.0:1767321066.458973:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380173056:0@lo:400:kworker.0
00000100:00100000:2.0:1767321066.459120:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172800
00000100:00100000:2.0:1767321066.459125:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172800
00000100:00100000:2.0:1767321066.459159:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102
00000100:00100000:2.0:1767321066.459167:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380172928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321066.459213:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380172928:12345-0@lo:400:kworker.0 Request processed in 48us (1929us total) trans 0 rc 0/0
00000100:00080000:0.0:1767321066.459220:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321066.459227:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321066.459231:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380172544:0@lo:38:kworker.0
00000100:00100000:2.0:1767321066.459232:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102
00000100:00080000:0.0:1767321066.459244:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767321066.459246:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103
00000100:00080000:0.0:1767321066.459248:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321066.459251:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380173184:0@lo:38:kworker.0
00000100:00100000:2.0:1767321066.459252:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380172800:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767321066.459258:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321066.459262:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321066.459264:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380173440:0@lo:38:kworker.0
00000100:00100000:2.0:1767321066.459284:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380172800:12345-0@lo:400:kworker.0 Request processed in 32us (1539us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321066.459290:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103
00000100:00100000:2.0:1767321066.459322:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380172800:0@lo:400:kworker.0
00000100:00100000:0.0:1767321066.459323:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380172672
00000100:00100000:0.0:1767321066.459326:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380172672
00000100:00100000:2.0:1767321066.459345:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380172928:0@lo:400:kworker.0
00000100:00100000:0.0:1767321066.459346:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305
00000100:00100000:0.0:1767321066.459351:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380172672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321066.459362:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:2.0:1767321066.459366:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767321066.459393:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380172672:12345-0@lo:38:kworker.0 Request processed in 40us (1154us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321066.459402:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305
00000100:00080000:2.0:1767321066.459410:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321066.459545:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321066.459549:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380172672:0@lo:38:kworker.0
00010000:00010000:3.0:1767321067.031580:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321067.480098:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767321067.480120:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380173568:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321067.480179:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321067.480363:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380173568
00000100:00100000:0.0:1767321067.480371:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380173568
00000100:00100000:0.0:1767321067.480424:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922
00000100:00100000:0.0:1767321067.480433:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380173568:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321067.480462:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321067.480507:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380173568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (327us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321067.480515:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922
00000100:00100000:3.0:1767321067.480636:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380173568:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321068.055158:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321069.015168:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380173696:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321069.015249:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321069.015723:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380173696
00000100:00100000:0.0:1767321069.015741:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380173696
00000100:00100000:0.0:1767321069.015818:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923
00000100:00100000:0.0:1767321069.015829:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380173696:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767321069.015859:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321069.015940:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380173696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (689us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321069.015947:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923
00000100:00080000:2.0:1767321069.016011:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1767321069.016040:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380173696:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767321069.083402:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321070.106177:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321070.551021:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321045/real 1767321045]  req@ffff8b0e0be04000 x1853164380167296/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321070 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767321070.551059:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0be04000 x1853164380167296/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321070 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1767321070.551079:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321070.551109:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:2.0:1767321070.551113:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0be04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380167296:0@lo:250:kworker.0
00000100:00080000:3.0:1767321070.551222:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321070.551229:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767321070.551232:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321070.551237:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5948
00000100:00080000:3.0:1767321070.551241:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321070.551247:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321070.551280:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fd880 x1853164380173824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321070.551303:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321070.551314:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321070.551316:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321070.551319:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5968
00000100:00080000:3.0:1767321070.551322:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321070.551325:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321070.551341:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fdf80 x1853164380173952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321070.551350:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321070.551353:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321070.551355:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321070.551358:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5968
00000100:00080000:3.0:1767321070.551361:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321070.551364:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321070.551375:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fc000 x1853164380174080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321070.551862:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380173824:0@lo:250:kworker.0
00000400:00000100:2.0:1767321070.551937:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380173824 offset 0 length 520: 4
00000100:00100000:2.0:1767321070.551978:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380173952:0@lo:38:kworker.0
00000100:00100000:2.0:1767321070.552005:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321070.552036:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380174080:0@lo:38:kworker.0
00000100:00100000:2.0:1767321070.552059:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321070.552115:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174080
00000100:00100000:2.0:1767321070.552122:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174080
00000100:00100000:2.0:1767321070.552154:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306
00000100:00100000:2.0:1767321070.552161:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380174080:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321070.552180:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321070.552219:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380174080:12345-0@lo:38:kworker.0 Request processed in 57us (158us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321070.552225:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306
00000100:00080000:2.0:1767321070.552262:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321070.552266:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321070.552269:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380174080:0@lo:38:kworker.0
00000100:00100000:1.0:1767321070.552357:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380173952
00000100:00100000:1.0:1767321070.552361:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380173952
00000100:00100000:1.0:1767321070.552395:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18267
00000100:00100000:1.0:1767321070.552410:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380173952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321070.552419:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321070.552452:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380173952:12345-0@lo:38:kworker.0 Request processed in 51us (447us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321070.552458:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18267
00000100:00080000:2.0:1767321070.552929:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321070.552934:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321070.552937:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380173952:0@lo:38:kworker.0
00000100:00080000:3.0:1767321070.553055:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321070.553059:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321070.553062:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321070.553066:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5968
00000100:00080000:3.0:1767321070.553069:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321070.553074:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321070.553089:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fce00 x1853164380174592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321070.553110:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321070.553113:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321070.553115:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321070.553118:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5968
00000100:00080000:3.0:1767321070.553120:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321070.553123:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321070.553132:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f2f3fea00 x1853164380174848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321070.553200:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380174720:0@lo:400:kworker.0
00000100:00100000:1.0:1767321070.553239:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321070.553273:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1767321070.553278:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380174208:0@lo:400:kworker.0
00000100:00100000:1.0:1767321070.553304:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321070.553344:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174208
00000100:00100000:1.0:1767321070.553349:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174208
00000100:00100000:1.0:1767321070.553396:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104
00000100:00100000:1.0:1767321070.553416:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380174208:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321070.553461:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380174208:12345-0@lo:400:kworker.0 Request processed in 45us (155us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321070.553468:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104
00000100:00080000:1.0:1767321070.553485:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767321070.553505:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380174208:0@lo:400:kworker.0
00000100:00100000:3.0:1767321070.553945:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174720
00000100:00100000:3.0:1767321070.553950:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174720
00000100:00100000:3.0:1767321070.554037:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5223
00000100:00100000:3.0:1767321070.554044:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380174720:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321070.554088:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380174720:12345-0@lo:400:kworker.0 Request processed in 45us (848us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321070.554097:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5223
00000100:00100000:3.0:1767321070.554145:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380174720:0@lo:400:kworker.0
00000100:00100000:2.0:1767321070.554375:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380174336:0@lo:400:kworker.0
00000100:00100000:2.0:1767321070.554420:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321070.554449:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767321070.554455:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380174464:0@lo:400:kworker.0
00000100:00100000:2.0:1767321070.554474:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321070.554500:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174464
00000100:00100000:2.0:1767321070.554504:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174464
00000100:00100000:3.0:1767321070.554554:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174336
00000100:00100000:3.0:1767321070.554558:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174336
00000100:00100000:3.0:1767321070.554584:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105
00000100:00100000:3.0:1767321070.554590:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380174336:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321070.554638:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380174336:12345-0@lo:400:kworker.0 Request processed in 48us (217us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321070.554644:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105
00000100:00100000:3.0:1767321070.554677:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380174592:0@lo:38:kworker.0
00000100:00100000:3.0:1767321070.554712:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321070.554739:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380174848:0@lo:38:kworker.0
00000100:00100000:3.0:1767321070.554758:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321070.554783:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174592
00000100:00100000:3.0:1767321070.554787:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174592
00000100:00100000:3.0:1767321070.554803:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174848
00000100:00100000:3.0:1767321070.554805:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174848
00000100:00100000:3.0:1767321070.554820:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18268
00000100:00100000:3.0:1767321070.554824:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380174592:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321070.554838:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321070.554896:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380174592:12345-0@lo:38:kworker.0 Request processed in 44us (156us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321070.554902:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18268
00000100:00100000:3.0:1767321070.554913:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18269
00000100:00100000:3.0:1767321070.554917:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380174848:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321070.554926:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321070.554952:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380174848:12345-0@lo:38:kworker.0 Request processed in 33us (192us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321070.554958:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18269
00000100:00080000:3.0:1767321070.554989:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321070.554993:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321070.554997:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380174592:0@lo:38:kworker.0
00000100:00080000:3.0:1767321070.555004:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321070.555007:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321070.555009:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380174848:0@lo:38:kworker.0
00000100:00100000:3.0:1767321070.555042:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380174336:0@lo:400:kworker.0
00000100:00080000:1.0:1767321070.561608:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321070.564568:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5224
00000100:00100000:2.0:1767321070.564591:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380174464:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321070.564704:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0729d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380174464:12345-0@lo:400:kworker.0 Request processed in 123us (10228us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321070.564711:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5224
00000100:00100000:3.0:1767321070.564833:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380174464:0@lo:400:kworker.0
00010000:00010000:3.0:1767321071.128086:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321071.505001:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321071.505112:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292009856
00000100:00100000:2.0:1767321071.505122:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292009856
00000100:00100000:2.0:1767321071.505206:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5225
00000100:00100000:2.0:1767321071.505216:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292009856:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321071.505303:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292009856:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 89us (312us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321071.505311:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5225
00000100:00080000:1.0:1767321071.505802:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321071.511213:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321071.511556:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292009728
00000100:00100000:3.0:1767321071.511570:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292009728
00000100:00100000:3.0:1767321071.511645:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18270
00000100:00100000:3.0:1767321071.511656:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292009728:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321071.511687:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321071.511794:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292009728:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 139us (601us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321071.511802:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18270
00010000:00010000:1.0:1767321072.151205:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321072.599176:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767321072.599194:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380174976:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321072.599277:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321072.599373:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380174976
00000100:00100000:0.0:1767321072.599382:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380174976
00000100:00100000:0.0:1767321072.599433:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924
00000100:00100000:0.0:1767321072.599440:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380174976:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321072.599463:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321072.599512:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380174976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (234us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321072.599520:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924
00000100:00100000:0.0:1767321072.599566:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380174976:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767321072.599799:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767321073.178769:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321074.135219:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767321074.135847:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380175104:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321074.136372:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321074.136809:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380175104
00000100:00100000:3.0:1767321074.136821:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380175104
00000100:00100000:3.0:1767321074.136989:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925
00000100:00100000:3.0:1767321074.137004:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380175104:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321074.137052:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321074.137139:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380175104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (769us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321074.137146:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925
00000100:00100000:2.0:1767321074.137344:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380175104:0@lo:13:osp-pre-0-1.0
00000100:00080000:1.0:1767321074.137706:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767321074.199520:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321075.223709:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767321075.671296:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321075.671310:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767321075.671314:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321075.671319:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321075.671324:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321075.671334:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5972
00000100:00080000:1.0:1767321075.671340:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321075.671350:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321075.671421:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edf80 x1853164380175232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321075.671454:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321075.671458:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321075.671461:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321075.671465:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5972
00000100:00080000:1.0:1767321075.671467:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321075.671472:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321075.671487:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2ec700 x1853164380175360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321075.671570:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321075.671573:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321075.671575:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321075.671579:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5972
00000100:00080000:1.0:1767321075.671582:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321075.671586:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321075.671597:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2efb80 x1853164380175872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321075.671614:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321075.671618:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321075.671620:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321075.671623:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5972
00000100:00080000:1.0:1767321075.671626:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321075.671631:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321075.671643:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0a2edc00 x1853164380176128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321075.671686:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380175744:0@lo:400:kworker.0
00000100:00100000:1.0:1767321075.671774:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321075.671851:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321075.671863:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380175616:0@lo:400:kworker.0
00000100:00100000:1.0:1767321075.671944:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321075.672090:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380176000:0@lo:400:kworker.0
00000100:00100000:0.0:1767321075.672125:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321075.672147:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767321075.672153:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380175488:0@lo:400:kworker.0
00000100:00100000:0.0:1767321075.672175:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321075.672221:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380175616
00000100:00100000:0.0:1767321075.672230:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380175616
00000100:00100000:0.0:1767321075.672286:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380175488
00000100:00100000:0.0:1767321075.672290:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380175488
00000100:00100000:0.0:1767321075.672328:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106
00000100:00100000:0.0:1767321075.672338:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380175616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321075.672399:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380175616:12345-0@lo:400:kworker.0 Request processed in 62us (453us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321075.672408:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106
00000100:00100000:0.0:1767321075.672428:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107
00000100:00100000:0.0:1767321075.672434:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380175488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321075.672463:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380175488:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321075.672468:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107
00000100:00080000:0.0:1767321075.672513:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767321075.672553:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380175488:0@lo:400:kworker.0
00000100:00100000:0.0:1767321075.672586:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380175616:0@lo:400:kworker.0
00000100:00100000:1.0:1767321075.672666:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380175744
00000100:00100000:1.0:1767321075.672681:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380175744
00000100:00100000:1.0:1767321075.672724:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176000
00000100:00100000:1.0:1767321075.672728:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176000
00000100:00100000:1.0:1767321075.672748:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5226
00000100:00100000:1.0:1767321075.672754:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380175744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321075.673082:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380175744:12345-0@lo:400:kworker.0 Request processed in 319us (1298us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321075.673098:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5226
00000100:00100000:1.0:1767321075.673138:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5227
00000100:00100000:1.0:1767321075.673152:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380176000:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767321075.673168:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321075.673470:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380175744:0@lo:400:kworker.0
00000100:00100000:3.0:1767321075.673607:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380175232:0@lo:38:kworker.0
00000100:00100000:1.0:1767321075.675027:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380176000:12345-0@lo:400:kworker.0 Request processed in 1873us (2892us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321075.675041:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5227
00000100:00100000:0.0:1767321075.675864:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380176000:0@lo:400:kworker.0
00000100:00100000:3.0:1767321075.683943:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321075.684055:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380175360:0@lo:38:kworker.0
00000100:00100000:3.0:1767321075.684095:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321075.684128:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380175872:0@lo:38:kworker.0
00000100:00100000:3.0:1767321075.684152:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321075.684191:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380176128:0@lo:38:kworker.0
00000100:00100000:0.0:1767321075.684238:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380175360
00000100:00100000:0.0:1767321075.684255:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380175360
00000100:00100000:0.0:1767321075.684313:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307
00000100:00100000:0.0:1767321075.684322:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380175360:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321075.684346:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321075.684431:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380175360:12345-0@lo:38:kworker.0 Request processed in 108us (333us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321075.684440:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307
00000100:00100000:3.0:1767321075.684457:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767321075.684528:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321075.684533:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321075.684537:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380175360:0@lo:38:kworker.0
00000100:00100000:3.0:1767321075.684569:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380175232
00000100:00100000:3.0:1767321075.684574:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380175232
00000100:00100000:3.0:1767321075.684612:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380175872
00000100:00100000:3.0:1767321075.684616:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380175872
00000100:00100000:3.0:1767321075.684633:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176128
00000100:00100000:3.0:1767321075.684637:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176128
00000100:00100000:0.0:1767321075.684744:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18271
00000100:00100000:0.0:1767321075.684750:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380175232:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321075.684762:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321075.684798:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380175232:12345-0@lo:38:kworker.0 Request processed in 47us (871us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321075.684805:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18271
00000100:00100000:0.0:1767321075.684821:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18272
00000100:00100000:0.0:1767321075.684825:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380175872:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321075.684835:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321075.684864:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380175872:12345-0@lo:38:kworker.0 Request processed in 37us (710us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321075.684918:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18272
00000100:00100000:2.0:1767321075.684949:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18273
00000100:00100000:2.0:1767321075.685018:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380176128:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321075.685038:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321075.685093:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380176128:12345-0@lo:38:kworker.0 Request processed in 76us (639us total) trans 0 rc -19/-19
00000100:00080000:3.0:1767321075.686550:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321075.686560:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321075.686566:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380175232:0@lo:38:kworker.0
00000100:00080000:3.0:1767321075.686578:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321075.686581:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321075.686584:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380175872:0@lo:38:kworker.0
00000100:00080000:3.0:1767321075.686593:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321075.686596:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321075.686599:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0a2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380176128:0@lo:38:kworker.0
00000100:00100000:2.0:1767321075.688713:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18273
00010000:00010000:1.0:1767321076.247208:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321076.629417:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321076.629466:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321076.629523:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292009984
00000100:00100000:0.0:1767321076.629534:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292009984
00000100:00100000:0.0:1767321076.629583:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292010112
00000100:00100000:0.0:1767321076.629586:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292010112
00000100:00100000:0.0:1767321076.629642:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5228
00000100:00100000:0.0:1767321076.629653:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292010112:12345-192.168.202.33@tcp:400:kworker.0
00000100:00080000:1.0:1767321076.629755:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321076.629762:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292010112:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 109us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321076.629771:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5228
00000100:00100000:1.0:1767321076.629779:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18274
00000100:00100000:1.0:1767321076.629787:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292009984:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767321076.629810:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321076.629844:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0be04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292009984:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 56us (438us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321076.629851:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18274
00010000:00010000:2.0:1767321077.272785:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321077.720483:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380176256:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1767321077.720566:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321077.720888:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176256
00000100:00100000:0.0:1767321077.720897:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176256
00000100:00100000:0.0:1767321077.720969:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926
00000100:00100000:0.0:1767321077.720979:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380176256:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321077.721010:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321077.721068:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380176256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (500us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321077.721075:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926
00000100:00080000:1.0:1767321077.721137:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767321077.721212:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380176256:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321078.295298:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321079.255392:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321079.255418:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380176384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321079.255489:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321079.255606:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176384
00000100:00100000:3.0:1767321079.255615:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176384
00000100:00100000:3.0:1767321079.255689:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927
00000100:00100000:3.0:1767321079.255699:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380176384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321079.255730:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321079.255795:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380176384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (305us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321079.255804:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927
00000100:00080000:1.0:1767321079.256065:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767321079.256102:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380176384:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767321079.319964:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321080.343697:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767321080.791295:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321080.791305:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321080.791308:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321080.791313:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321080.791317:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321080.791325:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5978
00000100:00080000:2.0:1767321080.791329:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321080.791336:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321080.791376:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d880 x1853164380176512/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321080.791407:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321080.791411:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321080.791413:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321080.791416:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5978
00000100:00080000:2.0:1767321080.791419:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321080.791422:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321080.791439:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9d500 x1853164380176640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321080.791514:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321080.791518:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321080.791520:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321080.791523:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5978
00000100:00080000:2.0:1767321080.791525:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321080.791528:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321080.791541:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ca80 x1853164380177152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321080.791554:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321080.791557:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321080.791559:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321080.791562:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5978
00000100:00080000:2.0:1767321080.791564:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321080.791568:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321080.791577:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ed80 x1853164380177408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321080.791602:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380177024:0@lo:400:kworker.0
00000100:00100000:2.0:1767321080.791680:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321080.791742:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767321080.791749:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380176896:0@lo:400:kworker.0
00000100:00100000:2.0:1767321080.791778:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321080.791817:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176896
00000100:00100000:2.0:1767321080.791823:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176896
00000100:00100000:2.0:1767321080.791892:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108
00000100:00100000:2.0:1767321080.791901:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380176896:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321080.792131:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380176896:12345-0@lo:400:kworker.0 Request processed in 230us (350us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321080.792139:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108
00000100:00100000:2.0:1767321080.792179:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380176896:0@lo:400:kworker.0
00000100:00100000:1.0:1767321080.792253:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380176768:0@lo:400:kworker.0
00000100:00100000:1.0:1767321080.792284:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321080.792317:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321080.792323:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380177280:0@lo:400:kworker.0
00000100:00100000:1.0:1767321080.792345:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321080.792375:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177024
00000100:00100000:1.0:1767321080.792379:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177024
00000100:00100000:1.0:1767321080.792414:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177280
00000100:00100000:1.0:1767321080.792417:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177280
00000100:00100000:1.0:1767321080.792439:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229
00000100:00100000:1.0:1767321080.792445:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380177024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321080.792481:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380177024:12345-0@lo:400:kworker.0 Request processed in 35us (801us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321080.792496:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229
00000100:00100000:1.0:1767321080.792514:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5230
00000100:00100000:1.0:1767321080.792521:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380177280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321080.792549:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380177280:12345-0@lo:400:kworker.0 Request processed in 29us (204us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321080.792555:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5230
00000100:00080000:1.0:1767321080.792571:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321080.792599:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380177280:0@lo:400:kworker.0
00000100:00100000:1.0:1767321080.792620:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380177024:0@lo:400:kworker.0
00000100:00100000:3.0:1767321080.792912:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380176512:0@lo:38:kworker.0
00000100:00100000:3.0:1767321080.792955:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321080.792979:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380176640:0@lo:38:kworker.0
00000100:00100000:3.0:1767321080.793002:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321080.793025:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380177152:0@lo:38:kworker.0
00000100:00100000:3.0:1767321080.793042:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321080.793055:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380177408:0@lo:38:kworker.0
00000100:00100000:3.0:1767321080.793075:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321080.793099:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176640
00000100:00100000:3.0:1767321080.793103:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176640
00000100:00100000:3.0:1767321080.793128:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308
00000100:00100000:3.0:1767321080.793133:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380176640:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321080.793153:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321080.793187:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380176640:12345-0@lo:38:kworker.0 Request processed in 52us (184us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321080.793194:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308
00000100:00080000:3.0:1767321080.793225:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321080.793230:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321080.793233:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380176640:0@lo:38:kworker.0
00000100:00100000:2.0:1767321080.793392:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176768
00000100:00100000:2.0:1767321080.793397:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176768
00000100:00100000:2.0:1767321080.793453:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109
00000100:00100000:2.0:1767321080.793461:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380176768:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321080.793519:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380176768:12345-0@lo:400:kworker.0 Request processed in 59us (1234us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321080.793525:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109
00000100:00100000:1.0:1767321080.793749:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380176512
00000100:00100000:1.0:1767321080.793755:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380176512
00000100:00100000:1.0:1767321080.793785:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177152
00000100:00100000:1.0:1767321080.793789:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177152
00000100:00100000:1.0:1767321080.793805:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177408
00000100:00100000:1.0:1767321080.793808:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177408
00000100:00100000:1.0:1767321080.793824:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18275
00000100:00100000:1.0:1767321080.793829:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380176512:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321080.793843:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321080.793903:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380176512:12345-0@lo:38:kworker.0 Request processed in 73us (947us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321080.793909:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18275
00000100:00100000:1.0:1767321080.793925:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18276
00000100:00100000:1.0:1767321080.793929:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380177152:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321080.793948:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321080.793972:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380177152:12345-0@lo:38:kworker.0 Request processed in 41us (929us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321080.793977:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18276
00000100:00100000:1.0:1767321080.793989:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18277
00000100:00100000:1.0:1767321080.793993:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380177408:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321080.794002:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321080.794023:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380177408:12345-0@lo:38:kworker.0 Request processed in 29us (948us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321080.794029:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18277
00000100:00100000:1.0:1767321080.794076:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380176768:0@lo:400:kworker.0
00000100:00080000:3.0:1767321080.794807:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767321080.794848:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321080.794853:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321080.794857:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380176512:0@lo:38:kworker.0
00000100:00080000:3.0:1767321080.794866:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321080.794899:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321080.794903:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380177152:0@lo:38:kworker.0
00000100:00080000:3.0:1767321080.794914:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321080.794918:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321080.794921:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380177408:0@lo:38:kworker.0
00010000:00010000:1.0:1767321081.367249:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321081.747688:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321081.747745:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321081.748139:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292010240
00000100:00100000:3.0:1767321081.748154:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292010240
00000100:00100000:3.0:1767321081.748208:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292010368
00000100:00100000:3.0:1767321081.748211:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292010368
00000100:00100000:3.0:1767321081.748266:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5231
00000100:00100000:3.0:1767321081.748278:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292010368:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767321081.748377:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292010368:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (631us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321081.748386:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5231
00000100:00100000:3.0:1767321081.748407:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18278
00000100:00100000:3.0:1767321081.748412:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292010240:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321081.748436:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321081.748466:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292010240:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 52us (797us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321081.748473:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18278
00000100:00080000:2.0:1767321081.748546:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767321082.391416:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321082.839349:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767321082.839366:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380177536:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321082.839460:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321082.842173:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177536
00000100:00100000:0.0:1767321082.842193:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177536
00000100:00100000:0.0:1767321082.842391:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928
00000100:00100000:0.0:1767321082.842404:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380177536:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321082.842462:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321082.842863:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380177536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 460us (3399us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321082.842873:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928
00000100:00080000:2.0:1767321082.845477:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767321082.848523:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380177536:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767321083.418644:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321084.375262:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767321084.375294:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380177664:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321084.375390:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321084.375434:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177664
00000100:00100000:0.0:1767321084.375445:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177664
00000100:00080000:3.0:1767321084.375689:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321084.375862:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929
00000100:00100000:0.0:1767321084.375901:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380177664:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767321084.375949:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321084.376019:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380177664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (628us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321084.376027:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929
00000100:00100000:2.0:1767321084.376119:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380177664:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321084.439255:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321085.463303:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1767321085.911585:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321085.911595:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:0.0:1767321085.911599:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321085.911604:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321085.911609:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321085.911628:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5983
00000100:00080000:0.0:1767321085.911634:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321085.911642:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321085.911690:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035ff100 x1853164380177792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767321085.911720:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321085.911724:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321085.911727:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321085.911731:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5983
00000100:00080000:0.0:1767321085.911733:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321085.911737:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321085.911752:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fce00 x1853164380177920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767321085.911819:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321085.911823:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321085.911825:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321085.911829:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5983
00000100:00080000:0.0:1767321085.911832:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321085.911836:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321085.911848:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebfb80 x1853164380178432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1767321085.911865:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321085.911896:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1767321085.911898:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321085.911902:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5983
00000100:00080000:0.0:1767321085.911904:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321085.911909:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321085.911921:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e08ebdc00 x1853164380178688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767321085.911950:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380178304:0@lo:400:kworker.0
00000100:00100000:3.0:1767321085.911950:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380177792:0@lo:38:kworker.0
00000100:00100000:1.0:1767321085.912039:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380178560:0@lo:400:kworker.0
00000100:00100000:2.0:1767321085.912090:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380178048:0@lo:400:kworker.0
00000100:00100000:3.0:1767321085.912572:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321085.912658:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380177920:0@lo:38:kworker.0
00000100:00100000:3.0:1767321085.912688:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321085.912713:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380178432:0@lo:38:kworker.0
00000100:00100000:3.0:1767321085.912733:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321085.912750:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380178688:0@lo:38:kworker.0
00000100:00100000:3.0:1767321085.912773:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321085.912822:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177792
00000100:00100000:3.0:1767321085.913085:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177792
00000100:00100000:3.0:1767321085.913128:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178432
00000100:00100000:3.0:1767321085.913131:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178432
00000100:00100000:3.0:1767321085.913146:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178688
00000100:00100000:3.0:1767321085.913149:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178688
00000100:00100000:3.0:1767321085.913264:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18279
00000100:00100000:3.0:1767321085.913274:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380177792:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321085.913302:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321085.913362:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380177792:12345-0@lo:38:kworker.0 Request processed in 87us (791us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321085.913370:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18279
00000100:00100000:3.0:1767321085.913388:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18280
00000100:00100000:3.0:1767321085.913392:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380178432:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321085.913402:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321085.913425:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380178432:12345-0@lo:38:kworker.0 Request processed in 31us (690us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321085.913431:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18280
00000100:00100000:3.0:1767321085.913440:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18281
00000100:00100000:3.0:1767321085.913444:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380178688:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321085.913453:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321085.913544:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380178688:12345-0@lo:38:kworker.0 Request processed in 31us (703us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321085.913551:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18281
00000100:00100000:3.0:1767321085.913595:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380177920
00000100:00100000:3.0:1767321085.913600:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380177920
00000100:00100000:3.0:1767321085.913622:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309
00000100:00100000:3.0:1767321085.913627:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380177920:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321085.913636:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321085.913667:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380177920:12345-0@lo:38:kworker.0 Request processed in 39us (977us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321085.913673:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309
00000100:00080000:3.0:1767321085.913740:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321085.913747:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321085.913750:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380177792:0@lo:38:kworker.0
00000100:00080000:3.0:1767321085.913761:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321085.913765:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321085.913767:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380177920:0@lo:38:kworker.0
00000100:00080000:3.0:1767321085.913775:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321085.913778:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321085.913781:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380178432:0@lo:38:kworker.0
00000100:00080000:3.0:1767321085.913789:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321085.913792:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321085.913795:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380178688:0@lo:38:kworker.0
00000100:00100000:3.0:1767321085.914905:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380178176:0@lo:400:kworker.0
00000100:00100000:3.0:1767321085.914987:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321085.915018:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321085.915061:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178560
00000100:00100000:1.0:1767321085.915068:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178560
00000100:00100000:1.0:1767321085.915128:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232
00000100:00100000:1.0:1767321085.915136:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380178560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321085.915194:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178176
00000100:00100000:3.0:1767321085.915199:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178176
00000100:00100000:3.0:1767321085.915236:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110
00000100:00100000:3.0:1767321085.915244:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380178176:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321085.915699:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380178560:12345-0@lo:400:kworker.0 Request processed in 561us (678us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321085.915709:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232
00000100:00080000:1.0:1767321085.915751:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321085.915798:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380178560:0@lo:400:kworker.0
00000100:00100000:2.0:1767321085.916154:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321085.916795:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178048
00000100:00100000:1.0:1767321085.916807:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178048
00000100:00100000:1.0:1767321085.916902:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111
00000100:00100000:1.0:1767321085.916912:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380178048:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321085.916985:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380178048:12345-0@lo:400:kworker.0 Request processed in 76us (832us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321085.916992:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111
00000100:00080000:2.0:1767321085.917089:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767321085.917126:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380178048:0@lo:400:kworker.0
00000100:00100000:0.0:1767321085.917366:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321085.918077:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178304
00000100:00100000:1.0:1767321085.918089:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178304
00000100:00100000:1.0:1767321085.918306:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233
00000100:00100000:1.0:1767321085.918320:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380178304:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321085.918408:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380178304:12345-0@lo:400:kworker.0 Request processed in 92us (1039us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321085.918420:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233
00000100:00080000:0.0:1767321085.918821:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321085.918922:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380178304:0@lo:400:kworker.0
00000100:00100000:3.0:1767321085.919440:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380178176:12345-0@lo:400:kworker.0 Request processed in 4187us (4443us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321085.919455:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110
00000100:00100000:0.0:1767321085.919689:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380178176:0@lo:400:kworker.0
00010000:00010000:1.0:1767321086.487985:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321086.863828:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321086.863994:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321086.864273:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292010624
00000100:00100000:3.0:1767321086.864288:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292010624
00000100:00100000:3.0:1767321086.864372:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292010496
00000100:00100000:3.0:1767321086.864376:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292010496
00000100:00100000:3.0:1767321086.864401:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5234
00000100:00100000:3.0:1767321086.864414:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292010624:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:3.0:1767321086.864513:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2520:x1853164292010624:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 102us (698us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321086.864522:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5234
00000100:00100000:3.0:1767321086.864543:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18282
00000100:00100000:3.0:1767321086.864548:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292010496:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321086.864584:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321086.864615:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292010496:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 65us (621us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321086.864622:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18282
00000100:00080000:0.0:1767321086.864670:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767321087.523290:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321087.959370:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380178816:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321087.959474:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321087.959624:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178816
00000100:00100000:0.0:1767321087.959635:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178816
00000100:00100000:0.0:1767321087.959726:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930
00000100:00100000:0.0:1767321087.959739:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380178816:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321087.959792:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321087.959859:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380178816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321087.959890:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930
00000100:00100000:3.0:1767321087.959933:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e08ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380178816:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767321087.960024:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767321088.535285:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321089.495692:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380178944:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321089.495793:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321089.496079:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380178944
00000100:00100000:2.0:1767321089.496089:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380178944
00000100:00100000:2.0:1767321089.496174:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931
00000100:00100000:2.0:1767321089.496185:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380178944:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767321089.496231:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767321089.496244:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767321089.501237:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380178944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5035us (5424us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321089.501263:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931
00000100:00100000:0.0:1767321089.503252:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380178944:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321089.563083:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321090.583278:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767321091.031217:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321091.031233:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321091.031238:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321091.031243:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321091.031249:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321091.031260:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5988
00000100:00080000:2.0:1767321091.031265:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321091.031274:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321091.031335:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ed80 x1853164380179072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321091.031366:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321091.031370:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321091.031372:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321091.031377:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5988
00000100:00080000:2.0:1767321091.031380:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321091.031384:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321091.031401:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9ca80 x1853164380179200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321091.031499:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321091.031503:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321091.031506:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321091.031510:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5988
00000100:00080000:2.0:1767321091.031513:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321091.031518:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321091.031540:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f08e9c700 x1853164380179712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767321091.031545:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00080000:2.0:1767321091.031557:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321091.031560:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321091.031562:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321091.031566:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5988
00000100:00100000:0.0:1767321091.031568:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380179840:0@lo:400:kworker.0
00000100:00080000:2.0:1767321091.031577:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321091.031582:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321091.031598:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85ca80 x1853164380179968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321091.031625:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380179584:0@lo:400:kworker.0
00000100:00100000:0.0:1767321091.031661:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321091.031699:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179840
00000100:00100000:2.0:1767321091.031708:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179840
00000100:00100000:0.0:1767321091.031733:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380179328:0@lo:400:kworker.0
00000100:00100000:0.0:1767321091.031762:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321091.031773:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235
00000100:00100000:2.0:1767321091.031783:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380179840:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321091.031809:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321091.031828:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767321091.031834:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380179456:0@lo:400:kworker.0
00000100:00100000:2.0:1767321091.031847:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380179840:12345-0@lo:400:kworker.0 Request processed in 65us (185us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321091.031854:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321091.031855:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235
00000100:00100000:2.0:1767321091.031894:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179584
00000100:00100000:2.0:1767321091.031897:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179584
00000100:00100000:2.0:1767321091.031919:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236
00000100:00100000:2.0:1767321091.031924:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380179584:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321091.031930:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380179840:0@lo:400:kworker.0
00000100:00100000:2.0:1767321091.031956:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380179584:12345-0@lo:400:kworker.0 Request processed in 31us (145us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321091.031960:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380179584:0@lo:400:kworker.0
00000100:00100000:2.0:1767321091.031974:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236
00000100:00100000:3.0:1767321091.032409:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380179072:0@lo:38:kworker.0
00000100:00100000:3.0:1767321091.032546:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1767321091.032653:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321091.032768:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380179200:0@lo:38:kworker.0
00000100:00100000:3.0:1767321091.032810:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321091.032837:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380179712:0@lo:38:kworker.0
00000100:00100000:3.0:1767321091.032861:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321091.045422:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380179968:0@lo:38:kworker.0
00000100:00100000:3.0:1767321091.045523:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321091.048542:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179072
00000100:00100000:0.0:1767321091.048564:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179072
00000100:00100000:0.0:1767321091.048661:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179712
00000100:00100000:0.0:1767321091.048665:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179712
00000100:00100000:0.0:1767321091.048685:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18283
00000100:00100000:0.0:1767321091.048695:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380179072:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321091.048725:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321091.048926:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380179072:12345-0@lo:38:kworker.0 Request processed in 231us (16378us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321091.048935:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18283
00000100:00100000:0.0:1767321091.048954:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18284
00000100:00100000:0.0:1767321091.048958:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380179712:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321091.048968:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321091.048995:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380179712:12345-0@lo:38:kworker.0 Request processed in 35us (16134us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321091.049001:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18284
00000100:00100000:0.0:1767321091.049057:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179328
00000100:00100000:0.0:1767321091.049062:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179328
00000100:00100000:0.0:1767321091.049114:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179456
00000100:00100000:0.0:1767321091.049117:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179456
00000100:00100000:0.0:1767321091.049283:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112
00000100:00100000:0.0:1767321091.049289:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380179328:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321091.049345:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380179328:12345-0@lo:400:kworker.0 Request processed in 55us (17581us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321091.049352:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112
00000100:00100000:0.0:1767321091.049366:0:41753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113
00000100:00100000:0.0:1767321091.049372:0:41753:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380179456:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321091.050047:0:41753:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380179456:12345-0@lo:400:kworker.0 Request processed in 671us (18187us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321091.050056:0:41753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113
00000100:00100000:0.0:1767321091.050129:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380179456:0@lo:400:kworker.0
00000100:00100000:0.0:1767321091.050173:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380179328:0@lo:400:kworker.0
00000100:00080000:0.0:1767321091.050218:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:0.0:1767321091.050224:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767321091.050272:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179200
00000100:00100000:0.0:1767321091.050277:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179200
00000100:00100000:0.0:1767321091.050303:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310
00000100:00100000:0.0:1767321091.050308:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380179200:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321091.050325:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321091.050357:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380179200:12345-0@lo:38:kworker.0 Request processed in 48us (17547us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321091.050363:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310
00000100:00080000:3.0:1767321091.059419:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321091.059447:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321091.059453:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380179072:0@lo:38:kworker.0
00000100:00080000:3.0:1767321091.059472:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321091.059476:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321091.059479:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380179200:0@lo:38:kworker.0
00000100:00080000:3.0:1767321091.059491:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321091.059495:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321091.059498:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380179712:0@lo:38:kworker.0
00000100:00100000:2.0:1767321091.062539:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380179968
00000100:00100000:2.0:1767321091.062562:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380179968
00000100:00100000:2.0:1767321091.063362:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18285
00000100:00100000:2.0:1767321091.063374:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380179968:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321091.063404:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321091.063554:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380179968:12345-0@lo:38:kworker.0 Request processed in 180us (18030us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321091.063562:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18285
00000100:00080000:3.0:1767321091.063673:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321091.063680:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321091.063685:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380179968:0@lo:38:kworker.0
00010000:00010000:2.0:1767321091.608416:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321091.984805:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321091.984997:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011008
00000100:00100000:2.0:1767321091.985015:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011008
00000100:00100000:2.0:1767321091.985204:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5237
00000100:00100000:2.0:1767321091.985216:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292011008:12345-192.168.202.33@tcp:400:kworker.0
00000400:00000100:1.0:1767321091.985281:0:7011:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292010752 offset 0 length 520: 4
00000100:00100000:1.0:1767321091.985536:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321091.987117:0:15478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292010880
00000100:00100000:3.0:1767321091.987133:0:15478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292010880
00000100:00100000:3.0:1767321091.987200:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18286
00000100:00100000:3.0:1767321091.987208:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292010880:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321091.987238:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321091.987316:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2516:x1853164292010880:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 107us (1793us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321091.987324:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18286
00000100:00100000:2.0:1767321091.987563:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2518:x1853164292011008:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 302us (731us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321091.987572:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5237
00000100:00080000:0.0:1767321091.995599:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767321092.631582:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321093.079485:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1767321093.079506:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380180096:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1767321093.079640:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321093.079715:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380180096
00000100:00100000:2.0:1767321093.079726:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380180096
00000100:00100000:2.0:1767321093.079806:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932
00000100:00100000:2.0:1767321093.079817:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380180096:12345-0@lo:13:osp-pre-1-1.0
00000100:00080000:0.0:1767321093.079848:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00002000:00000024:2.0:1767321093.079855:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321093.079986:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380180096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 170us (345us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321093.080009:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932
00000100:00100000:0.0:1767321093.080157:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380180096:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321093.656034:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321094.616475:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767321094.616521:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380180224:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321094.616639:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321094.617221:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380180224
00000100:00100000:2.0:1767321094.617233:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380180224
00000100:00100000:2.0:1767321094.617325:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933
00000100:00100000:2.0:1767321094.617337:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380180224:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767321094.617379:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321094.617454:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380180224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (813us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321094.617462:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933
00000100:00080000:0.0:1767321094.617897:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321094.617956:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380180224:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321094.679331:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321095.191057:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321070/real 1767321070]  req@ffff8b0f2f3fd880 x1853164380173824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321095 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767321095.191102:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0f2f3fd880 x1853164380173824/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321095 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1767321095.191130:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321095.191171:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767321095.191175:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f2f3fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380173824:0@lo:250:kworker.0
00000100:00080000:3.0:1767321095.191296:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321095.191302:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1767321095.191306:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321095.191312:0:59923:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5972
00000100:00080000:3.0:1767321095.191316:0:59923:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321095.191335:0:59923:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321095.191388:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21c00 x1853164380180352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321095.191413:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321095.191417:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321095.191419:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321095.191422:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5993
00000100:00080000:3.0:1767321095.191425:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321095.191428:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321095.191445:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21500 x1853164380180480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321095.191454:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321095.191457:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321095.191459:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321095.191463:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5993
00000100:00080000:3.0:1767321095.191465:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321095.191469:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321095.191480:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22300 x1853164380180608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321095.191604:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380180736:0@lo:400:kworker.0
00000100:00100000:1.0:1767321095.191698:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767321095.191827:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321095.191832:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321095.191834:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321095.191838:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5993
00000100:00080000:3.0:1767321095.191841:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321095.191845:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321095.191860:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21f80 x1853164380180992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321095.191909:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321095.191912:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321095.191914:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321095.191918:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5993
00000100:00080000:3.0:1767321095.191920:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321095.191925:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321095.191936:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e035fd180 x1853164380181248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321095.191964:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380181120:0@lo:400:kworker.0
00000100:00100000:3.0:1767321095.192004:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321095.192040:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767321095.192046:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380180864:0@lo:400:kworker.0
00000100:00100000:3.0:1767321095.192068:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321095.192101:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380181120
00000100:00100000:3.0:1767321095.192110:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380181120
00000100:00100000:3.0:1767321095.192173:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380180864
00000100:00100000:3.0:1767321095.192177:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380180864
00000100:00100000:3.0:1767321095.192201:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238
00000100:00100000:3.0:1767321095.192210:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380181120:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321095.192271:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380181120:12345-0@lo:400:kworker.0 Request processed in 62us (267us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321095.192279:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238
00000100:00100000:3.0:1767321095.192297:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239
00000100:00100000:3.0:1767321095.192303:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380180864:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321095.192330:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380180864:12345-0@lo:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321095.192336:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239
00000100:00100000:3.0:1767321095.192379:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380180864:0@lo:400:kworker.0
00000100:00100000:3.0:1767321095.192390:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380181120:0@lo:400:kworker.0
00000100:00100000:2.0:1767321095.192531:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380180736
00000100:00100000:2.0:1767321095.192536:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380180736
00000100:00100000:2.0:1767321095.192583:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114
00000100:00100000:2.0:1767321095.192592:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380180736:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1767321095.192774:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1767321095.192781:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321095.192806:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380180352:0@lo:250:kworker.0
00000400:00000100:0.0:1767321095.192840:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380180352 offset 0 length 520: 4
00000100:00100000:0.0:1767321095.192864:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380180480:0@lo:38:kworker.0
00000100:00100000:0.0:1767321095.192915:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321095.192937:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380180480
00000100:00100000:0.0:1767321095.192940:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380180480
00000100:00100000:0.0:1767321095.192967:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18287
00000100:00100000:0.0:1767321095.192972:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380180480:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321095.192995:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321095.193027:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380180480:12345-0@lo:38:kworker.0 Request processed in 53us (111us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321095.193033:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18287
00000100:00080000:0.0:1767321095.193062:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321095.193068:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321095.193071:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380180480:0@lo:38:kworker.0
00000100:00100000:0.0:1767321095.193077:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380180608:0@lo:38:kworker.0
00000100:00100000:0.0:1767321095.193102:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321095.193143:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380180608
00000100:00100000:0.0:1767321095.193146:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380180608
00000100:00100000:0.0:1767321095.193167:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311
00000100:00100000:0.0:1767321095.193172:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380180608:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321095.193185:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321095.193213:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380180608:12345-0@lo:38:kworker.0 Request processed in 39us (110us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321095.193219:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311
00000100:00080000:0.0:1767321095.193246:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321095.193250:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321095.193253:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380180608:0@lo:38:kworker.0
00000100:00100000:0.0:1767321095.193259:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380180992:0@lo:38:kworker.0
00000100:00100000:0.0:1767321095.193286:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321095.193304:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380180992
00000100:00100000:0.0:1767321095.193307:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380180992
00000100:00100000:0.0:1767321095.193339:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18288
00000100:00100000:0.0:1767321095.193344:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380180992:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321095.193355:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321095.193380:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380180992:12345-0@lo:38:kworker.0 Request processed in 35us (93us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321095.193387:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18288
00000100:00080000:0.0:1767321095.193409:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321095.193414:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321095.193416:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380180992:0@lo:38:kworker.0
00000100:00100000:0.0:1767321095.193423:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380181248:0@lo:38:kworker.0
00000100:00100000:0.0:1767321095.193446:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321095.193462:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380181248
00000100:00100000:0.0:1767321095.193466:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380181248
00000100:00100000:0.0:1767321095.193481:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18289
00000100:00100000:0.0:1767321095.193485:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380181248:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321095.193505:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321095.193529:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380181248:12345-0@lo:38:kworker.0 Request processed in 43us (82us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321095.193536:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18289
00000100:00080000:0.0:1767321095.193559:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321095.193563:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321095.193566:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e035fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380181248:0@lo:38:kworker.0
00000100:00100000:2.0:1767321095.213143:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380180736:12345-0@lo:400:kworker.0 Request processed in 20537us (21428us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321095.214071:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114
00000100:00100000:1.0:1767321095.214975:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380180736:0@lo:400:kworker.0
00010000:00010000:2.0:1767321095.703336:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321096.733778:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321097.107403:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321097.107548:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011264
00000100:00100000:2.0:1767321097.107563:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011264
00000100:00100000:2.0:1767321097.107670:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5240
00000100:00100000:2.0:1767321097.107682:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292011264:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321097.107794:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292011264:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 114us (405us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321097.107803:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5240
00000100:00080000:1.0:1767321097.107932:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321097.127985:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321097.128280:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011136
00000100:00100000:0.0:1767321097.128291:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011136
00000100:00100000:0.0:1767321097.128347:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18290
00000100:00100000:0.0:1767321097.128357:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292011136:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767321097.128381:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321097.128457:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e035fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292011136:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 100us (493us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321097.128465:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18290
00010000:00010000:1.0:1767321097.752228:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321098.201945:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767321098.201964:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380181376:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321098.202037:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321098.202194:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380181376
00000100:00100000:3.0:1767321098.202202:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380181376
00000100:00100000:3.0:1767321098.202272:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934
00000100:00100000:3.0:1767321098.202283:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380181376:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321098.202324:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321098.202384:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0a2ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380181376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (347us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321098.202391:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934
00000100:00100000:0.0:1767321098.202685:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f08e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380181376:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767321098.202745:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767321098.775330:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321099.735242:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380181504:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321099.735333:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321099.735548:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380181504
00000100:00100000:2.0:1767321099.735556:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380181504
00000100:00100000:2.0:1767321099.735617:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935
00000100:00100000:2.0:1767321099.735626:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380181504:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767321099.735654:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:1.0:1767321099.735694:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767321099.735705:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f08e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380181504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (372us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321099.735712:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935
00000100:00100000:0.0:1767321099.736295:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380181504:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767321099.801059:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767321100.246997:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321100.247009:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767321100.247012:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321100.247017:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321100.247022:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321100.247032:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 5997
00000100:00080000:3.0:1767321100.247038:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321100.247046:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321100.247095:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21f80 x1853164380181632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321100.247121:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321100.247124:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321100.247126:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321100.247130:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 5997
00000100:00080000:3.0:1767321100.247132:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321100.247136:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321100.247149:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22300 x1853164380181760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321100.247197:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321100.247200:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321100.247202:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321100.247206:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 5997
00000100:00080000:3.0:1767321100.247209:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321100.247213:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321100.247223:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc23100 x1853164380182144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321100.247231:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380182016:0@lo:400:kworker.0
00000100:00080000:3.0:1767321100.247245:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321100.247248:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321100.247249:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321100.247253:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 5997
00000100:00080000:3.0:1767321100.247255:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321100.247259:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321100.247271:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c859c00 x1853164380182400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321100.247296:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380182272:0@lo:400:kworker.0
00000100:00100000:1.0:1767321100.247300:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321100.247339:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321100.247360:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321100.247365:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380181888:0@lo:400:kworker.0
00000100:00100000:1.0:1767321100.247389:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321100.247429:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380181888
00000100:00100000:3.0:1767321100.247437:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380181888
00000100:00100000:3.0:1767321100.247518:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115
00000100:00100000:3.0:1767321100.247527:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380181888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321100.247658:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380181888:12345-0@lo:400:kworker.0 Request processed in 53us (188us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321100.247667:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115
00000100:00080000:1.0:1767321100.247757:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767321100.247789:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380181888:0@lo:400:kworker.0
00000100:00100000:2.0:1767321100.247997:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182016
00000100:00100000:2.0:1767321100.248003:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182016
00000100:00100000:2.0:1767321100.248046:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182272
00000100:00100000:2.0:1767321100.248050:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182272
00000100:00080000:3.0:1767321100.248078:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321100.248083:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5241
00000100:00100000:2.0:1767321100.248092:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380182016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321100.248103:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5242
00000100:00100000:3.0:1767321100.248115:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380182272:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321100.248141:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380182016:12345-0@lo:400:kworker.0 Request processed in 50us (840us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321100.248149:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5241
00000100:00100000:3.0:1767321100.248170:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380182272:12345-0@lo:400:kworker.0 Request processed in 57us (829us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321100.248177:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5242
00000100:00100000:3.0:1767321100.248211:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380182272:0@lo:400:kworker.0
00000100:00100000:2.0:1767321100.248361:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380182016:0@lo:400:kworker.0
00000100:00100000:0.0:1767321100.250115:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380181632:0@lo:38:kworker.0
00000100:00100000:0.0:1767321100.250181:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321100.250227:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380181760:0@lo:38:kworker.0
00000100:00100000:0.0:1767321100.250257:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321100.250284:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380182144:0@lo:38:kworker.0
00000100:00100000:0.0:1767321100.250326:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321100.250351:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380182400:0@lo:38:kworker.0
00000100:00100000:0.0:1767321100.250381:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321100.250406:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380181632
00000100:00100000:1.0:1767321100.250412:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380181760
00000100:00100000:0.0:1767321100.250413:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380181632
00000100:00100000:1.0:1767321100.250416:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380181760
00000100:00100000:0.0:1767321100.250445:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182144
00000100:00100000:0.0:1767321100.250457:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182144
00000100:00100000:1.0:1767321100.250457:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312
00000100:00100000:1.0:1767321100.250463:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380181760:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767321100.250470:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182400
00000100:00100000:0.0:1767321100.250473:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182400
00000100:00100000:0.0:1767321100.250486:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18291
00010000:00020000:1.0:1767321100.250486:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321100.250490:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380181632:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321100.250498:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321100.250528:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f2f3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380181632:12345-0@lo:38:kworker.0 Request processed in 36us (347us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321100.250529:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380181760:12345-0@lo:38:kworker.0 Request processed in 66us (271us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321100.250536:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18291
00000100:00100000:1.0:1767321100.250536:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312
00000100:00100000:0.0:1767321100.250551:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18292
00000100:00100000:0.0:1767321100.250554:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380182144:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321100.250563:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321100.250580:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18293
00000100:00100000:0.0:1767321100.250584:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380182144:12345-0@lo:38:kworker.0 Request processed in 29us (266us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321100.250585:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380182400:12345-0@lo:38:kworker.0
00000100:00100000:0.0:1767321100.250590:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18292
00010000:00020000:1.0:1767321100.250594:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321100.250618:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380182400:12345-0@lo:38:kworker.0 Request processed in 32us (236us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321100.250624:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18293
00000100:00080000:1.0:1767321100.250658:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321100.250663:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321100.250667:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380182400:0@lo:38:kworker.0
00000100:00080000:1.0:1767321100.250694:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321100.250697:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321100.250700:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380181632:0@lo:38:kworker.0
00000100:00080000:1.0:1767321100.250708:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321100.250711:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321100.250714:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380181760:0@lo:38:kworker.0
00000100:00080000:1.0:1767321100.250721:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321100.250724:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321100.250727:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380182144:0@lo:38:kworker.0
00010000:00010000:2.0:1767321100.823037:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321101.847141:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321102.224109:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321102.224153:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321102.225477:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011520
00000100:00100000:1.0:1767321102.225490:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011520
00000100:00100000:1.0:1767321102.225575:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011392
00000100:00100000:1.0:1767321102.225589:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011392
00000100:00100000:1.0:1767321102.225619:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5243
00000100:00100000:1.0:1767321102.225630:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292011520:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:0.0:1767321102.225677:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18294
00000100:00100000:0.0:1767321102.225685:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292011392:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:0.0:1767321102.225708:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321102.225712:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292011520:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 82us (1612us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321102.225721:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5243
00000100:00100000:0.0:1767321102.225747:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2516:x1853164292011392:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 59us (1591us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321102.225755:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18294
00000100:00080000:3.0:1767321102.226389:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767321102.876709:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321103.324103:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380182528:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321103.324183:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321103.325095:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182528
00000100:00100000:0.0:1767321103.325109:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182528
00000100:00100000:0.0:1767321103.325196:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936
00000100:00100000:0.0:1767321103.325207:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380182528:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321103.325238:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321103.325334:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380182528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (1140us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321103.325343:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936
00000100:00080000:3.0:1767321103.325477:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767321103.326037:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380182528:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767321103.896739:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321104.856796:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380182656:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321104.856892:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321104.858148:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182656
00000100:00100000:1.0:1767321104.858159:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182656
00000100:00100000:1.0:1767321104.858250:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937
00000100:00100000:1.0:1767321104.858260:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380182656:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767321104.858291:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:0.0:1767321104.858363:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1767321104.872679:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380182656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 14409us (15774us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321104.872697:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937
00000100:00100000:2.0:1767321104.875085:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380182656:0@lo:13:osp-pre-0-1.0
00010000:00010000:2.0:1767321104.920362:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767321105.369447:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321105.369458:0:62609:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767321105.369462:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321105.369466:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321105.369471:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321105.369479:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 6002
00000100:00080000:1.0:1767321105.369485:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321105.369492:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321105.369535:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19180 x1853164380182784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321105.369566:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321105.369570:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321105.369572:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321105.369576:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 6002
00000100:00080000:1.0:1767321105.369579:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321105.369583:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321105.369596:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b480 x1853164380182912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321105.369671:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321105.369674:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321105.369676:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321105.369680:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 6002
00000100:00080000:1.0:1767321105.369682:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321105.369686:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321105.369700:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19f80 x1853164380183296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321105.369717:0:62609:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321105.369720:0:62609:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321105.369722:0:62609:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321105.369725:0:62609:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 6002
00000100:00080000:1.0:1767321105.369727:0:62609:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321105.369731:0:62609:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321105.369740:0:62609:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18700 x1853164380183552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321105.369782:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380183168:0@lo:400:kworker.0
00000100:00100000:1.0:1767321105.369847:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321105.369938:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767321105.369945:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380183424:0@lo:400:kworker.0
00000100:00100000:1.0:1767321105.369965:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321105.370032:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183168
00000100:00100000:2.0:1767321105.370041:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183168
00000100:00100000:2.0:1767321105.370110:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183424
00000100:00100000:0.0:1767321105.370114:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380183040:0@lo:400:kworker.0
00000100:00100000:2.0:1767321105.370116:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183424
00000100:00100000:0.0:1767321105.370148:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321105.370152:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244
00000100:00100000:2.0:1767321105.370164:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380183168:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321105.370185:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245
00000100:00100000:0.0:1767321105.370193:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380183424:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321105.370233:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380183168:12345-0@lo:400:kworker.0 Request processed in 69us (382us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321105.370234:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380183424:12345-0@lo:400:kworker.0 Request processed in 39us (265us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321105.370242:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245
00000100:00100000:2.0:1767321105.370253:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244
00000100:00100000:0.0:1767321105.370269:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183040
00000100:00100000:0.0:1767321105.370273:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183040
00000100:00100000:0.0:1767321105.370303:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116
00000100:00100000:2.0:1767321105.370307:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380183424:0@lo:400:kworker.0
00000100:00100000:0.0:1767321105.370312:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380183040:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321105.370326:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380183168:0@lo:400:kworker.0
00000100:00100000:0.0:1767321105.370351:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380183040:12345-0@lo:400:kworker.0 Request processed in 41us (201us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321105.370358:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116
00000100:00100000:0.0:1767321105.370388:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380183040:0@lo:400:kworker.0
00000100:00080000:1.0:1767321105.370459:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767321105.370463:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380182784:0@lo:38:kworker.0
00000100:00080000:1.0:1767321105.370464:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321105.370498:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321105.370574:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380182912:0@lo:38:kworker.0
00000100:00100000:3.0:1767321105.370598:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321105.370630:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380183296:0@lo:38:kworker.0
00000100:00100000:3.0:1767321105.370651:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321105.370693:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182912
00000100:00100000:1.0:1767321105.370697:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182912
00000100:00100000:1.0:1767321105.370726:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313
00000100:00100000:1.0:1767321105.370731:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380182912:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321105.370749:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321105.370791:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380182912:12345-0@lo:38:kworker.0 Request processed in 59us (192us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321105.370798:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313
00000100:00100000:3.0:1767321105.371045:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380183552:0@lo:38:kworker.0
00000100:00100000:3.0:1767321105.371068:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321105.371146:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380182784
00000100:00100000:2.0:1767321105.371150:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380182784
00000100:00100000:2.0:1767321105.371215:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183296
00000100:00100000:2.0:1767321105.371219:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183296
00000100:00100000:0.0:1767321105.371346:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183552
00000100:00100000:0.0:1767321105.371350:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183552
00000100:00100000:0.0:1767321105.371372:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18295
00000100:00100000:0.0:1767321105.371376:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380182784:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321105.371388:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321105.371432:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380182784:12345-0@lo:38:kworker.0 Request processed in 54us (933us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321105.371438:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18295
00000100:00100000:0.0:1767321105.371452:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18296
00000100:00100000:0.0:1767321105.371456:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380183296:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321105.371465:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321105.371487:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380183296:12345-0@lo:38:kworker.0 Request processed in 29us (835us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321105.371492:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18296
00000100:00100000:0.0:1767321105.371502:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18297
00000100:00100000:0.0:1767321105.371506:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380183552:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321105.371515:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321105.371537:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:7016:x1853164380183552:12345-0@lo:38:kworker.0 Request processed in 29us (468us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321105.371543:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18297
00000100:00080000:2.0:1767321105.371666:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321105.371672:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321105.371675:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380183552:0@lo:38:kworker.0
00000100:00080000:2.0:1767321105.371697:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321105.371700:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321105.371703:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380182784:0@lo:38:kworker.0
00000100:00080000:2.0:1767321105.371712:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321105.371715:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321105.371718:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380182912:0@lo:38:kworker.0
00000100:00080000:2.0:1767321105.371725:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321105.371728:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321105.371731:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380183296:0@lo:38:kworker.0
00010000:00010000:1.0:1767321105.943207:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321106.967308:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321107.346278:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321107.346391:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321107.346476:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011776
00000100:00100000:2.0:1767321107.346486:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011776
00000100:00100000:2.0:1767321107.346559:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011648
00000100:00100000:2.0:1767321107.346563:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011648
00000100:00100000:2.0:1767321107.346582:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5246
00000100:00100000:2.0:1767321107.346593:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292011776:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321107.346666:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292011776:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 75us (397us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321107.346675:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5246
00000100:00100000:2.0:1767321107.346696:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18298
00000100:00100000:2.0:1767321107.346700:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292011648:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767321107.346720:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321107.346748:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292011648:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 46us (367us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321107.346755:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18298
00000100:00080000:1.0:1767321107.347002:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767321107.992454:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321108.440059:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321108.440082:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380183680:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321108.440161:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321108.440455:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183680
00000100:00100000:0.0:1767321108.440464:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183680
00000100:00100000:0.0:1767321108.440535:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938
00000100:00100000:0.0:1767321108.440544:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380183680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321108.440575:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321108.440620:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380183680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (459us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321108.440625:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938
00000100:00100000:3.0:1767321108.440728:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380183680:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767321108.440745:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:2.0:1767321109.015865:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321109.977296:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380183808:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321109.977384:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321109.978813:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183808
00000100:00100000:2.0:1767321109.978828:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183808
00000100:00100000:2.0:1767321109.978941:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939
00000100:00100000:2.0:1767321109.978953:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380183808:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1767321109.978984:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321109.979065:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380183808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1679us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321109.979072:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939
00000100:00080000:1.0:1767321109.979320:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321109.979353:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380183808:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321110.039314:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767321110.487060:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321110.487071:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767321110.487074:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321110.487078:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321110.487083:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321110.487091:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 6007
00000100:00080000:3.0:1767321110.487096:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321110.487103:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321110.487142:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85bb80 x1853164380183936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321110.487180:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321110.487184:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321110.487186:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321110.487190:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 6007
00000100:00080000:3.0:1767321110.487193:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321110.487198:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321110.487212:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85b800 x1853164380184064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321110.487274:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321110.487277:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321110.487279:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321110.487283:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 6007
00000100:00080000:3.0:1767321110.487286:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321110.487290:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321110.487302:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0c85aa00 x1853164380184448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321110.487329:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321110.487333:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321110.487334:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321110.487338:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 6007
00000100:00080000:3.0:1767321110.487340:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321110.487344:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321110.487383:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0df800 x1853164380184704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321110.487434:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380184576:0@lo:400:kworker.0
00000100:00100000:3.0:1767321110.487506:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321110.487562:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184576
00000100:00100000:3.0:1767321110.487569:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184576
00000100:00100000:3.0:1767321110.487628:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247
00000100:00100000:3.0:1767321110.487639:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380184576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321110.487691:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380184576:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321110.487699:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247
00000100:00100000:3.0:1767321110.487775:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380184576:0@lo:400:kworker.0
00000100:00100000:2.0:1767321110.487970:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380183936:0@lo:38:kworker.0
00000100:00100000:2.0:1767321110.488001:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321110.488037:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380184064:0@lo:38:kworker.0
00000100:00100000:2.0:1767321110.488064:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321110.488090:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184064
00000100:00100000:2.0:1767321110.488094:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184064
00000100:00100000:2.0:1767321110.488115:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314
00000100:00100000:2.0:1767321110.488120:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380184064:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321110.488139:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321110.488167:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380184064:12345-0@lo:38:kworker.0 Request processed in 45us (101us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321110.488173:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314
00000100:00080000:2.0:1767321110.488200:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321110.488204:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321110.488207:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380184064:0@lo:38:kworker.0
00000100:00100000:2.0:1767321110.488213:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380184448:0@lo:38:kworker.0
00000100:00100000:2.0:1767321110.488232:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321110.488251:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380183936
00000100:00100000:2.0:1767321110.488254:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380183936
00000100:00100000:2.0:1767321110.488267:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184448
00000100:00100000:2.0:1767321110.488270:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184448
00000100:00100000:2.0:1767321110.488286:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18299
00000100:00100000:2.0:1767321110.488292:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380183936:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321110.488304:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321110.488308:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380184320:0@lo:400:kworker.0
00000100:00100000:2.0:1767321110.488335:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380183936:12345-0@lo:38:kworker.0 Request processed in 41us (331us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321110.488343:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18299
00000100:00100000:0.0:1767321110.488350:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321110.488388:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1767321110.488395:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380184192:0@lo:400:kworker.0
00000100:00100000:0.0:1767321110.488422:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321110.488474:0:15479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184320
00000100:00100000:2.0:1767321110.488479:0:15479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184320
00000100:00100000:2.0:1767321110.488509:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5248
00000100:00100000:2.0:1767321110.488515:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380184320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321110.488549:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380184320:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321110.488555:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5248
00000100:00100000:2.0:1767321110.488567:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18300
00000100:00100000:2.0:1767321110.488571:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380184448:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321110.488580:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321110.488603:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:7016:x1853164380184448:12345-0@lo:38:kworker.0 Request processed in 30us (369us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321110.488608:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18300
00000100:00080000:2.0:1767321110.488636:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321110.488640:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321110.488644:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380184448:0@lo:38:kworker.0
00000100:00100000:2.0:1767321110.488650:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380184704:0@lo:38:kworker.0
00000100:00100000:2.0:1767321110.488671:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321110.488689:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184704
00000100:00100000:2.0:1767321110.488693:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184704
00000100:00100000:2.0:1767321110.488710:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18301
00000100:00100000:2.0:1767321110.488714:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380184704:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321110.488724:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321110.488747:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380184704:12345-0@lo:38:kworker.0 Request processed in 32us (75us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321110.488752:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18301
00000100:00080000:2.0:1767321110.488773:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321110.488777:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321110.488780:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380184704:0@lo:38:kworker.0
00000100:00080000:2.0:1767321110.488802:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321110.488806:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321110.488809:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380183936:0@lo:38:kworker.0
00000100:00100000:2.0:1767321110.488847:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184192
00000100:00100000:2.0:1767321110.488851:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184192
00000100:00100000:2.0:1767321110.488908:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117
00000100:00100000:2.0:1767321110.488915:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380184192:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321110.488943:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380184192:12345-0@lo:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321110.488949:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117
00000100:00100000:2.0:1767321110.488994:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c85a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380184192:0@lo:400:kworker.0
00000100:00100000:2.0:1767321110.489004:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0c858380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380184320:0@lo:400:kworker.0
00000100:00080000:2.0:1767321110.489037:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321110.489041:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:1.0:1767321111.063185:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321112.087169:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321112.465581:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321112.465644:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321112.465718:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292011904
00000100:00100000:2.0:1767321112.465728:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292011904
00000100:00100000:2.0:1767321112.465766:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292012032
00000100:00100000:2.0:1767321112.465769:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292012032
00000100:00080000:1.0:1767321112.465816:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321112.465821:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5249
00000100:00100000:2.0:1767321112.465831:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292012032:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767321112.465849:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18302
00000100:00100000:1.0:1767321112.465854:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292011904:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767321112.465899:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321112.466377:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292012032:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 545us (731us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321112.466385:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5249
00000100:00100000:1.0:1767321112.469260:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292011904:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 3390us (3676us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321112.469275:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18302
00010000:00010000:2.0:1767321113.113131:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321113.562657:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380184832:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321113.562748:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321113.565445:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184832
00000100:00100000:0.0:1767321113.565462:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184832
00000100:00100000:0.0:1767321113.565730:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940
00000100:00100000:0.0:1767321113.565742:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380184832:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321113.565778:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321113.565884:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380184832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (3120us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321113.565911:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940
00000100:00100000:3.0:1767321113.566376:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380184832:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1767321113.569710:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767321114.139202:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321115.095646:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380184960:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321115.095731:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321115.096192:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380184960
00000100:00100000:3.0:1767321115.096201:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380184960
00000100:00100000:3.0:1767321115.096273:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941
00000100:00100000:3.0:1767321115.096284:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380184960:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321115.096326:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321115.096379:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380184960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (648us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321115.096387:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941
00000100:00080000:1.0:1767321115.096450:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1767321115.096533:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380184960:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321115.159430:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767321115.607346:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321115.607358:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767321115.607361:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321115.607365:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321115.607370:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321115.607378:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 6012
00000100:00080000:1.0:1767321115.607384:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321115.607389:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321115.607443:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b480 x1853164380185088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321115.607475:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321115.607478:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321115.607480:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321115.607485:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 6012
00000100:00080000:1.0:1767321115.607487:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321115.607491:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321115.607505:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c19180 x1853164380185216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321115.607590:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321115.607594:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321115.607596:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321115.607599:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 6012
00000100:00080000:1.0:1767321115.607602:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321115.607606:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321115.607617:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1a680 x1853164380185728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321115.607637:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321115.607640:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321115.607642:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321115.607646:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 6012
00000100:00080000:1.0:1767321115.607648:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321115.607652:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321115.607661:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22300 x1853164380185984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321115.607687:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380185600:0@lo:400:kworker.0
00000100:00100000:1.0:1767321115.607763:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321115.607826:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1767321115.607832:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380185472:0@lo:400:kworker.0
00000100:00100000:1.0:1767321115.607858:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321115.607921:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185600
00000100:00100000:1.0:1767321115.607928:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185600
00000100:00100000:1.0:1767321115.607985:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250
00000100:00100000:1.0:1767321115.607995:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380185600:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321115.608045:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380185600:12345-0@lo:400:kworker.0 Request processed in 51us (280us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321115.608053:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250
00000100:00100000:1.0:1767321115.608084:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185472
00000100:00100000:1.0:1767321115.608088:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185472
00000100:00100000:1.0:1767321115.608114:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118
00000100:00100000:1.0:1767321115.608121:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380185472:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321115.608151:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380185472:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321115.608157:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118
00000100:00080000:1.0:1767321115.608172:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321115.608202:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380185472:0@lo:400:kworker.0
00000100:00100000:1.0:1767321115.608212:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380185600:0@lo:400:kworker.0
00000100:00100000:3.0:1767321115.608292:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380185856:0@lo:400:kworker.0
00000100:00100000:3.0:1767321115.608332:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321115.608361:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1767321115.608367:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380185344:0@lo:400:kworker.0
00000100:00100000:3.0:1767321115.608390:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321115.608413:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185344
00000100:00100000:3.0:1767321115.608417:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185344
00000100:00100000:3.0:1767321115.608445:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119
00000100:00100000:3.0:1767321115.608451:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380185344:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321115.608481:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380185344:12345-0@lo:400:kworker.0 Request processed in 31us (90us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321115.608488:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119
00000100:00080000:3.0:1767321115.608500:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1767321115.608516:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380185344:0@lo:400:kworker.0
00000100:00100000:0.0:1767321115.608588:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185856
00000100:00100000:0.0:1767321115.608594:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185856
00000100:00100000:0.0:1767321115.608635:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251
00000100:00100000:0.0:1767321115.608641:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380185856:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321115.608677:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380185856:12345-0@lo:400:kworker.0 Request processed in 37us (345us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321115.608683:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251
00000100:00100000:0.0:1767321115.608719:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380185856:0@lo:400:kworker.0
00000100:00080000:3.0:1767321115.608777:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321115.609215:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380185088:0@lo:38:kworker.0
00000100:00100000:2.0:1767321115.609249:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321115.609269:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380185216:0@lo:38:kworker.0
00000100:00100000:2.0:1767321115.609296:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321115.609351:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380185728:0@lo:38:kworker.0
00000100:00100000:2.0:1767321115.609373:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321115.609392:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380185984:0@lo:38:kworker.0
00000100:00100000:2.0:1767321115.609409:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321115.609453:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185088
00000100:00100000:2.0:1767321115.609458:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185088
00000100:00100000:2.0:1767321115.609478:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185728
00000100:00100000:2.0:1767321115.609481:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185728
00000100:00100000:2.0:1767321115.609489:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185984
00000100:00100000:2.0:1767321115.609491:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185984
00000100:00100000:2.0:1767321115.609500:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18303
00000100:00100000:2.0:1767321115.609505:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380185088:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321115.609522:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321115.609555:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380185088:12345-0@lo:38:kworker.0 Request processed in 48us (304us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321115.609560:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18303
00000100:00100000:2.0:1767321115.609574:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18304
00000100:00100000:2.0:1767321115.609578:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380185728:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321115.609587:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321115.609608:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380185728:12345-0@lo:38:kworker.0 Request processed in 28us (234us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321115.609612:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18304
00000100:00100000:2.0:1767321115.609622:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18305
00000100:00100000:2.0:1767321115.609625:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380185984:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321115.609633:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321115.609653:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380185984:12345-0@lo:38:kworker.0 Request processed in 26us (243us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321115.609659:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18305
00000100:00080000:2.0:1767321115.609696:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321115.609700:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321115.609703:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380185088:0@lo:38:kworker.0
00000100:00080000:2.0:1767321115.609710:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321115.609713:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321115.609716:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380185728:0@lo:38:kworker.0
00000100:00080000:2.0:1767321115.609722:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321115.609725:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321115.609728:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380185984:0@lo:38:kworker.0
00000100:00100000:3.0:1767321115.609802:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380185216
00000100:00100000:3.0:1767321115.609806:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380185216
00000100:00100000:3.0:1767321115.609832:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315
00000100:00100000:3.0:1767321115.609837:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380185216:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321115.609847:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321115.609900:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380185216:12345-0@lo:38:kworker.0 Request processed in 61us (602us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321115.609905:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315
00000100:00080000:2.0:1767321115.610601:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321115.610608:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321115.610612:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380185216:0@lo:38:kworker.0
00010000:00010000:3.0:1767321116.184395:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1767321116.564371:0:7010:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-192.168.202.33@tcp portal 26 match 1853164292012160 offset 0 length 520: 4
00000100:00100000:2.0:1767321116.564425:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321116.564521:0:7010:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321116.574891:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292012288
00000100:00100000:1.0:1767321116.574909:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292012288
00000100:00100000:1.0:1767321116.574966:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292012416
00000100:00100000:1.0:1767321116.574970:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292012416
00000100:00100000:1.0:1767321116.575088:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5252
00000100:00100000:1.0:1767321116.575100:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292012416:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767321116.575184:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292012416:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 86us (10662us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321116.575192:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5252
00000100:00100000:1.0:1767321116.575214:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18306
00000100:00100000:1.0:1767321116.575220:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292012288:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767321116.575242:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321116.575268:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292012288:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 47us (10843us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321116.576721:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18306
00000100:00080000:3.0:1767321116.583270:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:2.0:1767321117.207178:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321118.231935:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321118.683295:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380186112:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1767321118.683374:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321118.683503:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380186112
00000100:00100000:0.0:1767321118.683512:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380186112
00000100:00100000:0.0:1767321118.683577:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942
00000100:00100000:0.0:1767321118.683586:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380186112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321118.683614:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321118.683652:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380186112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (277us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321118.683659:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942
00000100:00080000:1.0:1767321118.683728:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767321118.683766:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380186112:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321119.258608:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321120.216057:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380186240:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321120.216177:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321120.216819:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380186240
00000100:00100000:0.0:1767321120.216830:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380186240
00000100:00100000:0.0:1767321120.216971:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943
00000100:00100000:0.0:1767321120.216983:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380186240:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1767321120.217023:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00080000:3.0:1767321120.217135:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1767321120.223989:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380186240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6990us (7793us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321120.224010:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943
00000100:00100000:2.0:1767321120.231853:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380186240:0@lo:13:osp-pre-0-1.0
00010000:00010000:3.0:1767321120.279331:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767321120.727106:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321120.727118:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767321120.727122:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321120.727126:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321120.727131:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321120.727141:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 6018
00000100:00080000:1.0:1767321120.727146:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321120.727152:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321120.727193:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc21500 x1853164380186368/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321120.727218:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321120.727222:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321120.727224:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321120.727228:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 6018
00000100:00080000:1.0:1767321120.727231:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321120.727235:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321120.727250:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0dc22300 x1853164380186496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321120.727343:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321120.727347:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321120.727348:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321120.727352:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 6018
00000100:00080000:1.0:1767321120.727354:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321120.727358:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321120.727368:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c1b480 x1853164380187008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321120.727384:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321120.727387:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321120.727389:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321120.727392:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 6018
00000100:00080000:1.0:1767321120.727396:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s
00000100:00080000:1.0:1767321120.727400:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321120.727412:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e04c18380 x1853164380187264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321120.727462:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380186752:0@lo:400:kworker.0
00000100:00100000:1.0:1767321120.727536:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321120.727607:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1767321120.727613:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380186880:0@lo:400:kworker.0
00000100:00100000:1.0:1767321120.727641:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321120.727676:0:48334:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380186752
00000100:00100000:1.0:1767321120.727685:0:48334:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380186752
00000100:00100000:1.0:1767321120.727738:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120
00000100:00100000:1.0:1767321120.727747:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380186752:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321120.727801:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e04c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380186752:12345-0@lo:400:kworker.0 Request processed in 55us (264us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321120.727808:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120
00000100:00100000:1.0:1767321120.727856:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380186752:0@lo:400:kworker.0
00000100:00100000:3.0:1767321120.728212:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380186624:0@lo:400:kworker.0
00000100:00100000:3.0:1767321120.728245:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321120.728294:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767321120.728301:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380187136:0@lo:400:kworker.0
00000100:00100000:3.0:1767321120.728322:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321120.728656:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380186880
00000100:00100000:1.0:1767321120.728662:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380186880
00000100:00100000:1.0:1767321120.728755:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380187136
00000100:00100000:1.0:1767321120.728760:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380187136
00000100:00100000:2.0:1767321120.728816:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253
00000100:00100000:2.0:1767321120.728827:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380186880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321120.728899:0:7016:0:(client.c:2478:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1767321095/real 1767321095]  req@ffff8b0e0dc21c00 x1853164380180352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1767321120.728937:0:7016:0:(client.c:2509:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff8b0e0dc21c00 x1853164380180352/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1767321120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1767321120.728960:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:7017:x1853164380186880:12345-0@lo:400:kworker.0 Request processed in 132us (1313us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321120.728972:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253
00000100:00100000:0.0:1767321120.728979:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380186368:0@lo:38:kworker.0
00000100:00100000:2.0:1767321120.729007:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380186624
00000100:00100000:2.0:1767321120.729013:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380186624
00000100:00100000:0.0:1767321120.729052:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321120.729089:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380186496:0@lo:38:kworker.0
00000100:00100000:0.0:1767321120.729119:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321120.729150:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380187008:0@lo:38:kworker.0
00000100:00100000:0.0:1767321120.729170:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321120.729186:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380187264:0@lo:38:kworker.0
00000100:00100000:0.0:1767321120.729204:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1767321120.729220:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321120.729235:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110)
00000100:00100000:0.0:1767321120.729239:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380180352:0@lo:250:kworker.0
00000100:00100000:0.0:1767321120.729292:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380186496
00000100:00100000:0.0:1767321120.729299:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380186496
00000100:00100000:0.0:1767321120.729338:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316
00000100:00100000:0.0:1767321120.729346:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380186496:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321120.729374:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321120.729418:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380186496:12345-0@lo:38:kworker.0 Request processed in 72us (297us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321120.729425:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316
00000100:00100000:0.0:1767321120.729450:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380186368
00000100:00100000:0.0:1767321120.729454:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380186368
00000100:00100000:0.0:1767321120.729473:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380187008
00000100:00100000:0.0:1767321120.729476:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380187008
00000100:00100000:0.0:1767321120.729484:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380187264
00000100:00100000:0.0:1767321120.729486:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380187264
00000100:00100000:0.0:1767321120.729495:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18307
00000100:00100000:0.0:1767321120.729500:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380186368:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321120.729510:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321120.729535:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380186368:12345-0@lo:38:kworker.0 Request processed in 34us (484us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321120.729541:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18307
00000100:00100000:0.0:1767321120.729553:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18308
00000100:00100000:0.0:1767321120.729557:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380187008:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321120.729566:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321120.729591:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380187008:12345-0@lo:38:kworker.0 Request processed in 32us (419us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321120.729596:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18308
00000100:00100000:0.0:1767321120.729607:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18309
00000100:00100000:0.0:1767321120.729610:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380187264:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321120.729618:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321120.731359:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380187264:12345-0@lo:38:kworker.0 Request processed in 1732us (2139us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321120.731376:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18309
00000100:00080000:0.0:1767321120.731456:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1767321120.731463:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1767321120.731468:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f09124000 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1767321120.731474:0:26857:0:(import.c:509:import_select_connection()) MGC192.168.202.133@tcp: connect to NID 0@lo last attempt 5997
00000100:00080000:0.0:1767321120.731479:0:26857:0:(import.c:588:import_select_connection()) MGC192.168.202.133@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1767321120.731487:0:26857:0:(import.c:623:import_select_connection()) MGC192.168.202.133@tcp: import ffff8b0f09124000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:0.0:1767321120.731534:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e02680a80 x1853164380187392/t0(0) o250->MGC192.168.202.133@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767321120.731636:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ebfd87cc-7a91-408d-b11a-48b0318a8152:7016:1853164380187392:0@lo:250:kworker.0
00000400:00000100:0.0:1767321120.731675:0:7016:0:(lib-move.c:4502:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1853164380187392 offset 0 length 520: 4
00000100:00080000:0.0:1767321120.731729:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321120.731734:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321120.731738:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380186368:0@lo:38:kworker.0
00000100:00080000:0.0:1767321120.731754:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321120.731757:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321120.731760:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380186496:0@lo:38:kworker.0
00000100:00080000:0.0:1767321120.731771:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321120.731774:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321120.731777:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380187008:0@lo:38:kworker.0
00000100:00080000:0.0:1767321120.731787:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321120.731790:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321120.731793:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380187264:0@lo:38:kworker.0
00000100:00100000:0.0:1767321120.731951:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:7017:1853164380186880:0@lo:400:kworker.0
00000100:00080000:3.0:1767321120.736365:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1767321120.736377:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321120.747856:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5254
00000100:00100000:1.0:1767321120.747901:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380187136:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321120.748012:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7020:x1853164380187136:12345-0@lo:400:kworker.0 Request processed in 144us (19687us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321120.748021:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5254
00000100:00100000:3.0:1767321120.748244:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e04c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:7020:1853164380187136:0@lo:400:kworker.0
00000100:00100000:2.0:1767321120.748497:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121
00000100:00100000:2.0:1767321120.748507:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380186624:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321120.748552:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380186624:12345-0@lo:400:kworker.0 Request processed in 48us (20305us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321120.748558:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121
00000100:00100000:3.0:1767321120.748998:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0dc23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380186624:0@lo:400:kworker.0
00010000:00010000:2.0:1767321121.303019:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321121.679724:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321121.680352:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292012672
00000100:00100000:1.0:1767321121.680364:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292012672
00000100:00100000:1.0:1767321121.680449:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5255
00000100:00100000:1.0:1767321121.680459:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292012672:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:1.0:1767321121.680546:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2519:x1853164292012672:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 88us (833us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321121.680554:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5255
00000100:00080000:3.0:1767321121.681817:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321121.682112:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:1.0:1767321121.682369:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292012544
00000100:00100000:1.0:1767321121.682379:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292012544
00000100:00100000:1.0:1767321121.682427:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18310
00000100:00100000:1.0:1767321121.682435:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292012544:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:1.0:1767321121.682458:0:25133:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321121.682520:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2516:x1853164292012544:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 85us (412us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321121.682528:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18310
00010000:00010000:1.0:1767321122.332511:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321123.351215:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321123.804271:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767321123.804296:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380187520:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321123.804380:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321123.804593:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380187520
00000100:00100000:0.0:1767321123.804602:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380187520
00000100:00100000:0.0:1767321123.804671:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944
00000100:00100000:0.0:1767321123.804681:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380187520:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1767321123.804713:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:0.0:1767321123.804768:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c85ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380187520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (387us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321123.804774:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944
00000100:00080000:3.0:1767321123.805338:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1767321123.805428:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e02683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380187520:0@lo:13:osp-pre-1-1.0
00010000:00010000:3.0:1767321124.375266:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1767321125.337623:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767321125.337654:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380187648:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1767321125.337729:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321125.338049:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380187648
00000100:00100000:2.0:1767321125.338058:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380187648
00000100:00100000:2.0:1767321125.338141:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945
00000100:00100000:2.0:1767321125.338153:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380187648:12345-0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1767321125.338165:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:2.0:1767321125.338187:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:2.0:1767321125.338260:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380187648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (530us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321125.338268:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945
00000100:00100000:3.0:1767321125.338375:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380187648:0@lo:13:osp-pre-0-1.0
00010000:00010000:1.0:1767321125.400547:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1767321125.847110:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321125.847122:0:59923:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:3.0:1767321125.847125:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321125.847129:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321125.847134:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321125.847143:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 6023
00000100:00080000:3.0:1767321125.847148:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321125.847155:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321125.847324:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dce00 x1853164380187776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321125.847373:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321125.847387:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321125.847389:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321125.847394:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 6023
00000100:00080000:3.0:1767321125.847396:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321125.847399:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321125.847424:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0dea00 x1853164380187904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321125.847568:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321125.847572:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321125.847574:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321125.847578:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 6023
00000100:00080000:3.0:1767321125.847590:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1767321125.847594:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321125.847606:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0de300 x1853164380188416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1767321125.847634:0:59923:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1767321125.847638:0:59923:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1767321125.847640:0:59923:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1767321125.847654:0:59923:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 6023
00000100:00080000:3.0:1767321125.847658:0:59923:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s
00000100:00080000:3.0:1767321125.847662:0:59923:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321125.847687:0:59923:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0e0ddc00 x1853164380188672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1767321125.847749:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380188288:0@lo:400:kworker.0
00000100:00100000:3.0:1767321125.847930:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321125.848067:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1767321125.848086:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380188160:0@lo:400:kworker.0
00000100:00100000:3.0:1767321125.848125:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321125.848302:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380188032:0@lo:400:kworker.0
00000100:00100000:1.0:1767321125.848347:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321125.848421:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1767321125.848438:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380188544:0@lo:400:kworker.0
00000100:00100000:1.0:1767321125.848537:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321125.848581:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188288
00000100:00100000:1.0:1767321125.848600:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188288
00000100:00100000:1.0:1767321125.848694:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188544
00000100:00100000:1.0:1767321125.848698:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188544
00000100:00100000:1.0:1767321125.848735:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256
00000100:00100000:1.0:1767321125.848744:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380188288:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321125.848819:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:7020:x1853164380188288:12345-0@lo:400:kworker.0 Request processed in 76us (888us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321125.848826:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256
00000100:00100000:1.0:1767321125.848895:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257
00000100:00100000:1.0:1767321125.848915:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380188544:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321125.848976:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7018:x1853164380188544:12345-0@lo:400:kworker.0 Request processed in 50us (425us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321125.848984:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257
00000100:00080000:1.0:1767321125.849017:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1767321125.849072:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:7018:1853164380188544:0@lo:400:kworker.0
00000100:00100000:3.0:1767321125.849453:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:7020:1853164380188288:0@lo:400:kworker.0
00000100:00100000:3.0:1767321125.849489:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188160
00000100:00100000:3.0:1767321125.849493:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188160
00000100:00100000:3.0:1767321125.849562:0:40595:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188032
00000100:00100000:3.0:1767321125.849575:0:40595:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188032
00000100:00100000:3.0:1767321125.849619:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122
00000100:00100000:3.0:1767321125.849626:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380188160:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321125.849709:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380188160:12345-0@lo:400:kworker.0 Request processed in 83us (1582us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321125.849715:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122
00000100:00100000:3.0:1767321125.849755:0:40595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123
00000100:00100000:3.0:1767321125.849763:0:40595:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380188032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321125.849819:0:40595:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380188032:12345-0@lo:400:kworker.0 Request processed in 47us (1461us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321125.849826:0:40595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123
00000100:00100000:3.0:1767321125.849864:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380188160:0@lo:400:kworker.0
00000100:00080000:1.0:1767321125.853294:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767321125.853367:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380188032:0@lo:400:kworker.0
00000100:00100000:0.0:1767321125.853754:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380187776:0@lo:38:kworker.0
00000100:00100000:0.0:1767321125.853838:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321125.853914:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380187904:0@lo:38:kworker.0
00000100:00100000:0.0:1767321125.853940:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321125.853967:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380188416:0@lo:38:kworker.0
00000100:00100000:0.0:1767321125.853988:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321125.854006:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380188672:0@lo:38:kworker.0
00000100:00100000:0.0:1767321125.854025:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321125.854059:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380187776
00000100:00100000:0.0:1767321125.854066:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380187776
00000100:00100000:0.0:1767321125.854101:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188416
00000100:00100000:0.0:1767321125.854105:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188416
00000100:00100000:0.0:1767321125.854117:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188672
00000100:00100000:0.0:1767321125.854120:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188672
00000100:00100000:0.0:1767321125.854135:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18311
00000100:00100000:0.0:1767321125.854142:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380187776:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321125.854164:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321125.854205:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e02683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380187776:12345-0@lo:38:kworker.0 Request processed in 62us (366us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321125.854211:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18311
00000100:00100000:0.0:1767321125.854237:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18312
00000100:00100000:0.0:1767321125.854241:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380188416:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321125.854251:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321125.854274:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380188416:12345-0@lo:38:kworker.0 Request processed in 31us (284us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321125.854280:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18312
00000100:00100000:0.0:1767321125.854290:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18313
00000100:00100000:0.0:1767321125.854293:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380188672:12345-0@lo:38:kworker.0
00010000:00020000:0.0:1767321125.854301:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:0.0:1767321125.854323:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380188672:12345-0@lo:38:kworker.0 Request processed in 28us (297us total) trans 0 rc -19/-19
00000100:00100000:0.0:1767321125.854331:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18313
00000100:00080000:0.0:1767321125.854370:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321125.854375:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321125.854379:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380187776:0@lo:38:kworker.0
00000100:00080000:0.0:1767321125.854386:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321125.854389:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321125.854392:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380188416:0@lo:38:kworker.0
00000100:00080000:0.0:1767321125.854398:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1767321125.854401:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:0.0:1767321125.854404:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380188672:0@lo:38:kworker.0
00000100:00100000:3.0:1767321125.854839:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380187904
00000100:00100000:3.0:1767321125.854845:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380187904
00000100:00100000:3.0:1767321125.854901:0:62765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317
00000100:00100000:3.0:1767321125.854907:0:62765:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380187904:12345-0@lo:38:kworker.0
00010000:00020000:3.0:1767321125.854919:0:62765:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321125.854959:0:62765:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380187904:12345-0@lo:38:kworker.0 Request processed in 51us (1017us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321125.854965:0:62765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317
00000100:00080000:1.0:1767321125.855081:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321125.855087:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321125.855090:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380187904:0@lo:38:kworker.0
00010000:00010000:1.0:1767321126.423189:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321126.801978:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321126.802028:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:0.0:1767321126.802096:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292012928
00000100:00100000:0.0:1767321126.802106:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292012928
00000100:00100000:0.0:1767321126.802184:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292012800
00000100:00100000:0.0:1767321126.802188:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292012800
00000100:00100000:0.0:1767321126.802243:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5258
00000100:00080000:2.0:1767321126.802253:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321126.802254:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292012928:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321126.802292:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18314
00000100:00100000:2.0:1767321126.802299:0:15479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292012800:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:2.0:1767321126.802320:0:15479:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321126.802385:0:15479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2516:x1853164292012800:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 84us (356us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321126.802394:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18314
00000100:00100000:0.0:1767321126.802648:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292012928:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 395us (677us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321126.802656:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5258
00010000:00010000:1.0:1767321127.447713:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1767321128.472276:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321128.919276:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1767321128.919295:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380188800:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321128.919370:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321128.919492:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188800
00000100:00100000:3.0:1767321128.919504:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188800
00000100:00100000:3.0:1767321128.919587:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946
00000100:00100000:3.0:1767321128.919597:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380188800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1767321128.919627:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321128.919688:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380188800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (305us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321128.919696:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946
00000100:00100000:3.0:1767321128.919742:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380188800:0@lo:13:osp-pre-1-1.0
00000100:00080000:2.0:1767321128.920083:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00010000:00010000:1.0:1767321129.495256:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1767321130.459025:0:7020:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1767321130.459052:0:7020:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380188928:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1767321130.459142:0:7020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321130.459452:0:46716:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380188928
00000100:00100000:3.0:1767321130.459462:0:46716:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380188928
00000100:00100000:3.0:1767321130.459532:0:46716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947
00000100:00100000:3.0:1767321130.459543:0:46716:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380188928:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1767321130.459577:0:46716:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:3.0:1767321130.459643:0:46716:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0dc21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7020:x1853164380188928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (501us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321130.459651:0:46716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947
00000100:00100000:0.0:1767321130.460008:0:7020:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:7020:1853164380188928:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767321130.461558:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767321130.537083:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1767321130.968051:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321130.968063:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1767321130.968065:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321130.968069:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321130.968074:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321130.968081:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 6028
00000100:00080000:2.0:1767321130.968085:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321130.968092:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321130.968134:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcf800 x1853164380189056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1767321130.968174:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321130.968178:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321130.968180:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321130.968184:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 6028
00000100:00080000:2.0:1767321130.968187:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321130.968191:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321130.968208:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfced80 x1853164380189184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321130.968226:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380189056:0@lo:38:kworker.0
00000100:00080000:2.0:1767321130.968277:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321130.968280:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321130.968282:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321130.968285:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 6028
00000100:00080000:2.0:1767321130.968288:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1767321130.968291:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321130.968300:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcc380 x1853164380189696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1767321130.968308:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321130.968313:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1767321130.968316:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1767321130.968318:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1767321130.968321:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 6028
00000100:00080000:2.0:1767321130.968324:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s
00000100:00080000:2.0:1767321130.968327:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:2.0:1767321130.968335:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0e0cfcfb80 x1853164380189952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1767321130.968358:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380189568:0@lo:400:kworker.0
00000100:00100000:1.0:1767321130.968363:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380189184:0@lo:38:kworker.0
00000100:00100000:1.0:1767321130.968385:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321130.968385:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321130.968415:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380189696:0@lo:38:kworker.0
00000100:00100000:1.0:1767321130.968436:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321130.968467:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380189952:0@lo:38:kworker.0
00000100:00100000:1.0:1767321130.968487:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321130.968515:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189056
00000100:00100000:1.0:1767321130.968523:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189056
00000100:00100000:1.0:1767321130.968553:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189568
00000100:00100000:1.0:1767321130.968555:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189568
00000100:00100000:1.0:1767321130.968589:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189696
00000100:00100000:1.0:1767321130.968593:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189696
00000100:00100000:1.0:1767321130.968601:0:19567:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189952
00000100:00100000:1.0:1767321130.968603:0:19567:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189952
00000100:00100000:2.0:1767321130.968604:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767321130.968612:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380189440:0@lo:400:kworker.0
00000100:00100000:1.0:1767321130.968613:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259
00000100:00100000:1.0:1767321130.968622:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380189568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321130.968637:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321130.968671:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:7018:x1853164380189568:12345-0@lo:400:kworker.0 Request processed in 50us (285us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321130.968679:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259
00000100:00100000:2.0:1767321130.968688:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:7018:1853164380189568:0@lo:400:kworker.0
00000100:00100000:1.0:1767321130.968699:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18315
00000100:00100000:1.0:1767321130.968704:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380189056:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321130.968721:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321130.968725:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18316
00000100:00100000:2.0:1767321130.968730:0:15478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380189696:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321130.968739:0:15478:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:1.0:1767321130.968750:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380189056:12345-0@lo:38:kworker.0 Request processed in 46us (442us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321130.968757:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18315
00000100:00100000:2.0:1767321130.968759:0:15478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:7016:x1853164380189696:12345-0@lo:38:kworker.0 Request processed in 28us (323us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321130.968764:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18316
00000100:00100000:1.0:1767321130.968768:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18317
00000100:00100000:1.0:1767321130.968772:0:19567:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380189952:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321130.968780:0:19567:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321130.968785:0:18391:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189184
00000100:00100000:2.0:1767321130.968788:0:18391:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189184
00000100:00100000:1.0:1767321130.968800:0:19567:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:7016:x1853164380189952:12345-0@lo:38:kworker.0 Request processed in 27us (313us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321130.968805:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318
00000100:00100000:1.0:1767321130.968806:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18317
00000100:00100000:2.0:1767321130.968809:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380189184:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321130.968818:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00080000:1.0:1767321130.968823:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1767321130.968840:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1767321130.968841:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0f063a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380189184:12345-0@lo:38:kworker.0 Request processed in 31us (456us total) trans 0 rc -19/-19
00000100:00080000:1.0:1767321130.968844:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321130.968847:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380189696:0@lo:38:kworker.0
00000100:00100000:2.0:1767321130.968847:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318
00000100:00080000:1.0:1767321130.968854:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321130.968857:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321130.968860:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380189952:0@lo:38:kworker.0
00000100:00080000:1.0:1767321130.968867:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321130.968890:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321130.968894:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380189056:0@lo:38:kworker.0
00000100:00080000:1.0:1767321130.968903:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1767321130.968905:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:1.0:1767321130.968908:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380189184:0@lo:38:kworker.0
00000100:00100000:3.0:1767321130.969290:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380189824:0@lo:400:kworker.0
00000100:00100000:3.0:1767321130.969323:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321130.969364:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1767321130.969369:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380189312:0@lo:400:kworker.0
00000100:00100000:3.0:1767321130.969390:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321130.969465:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189440
00000100:00100000:1.0:1767321130.969469:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189440
00000100:00100000:0.0:1767321130.969667:0:25133:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189824
00000100:00100000:0.0:1767321130.969672:0:25133:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189824
00000100:00100000:0.0:1767321130.969708:0:25133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260
00000100:00100000:0.0:1767321130.969714:0:25133:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380189824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1767321130.969755:0:25133:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:7019:x1853164380189824:12345-0@lo:400:kworker.0 Request processed in 41us (431us total) trans 0 rc 0/0
00000100:00100000:0.0:1767321130.969760:0:25133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260
00000100:00100000:1.0:1767321130.969797:0:18379:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380189312
00000100:00100000:1.0:1767321130.969801:0:18379:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380189312
00000100:00100000:2.0:1767321130.971544:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:7019:1853164380189824:0@lo:400:kworker.0
00000100:00080000:2.0:1767321130.971593:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1767321130.971598:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1767321130.972625:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124
00000100:00100000:3.0:1767321130.972647:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380189440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321130.972748:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380189440:12345-0@lo:400:kworker.0 Request processed in 112us (4109us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321130.972756:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124
00000100:00100000:3.0:1767321130.972783:0:48334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125
00000100:00100000:3.0:1767321130.972790:0:48334:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380189312:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1767321130.972830:0:48334:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380189312:12345-0@lo:400:kworker.0 Request processed in 41us (3439us total) trans 0 rc 0/0
00000100:00100000:3.0:1767321130.972838:0:48334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125
00000100:00100000:3.0:1767321130.972897:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380189312:0@lo:400:kworker.0
00000100:00100000:2.0:1767321130.973281:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0cfcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380189440:0@lo:400:kworker.0
00010000:00010000:1.0:1767321131.547401:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1767321131.920217:0:7011:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:2.0:1767321131.924678:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292013184
00000100:00100000:2.0:1767321131.924695:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292013184
00000100:00100000:2.0:1767321131.924903:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 5261
00000100:00100000:2.0:1767321131.924916:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292013184:12345-192.168.202.33@tcp:400:kworker.0
00000100:00100000:2.0:1767321131.925006:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:664a2fe3-3696-4765-9fc9-ccd4c8d5d441+5:2517:x1853164292013184:12345-192.168.202.33@tcp:400:kworker.0 Request processed in 93us (4800us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321131.925015:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 5261
00000100:00100000:2.0:1767321131.928460:0:7012:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.33@tcp (source: 12345-192.168.202.33@tcp)
00000100:00100000:3.0:1767321131.928555:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164292013056
00000100:00100000:3.0:1767321131.928567:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164292013056
00000100:00100000:3.0:1767321131.928613:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.33@tcp, seq: 18318
00000100:00100000:3.0:1767321131.928622:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292013056:12345-192.168.202.33@tcp:38:kworker.0
00010000:00020000:3.0:1767321131.928644:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.33@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:3.0:1767321131.928718:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2516:x1853164292013056:12345-192.168.202.33@tcp:38:kworker.0 Request processed in 95us (266us total) trans 0 rc -19/-19
00000100:00100000:3.0:1767321131.928724:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.33@tcp, seq: 18318
00000100:00080000:1.0:1767321131.929375:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00010000:00010000:3.0:1767321132.568677:0:56990:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1767321133.597047:0:19815:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321134.044472:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767321134.044497:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380190080:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1767321134.044602:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321134.045005:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190080
00000100:00100000:1.0:1767321134.045017:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190080
00000100:00100000:1.0:1767321134.045170:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948
00000100:00100000:1.0:1767321134.045182:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380190080:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1767321134.045223:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 260288 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767321134.045305:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380190080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (702us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321134.045314:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948
00000100:00080000:2.0:1767321134.045378:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1767321134.047432:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380190080:0@lo:13:osp-pre-1-1.0
00010000:00010000:1.0:1767321134.615620:0:15471:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1767321135.575487:0:7018:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1767321135.575512:0:7018:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380190208:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1767321135.575584:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321135.575663:0:18381:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190208
00000100:00100000:1.0:1767321135.575680:0:18381:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190208
00000100:00100000:1.0:1767321135.575796:0:18381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949
00000100:00100000:1.0:1767321135.575809:0:18381:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380190208:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1767321135.575855:0:18381:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040
00000100:00100000:1.0:1767321135.575982:0:18381:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:7018:x1853164380190208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 175us (395us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321135.575993:0:18381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949
00000100:00100000:3.0:1767321135.576061:0:7018:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0e0e0dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:7018:1853164380190208:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1767321135.576470:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:1.0:1767321135.639387:0:15472:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1767321136.088835:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321136.088844:0:26857:0:(pinger.c:247:ptlrpc_pinger_process_import()) ebfd87cc-7a91-408d-b11a-48b0318a8152->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:1.0:1767321136.088848:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321136.088851:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321136.088855:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321136.088862:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 6033
00000100:00080000:1.0:1767321136.088866:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321136.088896:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8b0f27c65000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321136.088951:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063abb80 x1853164380190336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321136.088974:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321136.088978:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321136.088980:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321136.088984:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 6033
00000100:00080000:1.0:1767321136.088987:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321136.088991:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8b0f3f040000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321136.089005:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8380 x1853164380190464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321136.089059:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321136.089062:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321136.089064:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321136.089067:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 6033
00000100:00080000:1.0:1767321136.089070:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321136.089073:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b0e03f27000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:3.0:1767321136.089142:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380190336:0@lo:38:kworker.0
00000100:00100000:3.0:1767321136.089218:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1767321136.089543:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190336
00000100:00100000:2.0:1767321136.089553:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190336
00000100:00100000:2.0:1767321136.089595:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18319
00000100:00100000:2.0:1767321136.089603:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380190336:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321136.089624:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321136.089670:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380190336:12345-0@lo:38:kworker.0 Request processed in 66us (452us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321136.089678:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18319
00000100:00100000:2.0:1767321136.089738:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380190720:0@lo:400:kworker.0
00000100:00100000:2.0:1767321136.089770:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1767321136.089865:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a9880 x1853164380190976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1767321136.089914:0:26857:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1767321136.089927:0:26857:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1767321136.089929:0:26857:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1767321136.089933:0:26857:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 6033
00000100:00080000:1.0:1767321136.089936:0:26857:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1767321136.089946:0:26857:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b0f10b47000 using connection 192.168.202.133@tcp/0@lo
00000100:00100000:1.0:1767321136.089958:0:26857:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff8b0f063a8000 x1853164380191232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1767321136.090034:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380191104:0@lo:400:kworker.0
00000100:00100000:0.0:1767321136.090079:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:3.0:1767321136.090435:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f27c65000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1767321136.090442:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:3.0:1767321136.090446:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:7016:1853164380190336:0@lo:38:kworker.0
00000100:00100000:3.0:1767321136.090455:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380190464:0@lo:38:kworker.0
00000100:00100000:3.0:1767321136.090485:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321136.090529:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380190976:0@lo:38:kworker.0
00000100:00100000:3.0:1767321136.090551:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321136.090570:0:7016:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380191232:0@lo:38:kworker.0
00000100:00100000:1.0:1767321136.090581:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380191104
00000100:00100000:1.0:1767321136.090587:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380191104
00000100:00100000:3.0:1767321136.090594:0:7016:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1767321136.090633:0:62765:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190464
00000100:00100000:3.0:1767321136.090637:0:62765:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190464
00000100:00100000:1.0:1767321136.090640:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190976
00000100:00100000:1.0:1767321136.090645:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190976
00000100:00100000:1.0:1767321136.090664:0:15477:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380191232
00000100:00100000:1.0:1767321136.090666:0:15477:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380191232
00000100:00100000:1.0:1767321136.090684:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262
00000100:00100000:1.0:1767321136.090705:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380191104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321136.090755:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:7017:x1853164380191104:12345-0@lo:400:kworker.0 Request processed in 52us (675us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321136.090762:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262
00000100:00100000:1.0:1767321136.090781:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18320
00000100:00100000:1.0:1767321136.090784:0:15477:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380190976:12345-0@lo:38:kworker.0
00010000:00020000:1.0:1767321136.090797:0:15477:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321136.098181:0:7019:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1767321136.098206:0:7019:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380190848:0@lo:400:kworker.0
00000100:00100000:2.0:1767321136.098297:0:7019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1767321136.098353:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1767321136.098468:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:7017:1853164380191104:0@lo:400:kworker.0
00000100:00100000:0.0:1767321136.098488:0:7017:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1767321136.098494:0:7017:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380190592:0@lo:400:kworker.0
00000100:00100000:0.0:1767321136.098523:0:7017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1767321136.098583:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190720
00000100:00100000:0.0:1767321136.098589:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190720
00000100:00100000:1.0:1767321136.098716:0:15477:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:7016:x1853164380190976:12345-0@lo:38:kworker.0 Request processed in 7927us (8160us total) trans 0 rc -19/-19
00000100:00100000:1.0:1767321136.098727:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18320
00000100:00100000:2.0:1767321136.099038:0:18391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319
00000100:00100000:2.0:1767321136.099045:0:18391:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380190464:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321136.099068:0:18391:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321136.099254:0:18391:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0e0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:7016:x1853164380190464:12345-0@lo:38:kworker.0 Request processed in 207us (8767us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321136.099261:0:18391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319
00000100:00100000:2.0:1767321136.099280:0:19247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190848
00000100:00100000:2.0:1767321136.099284:0:19247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190848
00000100:00100000:2.0:1767321136.099314:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263
00000100:00100000:2.0:1767321136.099319:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380190848:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1767321136.099356:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:7019:x1853164380190848:12345-0@lo:400:kworker.0 Request processed in 37us (1060us total) trans 0 rc 0/0
00000100:00100000:2.0:1767321136.099362:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263
00000100:00100000:2.0:1767321136.099374:0:19247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18321
00000100:00100000:2.0:1767321136.099379:0:19247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380191232:12345-0@lo:38:kworker.0
00010000:00020000:2.0:1767321136.099389:0:19247:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server.
00000100:00100000:2.0:1767321136.099407:0:19247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0c858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:7016:x1853164380191232:12345-0@lo:38:kworker.0 Request processed in 27us (8814us total) trans 0 rc -19/-19
00000100:00100000:2.0:1767321136.099415:0:19247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18321
00000100:00080000:2.0:1767321136.099429:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1767321136.099449:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:7019:1853164380190848:0@lo:400:kworker.0
00000100:00080000:2.0:1767321136.099487:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0e03f27000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321136.099492:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321136.099495:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:7016:1853164380190976:0@lo:38:kworker.0
00000100:00080000:2.0:1767321136.099502:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f10b47000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321136.099505:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321136.099507:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:7016:1853164380191232:0@lo:38:kworker.0
00000100:00080000:2.0:1767321136.099515:0:7016:0:(import.c:65:import_set_state_nolock()) ffff8b0f3f040000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1767321136.099518:0:7016:0:(import.c:1499:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19)
00000100:00100000:2.0:1767321136.099521:0:7016:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:7016:1853164380190464:0@lo:38:kworker.0
00000100:00100000:0.0:1767321136.106605:0:41753:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164380190592
00000100:00100000:0.0:1767321136.106622:0:41753:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164380190592
00000100:00080000:2.0:1767321136.106813:0:15499:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1767321136.110854:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126
00000100:00100000:1.0:1767321136.111008:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380190720:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321136.111116:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e0cfcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7019:x1853164380190720:12345-0@lo:400:kworker.0 Request processed in 120us (21344us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321136.111132:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126
00000100:00100000:1.0:1767321136.111155:0:18379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127
00000100:00100000:1.0:1767321136.111162:0:18379:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380190592:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1767321136.111208:0:18379:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff8b0e08d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:7017:x1853164380190592:12345-0@lo:400:kworker.0 Request processed in 47us (12683us total) trans 0 rc 0/0
00000100:00100000:1.0:1767321136.111213:0:18379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127
00000100:00100000:2.0:1767321136.111325:0:7019:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:7019:1853164380190720:0@lo:400:kworker.0
00000100:00100000:2.0:1767321136.111383:0:7017:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff8b0f063aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:7017:1853164380190592:0@lo:400:kworker.0
Debug log: 93650 lines, 93650 kept, 0 dropped, 0 bad.